Vision Language Models Are Native 3D Learners

VLM3: Vision Language Models Are Native 3D Learners

Announce Type: new Abstract: Vision Language Models (VLMs) enable a unified model to solve various vision tasks through prompting. They have shown promising performance in semantic understanding. However, 3D understanding still largely relies on expert vision models with complex task-specific designs.