Undergraduate Research Summer 2026 Dataset Building Multi-Modal AI pre-training

Mission

This research develops a “Visual Physics Dataset” by taking existing 3D models from online datasets and annotating them with physical parameters, such as mass, density, and friction, to make them fully usable in physics-based simulators like Isaac Sim. This work supports broader research into physically grounded multi-modal AI pretraining.

Implementation

TODO…

Challenges

TODO…

Updated: