VLAHardware: MaxRoadmap scaffold
VLM agent in Isaac Sim
Vision-language reasoning over a simulated robotics scene.
Lab runtime / VLAOK / VIS-01
VLM agent in Isaac Sim runs against the same observable edge stack used for testing and deployment.
This entry is a roadmap scaffold, not a finished demo. Its description records intended scope; the linked repository is the source of truth for current code.
About this demo
A vision-language model observes the Isaac Sim scene via screenshots and reasons over what to do next ('clear the spilled bottle from aisle 3'). Bridges high-level reasoning with low-level skill execution.
Highlights
- →Isaac Sim integration
- →VLM-as-planner pattern
- →Skill library composition
- →Sim-to-real transferable plans
Supported robots
Simulated mobile manipulator