Editor’s word: This submit is a part of Into the Omniversea collection centered on how builders, 3D practitioners and enterprises can rework their workflows utilizing the newest developments in OpenUSD and NVIDIA Omniverse.
Open supply has turn into important for driving innovation in robotics and autonomy. By offering entry to crucial infrastructure — from simulation frameworks to AI fashions — NVIDIA is enabling collaborative improvement that accelerates the trail to safer, extra succesful autonomous programs.
At CES earlier this month, NVIDIA launched a brand new suite of open bodily AI fashions and frameworks to speed up the event of humanoids, autonomous automobiles and different bodily AI embodiments. These instruments span the whole robotics improvement lifecycle — from high-fidelity world simulation and artificial knowledge era to cloud-native orchestration and edge deployment — giving builders a modular toolkit to construct autonomous programs that may purpose, be taught and act in the true world.
OpenUSD supplies the frequent framework that standardizes how 3D knowledge is shared throughout these bodily AI instruments, enabling builders to construct correct digital twins and reuse them seamlessly from simulation to deployment. NVIDIA Omniverse libraries, constructed on OpenUSD, function the supply of floor?reality simulation that feeds the whole stack.
From Labs to the Present Ground
At CES 2026, builders introduced the NVIDIA bodily AI stack out of the lab and onto the present ground, debuting machines starting from heavy tools and manufacturing unit assistants to social and repair robots.
The stack faucets into NVIDIA Cosmos world fashions; NVIDIA Isaac applied sciences, together with the brand new Isaac Lab-Area open supply framework for coverage analysis; the Nvidia almayo open portfolio of AI fashions, simulation frameworks and bodily AI datasets for autonomous automobiles; and the NVIDIA OSMO framework to orchestrate coaching throughout compute environments.
Caterpillar‘s Cat AI Assistantpowered by NVIDIA Nemotron open fashions for agentic AI and working on the NVIDIA Jetson Thor edge AI module, brings pure language interplay immediately into the cab of heavy automobiles. Operators can ask “Hey Cat”-style questions and get step?by?step steerage, in addition to modify security parameters by voice.
Behind the scenes, Caterpillar makes use of Omniverse libraries to construct manufacturing unit and job?website digital twins that may assist simulate layouts, site visitors patterns and multi?machine workflows. These insights are fed again into tools and fleets earlier than adjustments are deployed to job websites, making AI?assisted operations safer and extra environment friendly.
LEM Surgical showcased its Dynamis Robotic Surgical System, which is FDA-cleared and in routine medical use for spinal procedures. The subsequent-generation system makes use of NVIDIA Jetson AGX Thor for compute, NVIDIA Holoscan for real-time sensor processing and NVIDIA Isaac for Healthcare to coach its autonomous arms.
LEM Surgical additionally makes use of NVIDIA Cosmos Switch — an open, absolutely customizable world mannequin that allows bodily based mostly artificial knowledge era — to generate artificial coaching knowledge and the NVIDIA Isaac Sim framework for digital twin simulation. Designed as a dual-arm humanoid surgical robotic for hard-tissue surgical procedure, the Dynamis system mimics human surgeon dexterity and allows advanced spinal procedures with enhanced precision, assuaging strenuous bodily calls for on surgeons and surgical assistants.
NEURA Robotics is constructing cognitive robots on a full NVIDIA stack, utilizing Isaac Sim and Isaac Lab to coach its 4NE1 humanoid and MiPA service robots in OpenUSD?based mostly digital twins earlier than deployment in home settings and workplaces. The corporate used NVIDIA Isaac GR00T?Mimic to submit?prepare the Isaac GR00T basis mannequin for its platforms.
As well as, NEURA Robotics is collaborating with SAP and NVIDIA to combine SAP’s Joule brokers with its robots, utilizing the Mega NVIDIA Omniverse Blueprint to simulate and refine robotic habits in advanced, reasonable operational situations earlier than these brokers and behaviors are deployed into the corporate’s Neuraverse ecosystem, in addition to in actual?world fleets.
AgiBot makes use of NVIDIA Cosmos Predict 2 because the world?modeling spine for its Genie Envisioner (GE-Sim) platform — permitting the platform to generate motion?conditioned movies grounded in sturdy visible and bodily priors. Combining this knowledge with Isaac Sim and Isaac Lab, in addition to submit?coaching on AgiBot’s personal knowledge, lets insurance policies developed in Genie Envisioner switch extra reliably to Genie2 humanoids and compact Jetson Thor-powered tabletop robots.
Intbot is utilizing the NVIDIA Cosmos Motive 2 open mannequin to present its social robots a “sixth sense” for the true world — utilizing the mannequin’s reasoning capabilities to determine easy social cues and security context that transcend easy scripted duties. In its Cosmos Cookbook recipeIntbot demonstrates how reasoning imaginative and prescient language fashions can support robots in deciding when to talk and how one can extra naturally work together with people.
How Robotics Builders Are Utilizing New Toolkits and Frameworks
NVIDIA just lately launched Agile, an Isaac Lab-based engine for humanoid loco?manipulation that packages a full, sim?to?actual?verified workflow for coaching strong reinforcement studying insurance policies on platforms just like the Unitree G1 and LimX Dynamics TRON.
Robotics builders can use Agile’s constructed?in process configurations, Markov Determination Course of mathematical fashions for decision-making, coaching utilities and deterministic analysis instruments to tune insurance policies. Builders can then stress?take a look at these insurance policies in Isaac Lab and switch locomotion and entire?physique behaviors to real-world robots extra reliably and effectively.
Hugging Face and NVIDIA are bringing collectively their robotics communities by integrating NVIDIA Isaac GR00T N fashions and simulation frameworks into the LeRobot ecosystem. Builders can now entry Isaac GR00T N1.6 fashions and Isaac Lab?Area immediately inside LeRobot to streamline coverage coaching and analysis.
Plus, Hugging Face’s open?supply Reachy 2 humanoid is now absolutely interoperable with NVIDIA Jetson Thor, enabling the direct deployment of superior imaginative and prescient language motion (VLA) fashions for strong actual?world efficiency.
ROBOTISa number one developer of good servos, industrial actuators, manipulators, open-source humanoid platforms and academic robotic kits, constructed an open supply sim-to-real pipeline utilizing NVIDIA Isaac applied sciences. The workflow begins with excessive?constancy knowledge era in Isaac Sim, scales up coaching units utilizing GR00T?Mimic for augmentation after which high-quality?tunes a VLA?based mostly Isaac GR00T N mannequin that deploys on to {hardware} — accelerating the transition from simulation to strong actual?world duties.
Get Plugged In
Study extra about OpenUSD and robotics improvement by exploring these assets:
- Learn this technical weblog to learn to develop generalist humanoid capabilities with NVIDIA Isaac and GR00T N1.6.
- Learn this technical weblog to learn to consider generalist robotic insurance policies in simulation utilizing NVIDIA Isaac Lab – Area.
- Study how one can post-train Isaac GR00T with this two-part video tutorial.
- Watch NVIDIA founder and CEO Jensen Huang’s CES particular presentation.
- Enhance abilities for robotics improvement with the self-paced robotics studying path.
- Take part within the Cosmos Cookoffa hands-on bodily AI problem the place builders use Cosmos Motive to energy robotics, autonomous programs and imaginative and prescient AI workflows.
Yougfin Snow Brush with Ice Scraper 33 inch, 2 in 1 Extendable Snow Removal for Cars with Foam Grip and 360° Pivoting Brush Head, Heavy Duty Snow Cleaner for Auto Truck SUV
$17.99 (as of January 28, 2026 05:24 GMT -08:00 - More infoProduct prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on [relevant Amazon Site(s), as applicable] at the time of purchase will apply to the purchase of this product.)
Amazon Basics Emergency Seat Belt Cutter and Window Hammer Tool, Car Accessories, 2 Pack, SW-835
$6.99 (as of January 28, 2026 05:24 GMT -08:00 - More infoProduct prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on [relevant Amazon Site(s), as applicable] at the time of purchase will apply to the purchase of this product.)
PULIDIKI Car Cleaning Gel Car Clean Putty, Universal Car Interior Cleaner Slime, Perfect Cleaning Kit Supplies, Auto Detailing Tools Car Accessories, Dust Remover Gifts for Men Women
$6.29 (as of January 28, 2026 05:24 GMT -08:00 - More infoProduct prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on [relevant Amazon Site(s), as applicable] at the time of purchase will apply to the purchase of this product.)
34.5" Snow Brush & Ice Scrapers for Car Windshield with Foam Grip for Cars Extendable, SUV, Trucks - Detachable Сar Scraper - No Scratch - Heavy Duty Handle, Snow Broom, Remover, Easy Scraper, Gray
$16.99 (as of January 28, 2026 05:24 GMT -08:00 - More infoProduct prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on [relevant Amazon Site(s), as applicable] at the time of purchase will apply to the purchase of this product.)
HOMEXCEL Microfiber Cleaning Cloth 12 Pack, 12.5 x 12.5 inch Microfiber Towels for Cars, Ultra Absorbent Washing Cloth, Lint Free Streak Free Cleaning Rags for Car, Kitchen, and Window (Grey)
$5.49 (as of January 28, 2026 05:24 GMT -08:00 - More infoProduct prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on [relevant Amazon Site(s), as applicable] at the time of purchase will apply to the purchase of this product.)
Mobil 1 Advanced Fuel Economy Full Synthetic Motor Oil 0W-20, 5 Quart
$26.99 (as of January 28, 2026 05:24 GMT -08:00 - More infoProduct prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on [relevant Amazon Site(s), as applicable] at the time of purchase will apply to the purchase of this product.)
YESLIFE Balaclava Ski Mask for Men and Women, Winter Face Mask, Shiesty for Skiing, Snowboarding & Motorcycle
$5.31 (as of January 28, 2026 05:24 GMT -08:00 - More infoProduct prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on [relevant Amazon Site(s), as applicable] at the time of purchase will apply to the purchase of this product.)
