Tech

Allsides 3D Digital Twin Factory gets underway, in partnership with Nvidia for Physical AI on an industrial scale

The South Tyrolean group has launched an industrial-scale automated production system that transforms physical objects into SimReady Digital Twins

Foto: Allsides

4' min read

Translated by AI
Versione italiana

4' min read

Translated by AI
Versione italiana

(Il Sole 24 Ore Radiocor) - Allsides, a South Tyrolean company that builds 3D data infrastructure for Physical AI and World Models, has launched the 3D Digital Twin Factory, an industrial-scale automated production system that transforms physical objects into SimReady Digital Twins, designed for the simulation training of robots and Physical AI systems. Thanks to Nvidia’s accelerated computing, Allsides’ automated pipeline is capable of transforming real-world objects into 3D Digital Twins – physically accurate digital replicas – which enable robots to train in simulation environments such as Nvidia Isaac Sim.

Each digital twin reproduces the object’s geometry with sub-millimetre precision, measuring PBR (physically based rendering – a 3D rendering and shading method that simulates the real-world behaviour of light as it strikes an object’s surface) materials and physical properties such as mass, collision properties and coefficients of friction with precision, so that, in a simulated environment, a robot can learn and train using objects from the real world.

Loading...

"Every major breakthrough in artificial intelligence has been made possible by higher-quality data, and Physical AI is no exception. Robots learn through simulation, so the simulation must be true to the real world. The 3D Digital Twin Factory provides SimReady Digital Twins of real-world objects on an industrial scale", Franz Tschimben, CEO and co-founder of Allsides, told Radiocor. The company started out in Bressanone as Covision Media and now has offices in New York and San Francisco, as well as partnerships with groups such as Mark Zuckerberg’s Meta, Adidas, Inditex, Gore-Tex and Zara. A simulation environment seeks to faithfully reproduce the behaviour of the real world.

So, “if a digital object is placed inside it that has a shape slightly different from the original, or if its surface behaves differently from the real one, the skill learnt may not translate to real-world application. Engineers call this the Sim2Real gap – the divide between simulation and reality”, explains Tschimben. To bridge this gap, we need physically accurate 3D data that is diverse and available in large volumes. Until now, developers have had to make a choice: synthetic datasets offer scale but lack physical realism, whilst those acquired in the studio guarantee quality but lack variety and volume. “The Allsides 3D Digital Twin Factory was created to eliminate this trade-off,” explains the CEO.

An object – be it a trainer, a power tool, a piece of fruit, an industrial component or a parcel – is placed in the Allsides 3D Scanner. In just a few minutes, the capture system is able to create a visually and physically accurate 3D Digital Twin. The company has also automated the entire process of capture, reconstruction, quality control and delivery: Digital Twins are thus produced continuously, rather than one at a time by specialist technicians. The pipeline is based on Nvidia accelerated computing.

"Accuracy in simulation stems from accuracy during the data acquisition phase," explained Burkhard Guessefeld, CTO and co-founder of Allsides, explaining that “running our reconstruction on Nvidia’s accelerated computing platform allows us to measure the geometry, materials and physical properties of every single object and provide them in formats that robotics teams can integrate directly into Isaac Sim”. Among the first partners and users of SimReady data are Nvidia, Mistral AI, Franka Robotics, Industrial Next, the Technical University of Munich (TUM) and the University of Heidelberg.

"Allsides has built the pipeline that produces SimReady and physically accurate Digital Twins at an industrial scale, based on Nvidia’s accelerated computing and capable of being integrated directly into Nvidia Isaac Sim, starting from the same capture system that adidas, Nike and Zara already use for digital commerce”, said Azita Martin, Vice President and General Manager of AI for Retail, CPG and QSR at Nvidia. In 2025, Meta Reality Labs Research began a collaboration with Allsides to power the capture pipeline underpinning the Digital Twin Catalogue (DTC), described as "the world’s highest-quality dataset for object reconstruction research".

In the peer-reviewed study on DTC conducted by Meta and Stanford, the data acquired by Allsides was compared with benchmark datasets, proving to be the only ones to combine real-world acquisition, multi-view consistency, comprehensive PBR materials, high geometric accuracy and adaptability to different lighting conditions. Even today, in fact, the DTC is used by companies and research teams training multimodal AI models and robots.

"Thanks to its research and development work in the fields of computer vision, machine learning and AI, Allsides has built on that initial study, making SimReady its 3D reconstruction and data management pipeline," said Tschimben. The factory is based on the same pipeline that Allsides has already used to produce hundreds of thousands of 3D assets. “The aim is to provide millions of 3D Digital Twins across several hundred categories of objects, with new data released every month and flexible licensing options,” added the CEO.

Copyright reserved ©
Loading...

Brand connect

Loading...

Newsletter

Notizie e approfondimenti sugli avvenimenti politici, economici e finanziari.

Iscriviti