Discover how AI is revolutionizing healthcare with early diagnostics, predictive analytics, and improved patient outcomes.
Neural reconstruction for AV simulation
Real world data collected from AV fleets serves as the foundation for AV workflows, however, it isn’t feasible to collect and annotate sensor data for rare events, objects, and scenarios. Through advanced 3D reconstruction techniques, neural reconstruction and rendering, developers can turn real world datasets into diverse, interactive simulations.
NVIDIA NuRec
NVIDIA NuRec is a set of APIs and tools for neural reconstruction and rendering. It enables developers to use their existing fleet data to reconstruct high-fidelity digital twins, simulate new events, and render sensor datasets from novel points of view. NuRec’s APIs and tools enable developers to:
Prepare and process sensor data for reconstruction
Reconstruct sensor data into 3D representations
Perform Gaussian-based rendering to connect with simulation
Sensor configurations vary between vehicle platforms. Before reconstructing digital twins from arbitrary sensor data with different calibration, extrinsics, and capture quality, the sensor data must be formatted in a standardized way for data processing.
Voxel51 is a visual AI data platform company that has built powerful, widely used open source tools for data processing, visualization and formatting for AI workloads. NuRec data toolkits, data ingestion libraries as well as the NuRec container will be available on Voxel51’s toolchain, so developers can ingest their own datasets, evaluate the quality of their reconstructions, and create 3D digital twins for downstream simulation tasks. This pipeline will be featured at CVPR in a demo at the Voxel 51 booth (#1417).