OpenLRM
OpenLRM is an open-source implementation of the Large Reconstruction Model architecture for single-image 3D reconstruction, developed by Zexiang Xu and collaborators.
Key Highlights
Foundation LRM Architecture
Open-source reference implementation of the Large Reconstruction Model architecture that influenced subsequent models including TripoSR and InstantMesh
Triplane-NeRF 3D Representation
Uses three axis-aligned feature planes to encode 3D geometry and appearance, enabling both volumetric rendering and mesh extraction from a compact representation
Vision Transformer Encoding
Leverages pre-trained Vision Transformer (ViT) encoders for robust visual feature extraction, providing strong generalization across diverse input image types
Reproducible Open Research
Provides fully reproducible training and inference code with pre-trained checkpoints, enabling the research community to build upon and extend the LRM paradigm
About
OpenLRM is an open-source implementation of the Large Reconstruction Model (LRM) architecture for single-image 3D reconstruction, developed by Zexiang Xu and collaborators. The project provides a fully open and reproducible implementation of the LRM approach, which uses a transformer-based architecture to reconstruct 3D objects from single images through a triplane neural radiance field representation. Playing a key role in democratizing the LRM paradigm, OpenLRM has served as the foundation for numerous subsequent 3D reconstruction models.
The LRM architecture processes an input image through a pre-trained vision transformer (ViT) encoder to extract visual features, then uses a transformer decoder to predict a triplane representation of the 3D object. This triplane representation consists of three axis-aligned feature planes that encode the object's geometry and appearance. The triplane can be queried at any 3D point to obtain density and color values, enabling both volumetric rendering and mesh extraction through marching cubes. DINO and DINOv2-based vision encoders extract strong semantic features from the input image, enhancing reconstruction accuracy and enabling the model to produce consistent results across different object types.
OpenLRM's significance lies in its open implementation of a powerful 3D reconstruction paradigm. While the original LRM paper described the architecture, OpenLRM made the approach accessible to the broader research and development community by providing pre-trained weights, training code, and inference scripts. This has enabled numerous downstream projects and research efforts to build upon the LRM foundation. The project offers multiple model variants at different scales, allowing users to adjust the speed-quality trade-off according to their specific needs, and this flexibility provides value in both research and production environments.
The model supports both text-to-3D and image-to-3D workflows, though image-to-3D is the primary use case. Feed-forward inference enables generation in seconds rather than the minutes or hours required by optimization-based methods. The output triplane representation can be rendered as novel views or extracted as a textured 3D mesh for use in standard 3D applications. The model's transformer-based architecture effectively captures global context information from the input image, enabling consistent 3D reconstruction even from partial views and logically completing unseen portions of the object.
In terms of training infrastructure, OpenLRM was trained on the Objaverse and Objaverse-XL datasets and demonstrates generalization capacity across diverse object categories. The project open-sources the entire training process, enabling researchers to retrain or fine-tune the model on their own datasets. This transparency has raised reproducibility standards in academic research and facilitated rapid iteration across the community of researchers and developers working in this space.
Released under the Apache 2.0 license, OpenLRM is freely available for research and commercial applications. The project is hosted on Hugging Face with pre-trained model checkpoints at multiple scales. OpenLRM has served as a foundation for several subsequent 3D reconstruction models, including TripoSR and InstantMesh, which built upon and improved the LRM architectural pattern, and it continues to serve as an indispensable reference implementation for the field.
Use Cases
3D Reconstruction Research
Serves as a baseline and starting point for academic research in feed-forward 3D reconstruction, providing reproducible results for comparison studies
Custom Model Development
Use OpenLRM's architecture and training code as a foundation for developing specialized 3D reconstruction models fine-tuned on domain-specific datasets
Rapid 3D Asset Generation
Generate 3D models from reference images quickly for prototyping, visualization, and content creation workflows requiring fast turnaround
Pipeline Component Integration
Integrate as a 3D reconstruction component within larger content creation or processing pipelines alongside image generation and post-processing tools
Pros & Cons
Pros
- Open-source model for 3D reconstruction from single images
- Open implementation of the Large Reconstruction Model concept
- Efficient transformer-based architecture
- Free to use for research and prototyping
Cons
- Production quality lower than commercial solutions
- Limited resolution and detail level
- Errors in geometry estimation from unseen angles
- Documentation and community support limited
Technical Details
Parameters
N/A
License
Apache 2.0
Features
- Single Image to 3D Reconstruction
- Large Reconstruction Model Architecture
- Triplane-NeRF Representation
- Fast Feed-Forward Inference
- Open-Source Apache 2.0
- Multiple Resolution Support
- Mesh Export Capability
- Hugging Face Integration
Benchmark Results
| Metric | Value | Compared To | Source |
|---|---|---|---|
| Novel View PSNR | 21.0 dB (GSO) | InstantMesh: 22.2 dB | GitHub 3DTopia/OpenLRM |
| SSIM (GSO) | 0.856 | InstantMesh: 0.880 | GitHub 3DTopia/OpenLRM |
| Üretim Süresi | ~5 saniye | — | GitHub 3DTopia/OpenLRM |
| Parametre Sayısı | ~300M | — | Hugging Face Model Card |
Available Platforms
Frequently Asked Questions
Related Models
InstantMesh
InstantMesh is a feed-forward 3D mesh generation model developed by Tencent that creates high-quality textured 3D meshes from single input images through a multi-view generation and sparse-view reconstruction pipeline. Released in April 2024 under the Apache 2.0 license, InstantMesh combines a multi-view diffusion model with a large reconstruction model to achieve both speed and quality in single-image 3D reconstruction. The pipeline first generates multiple consistent views of the input object using a fine-tuned multi-view diffusion model, then feeds these views into a transformer-based reconstruction network that predicts a triplane neural representation, which is finally converted to a textured mesh. This two-stage approach produces significantly higher quality results than single-stage methods while maintaining generation times of just a few seconds. InstantMesh supports both text-to-3D workflows when combined with an image generation model and direct image-to-3D conversion from photographs or artwork. The output meshes include detailed geometry and texture maps compatible with standard 3D software and game engines. The model handles a wide variety of object types including characters, vehicles, furniture, and organic shapes with good geometric fidelity. As an open-source project with code and weights available on GitHub and Hugging Face, InstantMesh has become a popular choice for developers building 3D asset generation pipelines. It is particularly useful for game development, e-commerce product visualization, and rapid prototyping scenarios where fast turnaround and reasonable quality are both important requirements.
LGM
LGM (Large Gaussian Model) is a 3D generation model developed by researchers at Peking University that produces high-quality 3D objects from single images or text prompts in approximately five seconds using 3D Gaussian Splatting representation. Released in 2024 under the MIT license, LGM combines multi-view image generation with Gaussian-based 3D reconstruction in an end-to-end framework. The model first generates multiple consistent views of the target object using a multi-view diffusion backbone, then a U-Net-based Gaussian decoder predicts 3D Gaussian parameters from these views to construct the full 3D representation. Unlike mesh-based approaches, the Gaussian Splatting output enables real-time rendering with high visual quality including accurate lighting, transparency, and reflective surface effects. LGM supports resolutions up to 512 pixels for the generated views and produces detailed 3D content with clean geometry and vivid textures. The model can be used for both image-to-3D conversion from photographs and text-to-3D generation when paired with a text-to-image model as a front end. As an open-source project with code and pre-trained weights available on GitHub, LGM is accessible to researchers and developers for both academic study and practical applications. The model is particularly suited for interactive 3D visualization, virtual reality content, game asset prototyping, and any scenario where real-time rendering of generated 3D content is required. LGM demonstrates that Gaussian Splatting provides a compelling alternative to traditional mesh representations for AI-generated 3D content.
Meshy
Meshy is a proprietary AI-powered 3D generation platform developed by Meshy AI that creates detailed, production-ready 3D models from text descriptions and images. The platform combines text-to-3D and image-to-3D capabilities with advanced AI texturing features, positioning itself as a comprehensive solution for rapid 3D content creation. Meshy uses a transformer-based architecture that generates textured 3D meshes with PBR-compatible materials, making outputs directly usable in game engines like Unity and Unreal Engine without additional processing. The platform offers multiple generation modes including text-to-3D for creating objects from written descriptions, image-to-3D for converting photographs into 3D models, and AI texturing for applying realistic materials to existing untextured meshes. Generated models include proper UV mapping, normal maps, and physically based rendering materials suitable for professional workflows. Meshy provides both a web-based interface and an API for programmatic access, making it accessible to individual artists and scalable for enterprise pipelines. The platform is particularly popular among game developers, animation studios, and AR/VR content creators who need to produce large volumes of 3D assets efficiently. As a proprietary commercial service launched in 2023, Meshy operates on a subscription model with free tier access for limited generations. The platform continuously updates its models to improve output quality, topology optimization, and texture fidelity, competing directly with other AI 3D generation services in the rapidly evolving market.
Meshy v4
Meshy-4 is a historical model version retired for API requests. Check the retirement boundary, migration dependencies and current plan terms before starting new work.