InstantMesh
InstantMesh is a feed-forward 3D mesh generation model developed by Tencent that creates high-quality textured 3D meshes from single input images through a multi-view generation and sparse-view reconstruction pipeline. Released in April 2024 under the Apache 2.0 license, InstantMesh combines a multi-view diffusion model with a large reconstruction model to achieve both speed and quality in single-image 3D reconstruction. The pipeline first generates multiple consistent views of the input object using a fine-tuned multi-view diffusion model, then feeds these views into a transformer-based reconstruction network that predicts a triplane neural representation, which is finally converted to a textured mesh. This two-stage approach produces significantly higher quality results than single-stage methods while maintaining generation times of just a few seconds. InstantMesh supports both text-to-3D workflows when combined with an image generation model and direct image-to-3D conversion from photographs or artwork. The output meshes include detailed geometry and texture maps compatible with standard 3D software and game engines. The model handles a wide variety of object types including characters, vehicles, furniture, and organic shapes with good geometric fidelity. As an open-source project with code and weights available on GitHub and Hugging Face, InstantMesh has become a popular choice for developers building 3D asset generation pipelines. It is particularly useful for game development, e-commerce product visualization, and rapid prototyping scenarios where fast turnaround and reasonable quality are both important requirements.
Key Highlights
FlexiCubes Clean Mesh Extraction
Uses FlexiCubes instead of marching cubes for mesh extraction, producing cleaner topology with more regular face distributions suitable for game engines and animation
Multi-View Consistency Pipeline
Generates consistent multi-view images of the object before 3D reconstruction, ensuring geometric accuracy through cross-view information fusion
UV-Mapped Textured Output
Produces meshes with proper UV mapping and texture images ready for immediate use in standard 3D workflows, game engines, and rendering applications
State-of-Art Open-Source Quality
Represents the current state of the art in open-source single-image 3D reconstruction, exceeding quality of simpler models like TripoSR and Shap-E
About
InstantMesh is a feed-forward 3D mesh generation model developed by Tencent that creates high-quality textured 3D meshes from single input images through a multi-view generation and sparse-view reconstruction pipeline. Released in 2024, InstantMesh combines a multi-view diffusion model with a large reconstruction model (LRM) and FlexiCubes-based mesh extraction to produce clean, well-textured 3D assets suitable for downstream applications. The model represents a significant leap in quality and usability within the open-source single-image 3D reconstruction space.
The pipeline operates in multiple stages. First, a multi-view diffusion model generates consistent views of the object from multiple angles based on the input image. These generated views are then fed into a sparse-view reconstruction network that processes the multi-view images to produce a 3D representation. Finally, FlexiCubes extraction converts this representation into a high-quality polygonal mesh with UV-mapped textures, producing assets with cleaner topology than methods using marching cubes extraction. Each stage builds upon the output of the previous one, minimizing quality loss from input to output and providing an integrated production process.
InstantMesh's use of FlexiCubes for mesh extraction is a key differentiator. Unlike marching cubes, which produces meshes with irregular topology and many unnecessary vertices, FlexiCubes generates meshes with more regular face distributions and better-defined surface details. This results in meshes that are more suitable for use in game engines, animation pipelines, and 3D printing without extensive post-processing. The differentiable nature of FlexiCubes allows the mesh extraction process to be optimized end-to-end during training, which directly improves final output quality by producing sharper edges and more accurate geometry.
The model produces textured meshes with corresponding UV maps and texture images, providing immediately usable 3D assets. The quality of both geometry and texture typically exceeds that of simpler feed-forward models like TripoSR or Shap-E, though generation takes somewhat longer due to the multi-stage pipeline. Output meshes can be exported in OBJ, GLB, and PLY formats and are fully compatible with standard 3D workflows. Texture maps are generated at sufficient resolution and do not require additional texture work for most applications.
InstantMesh's multi-view generation stage can utilize Zero123++ or similar models, and this modular design allows each component to be independently updated or replaced. The model was trained on the Objaverse dataset and demonstrates strong generalization capability across diverse object categories. It can successfully handle a wide range of inputs from product photography to artistic illustrations, producing consistent results for objects of different styles and complexity levels.
Released under the Apache 2.0 license, InstantMesh is fully open-source with pre-trained weights available on Hugging Face. A live demo on Hugging Face Spaces allows users to try the model without local installation. The model represents the state of the art in open-source single-image 3D reconstruction and is actively used in both research and production environments across the creative industry.
Use Cases
Game Asset Production
Generate game-ready 3D models with clean topology and UV-mapped textures from concept art for rapid asset creation in game development pipelines
3D Content for AR/VR
Create 3D objects from product photos or artwork for augmented reality experiences and virtual reality environments with production-quality mesh output
Digital Twin Generation
Rapidly create 3D digital representations of physical objects from photographs for inventory visualization, documentation, and virtual showcases
Research and Benchmarking
Use as a state-of-the-art baseline for 3D reconstruction research and as a comparison point for evaluating new single-image 3D generation methods
Pros & Cons
Pros
- Creates 3D mesh from a single image in seconds
- Efficient architecture based on LRM (Large Reconstruction Model)
- Open source — accessible on Hugging Face
- Consistent 3D structure with multi-view synthesis
Cons
- Low quality on back faces and unseen areas
- Limited resolution in detailed surface textures
- Difficulty with complex objects (transparent, reflective)
- Irregular mesh topology — not suitable for direct game engine use
Technical Details
Parameters
N/A
License
Apache 2.0
Features
- Single Image to 3D Mesh
- Sparse-View Reconstruction
- Multi-View Generation Pipeline
- FlexiCubes Mesh Extraction
- High-Quality Textured Output
- Open-Source Apache 2.0
- Tencent Research Model
- Hugging Face Spaces Demo
Benchmark Results
| Metric | Value | Compared To | Source |
|---|---|---|---|
| Novel View PSNR | 22.2 dB (GSO) | TripoSR: 21.7 dB | arXiv 2404.07191 |
| Üretim Süresi | ~10 saniye | LGM: ~5 saniye | GitHub InstantMesh |
| SSIM (GSO) | 0.880 | OpenLRM: 0.856 | arXiv 2404.07191 |
| LPIPS (GSO) | 0.125 | TripoSR: 0.138 | arXiv 2404.07191 |
Available Platforms
News & References
Frequently Asked Questions
Related Models
TripoSR
TripoSR is a fast feed-forward 3D reconstruction model jointly developed by Stability AI and Tripo AI that generates detailed 3D meshes from single input images in under one second. Unlike optimization-based methods that require minutes of processing per object, TripoSR uses a transformer-based architecture built on the Large Reconstruction Model framework to predict 3D geometry directly from a single 2D photograph in a single forward pass. The model accepts any standard image as input and produces a textured 3D mesh suitable for use in game engines, 3D modeling software, and augmented reality applications. TripoSR excels at reconstructing everyday objects, furniture, vehicles, characters, and organic shapes with impressive geometric accuracy and surface detail. Released under the MIT license in March 2024, the model is fully open source and can run on consumer-grade GPUs without specialized hardware. It supports batch processing for efficient conversion of multiple images and integrates seamlessly with popular 3D pipelines including Blender, Unity, and Unreal Engine. The model is particularly valuable for game developers, product designers, and e-commerce teams who need rapid 3D asset creation from product photographs. Output meshes can be exported in OBJ and GLB formats with configurable resolution settings. TripoSR represents a significant step toward democratizing 3D content creation by making high-quality reconstruction accessible without expensive scanning equipment or manual modeling expertise.
TRELLIS
TRELLIS is a revolutionary AI model developed by Microsoft Research that generates high-quality 3D assets from text descriptions or single 2D images using a novel Structured Latent Diffusion architecture. Released in December 2024, TRELLIS represents a fundamental advancement in 3D content generation by operating in a structured latent space that encodes geometry, texture, and material properties simultaneously rather than treating them as separate stages. The model produces complete 3D meshes with detailed PBR (Physically Based Rendering) textures, enabling direct use in game engines, 3D rendering pipelines, and AR/VR applications without extensive manual post-processing. TRELLIS supports both text-to-3D generation where users describe desired objects in natural language and image-to-3D reconstruction where a single photograph is converted into a full 3D model with inferred geometry from occluded viewpoints. The structured latent representation ensures geometric consistency and prevents the common artifacts seen in other 3D generation approaches such as floating geometry, texture seams, and unrealistic proportions. TRELLIS outputs standard 3D formats including GLB and OBJ with UV-mapped textures, making integration with professional tools like Blender, Unity, and Unreal Engine straightforward. Released under the MIT license, the model is fully open source and available on GitHub. Key applications include rapid 3D asset prototyping for game development, architectural visualization, product design mockups, virtual staging for real estate, educational 3D content creation, and metaverse asset generation. The model particularly benefits indie developers and small studios who lack resources for traditional 3D modeling workflows.
Meshy
Meshy is a proprietary AI-powered 3D generation platform developed by Meshy AI that creates detailed, production-ready 3D models from text descriptions and images. The platform combines text-to-3D and image-to-3D capabilities with advanced AI texturing features, positioning itself as a comprehensive solution for rapid 3D content creation. Meshy uses a transformer-based architecture that generates textured 3D meshes with PBR-compatible materials, making outputs directly usable in game engines like Unity and Unreal Engine without additional processing. The platform offers multiple generation modes including text-to-3D for creating objects from written descriptions, image-to-3D for converting photographs into 3D models, and AI texturing for applying realistic materials to existing untextured meshes. Generated models include proper UV mapping, normal maps, and physically based rendering materials suitable for professional workflows. Meshy provides both a web-based interface and an API for programmatic access, making it accessible to individual artists and scalable for enterprise pipelines. The platform is particularly popular among game developers, animation studios, and AR/VR content creators who need to produce large volumes of 3D assets efficiently. As a proprietary commercial service launched in 2023, Meshy operates on a subscription model with free tier access for limited generations. The platform continuously updates its models to improve output quality, topology optimization, and texture fidelity, competing directly with other AI 3D generation services in the rapidly evolving market.
Shap-E
Shap-E is a 3D generation model developed by OpenAI that creates 3D objects directly from text descriptions or input images by generating the parameters of implicit neural representations. Unlike its predecessor Point-E which produces point clouds, Shap-E generates Neural Radiance Fields (NeRF) and textured meshes that can be directly rendered and used in 3D applications. The model employs a two-stage training approach where an encoder first learns to map 3D assets to implicit function parameters, then a conditional diffusion model learns to generate those parameters from text or image inputs. This architecture enables fast generation times of just a few seconds on a modern GPU. Shap-E supports both text-to-3D and image-to-3D workflows, making it versatile for different creative pipelines. The generated 3D objects include color and texture information, producing more complete results than geometry-only approaches. Released under the MIT license in May 2023, the model is fully open source with pre-trained weights available on GitHub. While the output quality may not match optimization-heavy methods like DreamFusion that take minutes per object, Shap-E offers a practical balance between speed and quality for rapid prototyping and concept exploration. The model is particularly useful for game developers, 3D artists, and researchers who need quick 3D visualizations from text prompts. As one of OpenAI's contributions to open-source 3D AI research, Shap-E has influenced subsequent work in fast feed-forward 3D generation approaches.