IC-Light
IC-Light (Intrinsic Compositing Light) is an AI relighting model developed by Lvmin Zhang, the creator of ControlNet, that manipulates and transforms lighting conditions in photographs with remarkable realism.
Key Highlights
AI-Powered Lighting Control
Produces professional studio-quality results by rearranging lighting in existing images with artificial intelligence.
HDRI Map Support
Achieves realistic environment lighting by using HDRI environment maps as lighting references.
Light Direction and Color Control
Provides the ability to create desired atmosphere by precisely controlling light direction and color.
Background-Consistent Lighting
Creates natural composition by making lighting on objects or portraits consistent with the background.
About
IC-Light (Intrinsic Compositing Light) is a revolutionary model developed by lllyasviel (the creator of ControlNet) in 2024 that rearranges and manipulates lighting in images using artificial intelligence. The model takes a photograph of an object or person and can completely alter the light source direction, intensity, color, and overall lighting atmosphere. Designed to resolve lighting inconsistencies in compositing and photo editing workflows, IC-Light produces professional-grade results that would traditionally require expensive studio setups or complex 3D rendering pipelines.
The technical foundation of IC-Light is built upon intrinsic image decomposition principles. The model decomposes an image into its constituent components — albedo (material color), normal maps, and shading — enabling independent manipulation of each component. Through this decomposition, it can completely recalculate lighting while preserving the original object's material properties. Two primary modes are offered: IC-Light-FC (Foreground Conditioned) modifies the foreground subject's lighting while automatically generating a compatible background, while IC-Light-FGBG (Foreground-Background) ensures consistent lighting harmonization when both foreground and background images are provided.
IC-Light produces remarkable results in terms of lighting quality and realism across diverse scenarios. It achieves consistent and physically plausible results for different light directions (top, bottom, side, backlighting), various light colors (warm, cool, colored gels), soft and hard light transitions, and multi-source lighting simulations. It demonstrates particularly strong performance in portrait photography relighting, product photography studio light simulation, and lighting harmonization in composite images where elements from different sources must appear naturally unified.
The practical applications span from professional image production to e-commerce and content creation. Photographers use IC-Light to add professional lighting effects to outdoor shoots, product photographers virtually experiment with different lighting scenarios without physical setups, graphic designers ensure lighting consistency across compositing projects, and game developers adjust character and object lighting for scene integration. It is also employed in film post-production for correcting scene lighting and in social media content creation for producing dramatic lighting effects that enhance visual impact.
IC-Light is published as fully open source under the Apache 2.0 license on GitHub. Custom nodes are available for ComfyUI, enabling complex lighting editing workflows to be constructed visually through a node-based interface. An interactive demo page is hosted on Hugging Face Spaces for immediate experimentation. Since the model is built on Stable Diffusion infrastructure, it can run on consumer GPUs with 8 GB VRAM. A Gradio-based local interface is also provided for standalone use without cloud dependencies.
In the lighting manipulation domain, IC-Light stands out as the first open-source model to cross the practical usability threshold for AI-based relighting. While traditional relighting methods require 3D scene information, detailed depth maps, or multi-view captures, IC-Light's ability to work from a single 2D image represents a revolutionary step in accessibility and workflow simplification. Created by the same developer behind ControlNet, this project successfully transfers deep expertise in controllable image generation to the lighting manipulation domain, strengthening the bridge between professional photography and AI-powered creative tools.
Use Cases
Product Photography
Boosting sales by rearranging e-commerce product images with professional studio lighting.
Portrait Editing
Creating dramatic or natural light effects by changing lighting in portrait photographs.
Scene Compositing
Creating natural scenes by combining images from different sources with consistent lighting.
Concept Art Lighting
Determining atmosphere by quickly testing different lighting scenarios in concept art work.
Pros & Cons
Pros
- AI-powered relighting capability for images
- Independent control of foreground and background lighting
- Achieves studio-like results in product photography
- Integrates with ComfyUI and other diffusion tools
Cons
- Lighting artifacts can occur in complex scenes
- Only lighting changes — cannot perform general image editing
- High GPU requirements — real-time processing limited
- Light reflections may not look natural on some material types
Technical Details
Parameters
1B+
Architecture
Stable Diffusion + Lighting Conditioning
Training Data
Synthetic lighting pairs
License
Apache 2.0
Features
- Relighting
- HDR lighting
- Direction control
- Color control
- Background generation
- Portrait relighting
- ComfyUI support
Benchmark Results
| Metric | Value | Compared To | Source |
|---|---|---|---|
| Aydınlatma Doğruluğu (User Study) | %87 tercih oranı | DiffusionLight: %62 | IC-Light Paper (arXiv:2405.00126) |
| SSIM (Relighting) | 0.89 | Total Relighting: 0.83 | Papers With Code |
| İşleme Süresi (512×512) | ~5 saniye (A100) | — | GitHub Repository |
Available Platforms
Frequently Asked Questions
Related Models
ControlNet
ControlNet is a conditional control framework for Stable Diffusion models that enables precise structural guidance during image generation through various conditioning inputs such as edge maps, depth maps, human pose skeletons, segmentation masks, and normal maps. Developed by Lvmin Zhang and Maneesh Agrawala at Stanford University, ControlNet adds trainable copy branches to frozen diffusion model encoders, allowing the model to learn spatial conditioning without altering the original model's capabilities. This architecture preserves the base model's generation quality while adding fine-grained control over composition, structure, and spatial layout of generated images. ControlNet supports multiple conditioning types simultaneously, enabling complex multi-condition workflows where users can combine pose, depth, and edge information to guide generation with extraordinary precision. The framework revolutionized professional AI image generation workflows by solving the fundamental challenge of maintaining consistent spatial structures across generated images. It has become an essential tool for professional artists and designers who need precise control over character poses, architectural layouts, product placements, and scene compositions. ControlNet is open-source and available on Hugging Face with pre-trained models for various Stable Diffusion versions including SD 1.5 and SDXL. It integrates seamlessly with ComfyUI and Automatic1111. Concept artists, character designers, architectural visualizers, fashion designers, and animation studios rely on ControlNet for production workflows. Its influence has extended beyond Stable Diffusion, inspiring similar control mechanisms in FLUX.1 and other modern image generation models.
FaceSwap ROOP
FaceSwap ROOP is a historical face-replacement entry. The linked repository is archived and now describes a Stable Diffusion extension; verify the exact artifact and model terms before recovering older work.
FLUX Redux
FLUX Redux is the specialized image variation model within the FLUX model family developed by Black Forest Labs, designed for generating creative variations of reference images while preserving their core style, color palette, and compositional essence. Built on the 12-billion parameter Diffusion Transformer architecture, FLUX Redux takes a reference image as input and produces new images that maintain the visual DNA of the original while introducing controlled variations in content, composition, or perspective. The model captures high-level stylistic attributes including artistic technique, color harmony, lighting mood, and textural qualities, then applies them to generate fresh compositions that feel aesthetically consistent with the source material. FLUX Redux can be combined with text prompts to guide the direction of variation, allowing users to request specific changes like 'same style but with a mountain landscape' or 'similar color palette with an urban scene.' This makes it particularly powerful for brand consistency workflows where marketing teams need multiple visuals sharing a unified aesthetic. The model also supports image-to-image workflows where the reference serves as a strong stylistic prior while text prompts define new content. As a proprietary model, FLUX Redux is accessible through Black Forest Labs' API and partner platforms including Replicate and fal.ai with usage-based pricing. Key applications include generating cohesive visual content series for social media campaigns, creating style-consistent variations for A/B testing in advertising, producing product imagery in consistent brand aesthetics, and creative exploration where artists iterate on a visual direction without starting from scratch.
GFPGAN
GFPGAN is a practical face restoration algorithm developed by Tencent ARC that leverages generative facial priors embedded in a pre-trained StyleGAN2 model to restore severely degraded face images with remarkable quality. First released in December 2021, GFPGAN addresses the challenging problem of blind face restoration where input images may suffer from unknown combinations of low resolution, blur, noise, compression artifacts, and other forms of degradation. The model's architecture combines a degradation removal module with a StyleGAN2-based generative prior, using a novel channel-split spatial feature transform layer that balances fidelity to the original face with the high-quality facial details provided by the generative model. This approach allows GFPGAN to restore fine facial details including skin textures, eye clarity, hair strands, and tooth definition that are completely lost in the degraded input. The model processes faces through a U-Net encoder that extracts multi-resolution features from the degraded image, which then modulate the StyleGAN2 decoder's feature maps to produce a restored output that preserves the original identity while dramatically enhancing quality. GFPGAN excels in old photo restoration, enhancing low-resolution surveillance footage, improving video call quality, recovering damaged family photographs, and preparing low-quality source material for professional use. The model is open source under Apache 2.0, available on Hugging Face and Replicate, and has become a foundational component integrated into numerous creative AI tools and pipelines. Its ability to handle real-world degradation patterns rather than just synthetic corruption makes it particularly valuable for practical restoration tasks encountered by photographers, archivists, and content creators.
Quick Info
Stable Diffusion + Lighting Conditioning