PhotoMaker icon

PhotoMaker

Open weights
Tencent

PhotoMaker is a personalized photo generation model developed by TencentARC that creates realistic and diverse human portraits from reference images using a novel Stacked ID Embedding approach.

Image to Image

Key Highlights

Stacked ID Embedding System

Merges information from 1-4 reference images into a unified identity representation for strong and consistent personalization.

Personalization in Seconds

Unlike DreamBooth's minutes-long training, generates personalized outputs in seconds through an efficient embedding-based approach.

Identity Mixing Capability

Offers the ability to blend facial features from multiple people to create new and unique identities for creative applications.

Diverse Pose and Expression Support

Consistently preserves identity across different poses, expressions, ages, and artistic styles with natural-looking results.

About

PhotoMaker is a personalized photo generation model developed by TencentARC, introduced in December 2023 through the paper "PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding." The model enables the creation of realistic and diverse photos of specific individuals by extracting stacked ID embeddings from multiple reference images. Unlike fine-tuning approaches like DreamBooth that require lengthy training times, PhotoMaker achieves personalization through an efficient embedding-based approach that works in seconds, and this rapid inference time makes it extremely attractive for practical applications. The model has redefined the balance between speed and quality in personalized content generation.

The architecture introduces a Stacked ID Embedding mechanism that merges information from multiple input photos (typically 1-4 images) into a unified identity representation. This mechanism extracts separate embeddings from each reference image through a CLIP image encoder and a specialized identity encoder, then stacks them to create a rich identity representation. This representation is injected into the SDXL generation pipeline through modified cross-attention layers. When multiple reference images are used, the model synthesizes information from different angles, expressions, and lighting conditions to develop a more comprehensive understanding of identity. The stacked structure allows combining a variable number of embeddings rather than a single fixed-size vector, providing more flexible identity encoding.

PhotoMaker was trained on a large dataset of celebrity images with diverse poses and expressions, enabling it to generalize well to unseen identities. The model also supports identity mixing — offering the ability to blend features from multiple people to create new, unique faces. This feature is particularly valuable in character design and creative exploration processes. Identity mixing weights are adjustable, allowing control over each source identity's contribution to the final result and enabling blending at the desired ratio.

Use cases are extraordinarily diverse, ranging from professional production to individual use. Personalized portrait generation is the most fundamental use case — users can create portraits from their own photos in different artistic styles, settings, and poses. Identity-consistent story illustration is used in comic, children's book, and visual novel production where a character needs to appear consistently across different scenes. In virtual try-on scenarios, users can visualize different outfits or hairstyles. It is also widely preferred in advertising, marketing, and social media sectors for generating model visuals.

PhotoMaker V2 significantly improved upon the original, offering better identity preservation, more natural generation quality, and enhanced text alignment. The V2 version provides more consistent identity preservation particularly in challenging scenarios — extreme pose changes, age transformations, and stylistic transfers. Both versions are SDXL-based and use the CLIP ViT-L/14 image encoder.

PhotoMaker is open source under the Apache 2.0 license and available on Hugging Face, with community integrations in ComfyUI and other popular tools. Compared to its competitors, while InstantID offers higher identity fidelity in single-image scenarios, PhotoMaker provides more comprehensive identity representation and better style diversity when multiple reference images are used. Its greatest advantage over DreamBooth is that training time is practically zero, making it indispensable in scenarios requiring rapid iteration and batch production.

Use Cases

1

Personalized Portrait Generation

Creating personalized portraits in various styles and scenes from individual photographs.

2

Story Illustration

Supporting storytelling by creating consistent visuals of the same character across different scenes.

3

Identity Mixing and Creative Experiments

Creating creative character designs by blending features from multiple people.

4

Virtual Try-On and Fashion

Visualizing different clothing, hairstyle, and accessory combinations while preserving the person's facial identity.

Pros & Cons

Pros

  • Rapid personalization within seconds without requiring any LoRA training or fine-tuning
  • Strong identity preservation from arbitrary number of input photos with high-fidelity face generation
  • Supports gender/age transformation and multi-ID mixing while maintaining identity consistency
  • Integrates with ControlNet, T2I-Adapter, and IP-Adapter for enhanced control capabilities
  • CVPR 2024 accepted; better ID preservation than test-time fine-tuning methods with significant speed advantage

Cons

  • Customization performance degrades significantly on Asian male faces (acknowledged by developers)
  • Still struggles with accurately rendering human hands in generated images
  • Higher style strength reduces ID fidelity; trade-off between stylization and identity preservation
  • Minimum 11GB GPU memory required, limiting accessibility on consumer hardware

Technical Details

Parameters

N/A

Architecture

Stacked ID Embedding + Diffusion

Training Data

Face identity dataset (filtered)

License

Apache 2.0

Features

  • Stacked ID Embedding
  • Multi-Reference Input (1-4 images)
  • Identity Mixing/Blending
  • SDXL Base Architecture
  • Zero-Shot Personalization
  • Multi-Style Generation
  • Age/Expression Variation
  • PhotoMaker V2 Enhanced Quality

Benchmark Results

MetricValueCompared ToSource
Yüz Benzerlik Skoru%65 (FaceNet cosine)InstantID: %72PhotoMaker Paper (arXiv)
Gerekli Referans Görsel1-4 adetInstantID: 1 adetPhotoMaker GitHub
Kimlik Koruma (ID Preserve)0.58 (DINO score)IP-Adapter-Face: 0.41PhotoMaker Paper (arXiv)
Çıkarım Süresi~10 saniye (A100)InstantID: ~5 saniyePhotoMaker GitHub

Available Platforms

hugging face
replicate
fal ai

Frequently Asked Questions

Related Models

ControlNet icon

ControlNet

Lvmin Zhang|1.4B

ControlNet is a conditional control framework for Stable Diffusion models that enables precise structural guidance during image generation through various conditioning inputs such as edge maps, depth maps, human pose skeletons, segmentation masks, and normal maps. Developed by Lvmin Zhang and Maneesh Agrawala at Stanford University, ControlNet adds trainable copy branches to frozen diffusion model encoders, allowing the model to learn spatial conditioning without altering the original model's capabilities. This architecture preserves the base model's generation quality while adding fine-grained control over composition, structure, and spatial layout of generated images. ControlNet supports multiple conditioning types simultaneously, enabling complex multi-condition workflows where users can combine pose, depth, and edge information to guide generation with extraordinary precision. The framework revolutionized professional AI image generation workflows by solving the fundamental challenge of maintaining consistent spatial structures across generated images. It has become an essential tool for professional artists and designers who need precise control over character poses, architectural layouts, product placements, and scene compositions. ControlNet is open-source and available on Hugging Face with pre-trained models for various Stable Diffusion versions including SD 1.5 and SDXL. It integrates seamlessly with ComfyUI and Automatic1111. Concept artists, character designers, architectural visualizers, fashion designers, and animation studios rely on ControlNet for production workflows. Its influence has extended beyond Stable Diffusion, inspiring similar control mechanisms in FLUX.1 and other modern image generation models.

Open weights
FaceSwap ROOP icon

FaceSwap ROOP

s0md3v
Historical Status Unverified

FaceSwap ROOP is a historical face-replacement entry. The linked repository is archived and now describes a Stable Diffusion extension; verify the exact artifact and model terms before recovering older work.

License Unverified
FLUX Redux icon

FLUX Redux

Black Forest Labs|12B

FLUX Redux is the specialized image variation model within the FLUX model family developed by Black Forest Labs, designed for generating creative variations of reference images while preserving their core style, color palette, and compositional essence. Built on the 12-billion parameter Diffusion Transformer architecture, FLUX Redux takes a reference image as input and produces new images that maintain the visual DNA of the original while introducing controlled variations in content, composition, or perspective. The model captures high-level stylistic attributes including artistic technique, color harmony, lighting mood, and textural qualities, then applies them to generate fresh compositions that feel aesthetically consistent with the source material. FLUX Redux can be combined with text prompts to guide the direction of variation, allowing users to request specific changes like 'same style but with a mountain landscape' or 'similar color palette with an urban scene.' This makes it particularly powerful for brand consistency workflows where marketing teams need multiple visuals sharing a unified aesthetic. The model also supports image-to-image workflows where the reference serves as a strong stylistic prior while text prompts define new content. As a proprietary model, FLUX Redux is accessible through Black Forest Labs' API and partner platforms including Replicate and fal.ai with usage-based pricing. Key applications include generating cohesive visual content series for social media campaigns, creating style-consistent variations for A/B testing in advertising, producing product imagery in consistent brand aesthetics, and creative exploration where artists iterate on a visual direction without starting from scratch.

Proprietary
GFPGAN icon

GFPGAN

Tencent ARC|N/A

GFPGAN is a practical face restoration algorithm developed by Tencent ARC that leverages generative facial priors embedded in a pre-trained StyleGAN2 model to restore severely degraded face images with remarkable quality. First released in December 2021, GFPGAN addresses the challenging problem of blind face restoration where input images may suffer from unknown combinations of low resolution, blur, noise, compression artifacts, and other forms of degradation. The model's architecture combines a degradation removal module with a StyleGAN2-based generative prior, using a novel channel-split spatial feature transform layer that balances fidelity to the original face with the high-quality facial details provided by the generative model. This approach allows GFPGAN to restore fine facial details including skin textures, eye clarity, hair strands, and tooth definition that are completely lost in the degraded input. The model processes faces through a U-Net encoder that extracts multi-resolution features from the degraded image, which then modulate the StyleGAN2 decoder's feature maps to produce a restored output that preserves the original identity while dramatically enhancing quality. GFPGAN excels in old photo restoration, enhancing low-resolution surveillance footage, improving video call quality, recovering damaged family photographs, and preparing low-quality source material for professional use. The model is open source under Apache 2.0, available on Hugging Face and Replicate, and has become a foundational component integrated into numerous creative AI tools and pipelines. Its ability to handle real-world degradation patterns rather than just synthetic corruption makes it particularly valuable for practical restoration tasks encountered by photographers, archivists, and content creators.

Open weights

Quick Info

ParametersN/A
Typediffusion
LicenseApache 2.0
Released2023-12
Architecture

Stacked ID Embedding + Diffusion

CreatorTencent

Links

Tags

photomaker
face
realistic
image-to-image
Visit Website