Vec2Face Model Card

Project Page | Paper | Code | 🤗 Gradio demo

Introduction

Vec2Face is the first model that achieves the generated synthetic face recognition dataset (HSFace10K) first being higher than the same-scale real dataset (CASIA-WebFace).

Usage

You can directly download the model in this repository. You also can download the model in python script:

from huggingface_hub import hf_hub_download
hf_hub_download(repo_id="BooBooWu/Vec2Face", filename="weights/6DRepNet_300W_LP_AFLW2000.pth", local_dir="./")
hf_hub_download(repo_id="BooBooWu/Vec2Face", filename="weights/arcface-r100-glint360k.pth", local_dir="./")
hf_hub_download(repo_id="BooBooWu/Vec2Face", filename="weights/magface-r100-glint360k.pth", local_dir="./")
hf_hub_download(repo_id="BooBooWu/Vec2Face", filename="weights/vec2face_generator.pth", local_dir="./")

For the image generation and training code, please go to Vec2Face github repository.

Performance

Datasets in 0.5M scale

This table compares the existing synthetic dataset generation methods on five standard face recognition test sets. The model trained with HSFace10K has better performance on CALFW than that trained with real dataset.

Training sets	# images	LFW	CFP-FP	CPLFW	AgeDB	CALFW	Avg.
IDiff-Face	0.5M	98.00	85.47	80.45	86.43	90.65	88.20
DCFace	0.5M	98.55	85.33	82.62	89.70	91.60	89.56
Arc2Face	0.5M	98.81	91.87	85.16	90.18	92.63	91.73
DigiFace	1M	95.40	87.40	78.87	76.97	78.62	83.45
SynFace	0.5M	91.93	75.03	70.43	61.63	74.73	74.75
SFace	0.6M	91.87	73.86	73.20	71.68	77.93	77.71
IDnet	0.5M	92.58	75.40	74.25	63.88	79.90	79.13
ExFaceGAN	0.5M	93.50	73.84	71.60	78.92	82.98	80.17
SFace2	0.6M	95.60	77.11	74.60	77.37	83.40	81.62
Langevin-Disco	0.6M	96.60	73.89	74.77	80.70	87.77	82.75
HSFace10K(Ours)	0.5M	98.87	88.97	85.47	93.12	93.57	92.00
CASIA-WebFace (Real)	0.49M	99.38	96.91	89.78	94.50	93.35	94.79

###Dataset Scaling up to 300K identities and 15M images

This is the uniqueness of the proposed Vec2Face, which can easily scale the dataset size up.

Datasets	# images	LFW	CFP-FP	CPLFW	AgeDB	CALFW	Avg.
HSFace10K	0.5M	98.87	88.97	85.47	93.12	93.57	92.00
HSFace20K	1M	98.87	89.87	86.13	93.85	93.65	92.47
HSFace100K	5M	99.25	90.36	86.75	94.38	94.12	92.97
HSFace200K	10M	99.23	90.81	87.30	94.22	94.52	93.22
HSFace300K	15M	99.30	91.54	87.70	94.45	94.58	93.52
CASIA-WebFace (Real)	0.49M	99.38	96.91	89.78	94.50	93.35	94.79

Other challenging test sets

We test the model performance on other four datasets, Hadrian (facial hair), Eclipse (face exposure), SLLFW (similar-looking), and DoppelVer (doppelganger).

Datasets	Hadrian	Eclipse	SLLFW	DoppelVer
HSFace10K	69.47	64.55	92.87	86.91
HSFace20K	75.22	67.55	94.37	88.91
HSFace100K	80.00	70.35	95.58	90.39
HSFace200K	79.85	71.12	95.70	89.86
HSFace300K	81.55	71.35	95.95	90.49
CASIA-WebFace (Real)	77.82	68.52	96.95	95.11

Citation

@article{wu2024vec2face,
  title={Vec2Face: Scaling Face Dataset Generation with Loosely Constrained Vectors},
  author={Wu, Haiyu and Singh, Jaskirat and Tian, Sicong and Zheng, Liang and Bowyer, Kevin W},
  journal={arXiv preprint arXiv:2409.02979},
  year={2024}
}

BooBooWu
/

Vec2Face