File size: 1,410 Bytes
d3b89e0
 
 
4408d0f
d3b89e0
 
 
 
8b8efc0
d3b89e0
 
 
 
 
 
 
6ea877e
d3b89e0
 
 
 
 
 
 
fafa5ba
d3b89e0
fafa5ba
d3b89e0
 
 
 
5605208
1daa62c
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
---
tags:
- text-to-image
- style-transfer
- stable-diffusion
language:
- en
library_name: diffusers
license: mit
---

# StyleShot Model Card


<div align="center">

[**Project Page**](https://styleshot.github.io) **|** [**Paper (ArXiv)**](https://arxiv.org/abs/2407.01414) **|** [**Code**](https://github.com/open-mmlab/StyleShot)
</div>

---


## Introduction

we present StyleShot, a generalized plug-to-play style transfer method, capable of generating the high-quality stylized images that match the desired style from any reference image without test-time style-tuning. To the best of our knowledge, To the best of our knowledge, StyleShot is the first work to designate a style-aware encoder based on Stable Diffusion and a content-fusion encoder for better style and content integration, achieving the state-of-the-art text and image-driven style transfer performance compared to existing methods.

![arch](./framework.png)

## Models

### StyleShot for SD 1.5
- [ip.bin](https://huggingface.co/Gaojunyao/StyleShot/blob/main/pretrained_weight/ip.bin): weights for ip-adapter and our content-retention encoder.
- [style_aware_encoder.bin](https://huggingface.co/Gaojunyao/StyleShot/blob/main/pretrained_weight/style_aware_encoder.bin): weights for style-aware encoder.

## Disclaimer
We develop this repository for RESEARCH purposes, so it can only be used for personal/research/non-commercial purposes.