Tiny CLIP

Introduction

This is a smaller version of CLIP trained for EN only. The training script can be found here. This model is roughly 8 times smaller than CLIP. This was achieved by using a small text model (microsoft/xtremedistil-l6-h256-uncased) and a small vision model (edgenext_small). For a in-depth guide of training CLIP see this blog.

Usage

For now this is the recommended way to use this model

git lfs install 
git clone https://huggingface.co/sachin/tiny_clip
cd tiny_clip

Once you are in the folder you could do the following:

import models
text_encoder, tokenizer, vision_encoder, transform = models.get_model()