Running this on GPU

#2
by Sdspieg - opened

Has anybody managed to run this on a GPU? If so - could s/he share the code?

Owner

@Sdspieg Just like any other models, for example:

from transformers import pipeline


pipe = pipeline('feature-extraction', model='d0rj/e5-large-en-ru', device='cuda')
embeddings = pipe('Hello, world!', return_tensors=True)
embeddings[0].size()
d0rj changed discussion status to closed

Sign up or log in to comment