Hardware
#6
by
rileyjohnson
- opened
What is the recommended hardware for this model?
3090 / 4090 (24gb vram) is recommended - otherwise you may want to consider quantized solutions using the rwkv pip library
Will a laptop with a GTX 1650 and 24GB of RAM be sufficient?
FWIW, I got an OOM error on my laptop with these specs:
13th Gen Intel(R) Core(TM) i9-13900H 2.60 GHz
32.0 GB RAM
RTX 4070