how are you getting 7gb of vram usage
#3
by
ctranslate2-4you
- opened
When I run the script I posed in the "error" issue created on here I'm getting ~11gb-12 vram usage. How are you getting 7gb and can you post a benchmarking script or something?
They posted you need 12gb vram @ctranslate2-4you