Vision Language Models Quantization - a neuralmagic Collection

neuralmagic 's Collections

Vision Language Models Quantization

FP8 LLMs for vLLM

Llama-3.2 Quantization

Llama-3.1 Quantization

INT8 LLMs for vLLM

INT4 LLMs for vLLM

Sparse Foundational Llama 2 Models

Compression Papers

DeepSparse Sparse LLMs

Sparse Finetuning MPT

Compressed LLMs from the Community

Vision Language Models Quantization

updated 7 days ago

Vision Language Models (VLMs) quantized by Neural Magic

neuralmagic/Llama-3.2-11B-Vision-Instruct-FP8-dynamic

Text Generation • Updated Oct 2 • 19.9k • 10
neuralmagic/Llama-3.2-90B-Vision-Instruct-FP8-dynamic

Text Generation • Updated Oct 2 • 17.2k • 3
neuralmagic/pixtral-12b-FP8-dynamic

Text Generation • Updated 7 days ago • 2.45k • 1