Ivan Charapanau

av-codes's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16 3 days ago

The quant doesn't load in vLLM / Aphrodite Engine

2

#1 opened 6 days ago by av-codes

New activity in ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-1x16-hf 6 days ago

Tokenizer Config: incorrect EOS token and missing chat template

#1 opened 6 days ago by av-codes

New activity in Sreenington/Phi-3-mini-4k-instruct-AWQ about 2 months ago

Quantization approach

4

#1 opened 3 months ago by Bhawanaprasain10