Hugging Face's logo
Andrei Panferov's picture
29 2 3

Andrei Panferov

BlackSamorez
Kalemnor's profile picture cgus's profile picture tolkkkM's profile picture
·

AI & ML interests

NLP

Organizations

IST Austria Distributed Algorithms and Systems Lab's profile picture ISTA DASLab Testing Account's profile picture

BlackSamorez's activity

New activity in ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 5 months ago

Repetitive generation without additional EOS token

2
#5 opened 5 months ago by amrothemich
New activity in ISTA-DASLab/Llama-2-7b-AQLM-PV-2Bit-1x16-hf 6 months ago

Create model card
#1 opened 6 months ago by justheuristic
New activity in Intel/low_bit_open_llm_leaderboard 6 months ago

Add support for AQLM

3
#1 opened 6 months ago by BlackSamorez
New activity in ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 7 months ago

~8 tok/sec with ~5k context on vLLM with Flash Attention and `kv_cache_dtype="fp8"` on 3090TI 24GB VRAM

2
#2 opened 7 months ago by ubergarm
New activity in ISTA-DASLab/Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16 7 months ago

Update tokenizer_config.json
#2 opened 7 months ago by BlackSamorez
New activity in ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16 7 months ago

Update tokenizer_config.json
#1 opened 7 months ago by BlackSamorez
New activity in ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf 8 months ago

ZN2at4_ops15sum_IntList_out4callERKNS_6TensorEN3c1016OptionalArrayRefIlEEbSt8optionalINS5_10ScalarTypeEERS2

9
#3 opened 8 months ago by LaferriereJC
New activity in ISTA-DASLab/gemma-2b-AQLM-2Bit-1x16-hf 9 months ago

Update README.md

1
#2 opened 9 months ago by SpiridonSunRotator

Updated model description and added evaluation metrics.

1
#1 opened 9 months ago by SpiridonSunRotator
New activity in ISTA-DASLab/gemma-2b-AQLM-2Bit-2x8-hf 9 months ago

Updated description and the metrics
#1 opened 9 months ago by SpiridonSunRotator
New activity in ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf 9 months ago

Update README.md
#6 opened 9 months ago by SpiridonSunRotator
New activity in ISTA-DASLab/Llama-2-13b-AQLM-2Bit-1x16-hf 9 months ago

Updated 13b model.
#1 opened 9 months ago by SpiridonSunRotator
New activity in ISTA-DASLab/Llama-2-7b-AQLM-2Bit-8x8-hf 9 months ago

Upgrade format of this model?

2
#2 opened 9 months ago by jaemzfleming

Update README.md
#1 opened 9 months ago by SpiridonSunRotator
New activity in ISTA-DASLab/Llama-2-7b-AQLM-2Bit-1x16-hf 9 months ago

Upload finetuned Llama-2-7b models

1
#1 opened 9 months ago by SpiridonSunRotator
New activity in ISTA-DASLab/Llama-2-7b-AQLM-2Bit-2x8-hf 9 months ago

Upload finetuned Llama-2-7b models

1
#1 opened 9 months ago by SpiridonSunRotator
New activity in ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf 9 months ago

Loading Error: BlackSamorez/Mixtral-8x7B-Instruct-v0.1-AQLM-2Bit-1x16-hf Model in Colab

5
#2 opened 9 months ago by lxyuan
New activity in ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf 9 months ago

Endpoint encountered an error

2
#5 opened 9 months ago by vanokio
New activity in ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf 9 months ago

Update README.md
#1 opened 9 months ago by SpiridonSunRotator
New activity in ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf 9 months ago

NameError: name 'flash_attn_func' is not defined

2
#4 opened 9 months ago by Neman