Haihao Shen's picture

8 9 35

Haihao Shen

Haihao

·

https://github.com/intel/auto-round

AI & ML interests

LLM quantization, sparsity, and acceleration

Articles

Building Cost-Efficient Enterprise RAG applications with Intel Gaudi 2 and Intel Xeon

Accelerate StarCoder with 🤗 Optimum Intel on Xeon: Q8/Q4 and Speculative Decoding

Organizations

Papers 9

arxiv:2311.16133

arxiv:2311.00502

arxiv:2310.10944

arxiv:2309.14592

models

None public yet

datasets

None public yet