75 25 123

Yaowei Zheng

hiyouga

https://github.com/hiyouga

AI & ML interests

LLM Knowledge Management

Articles

GaLore: Advancing Large Model Training on Consumer-grade Hardware

Mar 20

• 25

Organizations

hiyouga's activity

upvoted a paper 20 days ago

LLM-based Optimization of Compound AI Systems: A Survey

Paper • 2410.16392 • Published 22 days ago • 13

upvoted an article about 1 month ago

Article

A Short Summary of Chinese AI Global Expansion

Oct 3

• 15

upvoted a collection about 2 months ago

Qwen2.5

Collection

Qwen2.5 language models, including pretrained and instruction-tuned models of 7 sizes, including 0.5B, 1.5B, 3B, 7B, 14B, 32B, and 72B. • 45 items • Updated Sep 18 • 326

upvoted an article 2 months ago

Article

Meet Yi-Coder: A Small but Mighty LLM for Code

•

Sep 4

• 12

upvoted a paper 2 months ago

OLMoE: Open Mixture-of-Experts Language Models

Paper • 2409.02060 • Published Sep 3 • 77

upvoted an article 2 months ago

Article

Understanding Vector Quantization in VQ-VAE

•

Aug 28

• 10

upvoted 2 papers 2 months ago

Mini-Omni: Language Models Can Hear, Talk While Thinking in Streaming

Paper • 2408.16725 • Published Aug 29 • 52

LongRecipe: Recipe for Efficient Long Context Generalization in Large Languge Models

Paper • 2409.00509 • Published Aug 31 • 38

upvoted 2 papers 3 months ago

Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts

Paper • 2408.15664 • Published Aug 28 • 11

I-SHEEP: Self-Alignment of LLM from Scratch through an Iterative Self-Enhancement Paradigm

Paper • 2408.08072 • Published Aug 15 • 31

upvoted 4 papers 4 months ago

upvoted 2 papers 5 months ago

Mixture-of-Agents Enhances Large Language Model Capabilities

Paper • 2406.04692 • Published Jun 7 • 55

DiveR-CT: Diversity-enhanced Red Teaming with Relaxing Constraints

Paper • 2405.19026 • Published May 29 • 7

upvoted a paper 6 months ago

OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Framework

Paper • 2405.11143 • Published May 20 • 33

upvoted a collection 7 months ago

ZeroGPU Spaces

Collection

ZeroGPU Spaces made by the community • 17 items • Updated Jun 6 • 229

upvoted an article 7 months ago

Article

GaLore: Advancing Large Model Training on Consumer-grade Hardware

Mar 20

• 25

upvoted a paper 7 months ago

Rho-1: Not All Tokens Are What You Need

Paper • 2404.07965 • Published Apr 11 • 84