MInference 1.0: 10x Faster Million Context Inference with a Single GPU
•
11
Yucheng
liyucheng
AI & ML interests
Robust LLMs Evaluation and Efficient LLMs Inference.
Recent Activity
liked
a Space
about 20 hours ago
DontPlanToEnd/UGI-Leaderboard
liked
a model
about 20 hours ago
BigHuggyD/NeverSleep_Lumimaid-v0.2-123B_exl2_4.0bpw_h8
liked
a model
about 20 hours ago
migtissera/Tess-3-Llama-3.1-405B
Articles
Organizations
Papers
2
spaces
1
datasets
28
liyucheng/annotation
Viewer
•
Updated
•
3.08k
•
2
liyucheng/long_paper_chunks
Viewer
•
Updated
•
368
•
38
liyucheng/mini_zh_news
Viewer
•
Updated
•
500
•
37
liyucheng/pg19-3k-long
Viewer
•
Updated
•
3k
•
45
liyucheng/pg19-4k
Viewer
•
Updated
•
4k
•
140
liyucheng/pg19
Viewer
•
Updated
•
13.6k
•
86
liyucheng/reject_sampling
Viewer
•
Updated
•
10
•
12
liyucheng/ShareGPT90K
Viewer
•
Updated
•
90.7k
•
157
•
2
liyucheng/mmlu_test
Viewer
•
Updated
•
14k
•
40
liyucheng/mmlu_train
Viewer
•
Updated
•
99.8k
•
38