Model Card for Model ID
Model Details
Model Description
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- Developed by: [More Information Needed]
- Funded by [optional]: [More Information Needed]
- Shared by [optional]: [More Information Needed]
- Model type: [More Information Needed]
- Language(s) (NLP): [More Information Needed]
- License: [More Information Needed]
- Finetuned from model [optional]: [More Information Needed]
Model Sources [optional]
- Repository: [More Information Needed]
- Paper [optional]: [More Information Needed]
- Demo [optional]: [More Information Needed]
Uses
Evaluation
hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM2-FP-v1.0,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| kobest_boolq | 0 | acc | 0.5976 | ± | 0.0131 |
| macro_f1 | 0.5224 | ± | 0.0136 | ||
| kobest_copa | 0 | acc | 0.8190 | ± | 0.0122 |
| macro_f1 | 0.8189 | ± | 0.0122 | ||
| kobest_hellaswag | 0 | acc | 0.5240 | ± | 0.0224 |
| acc_norm | 0.5740 | ± | 0.0221 | ||
| macro_f1 | 0.5214 | ± | 0.0224 | ||
| kobest_sentineg | 0 | acc | 0.7809 | ± | 0.0208 |
| macro_f1 | 0.7786 | ± | 0.0211 |
- Downloads last month
- 1,475
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.