Hugging Face's logo

FalconNet
/
Phi-3.5-mini-32K-output

Text Generation
Transformers
PyTorch
English
llama
text-generation-inference
unsloth
trl
sft
conversational
Inference Endpoints
Model card Files Community
Edit model card

Uploaded model

  • Developed by: FalconNet
  • License: apache-2.0
  • Finetuned from model: unsloth/phi-3.5-mini-instruct-bnb-4bit
  • Dataset used to Finetune: THUDM/LongWriter-6k

THUDM/LongWriter dataset contains 6,000 SFT data with ultra-long output ranging from 2k-32k words in length (both English and Chinese). The data can support training LLMs to extend their maximum output window size to 10,000+ words - used in this model

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
9
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.