microsoft
/

Phi-3-mini-128k-instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (90)

Interview request: genAI evaluation & documentation

#95 opened 2 months ago by

KV cahing problem during the inference loop

#94 opened 3 months ago by

Tokenization Mismatch Error

#93 opened 4 months ago by

ritwickchaudhryamazon

placeholder tokens are zero initialized

#89 opened 4 months ago by

Support for longrope implementation in llama.cpp

#88 opened 4 months ago by

When input tokens < 4096 but total input+output tokens >4096 the model produces poor output

#85 opened 5 months ago by