nm-testing
/

open_llama_3b_instruct_v_0.2-pruned50-quant-ds

Text Generation

text-generation-inference

Model card Files Files and versions Community

mwitiderrick commited on Dec 8, 2023

Commit

c832a75

•

1 Parent(s): d212550

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -24,7 +24,7 @@ Run in a [Python pipeline](https://github.com/neuralmagic/deepsparse/blob/main/d
 from deepsparse import TextGeneration
 prompt = "How to make banana bread?"
-formatted_prompt =  f"### Instruction:\n### Input:{prompt}### Response:\n"
 model = TextGeneration(model="hf:nm-testing/open_llama_3b_instruct_v_0.2-pruned50-quant-ds")

 from deepsparse import TextGeneration
 prompt = "How to make banana bread?"
+formatted_prompt =  f"### Instruction:\n{prompt}### Response:\n"
 model = TextGeneration(model="hf:nm-testing/open_llama_3b_instruct_v_0.2-pruned50-quant-ds")