akjindal53244
commited on
Commit
•
017d6bf
1
Parent(s):
c671c51
Add Ollama example for Function Calling
Browse files
README.md
CHANGED
@@ -28,6 +28,8 @@ Authors: [Ashvini Kumar Jindal](https://www.linkedin.com/in/ashvini-jindal-26653
|
|
28 |
|
29 |
**🤗 Hugging Face Announcement Blog**: https://huggingface.co/blog/akjindal53244/llama31-storm8b
|
30 |
|
|
|
|
|
31 |
|
32 |
## TL;DR
|
33 |
|
@@ -95,7 +97,7 @@ Llama-3.1-Storm-8B is a powerful generalist model useful for diverse application
|
|
95 |
1. `BF16`: [Llama-3.1-Storm-8B](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B)
|
96 |
2. ⚡ `FP8`: [Llama-3.1-Storm-8B-FP8-Dynamic](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B-FP8-Dynamic)
|
97 |
3. ⚡ `GGUF`: [Llama-3.1-Storm-8B-GGUF](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B-GGUF)
|
98 |
-
4. Ollama: `ollama run ajindal/llama3.1-storm:8b`
|
99 |
|
100 |
|
101 |
## 💻 How to Use the Model
|
@@ -286,7 +288,7 @@ prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tok
|
|
286 |
print(llm.generate([prompt], sampling_params)[0].outputs[0].text.strip()) # Expected Output: <tool_call>{'tool_name': 'web_chain_details', 'tool_arguments': {'chain_slug': 'ethereum'}}</tool_call>
|
287 |
```
|
288 |
|
289 |
-
#### Use with [
|
290 |
```
|
291 |
import ollama
|
292 |
|
|
|
28 |
|
29 |
**🤗 Hugging Face Announcement Blog**: https://huggingface.co/blog/akjindal53244/llama31-storm8b
|
30 |
|
31 |
+
**🚀Ollama:** `ollama run ajindal/llama3.1-storm:8b`
|
32 |
+
|
33 |
|
34 |
## TL;DR
|
35 |
|
|
|
97 |
1. `BF16`: [Llama-3.1-Storm-8B](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B)
|
98 |
2. ⚡ `FP8`: [Llama-3.1-Storm-8B-FP8-Dynamic](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B-FP8-Dynamic)
|
99 |
3. ⚡ `GGUF`: [Llama-3.1-Storm-8B-GGUF](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B-GGUF)
|
100 |
+
4. 🚀 Ollama: `ollama run ajindal/llama3.1-storm:8b`
|
101 |
|
102 |
|
103 |
## 💻 How to Use the Model
|
|
|
288 |
print(llm.generate([prompt], sampling_params)[0].outputs[0].text.strip()) # Expected Output: <tool_call>{'tool_name': 'web_chain_details', 'tool_arguments': {'chain_slug': 'ethereum'}}</tool_call>
|
289 |
```
|
290 |
|
291 |
+
#### Use with [Ollama](https://ollama.com/)
|
292 |
```
|
293 |
import ollama
|
294 |
|