akjindal53244 commited on
Commit
017d6bf
1 Parent(s): c671c51

Add Ollama example for Function Calling

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -28,6 +28,8 @@ Authors: [Ashvini Kumar Jindal](https://www.linkedin.com/in/ashvini-jindal-26653
28
 
29
  **🤗 Hugging Face Announcement Blog**: https://huggingface.co/blog/akjindal53244/llama31-storm8b
30
 
 
 
31
 
32
  ## TL;DR
33
 
@@ -95,7 +97,7 @@ Llama-3.1-Storm-8B is a powerful generalist model useful for diverse application
95
  1. `BF16`: [Llama-3.1-Storm-8B](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B)
96
  2. ⚡ `FP8`: [Llama-3.1-Storm-8B-FP8-Dynamic](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B-FP8-Dynamic)
97
  3. ⚡ `GGUF`: [Llama-3.1-Storm-8B-GGUF](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B-GGUF)
98
- 4. Ollama: `ollama run ajindal/llama3.1-storm:8b`
99
 
100
 
101
  ## 💻 How to Use the Model
@@ -286,7 +288,7 @@ prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tok
286
  print(llm.generate([prompt], sampling_params)[0].outputs[0].text.strip()) # Expected Output: <tool_call>{'tool_name': 'web_chain_details', 'tool_arguments': {'chain_slug': 'ethereum'}}</tool_call>
287
  ```
288
 
289
- #### Use with [Ollma](https://ollama.com/)
290
  ```
291
  import ollama
292
 
 
28
 
29
  **🤗 Hugging Face Announcement Blog**: https://huggingface.co/blog/akjindal53244/llama31-storm8b
30
 
31
+ **🚀Ollama:** `ollama run ajindal/llama3.1-storm:8b`
32
+
33
 
34
  ## TL;DR
35
 
 
97
  1. `BF16`: [Llama-3.1-Storm-8B](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B)
98
  2. ⚡ `FP8`: [Llama-3.1-Storm-8B-FP8-Dynamic](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B-FP8-Dynamic)
99
  3. ⚡ `GGUF`: [Llama-3.1-Storm-8B-GGUF](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B-GGUF)
100
+ 4. 🚀 Ollama: `ollama run ajindal/llama3.1-storm:8b`
101
 
102
 
103
  ## 💻 How to Use the Model
 
288
  print(llm.generate([prompt], sampling_params)[0].outputs[0].text.strip()) # Expected Output: <tool_call>{'tool_name': 'web_chain_details', 'tool_arguments': {'chain_slug': 'ethereum'}}</tool_call>
289
  ```
290
 
291
+ #### Use with [Ollama](https://ollama.com/)
292
  ```
293
  import ollama
294