Add use this model

README.md

@@ -16,20 +16,36 @@ library_name: transformers
 
 This model is a clone of [**ibm-granite/granite-7b-instruct**](https://huggingface.co/ibm-granite/granite-7b-instruct) compressed using ZipNN. Compressed losslessly to 67% its original size, ZipNN saved ~5GB in storage and potentially ~30TB in data transfer **monthly**.
 
-## Requirement
+### Requirement
 
 In order to use the model, ZipNN is necessary:
 ```bash
 pip install zipnn
 ```
+### Use This Model
+```python
+# Use a pipeline as a high-level helper
+from transformers import pipeline
+from zipnn import zipnn_hf
+
+zipnn_hf()
 
-Then simply add at the beginning of the file
+messages = [
+    {"role": "user", "content": "Who are you?"},
+]
+pipe = pipeline("text-generation", model="royleibov/granite-7b-instruct-ZipNN-Compressed")
+pipe(messages)
+```
 ```python
+# Load model directly
+from transformers import AutoTokenizer, AutoModelForCausalLM
 from zipnn import zipnn_hf
 
 zipnn_hf()
+
+tokenizer = AutoTokenizer.from_pretrained("royleibov/granite-7b-instruct-ZipNN-Compressed")
+model = AutoModelForCausalLM.from_pretrained("royleibov/granite-7b-instruct-ZipNN-Compressed")
 ```
-And continue as usual. The patch will take care of decompressing the model correctly and safely.
 
 # Model Card for Granite-7b-lab [Paper](https://arxiv.org/abs/2403.01081)