add text-generation pipeline example with autocast (#40)

- add text-generation pipeline example with autocast (8cee036ddd83d886eb157a72ab1c3648c0753bd8)


Co-authored-by: Vitaliy Chiley <[email protected]>

README.md

@@ -91,6 +91,22 @@ from transformers import AutoTokenizer
 tokenizer = AutoTokenizer.from_pretrained("EleutherAI/gpt-neox-20b")
 ```
 
+The model can then be used, for example, within a text-generation pipeline.  
+Note: when running Torch modules in lower precision, it is best practice to use the [torch.autocast context manager](https://pytorch.org/docs/stable/amp.html).
+
+```python
+from transformers import pipeline
+
+pipe = pipeline('text-generation', model=model, tokenizer=tokenizer, device='cuda:0')
+
+with torch.autocast('cuda', dtype=torch.bfloat16):
+    print(
+        pipe('Here is a recipe for vegan banana bread:\n',
+            max_new_tokens=100,
+            do_sample=True,
+            use_cache=True))
+```
+
 ## Community-Created Resources
 
 These were not created by MosaicML, but you may find them useful. These links are not an endorsement of the creators or their content.