---
language:
- zh
- en
---


# ChatTruth-7B


## 安装要求 (Requirements)

* python 3.8及以上版本
* pytorch 1.13及以上版本
* CUDA 11.4及以上版本
* transformers 4.32.0
* python 3.8 and above
* pytorch 1.13 and above
* CUDA 11.4 and above
  
  <br>


## 快速开始 (Quickstart)

```python
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
torch.manual_seed(1234)
model_path = 'ChatTruth-7B' # your downloaded model path.

tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)

# use cuda device
model = AutoModelForCausalLM.from_pretrained(model_path, device_map="cuda", trust_remote_code=True).eval()

query = tokenizer.from_list_format([
    {'image': 'demo.jpeg'},
    {'text': '图片中的文字是什么'},
])
response, history = model.chat(tokenizer, query=query, history=None)
print(response)

# 昆明太厉害了
```