|
--- |
|
license: apache-2.0 |
|
--- |
|
Text Detoxification Task is a process of transforming the text with toxic style into the text with the same meaning but with neutral style |
|
|
|
```python |
|
import torch |
|
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM |
|
|
|
device = 'cuda' if torch.cuda.is_available() else 'cpu' |
|
|
|
tokenizer = AutoTokenizer.from_pretrained("the-hir0/pegasus-detoxify") |
|
model = AutoModelForSeq2SeqLM.from_pretrained("the-hir0/pegasus-detoxify").to(device) |
|
|
|
input_ids = tokenizer(inference_request, return_tensors="pt", padding=True).input_ids.to(device) |
|
outputs = model.generate(input_ids=input_ids) |
|
tokenizer.batch_decode(outputs, skip_special_tokens=True,temperature=0) |
|
``` |
