Spaces:

pseudolab
/

KOMUChat

Paused

ElPlaguister commited on Nov 7, 2023

Commit

6961a55

•

1 Parent(s): abdd246

CUDA

Files changed (1) hide show

koalpaca.py CHANGED Viewed

@@ -26,7 +26,7 @@ class KoAlpaca:
                 inputs,
                 return_tensors='pt',
                 return_token_type_ids=False
-            ),#.to('cuda'),
             generation_config=self.gen_config
         )
         outputs = self.tokenizer.decode(output_ids[0]).split("### 답변: ")[-1]

                 inputs,
                 return_tensors='pt',
                 return_token_type_ids=False
+            ).to('cuda'),
             generation_config=self.gen_config
         )
         outputs = self.tokenizer.decode(output_ids[0]).split("### 답변: ")[-1]