anakin87
/

Phi-3.5-mini-ITA

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

anakin87 commited on Sep 2

Commit

eb9c286

•

1 Parent(s): afd4fb2

nb refinements

Files changed (1) hide show

notebooks/training.ipynb +2 -2

notebooks/training.ipynb CHANGED Viewed

@@ -11,7 +11,7 @@
     "\n",
     "**👣 For a complete walk-through of the fine-tuning process, check out the [accompanying article](https://huggingface.co/blog/anakin87/spectrum).**\n",
     "\n",
-    "Model:\n",
     "- [🪪 fine-tuned model: Phi-3.5-mini-ITA](https://huggingface.co/anakin87/Phi-3.5-mini-ITA)\n",
     "- [💬🇮🇹 Chat with the model](https://huggingface.co/spaces/anakin87/Phi-3.5-mini-ITA)"
    ]
@@ -257,7 +257,7 @@
     "\n",
     "finetome_ds = Dataset.from_list([process_conversation(row) for row in finetome_ds])\n",
     "\n",
-    "tokenizer = AutoTokenizer.from_pretrained(\"microsoft/Phi-3.5-mini-instruct\")\n",
     "\n",
     "def apply_template(examples):\n",
     "    text = [tokenizer.apply_chat_template(msg, tokenize=False, add_generation_prompt=False) for msg in examples[\"conversations\"]]\n",

     "\n",
     "**👣 For a complete walk-through of the fine-tuning process, check out the [accompanying article](https://huggingface.co/blog/anakin87/spectrum).**\n",
     "\n",
+    "\n",
     "- [🪪 fine-tuned model: Phi-3.5-mini-ITA](https://huggingface.co/anakin87/Phi-3.5-mini-ITA)\n",
     "- [💬🇮🇹 Chat with the model](https://huggingface.co/spaces/anakin87/Phi-3.5-mini-ITA)"
    ]
     "\n",
     "finetome_ds = Dataset.from_list([process_conversation(row) for row in finetome_ds])\n",
     "\n",
+    "tokenizer = AutoTokenizer.from_pretrained(\"microsoft/Phi-3.5-mini-instruct\", trust_remote_code=True)\n",
     "\n",
     "def apply_template(examples):\n",
     "    text = [tokenizer.apply_chat_template(msg, tokenize=False, add_generation_prompt=False) for msg in examples[\"conversations\"]]\n",