Spaces:
Paused
Paused
File size: 27,806 Bytes
ee6e328 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 |
<!--โ ๏ธ Note that this file is in Markdown but contain specific syntax for our doc-builder (similar to MDX) that may not be
rendered properly in your Markdown viewer.
-->
# ์ปค๋ฎค๋ํฐ [[community]]
์ด ํ์ด์ง๋ ์ปค๋ฎค๋ํฐ์์ ๊ฐ๋ฐํ ๐ค Transformers ๋ฆฌ์์ค๋ฅผ ์ฌ๊ตฌ์ฑํ ํ์ด์ง์
๋๋ค.
## ์ปค๋ฎค๋ํฐ ๋ฆฌ์์ค: [[community-resources]]
| ๋ฆฌ์์ค | ์ค๋ช
| ๋ง๋ ์ด |
|:----------|:-------------|------:|
| [Hugging Face Transformers ์ฉ์ด์ง ํ๋์์นด๋](https://www.darigovresearch.com/huggingface-transformers-glossary-flashcards) | [Transformers ๋ฌธ์ ์ฉ์ด์ง](glossary)์ ๊ธฐ๋ฐ์ผ๋ก ํ ํ๋์์นด๋ ์ธํธ๋ก, ์ง์์ ์ฅ๊ธฐ์ ์ผ๋ก ์ ์งํ๊ธฐ ์ํด ํน๋ณํ ์ค๊ณ๋ ์คํ์์ค ํฌ๋ก์ค ํ๋ซํผ ์ฑ์ธ [Anki](https://apps.ankiweb.net/)๋ฅผ ์ฌ์ฉํ์ฌ ์ฝ๊ฒ ํ์ต/์์ ํ ์ ์๋ ํํ๋ก ์ ์๋์์ต๋๋ค. [ํ๋์์นด๋ ์ฌ์ฉ๋ฒ์ ๋ํ ์๊ฐ ๋์์](https://www.youtube.com/watch?v=Dji_h7PILrw)์ ์ฐธ์กฐํ์ธ์. | [Darigov ๋ฆฌ์์น](https://www.darigovresearch.com/) |
## ์ปค๋ฎค๋ํฐ ๋
ธํธ๋ถ: [[community-notebooks]]
| ๋
ธํธ๋ถ | ์ค๋ช
| ๋ง๋ ์ด | |
|:----------|:-------------|:-------------|------:|
| [๊ฐ์ฌ๋ฅผ ์์ฑํ๊ธฐ ์ํด ์ฌ์ ํ๋ จ๋ ํธ๋์คํฌ๋จธ๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/AlekseyKorshuk/huggingartists) | GPT-2 ๋ชจ๋ธ์ ๋ฏธ์ธ ์กฐ์ ํ์ฌ ์ข์ํ๋ ์ํฐ์คํธ์ ์คํ์ผ๋ก ๊ฐ์ฌ๋ฅผ ์์ฑํ๋ ๋ฐฉ๋ฒ | [Aleksey Korshuk](https://github.com/AlekseyKorshuk) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/AlekseyKorshuk/huggingartists/blob/master/huggingartists-demo.ipynb) |
| [Tensorflow 2๋ก T5 ํ๋ จํ๊ธฐ](https://github.com/snapthat/TF-T5-text-to-text) | Tensorflow 2๋ฅผ ์ฌ์ฉํ์ฌ T5๋ฅผ ํ๋ จ์ํค๋ ๋ฐฉ๋ฒ. ์ด ๋
ธํธ๋ถ์ Tensorflow 2๋ก SQUAD๋ฅผ ์ฌ์ฉํ์ฌ ๊ตฌํํ ์ง์์๋ต ์์
์ ๋ณด์ฌ์ค๋๋ค. | [Muhammad Harris](https://github.com/HarrisDePerceptron) |[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/snapthat/TF-T5-text-to-text/blob/master/snapthatT5/notebooks/TF-T5-Datasets%20Training.ipynb) |
| [TPU์์ T5 ํ๋ จํ๊ธฐ](https://github.com/patil-suraj/exploring-T5/blob/master/T5_on_TPU.ipynb) | Transformers์ Nlp๋ฅผ ์ฌ์ฉํ์ฌ SQUAD๋ก T5๋ฅผ ํ๋ จํ๋ ๋ฐฉ๋ฒ | [Suraj Patil](https://github.com/patil-suraj) |[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/patil-suraj/exploring-T5/blob/master/T5_on_TPU.ipynb#scrollTo=QLGiFCDqvuil) |
| [๋ถ๋ฅ ๋ฐ ๊ฐ๊ด์ ๋ฌธ์ ๋ฅผ ์ํด T5 ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/patil-suraj/exploring-T5/blob/master/t5_fine_tuning.ipynb) | ๋ถ๋ฅ ๋ฐ ๊ฐ๊ด์ ๋ฌธ์ ์ ๋ง๊ฒ ํ
์คํธ-ํ
์คํธ ํ์์ ์ฌ์ฉํ์ฌ PyTorch Lightning์ผ๋ก T5๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Suraj Patil](https://github.com/patil-suraj) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/patil-suraj/exploring-T5/blob/master/t5_fine_tuning.ipynb) |
| [์๋ก์ด ๋ฐ์ดํฐ ์ธํธ์ ์ธ์ด๋ก DialoGPT ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/ncoop57/i-am-a-nerd/blob/master/_notebooks/2020-05-12-chatbot-part-1.ipynb) | ์์ ๋ํํ ์ฑ๋ด์ ๋ง๋ค๊ธฐ ์ํด ์๋ก์ด ๋ฐ์ดํฐ ์ธํธ๋ก DialoGPT ๋ชจ๋ธ์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Nathan Cooper](https://github.com/ncoop57) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ncoop57/i-am-a-nerd/blob/master/_notebooks/2020-05-12-chatbot-part-1.ipynb) |
| [Reformer๋ก ๊ธด ์ํ์ค ๋ชจ๋ธ๋งํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/PyTorch_Reformer.ipynb) | Reformer๋ก ์ต๋ 50๋ง ํ ํฐ์ ์ํ์ค๋ฅผ ํ๋ จํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/patrickvonplaten/notebooks/blob/master/PyTorch_Reformer.ipynb) |
| [์์ฝ์ ์ํด BART ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/ohmeow/ohmeow_website/blob/master/posts/2021-05-25-mbart-sequence-classification-with-blurr.ipynb) | blurr๋ฅผ ์ฌ์ฉํ์ฌ fastai๋ก ์์ฝํ๊ธฐ ์ํด BART๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Wayde Gilliam](https://ohmeow.com/) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/ohmeow/ohmeow_website/blob/master/posts/2021-05-25-mbart-sequence-classification-with-blurr.ipynb) |
| [๋ค๋ฅธ ์ฌ๋์ ํธ์์ผ๋ก ์ฌ์ ํ๋ จ๋ ํธ๋์คํฌ๋จธ ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://colab.research.google.com/github/borisdayma/huggingtweets/blob/master/huggingtweets-demo.ipynb) | GPT-2 ๋ชจ๋ธ์ ๋ฏธ์ธ ์กฐ์ ํ์ฌ ์ข์ํ๋ ํธ์ํฐ ๊ณ์ ์คํ์ผ๋ก ํธ์์ ์์ฑํ๋ ๋ฐฉ๋ฒ | [Boris Dayma](https://github.com/borisdayma) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/borisdayma/huggingtweets/blob/master/huggingtweets-demo.ipynb) |
| [Weights & Biases๋ก ๐ค Hugging Face ๋ชจ๋ธ ์ต์ ํํ๊ธฐ](https://colab.research.google.com/github/wandb/examples/blob/master/colabs/huggingface/Optimize_Hugging_Face_models_with_Weights_%26_Biases.ipynb) | W&B์ Hugging Face์ ํตํฉ์ ๋ณด์ฌ์ฃผ๋ ์ ์ฒด ํํ ๋ฆฌ์ผ | [Boris Dayma](https://github.com/borisdayma) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/wandb/examples/blob/master/colabs/huggingface/Optimize_Hugging_Face_models_with_Weights_%26_Biases.ipynb) |
| [Longformer ์ฌ์ ํ๋ จํ๊ธฐ](https://github.com/allenai/longformer/blob/master/scripts/convert_model_to_long.ipynb) | ๊ธฐ์กด ์ฌ์ ํ๋ จ๋ ๋ชจ๋ธ์ "๊ธด" ๋ฒ์ ์ ๋น๋ํ๋ ๋ฐฉ๋ฒ | [Iz Beltagy](https://beltagy.net) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/allenai/longformer/blob/master/scripts/convert_model_to_long.ipynb) |
| [QA๋ฅผ ์ํด Longformer ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/patil-suraj/Notebooks/blob/master/longformer_qa_training.ipynb) | QA ์์
์ ์ํด Longformer๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Suraj Patil](https://github.com/patil-suraj) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/patil-suraj/Notebooks/blob/master/longformer_qa_training.ipynb) |
| [๐ค Nlp๋ก ๋ชจ๋ธ ํ๊ฐํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/How_to_evaluate_Longformer_on_TriviaQA_using_NLP.ipynb) | `Nlp`๋ก TriviaQA์์ Longformer๋ฅผ ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1m7eTGlPmLRgoPkkA7rkhQdZ9ydpmsdLE?usp=sharing) |
| [๊ฐ์ ๋ฒ์ ์ถ์ถ์ ์ํด T5 ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/enzoampil/t5-intro/blob/master/t5_qa_training_pytorch_span_extraction.ipynb) | ๊ฐ์ ๋ฒ์ ์ถ์ถ์ ์ํด ํ
์คํธ-ํ
์คํธ ํ์์ ์ฌ์ฉํ์ฌ PyTorch Lightning์ผ๋ก T5๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Lorenzo Ampil](https://github.com/enzoampil) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/enzoampil/t5-intro/blob/master/t5_qa_training_pytorch_span_extraction.ipynb) |
| [๋ค์ค ํด๋์ค ๋ถ๋ฅ๋ฅผ ์ํด DistilBert ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/abhimishra91/transformers-tutorials/blob/master/transformers_multiclass_classification.ipynb) | ๋ค์ค ํด๋์ค ๋ถ๋ฅ๋ฅผ ์ํด PyTorch๋ฅผ ์ฌ์ฉํ์ฌ DistilBert๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Abhishek Kumar Mishra](https://github.com/abhimishra91) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/abhimishra91/transformers-tutorials/blob/master/transformers_multiclass_classification.ipynb)|
| [๋ค์ค ๋ ์ด๋ธ ๋ถ๋ฅ๋ฅผ ์ํด BERT ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/abhimishra91/transformers-tutorials/blob/master/transformers_multi_label_classification.ipynb) | ๋ค์ค ๋ ์ด๋ธ ๋ถ๋ฅ๋ฅผ ์ํด PyTorch๋ฅผ ์ฌ์ฉํ์ฌ BERT๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Abhishek Kumar Mishra](https://github.com/abhimishra91) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/abhimishra91/transformers-tutorials/blob/master/transformers_multi_label_classification.ipynb)|
| [์์ฝ์ ์ํด T5 ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/abhimishra91/transformers-tutorials/blob/master/transformers_summarization_wandb.ipynb) | ์์ฝ์ ์ํด PyTorch๋ก T5๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๊ณ WandB๋ก ์คํ์ ์ถ์ ํ๋ ๋ฐฉ๋ฒ | [Abhishek Kumar Mishra](https://github.com/abhimishra91) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/abhimishra91/transformers-tutorials/blob/master/transformers_summarization_wandb.ipynb)|
| [๋์ ํจ๋ฉ/๋ฒ์ผํ
์ผ๋ก Transformers ๋ฏธ์ธ ์กฐ์ ์๋ ๋์ด๊ธฐ](https://github.com/ELS-RD/transformers-notebook/blob/master/Divide_Hugging_Face_Transformers_training_time_by_2_or_more.ipynb)| ๋์ ํจ๋ฉ/๋ฒ์ผํ
์ ์ฌ์ฉํ์ฌ ๋ฏธ์ธ ์กฐ์ ์๋๋ฅผ 2๋ฐฐ๋ก ๋์ด๋ ๋ฐฉ๋ฒ |[Michael Benesty](https://github.com/pommedeterresautee) |[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1CBfRU1zbfu7-ijiOqAAQUA-RJaxfcJoO?usp=sharing)|
|[๋ง์คํน๋ ์ธ์ด ๋ชจ๋ธ๋ง์ ์ํด Reformer ์ฌ์ ํ๋ จํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/Reformer_For_Masked_LM.ipynb)| ์๋ฐฉํฅ ์
ํ ์ดํ
์
๋ ์ด์ด๋ฅผ ์ด์ฉํด์ Reformer ๋ชจ๋ธ์ ํ๋ จํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1tzzh0i8PgDQGV3SMFUGxM7_gGae3K-uW?usp=sharing)|
| [Sci-BERT ํ์ฅ ๋ฐ ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/lordtt13/word-embeddings/blob/master/COVID-19%20Research%20Data/COVID-SciBERT.ipynb)| CORD ๋ฐ์ดํฐ ์ธํธ๋ก AllenAI์์ ์ฌ์ ํ๋ จ๋ SciBERT ๋ชจ๋ธ์ ์ดํ๋ฅผ ๋๋ฆฌ๊ณ ํ์ดํ๋ผ์ธ์ ๊ตฌ์ถํ๋ ๋ฐฉ๋ฒ | [Tanmay Thakur](https://github.com/lordtt13) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1rqAR40goxbAfez1xvF3hBJphSCsvXmh8)|
| [์์ฝ์ ์ํด Trainer API๋ก BlenderBotSmall ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/lordtt13/transformers-experiments/blob/master/Custom%20Tasks/fine-tune-blenderbot_small-for-summarization.ipynb)| ์์ฝ์ ์ํด Trainer API๋ฅผ ์ฌ์ฉํ์ฌ ์ฌ์ฉ์ ์ง์ ๋ฐ์ดํฐ ์ธํธ๋ก BlenderBotSmall ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ | [Tanmay Thakur](https://github.com/lordtt13) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/19Wmupuls7mykSGyRN_Qo6lPQhgp56ymq?usp=sharing)|
| [ํตํฉ ๊ธฐ์ธ๊ธฐ(Integrated Gradient)๋ฅผ ์ด์ฉํ์ฌ Electra ๋ฏธ์ธ ์กฐ์ ํ๊ณ ํด์ํ๊ธฐ](https://github.com/elsanns/xai-nlp-notebooks/blob/master/electra_fine_tune_interpret_captum_ig.ipynb) | ๊ฐ์ ๋ถ์์ ์ํด Electra๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๊ณ Captum ํตํฉ ๊ธฐ์ธ๊ธฐ๋ก ์์ธก์ ํด์ํ๋ ๋ฐฉ๋ฒ | [Eliza Szczechla](https://elsanns.github.io) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/elsanns/xai-nlp-notebooks/blob/master/electra_fine_tune_interpret_captum_ig.ipynb)|
| [Trainer ํด๋์ค๋ก ๋น์์ด๊ถ GPT-2 ๋ชจ๋ธ ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/philschmid/fine-tune-GPT-2/blob/master/Fine_tune_a_non_English_GPT_2_Model_with_Huggingface.ipynb) | Trainer ํด๋์ค๋ก ๋น์์ด๊ถ GPT-2 ๋ชจ๋ธ์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Philipp Schmid](https://www.philschmid.de) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/philschmid/fine-tune-GPT-2/blob/master/Fine_tune_a_non_English_GPT_2_Model_with_Huggingface.ipynb)|
|[๋ค์ค ๋ผ๋ฒจ ๋ถ๋ฅ ์์
์ ์ํด DistilBERT ๋ชจ๋ธ ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/DhavalTaunk08/Transformers_scripts/blob/master/Transformers_multilabel_distilbert.ipynb) | ๋ค์ค ๋ผ๋ฒจ ๋ถ๋ฅ ์์
์ ์ํด DistilBERT ๋ชจ๋ธ์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Dhaval Taunk](https://github.com/DhavalTaunk08) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/DhavalTaunk08/Transformers_scripts/blob/master/Transformers_multilabel_distilbert.ipynb)|
|[๋ฌธ์ฅ์ ๋ถ๋ฅ๋ฅผ ์ํด ALBERT ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/NadirEM/nlp-notebooks/blob/master/Fine_tune_ALBERT_sentence_pair_classification.ipynb) | ๋ฌธ์ฅ์ ๋ถ๋ฅ ์์
์ ์ํด ALBERT ๋ชจ๋ธ ๋๋ ๋ค๋ฅธ BERT ๊ธฐ๋ฐ ๋ชจ๋ธ์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Nadir El Manouzi](https://github.com/NadirEM) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NadirEM/nlp-notebooks/blob/master/Fine_tune_ALBERT_sentence_pair_classification.ipynb)|
|[๊ฐ์ ๋ถ์์ ์ํด Roberta ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/DhavalTaunk08/NLP_scripts/blob/master/sentiment_analysis_using_roberta.ipynb) | ๊ฐ์ ๋ถ์์ ์ํด Roberta ๋ชจ๋ธ์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Dhaval Taunk](https://github.com/DhavalTaunk08) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/DhavalTaunk08/NLP_scripts/blob/master/sentiment_analysis_using_roberta.ipynb)|
|[์ง๋ฌธ ์์ฑ ๋ชจ๋ธ ํ๊ฐํ๊ธฐ](https://github.com/flexudy-pipe/qugeev) | seq2seq ํธ๋์คํฌ๋จธ ๋ชจ๋ธ์ด ์์ฑํ ์ง๋ฌธ๊ณผ ์ด์ ๋ํ ๋ต๋ณ์ด ์ผ๋ง๋ ์ ํํ๊ฐ์? | [Pascal Zoleko](https://github.com/zolekode) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1bpsSqCQU-iw_5nNoRm_crPq6FRuJthq_?usp=sharing)|
|[DistilBERT์ Tensorflow๋ก ํ
์คํธ ๋ถ๋ฅํ๊ธฐ](https://github.com/peterbayerle/huggingface_notebook/blob/main/distilbert_tf.ipynb) | ํ
์คํธ ๋ถ๋ฅ๋ฅผ ์ํด TensorFlow๋ก DistilBERT๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Peter Bayerle](https://github.com/peterbayerle) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/peterbayerle/huggingface_notebook/blob/main/distilbert_tf.ipynb)|
|[CNN/Dailail ์์ฝ์ ์ํด ์ธ์ฝ๋-๋์ฝ๋ ๋ชจ๋ธ์ BERT ํ์ฉํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/BERT2BERT_for_CNN_Dailymail.ipynb) | CNN/Dailail ์์ฝ์ ์ํด *bert-base-uncased* ์ฒดํฌํฌ์ธํธ๋ฅผ ํ์ฉํ์ฌ *EncoderDecoderModel*์ ์๋ฐ์
ํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/patrickvonplaten/notebooks/blob/master/BERT2BERT_for_CNN_Dailymail.ipynb)|
|[BBC XSum ์์ฝ์ ์ํด ์ธ์ฝ๋-๋์ฝ๋ ๋ชจ๋ธ์ RoBERTa ํ์ฉํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/RoBERTaShared_for_BBC_XSum.ipynb) | BBC/XSum ์์ฝ์ ์ํด *roberta-base* ์ฒดํฌํฌ์ธํธ๋ฅผ ํ์ฉํ์ฌ ๊ณต์ *EncoderDecoderModel*์ ์๋ฐ์
ํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/patrickvonplaten/notebooks/blob/master/RoBERTaShared_for_BBC_XSum.ipynb)|
|[์์ฐจ์ ์ง๋ฌธ ๋ต๋ณ(SQA)์ ์ํด TAPAS ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/TAPAS/Fine_tuning_TapasForQuestionAnswering_on_SQA.ipynb) | *tapas-base* ์ฒดํฌํฌ์ธํธ๋ฅผ ํ์ฉํ์ฌ ์์ฐจ์ ์ง๋ฌธ ๋ต๋ณ(SQA) ๋ฐ์ดํฐ ์ธํธ๋ก *TapasForQuestionAnswering*์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/nielsrogge) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/TAPAS/Fine_tuning_TapasForQuestionAnswering_on_SQA.ipynb)|
|[ํ ์ฌ์ค ๊ฒ์ฌ(TabFact)๋ก TAPAS ํ๊ฐํ๊ธฐ](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/TAPAS/Evaluating_TAPAS_on_the_Tabfact_test_set.ipynb) | ๐ค Datasets์ ๐ค Transformer ๋ผ์ด๋ธ๋ฌ๋ฆฌ๋ฅผ ํจ๊ป ์ฌ์ฉํ์ฌ *tapas-base-finetuned-tabfact* ์ฒดํฌํฌ์ธํธ๋ก ๋ฏธ์ธ ์กฐ์ ๋ *TapasForSequenceClassification*์ ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/nielsrogge) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/TAPAS/Evaluating_TAPAS_on_the_Tabfact_test_set.ipynb)|
|[๋ฒ์ญ์ ์ํด mBART ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://colab.research.google.com/github/vasudevgupta7/huggingface-tutorials/blob/main/translation_training.ipynb) | ํ๋์ด์์ ์์ด๋ก ๋ฒ์ญํ๊ธฐ ์ํด Seq2SeqTrainer๋ฅผ ์ฌ์ฉํ์ฌ mBART๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Vasudev Gupta](https://github.com/vasudevgupta7) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/vasudevgupta7/huggingface-tutorials/blob/main/translation_training.ipynb)|
|[FUNSD(์์ ์ดํด ๋ฐ์ดํฐ ์ธํธ)๋ก LayoutLM ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/LayoutLM/Fine_tuning_LayoutLMForTokenClassification_on_FUNSD.ipynb) | ์ค์บํ ๋ฌธ์์์ ์ ๋ณด ์ถ์ถ์ ์ํด FUNSD ๋ฐ์ดํฐ ์ธํธ๋ก *LayoutLMForTokenClassification*์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/nielsrogge) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/LayoutLM/Fine_tuning_LayoutLMForTokenClassification_on_FUNSD.ipynb)|
|[DistilGPT2 ๋ฏธ์ธ ์กฐ์ ํ๊ณ ๋ฐ ํ
์คํธ ์์ฑํ๊ธฐ](https://colab.research.google.com/github/tripathiaakash/DistilGPT2-Tutorial/blob/main/distilgpt2_fine_tuning.ipynb) | DistilGPT2๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๊ณ ํ
์คํธ๋ฅผ ์์ฑํ๋ ๋ฐฉ๋ฒ | [Aakash Tripathi](https://github.com/tripathiaakash) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/tripathiaakash/DistilGPT2-Tutorial/blob/main/distilgpt2_fine_tuning.ipynb)|
|[์ต๋ 8K ํ ํฐ์์ LED ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/Fine_tune_Longformer_Encoder_Decoder_(LED)_for_Summarization_on_pubmed.ipynb) | ๊ธด ๋ฒ์๋ฅผ ์์ฝํ๊ธฐ ์ํด PubMed๋ก LED๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/patrickvonplaten/notebooks/blob/master/Fine_tune_Longformer_Encoder_Decoder_(LED)_for_Summarization_on_pubmed.ipynb)|
|[Arxiv๋ก LED ํ๊ฐํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/LED_on_Arxiv.ipynb) | ๊ธด ๋ฒ์ ์์ฝ์ ๋ํด LED๋ฅผ ํจ๊ณผ์ ์ผ๋ก ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/patrickvonplaten/notebooks/blob/master/LED_on_Arxiv.ipynb)|
|[RVL-CDIP(๋ฌธ์ ์ด๋ฏธ์ง ๋ถ๋ฅ ๋ฐ์ดํฐ ์ธํธ)๋ก LayoutLM ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ)](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/LayoutLM/Fine_tuning_LayoutLMForSequenceClassification_on_RVL_CDIP.ipynb) | ์ค์บ ๋ฌธ์ ๋ถ๋ฅ๋ฅผ ์ํด RVL-CDIP ๋ฐ์ดํฐ ์ธํธ๋ก *LayoutLMForSequenceClassification*์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/nielsrogge) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/LayoutLM/Fine_tuning_LayoutLMForSequenceClassification_on_RVL_CDIP.ipynb)|
|[GPT2 ์กฐ์ ์ ํตํ Wav2Vec2 CTC ๋์ฝ๋ฉ](https://github.com/voidful/huggingface_notebook/blob/main/xlsr_gpt.ipynb) | ์ธ์ด ๋ชจ๋ธ ์กฐ์ ์ ํตํด CTC ์ํ์ค๋ฅผ ๋์ฝ๋ฉํ๋ ๋ฐฉ๋ฒ | [Eric Lam](https://github.com/voidful) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1e_z5jQHYbO2YKEaUgzb1ww1WwiAyydAj?usp=sharing)|
|[Trainer ํด๋์ค๋ก ๋ ๊ฐ ์ธ์ด๋ก ์์ฝํ๊ธฐ ์ํด BART ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/elsanns/xai-nlp-notebooks/blob/master/fine_tune_bart_summarization_two_langs.ipynb) | Trainer ํด๋์ค๋ก ๋ ๊ฐ ์ธ์ด๋ก ์์ฝํ๊ธฐ ์ํด BART ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Eliza Szczechla](https://github.com/elsanns) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/elsanns/xai-nlp-notebooks/blob/master/fine_tune_bart_summarization_two_langs.ipynb)|
|[Trivia QA๋ก Big Bird ํ๊ฐํ๊ธฐ](https://github.com/patrickvonplaten/notebooks/blob/master/Evaluating_Big_Bird_on_TriviaQA.ipynb) | Trivia QA๋ก ๊ธด ๋ฌธ์ ์ง๋ฌธ์ ๋ํ ๋ต๋ณ์ ๋ํด BigBird๋ฅผ ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Patrick von Platen](https://github.com/patrickvonplaten) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/patrickvonplaten/notebooks/blob/master/Evaluating_Big_Bird_on_TriviaQA.ipynb)|
| [Wav2Vec2๋ฅผ ์ฌ์ฉํ์ฌ ๋์์ ์บก์
๋ง๋ค๊ธฐ](https://github.com/Muennighoff/ytclipcc/blob/main/wav2vec_youtube_captions.ipynb) | Wav2Vec์ผ๋ก ์ค๋์ค๋ฅผ ํ
์คํธ๋ก ๋ณํํ์ฌ ๋ชจ๋ ๋์์์์ YouTube ์บก์
๋ง๋๋ ๋ฐฉ๋ฒ | [Niklas Muennighoff](https://github.com/Muennighoff) |[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/Muennighoff/ytclipcc/blob/main/wav2vec_youtube_captions.ipynb) |
| [PyTorch Lightning์ ์ฌ์ฉํ์ฌ CIFAR-10์ผ๋ก ๋น์ ํธ๋์คํฌ๋จธ ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/VisionTransformer/Fine_tuning_the_Vision_Transformer_on_CIFAR_10_with_PyTorch_Lightning.ipynb) | HuggingFace Transformers, Datasets, PyTorch Lightning์ ์ฌ์ฉํ์ฌ CIFAR-10์ผ๋ก ๋น์ ํธ๋์คํฌ๋จธ(ViT)๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/nielsrogge) |[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/VisionTransformer/Fine_tuning_the_Vision_Transformer_on_CIFAR_10_with_PyTorch_Lightning.ipynb) |
| [๐ค Trainer๋ฅผ ์ฌ์ฉํ์ฌ CIFAR-10์์ ๋น์ ํธ๋์คํฌ๋จธ ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/VisionTransformer/Fine_tuning_the_Vision_Transformer_on_CIFAR_10_with_the_%F0%9F%A4%97_Trainer.ipynb) | Datasets, ๐ค Trainer๋ฅผ ์ฌ์ฉํ์ฌ CIFAR-10์์ ๋น์ ํธ๋์คํฌ๋จธ(ViT)๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/nielsrogge) |[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/VisionTransformer/Fine_tuning_the_Vision_Transformer_on_CIFAR_10_with_the_%F0%9F%A4%97_Trainer.ipynb) |
| [๊ฐ์ฒด ์
๋ ฅ ๋ฐ์ดํฐ ์ธํธ์ธ Open Entity๋ก LUKE ํ๊ฐํ๊ธฐ](https://github.com/studio-ousia/luke/blob/master/notebooks/huggingface_open_entity.ipynb) | Open Entity ๋ฐ์ดํฐ ์ธํธ๋ก *LukeForEntityClassification*์ ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Ikuya Yamada](https://github.com/ikuyamada) |[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/studio-ousia/luke/blob/master/notebooks/huggingface_open_entity.ipynb) |
| [๊ด๊ณ ์ถ์ถ ๋ฐ์ดํฐ ์ธํธ์ธ TACRED๋ก LUKE ํ๊ฐํ๊ธฐ](https://github.com/studio-ousia/luke/blob/master/notebooks/huggingface_tacred.ipynb) | TACRED ๋ฐ์ดํฐ ์ธํธ๋ก *LukeForEntityPairClassification*์ ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Ikuya Yamada](https://github.com/ikuyamada) |[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/studio-ousia/luke/blob/master/notebooks/huggingface_tacred.ipynb) |
| [์ค์ NER ๋ฒค์น๋งํฌ์ธ CoNLL-2003์ผ๋ก LUKE ํ๊ฐํ๊ธฐ](https://github.com/studio-ousia/luke/blob/master/notebooks/huggingface_conll_2003.ipynb) | CoNLL-2003 ๋ฐ์ดํฐ ์ธํธ๋ก *LukeForEntitySpanClassification*๋ฅผ ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Ikuya Yamada](https://github.com/ikuyamada) |[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/studio-ousia/luke/blob/master/notebooks/huggingface_conll_2003.ipynb) |
| [PubMed ๋ฐ์ดํฐ ์ธํธ๋ก BigBird-Pegasus ํ๊ฐํ๊ธฐ](https://github.com/vasudevgupta7/bigbird/blob/main/notebooks/bigbird_pegasus_evaluation.ipynb) | PubMed ๋ฐ์ดํฐ ์ธํธ๋ก *BigBirdPegasusForConditionalGeneration*๋ฅผ ํ๊ฐํ๋ ๋ฐฉ๋ฒ | [Vasudev Gupta](https://github.com/vasudevgupta7) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/vasudevgupta7/bigbird/blob/main/notebooks/bigbird_pegasus_evaluation.ipynb) |
| [Wav2Vec2๋ฅผ ์ฌ์ฉํด์ ์์ฑ ๊ฐ์ ๋ถ๋ฅํ๊ธฐ](https://github/m3hrdadfi/soxan/blob/main/notebooks/Emotion_recognition_in_Greek_speech_using_Wav2Vec2.ipynb) | ๊ฐ์ ๋ถ๋ฅ๋ฅผ ์ํด ์ฌ์ ํ๋ จ๋ Wav2Vec2 ๋ชจ๋ธ์ MEGA ๋ฐ์ดํฐ ์ธํธ์ ํ์ฉํ๋ ๋ฐฉ๋ฒ | [Mehrdad Farahani](https://github.com/m3hrdadfi) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/m3hrdadfi/soxan/blob/main/notebooks/Emotion_recognition_in_Greek_speech_using_Wav2Vec2.ipynb) |
| [DETR๋ก ์ด๋ฏธ์ง์์ ๊ฐ์ฒด ํ์งํ๊ธฐ](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/DETR/DETR_minimal_example_(with_DetrFeatureExtractor).ipynb) | ํ๋ จ๋ *DetrForObjectDetection* ๋ชจ๋ธ์ ์ฌ์ฉํ์ฌ ์ด๋ฏธ์ง์์ ๊ฐ์ฒด๋ฅผ ํ์งํ๊ณ ์ดํ
์
์ ์๊ฐํํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/NielsRogge) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/DETR/DETR_minimal_example_(with_DetrFeatureExtractor).ipynb) |
| [์ฌ์ฉ์ ์ง์ ๊ฐ์ฒด ํ์ง ๋ฐ์ดํฐ ์ธํธ๋ก DETR ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/DETR/Fine_tuning_DetrForObjectDetection_on_custom_dataset_(balloon).ipynb) | ์ฌ์ฉ์ ์ง์ ๊ฐ์ฒด ํ์ง ๋ฐ์ดํฐ ์ธํธ๋ก *DetrForObjectDetection*์ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Niels Rogge](https://github.com/NielsRogge) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/DETR/Fine_tuning_DetrForObjectDetection_on_custom_dataset_(balloon).ipynb) |
| [๊ฐ์ฒด๋ช
์ธ์์ ์ํด T5 ๋ฏธ์ธ ์กฐ์ ํ๊ธฐ](https://github.com/ToluClassics/Notebooks/blob/main/T5_Ner_Finetuning.ipynb) | ๊ฐ์ฒด๋ช
์ธ์ ์์
์ ์ํด *T5*๋ฅผ ๋ฏธ์ธ ์กฐ์ ํ๋ ๋ฐฉ๋ฒ | [Ogundepo Odunayo](https://github.com/ToluClassics) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1obr78FY_cBmWY5ODViCmzdY6O1KB65Vc?usp=sharing) |
|