koCSN_SAPR / README.md
yuneun92's picture
Update README.md
9871a92 verified
|
raw
history blame
No virus
2.19 kB
metadata
license: mit
language:
  - ko
pipeline_tag: text-classification
library_name: transformers

ํ…์ŠคํŠธ ๊ธฐ๋ฐ˜ ๋ฐœํ™”์ž ์ธ์‹ ๋ชจ๋ธ

ํ…์ŠคํŠธ, ํŠนํžˆ ์†Œ์„ค๊ณผ ๊ฐ™์ด ์ธ์šฉ ๋ถ€ํ˜ธ๋กœ ๋ฐœํ™”๊ฐ€ ๊ธฐ๋ก๋˜์–ด ์žˆ๋Š” ํ…์ŠคํŠธ์—์„œ ๋Œ€ํ™” ์ฐธ์—ฌ ์ธ๋ฌผ์„ ์ธ์‹ํ•˜๊ณ , ํƒ€๊ฒŸ ์ธ์šฉ๋ฌธ์˜ ๋ฐœํ™”์ž๋ฅผ ์ถ”์ถœํ•˜๋Š” ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.

๋ฐœํ™”์ž ์ธ์‹์€ ๋‹ค์Œ์˜ ์ˆœ์„œ๋กœ ์ด๋ฃจ์–ด์ง‘๋‹ˆ๋‹ค.

  1. ๋Œ€ํ™” ์ฐธ์—ฌ์ž ์ธ์‹: ์ „ ํ…์ŠคํŠธ์— ๊ฑธ์ณ, NER์„ ํ†ตํ•ด ๋ชจ๋“  ๋Œ€ํ™” ์ฐธ์—ฌ์ž๋ฅผ ์ธ์‹ํ•ฉ๋‹ˆ๋‹ค.
  2. ์ธ์šฉ๋ฌธ ๋ณ„ ์ธ์Šคํ„ด์Šค ์ƒ์„ฑ: window ์‚ฌ์ด์ฆˆ๋Š” ์กฐ์ ˆ ๊ฐ€๋Šฅํ•˜๋ฉฐ, ์ธ์šฉ๋ฌธ ๊ธฐ์ค€ ์•ž๋’ค ๊ฐ๊ฐ 10์ค„์„ ๋””ํดํŠธ๋กœ ํ•ฉ๋‹ˆ๋‹ค. ์ฆ‰ ์ธ์Šคํ„ด์Šค๋Š” 21์ค„์ด ๊ธฐ๋ณธ์ž…๋‹ˆ๋‹ค.
  3. ์ธ์šฉ๋ฌธ ๋ณ„ ๋ฐœํ™”์ž ์ถ”๋ก : ์ธ์Šคํ„ด์Šค ๋‚ด์—์„œ ๋ฐœํ™”์ž ํ›„๋ณด๋ฅผ ์ถ”๋ฆฌ๊ณ , ๋ฐœํ™”์ž๋ฅผ ์ถ”๋ก ํ•ฉ๋‹ˆ๋‹ค.

GitHub Repository: https://github.com/Novel-Transformation-for-You/service.git

image/png

ํŒ€์›

์‹œ์Šคํ…œ ๊ตฌ์„ฑ๋„

image/png

๋ชจ๋ธ ์ •๋ณด

  1. Base model: koRoBERTa
  2. NER model: ํ•œ๊ตญํ•ด์–‘๋Œ€ํ•™๊ต NER ๋ชจ๋ธ (MIT License) https://github.com/kmounlp/NER
max_seq_length = 512