Commit
•
a2421af
1
Parent(s):
46d08de
typos
Browse files
README.md
CHANGED
|
@@ -211,7 +211,7 @@ This scheme captures acronyms, e.g., "NATO", as well as bi-capitalized words, e.
|
|
| 211 |
|
| 212 |
|
| 213 |
## Post-Punctuation Tokens
|
| 214 |
-
This model predicts the following set of "post" punctuation tokens:
|
| 215 |
|
| 216 |
| Token | Description | Relevant Languages |
|
| 217 |
| ---: | :---------- | :----------- |
|
|
@@ -232,7 +232,7 @@ This model predicts the following set of "post" punctuation tokens:
|
|
| 232 |
|
| 233 |
|
| 234 |
## Pre-Punctuation Tokens
|
| 235 |
-
This model predicts the following set of "
|
| 236 |
|
| 237 |
| Token | Description | Relevant Languages |
|
| 238 |
| ---: | :---------- | :----------- |
|
|
|
|
| 211 |
|
| 212 |
|
| 213 |
## Post-Punctuation Tokens
|
| 214 |
+
This model predicts the following set of "post" punctuation tokens after each subword:
|
| 215 |
|
| 216 |
| Token | Description | Relevant Languages |
|
| 217 |
| ---: | :---------- | :----------- |
|
|
|
|
| 232 |
|
| 233 |
|
| 234 |
## Pre-Punctuation Tokens
|
| 235 |
+
This model predicts the following set of "pre" punctuation tokens before each subword:
|
| 236 |
|
| 237 |
| Token | Description | Relevant Languages |
|
| 238 |
| ---: | :---------- | :----------- |
|