fazni commited on
Commit
dd564a5
1 Parent(s): 51fb54e

added tokenizer

Browse files
tokenized_words/tokenized_words.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6f9a85fba9a51cced8d28b6251328c5debe5c8598857f476e445203ffc53640
3
+ size 2443597