Egor Pakhomov

egor-pakhomov's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in airtrain-ai/fineweb-edu-fortified about 1 month ago

Deduped version of fineweb on HuggingFace yields "This dataset has 218 files that have been marked as unsafe."

1

#103 opened about 1 month ago by egor-pakhomov

New activity in HuggingFaceFW/fineweb about 1 month ago

Exact copy of this dataset on HuggingFace yields "This dataset has 218 files that have been marked as unsafe."

1

#50 opened about 1 month ago by egor-pakhomov

Simple exact deduplication removes 2/3 of data.

3

#49 opened about 1 month ago by egor-pakhomov

New activity in mlfoundations/dclm-baseline-1.0 3 months ago

Can't read with Spark

4

#1 opened 3 months ago by egor-pakhomov