Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
---
|
|
|
|
| 1 |
+
# Roberta Zinc 480m
|
| 2 |
+
|
| 3 |
+
This is a Roberta style masked language model trained on ~480m SMILES strings from the [ZINC database](https://zinc.docking.org/).
|
| 4 |
+
The model has ~102m parameters and was trained for 150000 iterations with a batch size of 4096 to a validation loss of ~0.122.
|
| 5 |
+
This model is useful for generating embeddings from SMILES strings.
|
| 6 |
+
|
| 7 |
---
|
| 8 |
license: mit
|
| 9 |
---
|