Commit
•
389d928
1
Parent(s):
9db298c
Update README.md
Browse files
README.md
CHANGED
|
@@ -36,7 +36,9 @@ sae, cfg_dict, sparsity = SAE.from_pretrained(
|
|
| 36 |
)
|
| 37 |
```
|
| 38 |
|
| 39 |
-
|
|
|
|
|
|
|
| 40 |
|
| 41 |
# 5. Point of Contact
|
| 42 |
|
|
|
|
| 36 |
)
|
| 37 |
```
|
| 38 |
|
| 39 |
+
This uses **canonical** SAEs, those with average L0 closest to 100, which we expect to be reasonably useful for most tasks. The exact defined here is determined by this file in the SAELens repo, snappshotted on 22nd October 2024: https://github.com/jbloomAus/SAELens/blob/a470460/sae_lens/pretrained_saes.yaml#L1667
|
| 40 |
+
|
| 41 |
+
See https://github.com/jbloomAus/SAELens for more details on this library.
|
| 42 |
|
| 43 |
# 5. Point of Contact
|
| 44 |
|