ArthurConmyGDM
commited on
Commit
•
4c9df61
1
Parent(s):
a7769ac
Update README.md
Browse files
README.md
CHANGED
@@ -26,6 +26,8 @@ sae, cfg_dict, sparsity = SAE.from_pretrained(
|
|
26 |
)
|
27 |
```
|
28 |
|
|
|
|
|
29 |
See https://github.com/jbloomAus/SAELens for details on this library.
|
30 |
|
31 |
# 4. Point of Contact
|
|
|
26 |
)
|
27 |
```
|
28 |
|
29 |
+
This uses **canonical** SAEs, those with average L0 closest to 100, which we expect to be reasonably useful for most tasks. The exact defined here is determined by this file in the SAELens repo, snappshotted on 22nd October 2024: https://github.com/jbloomAus/SAELens/blob/a470460/sae_lens/pretrained_saes.yaml#L2635
|
30 |
+
|
31 |
See https://github.com/jbloomAus/SAELens for details on this library.
|
32 |
|
33 |
# 4. Point of Contact
|