SAELens
ArthurConmyGDM commited on
Commit
bd3fe55
1 Parent(s): f8afffd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -31
README.md CHANGED
@@ -4,50 +4,25 @@ license: cc-by-4.0
4
 
5
  # 1. Gemma Scope
6
 
7
- Gemma Scope is TODO
8
 
9
- You can learn more about Gemma Scope from:
10
 
11
- - Neuronpedia, an interactive external site hosting Gemma Scope: https://www.neuronpedia.org/gemma-scope
12
- - Our official Google DeepMind blog post: TODO
13
- - Our technical report: TODO (arxiv link here)
14
- - A colab demo for Gemma Scope:
15
 
16
- # 2. What Is `gemmascope-2b-pt-res`?
17
-
18
- - `gemmascope-`: See <b>1.</b>
19
  - `2b-pt-`: These SAEs were trained on Gemma v2 2B base model.
20
  - `res`: These SAEs were trained on the model's residual stream.
21
 
22
- # 3. Quick start
23
-
24
- ```python
25
- # TODO(conmy): write code
26
- ```
27
-
28
- # 4. Point of Contact
29
 
30
  Point of contact: Arthur Conmy
31
 
32
  Contact by email:
 
33
  ```python
34
  ''.join(list('moc.elgoog@ymnoc')[::-1])
35
  ```
36
 
37
  HuggingFace account:
38
  https://huggingface.co/ArthurConmyGDM
39
-
40
- # 5. Full License
41
-
42
- All software is licensed under the Apache License, Version 2.0 (Apache 2.0). You may not use this file except in compliance with the Apache 2.0 license. You may obtain a copy of the Apache 2.0 license at: https://www.apache.org/licenses/LICENSE-2.0.
43
-
44
-
45
- All other materials are licensed under the terms of the Creative Commons Attribution 4.0 International License (CC BY). You may obtain a copy of the CC-BY license at: https://creativecommons.org/licenses/by/4.0/legalcode.
46
-
47
- Unless required by applicable law or agreed to in writing, all software and materials distributed here under the Apache 2.0 or CC-BY licenses are distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the licenses for the specific language governing permissions and limitations under those licenses.
48
-
49
-
50
- This is not an official Google product.
51
-
52
-
53
- Copyright 2024 DeepMind Technologies Limited.
 
4
 
5
  # 1. Gemma Scope
6
 
7
+ Gemma Scope is a comprehensive, open suite of sparse autoencoders for Gemma 2 9B and 2B. Sparse Autoencoders are a "microscope" of sorts that can help us break down a model’s internal activations into the underlying concepts, just as biologists use microscopes to study the individual cells of plants and animals.
8
 
9
+ See our [landing page](https://huggingface.co/google/gemma-scope) for details on the whole suite. This is a specific set of SAEs:
10
 
11
+ # 2. What Is `gemma-scope-2b-pt-att`?
 
 
 
12
 
13
+ - `gemma-scope-`: See 1.
 
 
14
  - `2b-pt-`: These SAEs were trained on Gemma v2 2B base model.
15
  - `res`: These SAEs were trained on the model's residual stream.
16
 
17
+ ## 3. Point of Contact
 
 
 
 
 
 
18
 
19
  Point of contact: Arthur Conmy
20
 
21
  Contact by email:
22
+
23
  ```python
24
  ''.join(list('moc.elgoog@ymnoc')[::-1])
25
  ```
26
 
27
  HuggingFace account:
28
  https://huggingface.co/ArthurConmyGDM