Layer 13 saes raising "zipfile.BadZipFile: File is not a zip file"

by MrGonao - opened Sep 6

Discussion

MrGonao

Sep 6

I tried both l0 30 and 54 and they get that error when loading the sae.

MrGonao

Sep 6

Same with layer 6 l0 36.

Renu11

Google org Sep 9

Hi @MrGonao , Please provide more clear context or details on this issue you are facing to understand the issue better. Thank you

MrGonao

Sep 11

Sorry, I should have been more clear. When downloading these SAEs with path_to_params = hf_hub_download( repo_id="google/gemma-scope-9b-pt-res", filename=f"layer_13/width_131k/average_l0_30"/params.npz", force_download=False, ) and then loading them using params = np.load(path_to_params) leads to the above error for SAEs of width 131k on layer 3 and 6 (at least in the specified l0s). All other layers I tried seem to be working fine.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment