Tiny dummy models
Collection
Randomly initialized tiny models for debugging/testing purpose
•
50 items
•
Updated
•
3
This model is randomly initialized, using the config from meta-llama/Llama-2-7b-chat-hf but with the following modifications:
{
"hidden_size": 8,
"intermediate_size": 32,
"num_attention_heads": 2,
"num_hidden_layers": 3,
"num_key_value_heads": 2,
}