lachiewyoung

/

mistral-7b-instruct-1.58bit

like 3

Please check : https://arxiv.org/abs/2402.17764 and https://arxiv.org/abs/2402.17764 @ramzeez88

The model is 30 gb in side, and you write 1.58bit ? Probably exploits

The model is 30 gb in side, and you write 1.58bit ? Probably exploits

This is uploaded in f32, just like the original 1.58b model
1bitLLM/bitnet_b1_58-3B

Since when did we get a Mistrial 1.58 bit models? I thought that required making a new model from scratch?!!?????

Since when did we get a Mistrial 1.58 bit models? I thought that required making a new model from scratch?!!?????

I'm unsure as to what this model actually is or does, I just wanted to address the size difference.
We would need info from the poster of this model.