Spaces:
Running
on
CPU Upgrade
Failure of chargoddard/mixtralnt-4x7b-test
Hi there!
I was wondering why this particular model failed. It is in safetensors format and able to be loaded with AutoModel.
It's an unconventional Mixtral config, but it works locally.
Here is the requests file in question:
https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/chargoddard/mixtralnt-4x7b-test_eval_request_False_bfloat16_Original.json
Thanks!
Hi!
Thank you for your issue!
This job was cancelled this morning, as your model was downloading (during cluster maintenance) - I passed it to pending again.
Thanks for the prompt response!
Unfortunately it looks like it failed again. What was the cause this time?
Thanks again for your time.
Hi!
Your model failed while loading the checkpoint's shards. I relaunched it in case it was a hardware failure, but if it fails again, it's probably an issue with your model. Did you follow all the pre-submission steps?