Remote Code Preventing Submission

#735
by Kquant03 - opened

I performed a huge passthrough of microsoft's phi-3 instruct tune and I would highly appreciate it if you guys would run an evaluation of it for me.

https://huggingface.co/Replete-AI/Phi-3-Goru

FYI I'm running another evaluation on it now! Should be available in about 2 hours on: https://huggingface.co/spaces/CultriX/Alt_LLM_LeaderBoard

:)!

FYI I'm running another evaluation on it now! Should be available in about 2 hours on: https://huggingface.co/spaces/CultriX/Alt_LLM_LeaderBoard

:)!

Thanks CultriX

Open LLM Leaderboard org

Hi @Kquant03 !

Thanks for your interest in the leaderboard. Unfortunately, we do not run models that require trust_remote_code=True. Can you confirm that your model needs this flag? If not there might have ben an issue during model submission

Hi @Kquant03 !

Thanks for your interest in the leaderboard. Unfortunately, we do not run models that require trust_remote_code=True. Can you confirm that your model needs this flag? If not there might have ben an issue during model submission

is there a way to change phi-3 to make it not require this?

Open LLM Leaderboard org

Hi @Kquant03 ,

I don't think we can do it. Since I can't help you with your model, I'm closing this discussion. Please feel free to open a new one if you need any help!

alozowski changed discussion status to closed

Sign up or log in to comment