Two model evaluations failed for abacusai/Dracarys-*

#896
by siddartha-abacus - opened

Hi,

following up on two model eval failures that occured:
https://huggingface.co./datasets/open-llm-leaderboard/requests/blob/main/abacusai/Dracarys-72B-Instruct_eval_request_False_bfloat16_Original.json
https://huggingface.co./datasets/open-llm-leaderboard/requests/blob/main/abacusai/Dracarys-Llama-3.1-70B-Instruct_eval_request_False_bfloat16_Original.json

We have run a subset of the leaderboard evals with no issue. Could you please see if this was a transient infra failure during eval?

Thank you.

  • Siddartha
Open LLM Leaderboard org

Hi @siddartha-abacus ,

I've resubmitted your models. It seems like it was a network problem on our side, it should be fine now

I close this discussion, please, ping me here in case of any questions about these models or open a new discussion

alozowski changed discussion status to closed

Sign up or log in to comment