Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Two model evaluations failed for abacusai/Dracarys-*
#896
by
siddartha-abacus
- opened
Hi,
following up on two model eval failures that occured:
https://huggingface.co./datasets/open-llm-leaderboard/requests/blob/main/abacusai/Dracarys-72B-Instruct_eval_request_False_bfloat16_Original.json
https://huggingface.co./datasets/open-llm-leaderboard/requests/blob/main/abacusai/Dracarys-Llama-3.1-70B-Instruct_eval_request_False_bfloat16_Original.json
We have run a subset of the leaderboard evals with no issue. Could you please see if this was a transient infra failure during eval?
Thank you.
- Siddartha
Hi @siddartha-abacus ,
I've resubmitted your models. It seems like it was a network problem on our side, it should be fine now
I close this discussion, please, ping me here in case of any questions about these models or open a new discussion
alozowski
changed discussion status to
closed