Model Failed

#283
by deleted - opened
deleted

Hi our AIDC-ai-business/Marcoroni-70B model seems to be failed on the request file. Here is the request file:
https://huggingface.co./datasets/open-llm-leaderboard/requests/blob/main/AIDC-ai-business/Marcoroni-70B_eval_request_False_float16_Original.json

To fix our model can you share what is wrong? Thanks.

@clefourrier

deleted

We have no problem running it locally

Open LLM Leaderboard org
edited Sep 14, 2023

Hi!
There was a connection error when downloading shard 7.
I relaunched it in case it was a network problem, but it could also be a format problem.

Exception: Error while downloading: reqwest::Error { kind: Status(503), url: Url { scheme: "https", cannot_be_a_base: false, username: "", password: None, host: Some(Domain("cdn-lfs.huggingface.co")), port: None, path: "/repos/fc/b4/fcb416536df00c5b8f634b43355196ef08fddd9a2288a77bd3da123fdfb2d618/430fce29d9e78fe51c0b500b3c0df3aa1a86a91c23b996f6673c6f67b22efe89", query: Some("response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27pytorch_model-00007-of-00015.bin%3B+filename%3D%22pytorch_model-00007-of-00015.bin%22%3B&response-content-type=application%2Foctet-stream&Expires=1694879705&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTY5NDg3OTcwNX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy5odWdnaW5nZmFjZS5jby9yZXBvcy9mYy9iNC9mY2I0MTY1MzZkZjAwYzViOGY2MzRiNDMzNTUxOTZlZjA4ZmRkZDlhMjI4OGE3N2JkM2RhMTIzZmRmYjJkNjE4LzQzMGZjZTI5ZDllNzhmZTUxYzBiNTAwYjNjMGRmM2FhMWE4NmE5MWMyM2I5OTZmNjY3M2M2ZjY3YjIyZWZlODk%7EcmVzcG9uc2UtY29udGVudC1kaXNwb3NpdGlvbj0qJnJlc3BvbnNlLWNvbnRlbnQtdHlwZT0qIn1dfQ__&Signature=bKhYhZMW7r1QgmZyx7yk-PX9p5V2R0H93yFG15sBzp5k%7EewfOLxs37X6bDTef7fhGVBikldado4Mz7Cum-Cvsw77ApPic0o%7EMUe7P7hjdKgc0QW8iqyR1wmhIWIT7Vpd94S%7EEO6eHgQzsbcOFAdbSjzyD0087xC7jnEjDPBeLykcAfXnN1TOfIMKDU1KXOOMkubvOK08P3M3CDjtgGG0mCpnXOxC-liGSsT1DY5R6aodxJd8QLfJ%7EYZ2AiNNoYN-BreLT5Z-foCqKAbkStAT-uAiZPqhEDcJPfmVDBj1fRT9JPTbA6PecOaX62wFRXef6CoRrPMzWlJj4TQ-9xzQfA__&Key-Pair-Id=KVTP0A1DKRTAX"), fragment: None } }

If it fails again, make sure you have followed all the steps on the About page (notably conversion to safetensors), and feel free to repoen this issue :)

clefourrier changed discussion status to closed
deleted changed discussion status to open
This comment has been hidden
deleted

image.png
hello @clefourrier ,After our initial failure, we submitted a revised version. Now, with the addition of the resubmitted version, we have two results: the first-ranked model is bf16, and the second-ranked model is fp16. Could you please delete the score of the second-ranked model for us? Thank you!

Open LLM Leaderboard org

Hi @AIDC-ai-business, your model was removed from the leaderboard.

SaylorTwift changed discussion status to closed

Sign up or log in to comment