Upload ./Qwen2-7B-Q3_K_M.mmlu.pro.txt with huggingface_hub

Qwen2-7B-Q3_K_M.mmlu.pro.txt

@@ -1,80 +1,2 @@
-multiple_choice_score: there are 70 tasks in prompt
-multiple_choice_score: reading tasks......................................................................done
-multiple_choice_score: preparing task data......................................................................done
-multiple_choice_score : calculating TruthfulQA score over 70 tasks.
-
-task	acc_norm
-1	0.00000000
-2	50.00000000
-3	33.33333333
-4	25.00000000
-5	40.00000000
-6	33.33333333
-7	28.57142857
-8	25.00000000
-9	22.22222222
-10	30.00000000
-11	36.36363636
-12	41.66666667
-13	38.46153846
-14	42.85714286
-15	46.66666667
-16	43.75000000
-17	41.17647059
-18	38.88888889
-19	36.84210526
-20	35.00000000
-21	33.33333333
-22	31.81818182
-23	30.43478261
-24	29.16666667
-25	28.00000000
-26	26.92307692
-27	25.92592593
-28	25.00000000
-29	24.13793103
-30	23.33333333
-31	22.58064516
-32	21.87500000
-33	24.24242424
-34	23.52941176
-35	22.85714286
-36	22.22222222
-37	21.62162162
-38	21.05263158
-39	20.51282051
-40	22.50000000
-41	21.95121951
-42	21.42857143
-43	20.93023256
-44	20.45454545
-45	20.00000000
-46	21.73913043
-47	21.27659574
-48	22.91666667
-49	22.44897959
-50	22.00000000
-51	21.56862745
-52	21.15384615
-53	22.64150943
-54	22.22222222
-55	23.63636364
-56	23.21428571
-57	22.80701754
-58	22.41379310
-59	22.03389831
-60	23.33333333
-61	22.95081967
-62	22.58064516
-63	22.22222222
-64	23.43750000
-65	23.07692308
-66	22.72727273
-67	22.38805970
-68	22.05882353
-69	21.73913043
-70	21.42857143
-
- Final result: 21.4286 +/- 4.9397
-Random chance: 10.0000 +/- 3.6116
-
+multiple_choice_score: there are 12032 tasks in prompt
+multiple_choice_score: reading tasksmultiple_choice_score: failed to read task 1 of 12032