diff --git "a/qqp_interpol@34110steps/19331465_interpolate_models.out" "b/qqp_interpol@34110steps/19331465_interpolate_models.out" new file mode 100644--- /dev/null +++ "b/qqp_interpol@34110steps/19331465_interpolate_models.out" @@ -0,0 +1,12871 @@ +Tue May 10 01:04:53 2022 ++-----------------------------------------------------------------------------+ +| NVIDIA-SMI 470.57.02 Driver Version: 470.57.02 CUDA Version: 11.4 | +|-------------------------------+----------------------+----------------------+ +| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | +| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | +| | | MIG M. | +|===============================+======================+======================| +| 0 Quadro RTX 8000 On | 00000000:D8:00.0 Off | 0 | +| N/A 29C P8 24W / 250W | 0MiB / 45556MiB | 0% Default | +| | | N/A | ++-------------------------------+----------------------+----------------------+ + ++-----------------------------------------------------------------------------+ +| Processes: | +| GPU GI CI PID Type Process name GPU Memory | +| ID ID Usage | +|=============================================================================| +| No running processes found | ++-----------------------------------------------------------------------------+ +Obtaining file:///scratch/rb5139/constellations/src + Preparing metadata (setup.py): started + Preparing metadata (setup.py): finished with status 'done' +Installing collected packages: constellations + Attempting uninstall: constellations + Found existing installation: constellations 0.0.0 + Uninstalling constellations-0.0.0: + Successfully uninstalled constellations-0.0.0 + Running setup.py develop for constellations +Successfully installed constellations-0.0.0 +Creating .9SSZ514TLW32MUEBVAY6, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .SQZ61SSB7U0HX3OOGJ6H, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Euclidean distance between 0 and 1: 21.27473258972168. +Interpolating between 0 and 1 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2787 0.9141 0.8778 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2652 0.9102 0.8736 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2579 0.9102 0.8743 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2569 0.9062 0.8696 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2601 0.9043 0.8672 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2653 0.9023 0.8649 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2686 0.9023 0.8641 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2694 0.8965 0.8548 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2729 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 1 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .SPAUGL0T96XWHM51FRZA, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Euclidean distance between 0 and 2: 21.07608985900879. +Interpolating between 0 and 2 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2856 0.9102 0.8729 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2595 0.9121 0.8760 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2461 0.9141 0.8791 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2410 0.9180 0.8852 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2403 0.9141 0.8798 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2405 0.9141 0.8804 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2422 0.9062 0.8689 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2486 0.9023 0.8634 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2615 0.9004 0.8603 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 2 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .FLMLXI21WYA3W0P43GSO, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-3 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-3.pt +Euclidean distance between 0 and 3: 21.171306610107422. +Interpolating between 0 and 3 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2570 0.9160 0.8815 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2486 0.9160 0.8828 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2455 0.9180 0.8859 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2472 0.9141 0.8804 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2515 0.9023 0.8649 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2552 0.9023 0.8641 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2561 0.9004 0.8610 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2583 0.9023 0.8626 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2664 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 3 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .YG0EP4DOEAQ57DGK9WW4, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-4 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-4.pt +Euclidean distance between 0 and 4: 21.96269989013672. +Interpolating between 0 and 4 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2649 0.9102 0.8736 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2421 0.9121 0.8774 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2330 0.9082 0.8726 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2352 0.9141 0.8817 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2423 0.9102 0.8763 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2472 0.9062 0.8710 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2490 0.9062 0.8703 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2541 0.9062 0.8703 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2651 0.8984 0.8579 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 4 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .A7XNQSAA0F1X1XXV0FKT, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-5 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-5.pt +Euclidean distance between 0 and 5: 21.522537231445312. +Interpolating between 0 and 5 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2900 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2765 0.9102 0.8729 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2681 0.9062 0.8681 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2652 0.9023 0.8619 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2676 0.9043 0.8650 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2702 0.9043 0.8650 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2693 0.9004 0.8595 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2678 0.9004 0.8603 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2706 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 5 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .CE8N5C26XJSHCFVGM9LC, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-6 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-6.pt +Euclidean distance between 0 and 6: 21.31351089477539. +Interpolating between 0 and 6 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2830 0.9043 0.8635 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2712 0.9082 0.8705 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2672 0.9062 0.8696 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2666 0.9082 0.8726 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2676 0.9102 0.8750 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2698 0.9043 0.8665 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2702 0.9043 0.8658 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2687 0.9043 0.8658 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2710 0.9004 0.8603 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 6 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .7N2PA24051FLE2Q8R9JU, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-7 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-7.pt +Euclidean distance between 0 and 7: 24.084291458129883. +Interpolating between 0 and 7 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2917 0.9160 0.8828 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2401 0.9082 0.8712 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2302 0.9004 0.8595 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2827 0.8867 0.8314 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3937 0.8496 0.7442 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.4361 0.8301 0.6947 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.3099 0.8926 0.8564 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2261 0.9062 0.8750 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2345 0.8984 0.8602 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 7 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .NR0UKY1MMSRMPJQS1U63, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-8 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-8.pt +Euclidean distance between 0 and 8: 21.317813873291016. +Interpolating between 0 and 8 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2796 0.9102 0.8736 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2660 0.9043 0.8665 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2578 0.8984 0.8587 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2541 0.8965 0.8564 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2527 0.8945 0.8548 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2518 0.8926 0.8518 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2503 0.8926 0.8509 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2513 0.8965 0.8548 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2611 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 8 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .69Z6NB02OSK30D45Y8I2, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-9 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-9.pt +Euclidean distance between 0 and 9: 21.172636032104492. +Interpolating between 0 and 9 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2856 0.9121 0.8760 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2661 0.9121 0.8767 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2574 0.9082 0.8719 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2561 0.8984 0.8595 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2588 0.8984 0.8602 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2621 0.8965 0.8571 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2643 0.9004 0.8618 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2662 0.8945 0.8525 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2716 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 9 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .AWI6CAXONXEH3TRUD6VM, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-10 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-10.pt +Euclidean distance between 0 and 10: 21.399532318115234. +Interpolating between 0 and 10 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2707 0.9160 0.8828 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2537 0.9141 0.8798 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2457 0.9082 0.8733 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2443 0.9102 0.8763 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2462 0.9023 0.8663 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2476 0.8984 0.8602 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2490 0.9004 0.8625 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2542 0.8984 0.8579 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2649 0.8984 0.8579 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 10 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .NY7MEHV7U3KML3TE6NPU, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-11 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-11.pt +Euclidean distance between 0 and 11: 23.653718948364258. +Interpolating between 0 and 11 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2755 0.9062 0.8681 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2299 0.9102 0.8743 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2187 0.9121 0.8780 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2360 0.9062 0.8730 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2577 0.9121 0.8831 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2522 0.9102 0.8814 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2290 0.9062 0.8743 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2234 0.9023 0.8670 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2457 0.8984 0.8587 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 11 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .PCETQVKCAIVMLKKO73R0, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-12 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-12.pt +Euclidean distance between 0 and 12: 23.670473098754883. +Interpolating between 0 and 12 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2858 0.8984 0.8595 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2374 0.9023 0.8641 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2216 0.9102 0.8750 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2339 0.9082 0.8719 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2496 0.8984 0.8602 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2454 0.9023 0.8677 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2357 0.9004 0.8647 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2366 0.9004 0.8633 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2537 0.8965 0.8556 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 12 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .L5MQN5WGUCDKBNOL22MK, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-13 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-13.pt +Euclidean distance between 0 and 13: 22.51252555847168. +Interpolating between 0 and 13 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2493 0.9062 0.8667 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2315 0.9062 0.8674 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2242 0.9121 0.8760 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2272 0.9121 0.8774 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2346 0.9043 0.8679 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2400 0.9023 0.8656 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2444 0.8984 0.8602 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2513 0.8965 0.8564 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2633 0.9004 0.8610 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 13 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .ZYQKC1TVE08YVAJAGIQO, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-14 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-14.pt +Euclidean distance between 0 and 14: 21.054790496826172. +Interpolating between 0 and 14 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2803 0.9043 0.8650 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2637 0.9023 0.8626 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2547 0.8984 0.8595 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2518 0.9004 0.8633 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2519 0.8965 0.8571 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2519 0.8965 0.8579 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2517 0.8984 0.8587 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2550 0.8965 0.8556 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2647 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 14 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .PJJZFJZOE6RJIEFE2XFY, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-15 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-15.pt +Euclidean distance between 0 and 15: 21.35474395751953. +Interpolating between 0 and 15 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2780 0.9141 0.8804 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2637 0.9180 0.8871 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2551 0.9160 0.8847 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2509 0.9141 0.8817 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2509 0.9102 0.8750 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2536 0.9062 0.8681 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2579 0.9023 0.8626 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2622 0.9023 0.8619 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2685 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 15 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .WX202796XJLAHF4L5AL7, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-16 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-16.pt +Euclidean distance between 0 and 16: 21.55874252319336. +Interpolating between 0 and 16 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2572 0.9121 0.8760 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2458 0.9102 0.8736 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2415 0.9121 0.8767 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2419 0.9121 0.8774 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2440 0.9102 0.8750 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2465 0.9062 0.8710 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2495 0.9062 0.8710 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2556 0.8984 0.8587 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2662 0.9004 0.8603 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 16 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .WSA67B9WULEHXD6UC0ZE, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-17 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-17.pt +Euclidean distance between 0 and 17: 23.941402435302734. +Interpolating between 0 and 17 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2750 0.9062 0.8681 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2307 0.9043 0.8650 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2264 0.9023 0.8603 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2723 0.8926 0.8442 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3473 0.8984 0.8587 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3664 0.8691 0.8401 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2943 0.8711 0.8413 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2381 0.9004 0.8702 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2450 0.9023 0.8670 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 17 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .S4XWR2IUEIU5M7XJARB5, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-18 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-18.pt +Euclidean distance between 0 and 18: 21.366321563720703. +Interpolating between 0 and 18 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2570 0.9102 0.8729 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2436 0.9082 0.8698 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2371 0.9082 0.8705 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2375 0.9062 0.8689 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2409 0.9023 0.8634 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2437 0.8984 0.8579 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2464 0.8984 0.8571 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2522 0.9004 0.8603 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2637 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 18 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .MTLFH142RCKPCERXHKAR, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-19 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-19.pt +Euclidean distance between 0 and 19: 21.46351432800293. +Interpolating between 0 and 19 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2572 0.9219 0.8901 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2444 0.9219 0.8901 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2395 0.9160 0.8815 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2405 0.9141 0.8791 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2452 0.9062 0.8681 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2492 0.9004 0.8603 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2520 0.8965 0.8548 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2563 0.8984 0.8571 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2651 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 19 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .LCLB9XRSGM5VIPI7FVOX, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-20 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-20.pt +Euclidean distance between 0 and 20: 21.28291893005371. +Interpolating between 0 and 20 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.3024 0.9004 0.8610 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2753 0.9043 0.8665 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2596 0.9062 0.8696 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2531 0.9004 0.8625 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2516 0.9004 0.8625 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2520 0.8945 0.8541 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2529 0.8945 0.8533 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2569 0.8965 0.8548 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2664 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 20 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .L57UZ76TL18UG27ZSH2V, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-21 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-21.pt +Euclidean distance between 0 and 21: 21.408126831054688. +Interpolating between 0 and 21 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2693 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2606 0.9121 0.8774 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2554 0.9102 0.8750 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2525 0.9062 0.8703 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2519 0.9023 0.8649 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2526 0.9043 0.8686 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2522 0.9004 0.8625 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2531 0.9004 0.8618 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2620 0.8984 0.8579 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 21 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .QL402TNIUDHTTOY5DH8X, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-22 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-22.pt +Euclidean distance between 0 and 22: 23.885957717895508. +Interpolating between 0 and 22 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2642 0.9082 0.8719 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2259 0.9102 0.8743 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2234 0.9141 0.8798 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2594 0.9102 0.8743 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3116 0.9121 0.8794 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3206 0.9043 0.8759 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2634 0.9082 0.8822 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2246 0.9023 0.8684 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2387 0.9043 0.8686 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 22 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .CC13DW9MNO6NSBZ73DR2, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-23 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-23.pt +Euclidean distance between 0 and 23: 23.23101806640625. +Interpolating between 0 and 23 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2711 0.8984 0.8587 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2304 0.9062 0.8703 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2152 0.9082 0.8733 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2219 0.9082 0.8740 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2346 0.9102 0.8789 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2359 0.9102 0.8789 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2310 0.9023 0.8670 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2357 0.9043 0.8686 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2538 0.8965 0.8556 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 23 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .SBXPXNLFP6DENAN1CIDF, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-24 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-24.pt +Euclidean distance between 0 and 24: 21.514623641967773. +Interpolating between 0 and 24 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2786 0.8984 0.8556 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2625 0.9043 0.8650 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2516 0.9004 0.8595 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2478 0.9023 0.8626 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2490 0.9004 0.8625 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2498 0.8965 0.8571 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2490 0.8945 0.8541 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2509 0.8965 0.8556 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2608 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 24 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .9CSL2GO7P61IIWYYRMVZ, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-25 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-25.pt +Euclidean distance between 0 and 25: 21.286893844604492. +Interpolating between 0 and 25 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2752 0.9102 0.8722 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2726 0.9062 0.8674 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2727 0.9062 0.8681 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2745 0.9004 0.8610 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2754 0.9023 0.8641 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2741 0.8984 0.8587 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2695 0.9004 0.8610 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2673 0.8984 0.8571 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2703 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 25 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .0NZWX33Z9H1RYOF9GQQ8, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-26 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-26.pt +Euclidean distance between 0 and 26: 21.300737380981445. +Interpolating between 0 and 26 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2601 0.9141 0.8771 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2413 0.9121 0.8760 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2325 0.9062 0.8703 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2326 0.9082 0.8740 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2367 0.9062 0.8717 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2404 0.9023 0.8663 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2435 0.8945 0.8548 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2498 0.8984 0.8587 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2619 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 26 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .BWJK98A97YQEX7AVBPQU, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-27 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-27.pt +Euclidean distance between 0 and 27: 21.658641815185547. +Interpolating between 0 and 27 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2369 0.9199 0.8864 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2269 0.9219 0.8895 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2242 0.9199 0.8871 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2281 0.9141 0.8791 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2349 0.9102 0.8743 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2395 0.9043 0.8665 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2419 0.9062 0.8689 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2470 0.9023 0.8634 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2601 0.9004 0.8603 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 27 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .97HKYDVZWRX20E5A1E2X, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-28 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-28.pt +Euclidean distance between 0 and 28: 21.213607788085938. +Interpolating between 0 and 28 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2705 0.9062 0.8681 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2613 0.9062 0.8681 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2545 0.9062 0.8681 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2533 0.9102 0.8757 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2563 0.9102 0.8757 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2593 0.9102 0.8763 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2604 0.9043 0.8679 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2630 0.8984 0.8587 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2693 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 28 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .WH5IKO3GPYC2P8JO9FDN, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-29 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-29.pt +Euclidean distance between 0 and 29: 21.052980422973633. +Interpolating between 0 and 29 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2667 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2513 0.9102 0.8750 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2442 0.9141 0.8804 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2438 0.9102 0.8750 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2451 0.9102 0.8750 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2456 0.9102 0.8750 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2456 0.9004 0.8603 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2489 0.9004 0.8603 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2603 0.9004 0.8595 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 29 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .EF33JG9K05OM7EXSBM58, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-30 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-30.pt +Euclidean distance between 0 and 30: 21.707969665527344. +Interpolating between 0 and 30 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2733 0.9062 0.8674 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2562 0.9082 0.8705 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2471 0.9043 0.8665 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2450 0.9062 0.8689 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2472 0.9023 0.8634 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2493 0.9004 0.8610 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2505 0.9023 0.8634 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2557 0.9023 0.8634 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2663 0.9004 0.8603 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 30 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .KV8R1B1ZRE7APTXUNJKG, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-31 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-31.pt +Euclidean distance between 0 and 31: 23.941192626953125. +Interpolating between 0 and 31 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2781 0.9062 0.8674 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2366 0.9082 0.8705 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2320 0.8984 0.8556 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2646 0.8906 0.8400 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3180 0.8867 0.8343 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3305 0.8965 0.8630 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2736 0.8809 0.8516 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2315 0.9062 0.8769 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2437 0.9004 0.8640 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 31 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .XFK3Q2REGHKJVVR4PPEV, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-32 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-32.pt +Euclidean distance between 0 and 32: 21.14760971069336. +Interpolating between 0 and 32 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2753 0.9043 0.8658 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2627 0.9062 0.8703 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2549 0.9023 0.8649 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2511 0.9023 0.8656 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2501 0.9023 0.8656 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2502 0.9023 0.8649 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2512 0.9023 0.8641 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2553 0.8965 0.8556 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2649 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 32 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .LH1IKC30VI2YEKSJ484I, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-33 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-33.pt +Euclidean distance between 0 and 33: 23.662935256958008. +Interpolating between 0 and 33 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2708 0.9062 0.8652 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2251 0.9121 0.8753 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2125 0.9180 0.8859 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2269 0.9141 0.8817 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2478 0.9062 0.8756 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2473 0.9062 0.8769 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2324 0.9004 0.8675 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2306 0.9043 0.8700 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2504 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 33 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .YD1F7YEUUE1X12SAD3FU, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-34 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-34.pt +Euclidean distance between 0 and 34: 21.185911178588867. +Interpolating between 0 and 34 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2721 0.9023 0.8619 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2605 0.9043 0.8658 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2525 0.9023 0.8634 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2506 0.9023 0.8634 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2529 0.8984 0.8579 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2558 0.8984 0.8579 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2591 0.9004 0.8603 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2621 0.8984 0.8571 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2690 0.9004 0.8595 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 34 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .NFM3LR97SV8ISUQBU7T2, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-35 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-35.pt +Euclidean distance between 0 and 35: 21.177997589111328. +Interpolating between 0 and 35 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2786 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2664 0.9082 0.8712 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2588 0.9043 0.8665 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2558 0.8984 0.8595 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2562 0.8965 0.8579 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2570 0.9004 0.8633 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2578 0.8984 0.8595 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2615 0.8984 0.8587 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2689 0.8984 0.8579 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 35 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .RIEVWNQMEWH7S1UDXV2J, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-36 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-36.pt +Euclidean distance between 0 and 36: 21.348278045654297. +Interpolating between 0 and 36 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2945 0.9141 0.8791 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2774 0.9102 0.8743 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2675 0.9102 0.8750 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2649 0.9062 0.8689 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2668 0.9043 0.8658 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2710 0.9004 0.8595 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2742 0.9004 0.8595 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2744 0.8965 0.8548 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2763 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 36 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .IF0NJ04DDMIG8AMHRXYB, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-37 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-37.pt +Euclidean distance between 0 and 37: 21.37672233581543. +Interpolating between 0 and 37 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2673 0.9121 0.8760 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2560 0.9082 0.8705 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2509 0.9043 0.8650 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2507 0.9023 0.8626 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2539 0.9004 0.8603 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2565 0.9043 0.8658 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2577 0.9004 0.8618 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2607 0.8984 0.8579 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2682 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 37 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .WNWNO2Z31CCC9KCSM5FJ, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-38 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-38.pt +Euclidean distance between 0 and 38: 21.36838150024414. +Interpolating between 0 and 38 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2651 0.9102 0.8729 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2616 0.9062 0.8689 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2603 0.9043 0.8665 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2626 0.8984 0.8587 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2649 0.8984 0.8587 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2656 0.8984 0.8579 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2646 0.9004 0.8603 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2649 0.9023 0.8619 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2693 0.9023 0.8619 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 38 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .TORG4TPQ93FM2J5BXXN2, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-39 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-39.pt +Euclidean distance between 0 and 39: 21.161033630371094. +Interpolating between 0 and 39 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2638 0.9219 0.8907 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2550 0.9160 0.8828 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2521 0.9141 0.8804 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2535 0.9082 0.8733 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2565 0.9062 0.8710 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2585 0.9043 0.8679 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2596 0.9023 0.8641 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2619 0.9023 0.8634 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2686 0.8984 0.8579 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 39 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .O8H23F1LYORBNE7U7UAB, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-40 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-40.pt +Euclidean distance between 0 and 40: 21.828445434570312. +Interpolating between 0 and 40 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2763 0.9160 0.8815 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2571 0.9141 0.8804 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2488 0.9102 0.8743 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2500 0.9043 0.8665 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2544 0.9043 0.8665 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2579 0.8965 0.8564 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2605 0.8965 0.8564 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2626 0.8984 0.8587 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2691 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 40 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .YR6MEWP0JOI6RCEKMP0F, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-41 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-41.pt +Euclidean distance between 0 and 41: 21.0714054107666. +Interpolating between 0 and 41 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2713 0.9082 0.8712 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2544 0.9062 0.8696 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2460 0.9102 0.8763 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2441 0.9102 0.8763 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2445 0.9082 0.8747 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2445 0.9043 0.8686 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2449 0.9082 0.8733 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2495 0.8965 0.8548 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2613 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 41 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .3P0KDFH1EG635JBF312Z, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-42 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-42.pt +Euclidean distance between 0 and 42: 21.48857307434082. +Interpolating between 0 and 42 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2910 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2827 0.9062 0.8681 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2784 0.9023 0.8626 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2772 0.9023 0.8626 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2767 0.8965 0.8548 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2739 0.8965 0.8548 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2683 0.8945 0.8525 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2650 0.9004 0.8603 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2696 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 42 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .2KBVHS28W4RGDCCP3CN2, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-43 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-43.pt +Euclidean distance between 0 and 43: 21.237215042114258. +Interpolating between 0 and 43 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2748 0.9141 0.8785 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2605 0.9121 0.8767 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2514 0.9121 0.8774 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2471 0.9043 0.8658 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2465 0.9043 0.8658 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2477 0.9023 0.8626 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2497 0.8984 0.8579 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2541 0.8984 0.8579 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2639 0.9004 0.8603 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 43 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .J1BX47C9JTQZD03YT9F9, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-44 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-44.pt +Euclidean distance between 0 and 44: 21.36084747314453. +Interpolating between 0 and 44 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2833 0.9023 0.8603 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2688 0.9062 0.8674 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2604 0.9062 0.8681 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2580 0.9062 0.8689 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2588 0.9043 0.8658 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2601 0.9062 0.8689 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2607 0.9023 0.8634 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2636 0.8984 0.8579 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2706 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 44 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .1S720Q6MZCPC0BGUBW9M, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-45 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-45.pt +Euclidean distance between 0 and 45: 21.142560958862305. +Interpolating between 0 and 45 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2410 0.9219 0.8901 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2327 0.9199 0.8883 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2298 0.9160 0.8835 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2312 0.9141 0.8811 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2353 0.9102 0.8763 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2401 0.9043 0.8679 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2439 0.9023 0.8649 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2504 0.9023 0.8641 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2622 0.8984 0.8579 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 45 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .TDY8YLQK5V4JEWRXBH5Y, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-46 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-46.pt +Euclidean distance between 0 and 46: 21.624393463134766. +Interpolating between 0 and 46 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2648 0.9102 0.8722 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2546 0.9141 0.8778 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2485 0.9102 0.8729 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2473 0.9102 0.8722 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2519 0.9082 0.8698 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2579 0.9043 0.8643 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2620 0.9023 0.8611 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2656 0.8965 0.8540 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2706 0.9004 0.8595 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 46 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .BMY4E5PH4HT1GSCQUKAK, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-47 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-47.pt +Euclidean distance between 0 and 47: 22.38297462463379. +Interpolating between 0 and 47 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2680 0.9121 0.8760 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2467 0.9121 0.8780 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2362 0.9102 0.8750 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2364 0.9121 0.8780 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2419 0.9082 0.8747 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2466 0.9043 0.8700 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2486 0.9023 0.8656 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2531 0.9004 0.8610 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2642 0.9004 0.8603 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 47 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .EG9NX3RKF1S91Z742XJM, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-48 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-48.pt +Euclidean distance between 0 and 48: 21.565988540649414. +Interpolating between 0 and 48 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2645 0.9199 0.8864 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2442 0.9082 0.8705 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2345 0.9102 0.8736 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2351 0.9082 0.8712 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2403 0.9043 0.8672 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2418 0.8984 0.8587 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2397 0.9004 0.8610 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2431 0.8965 0.8556 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2568 0.9004 0.8610 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 48 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .GS92JGX10CSF5E7ONT5M, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-49 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-49.pt +Euclidean distance between 0 and 49: 21.433822631835938. +Interpolating between 0 and 49 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2938 0.9062 0.8659 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2790 0.9043 0.8635 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2691 0.8984 0.8539 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2636 0.9004 0.8571 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2628 0.9004 0.8579 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2607 0.9023 0.8626 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2580 0.9043 0.8650 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2582 0.8984 0.8571 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2657 0.9004 0.8603 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 49 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .0Q4B6L7Q8W8T2YSUZE0L, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-50 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-50.pt +Euclidean distance between 0 and 50: 21.257278442382812. +Interpolating between 0 and 50 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2784 0.9141 0.8798 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2763 0.9043 0.8672 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2741 0.9062 0.8703 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2747 0.9043 0.8679 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2764 0.9023 0.8656 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2770 0.9023 0.8649 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2744 0.9023 0.8641 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2723 0.9023 0.8634 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2740 0.8984 0.8579 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 50 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .8ZEZ136YFBZLL5JCOKWC, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-51 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-51.pt +Euclidean distance between 0 and 51: 21.529577255249023. +Interpolating between 0 and 51 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2795 0.9062 0.8681 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2643 0.9062 0.8681 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2554 0.9023 0.8626 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2528 0.9004 0.8603 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2541 0.9043 0.8665 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2541 0.9043 0.8672 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2532 0.8965 0.8556 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2541 0.8945 0.8525 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2637 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 51 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .X3ASJ57GRASPU5YUBV6E, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-52 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-52.pt +Euclidean distance between 0 and 52: 21.533031463623047. +Interpolating between 0 and 52 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2842 0.9121 0.8753 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2655 0.9102 0.8722 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2561 0.9082 0.8698 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2553 0.9004 0.8587 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2584 0.8984 0.8556 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2597 0.8984 0.8556 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2594 0.9023 0.8611 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2615 0.9062 0.8667 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2687 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 52 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .07886NH2T8P1G8ZN5IHP, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-53 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-53.pt +Euclidean distance between 0 and 53: 23.812646865844727. +Interpolating between 0 and 53 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2750 0.9082 0.8712 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2333 0.9062 0.8689 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2253 0.9023 0.8626 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2500 0.9023 0.8611 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2854 0.9004 0.8603 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2841 0.8926 0.8556 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2441 0.8965 0.8609 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2199 0.9023 0.8670 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2388 0.9004 0.8618 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 53 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .I5D83LYT8SX27PV5XSG3, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-54 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-54.pt +Euclidean distance between 0 and 54: 21.082530975341797. +Interpolating between 0 and 54 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2850 0.9141 0.8791 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2680 0.9141 0.8804 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2566 0.9141 0.8804 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2502 0.9121 0.8780 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2487 0.9062 0.8696 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2495 0.9023 0.8634 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2517 0.9043 0.8658 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2561 0.9023 0.8619 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2660 0.9004 0.8595 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 54 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .2S8MA9NBJVNYF052OOBC, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-55 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-55.pt +Euclidean distance between 0 and 55: 21.276878356933594. +Interpolating between 0 and 55 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2653 0.9141 0.8778 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2563 0.9102 0.8722 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2515 0.9062 0.8674 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2503 0.9062 0.8681 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2507 0.9023 0.8626 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2513 0.9023 0.8619 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2527 0.9043 0.8650 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2568 0.8965 0.8548 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2657 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 55 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .BPSUO2XX2KF7BEGHDJ19, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-56 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-56.pt +Euclidean distance between 0 and 56: 21.412630081176758. +Interpolating between 0 and 56 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2727 0.9082 0.8676 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2533 0.9082 0.8683 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2438 0.9082 0.8705 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2424 0.9062 0.8696 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2454 0.9062 0.8696 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2474 0.9043 0.8665 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2504 0.8965 0.8556 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2562 0.8965 0.8556 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2666 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 56 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .YK1YWVHVY9UXFBD667WU, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-57 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-57.pt +Euclidean distance between 0 and 57: 21.667930603027344. +Interpolating between 0 and 57 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2734 0.9062 0.8667 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2516 0.9023 0.8611 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2434 0.9043 0.8658 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2448 0.9043 0.8658 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2493 0.9023 0.8626 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2524 0.9004 0.8603 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2533 0.8984 0.8579 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2571 0.8965 0.8548 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2660 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 57 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .32TTWS4L9VQJ5CT1CUUH, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-58 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-58.pt +Euclidean distance between 0 and 58: 21.244766235351562. +Interpolating between 0 and 58 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2916 0.9023 0.8641 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2779 0.9023 0.8649 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2695 0.8984 0.8610 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2662 0.9004 0.8640 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2648 0.8965 0.8587 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2625 0.8945 0.8564 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2596 0.8984 0.8602 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2598 0.8945 0.8533 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2669 0.8984 0.8579 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 58 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .TM9A3NI1A4PXVHA4B1IP, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-59 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-59.pt +Euclidean distance between 0 and 59: 21.349349975585938. +Interpolating between 0 and 59 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2812 0.9102 0.8722 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2648 0.9043 0.8643 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2568 0.9043 0.8650 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2561 0.9023 0.8626 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2584 0.8945 0.8516 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2604 0.8926 0.8493 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2611 0.8965 0.8548 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2628 0.8965 0.8548 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2692 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 59 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .0UR7DM5PHQURQPLQVHOW, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-60 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-60.pt +Euclidean distance between 0 and 60: 21.251628875732422. +Interpolating between 0 and 60 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2689 0.9121 0.8747 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2492 0.9121 0.8747 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2388 0.9062 0.8681 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2357 0.9082 0.8726 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2361 0.9082 0.8726 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2372 0.9062 0.8696 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2401 0.9043 0.8658 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2480 0.9023 0.8626 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2617 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 60 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .LVTBTSVRN1QG304MD915, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-61 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-61.pt +Euclidean distance between 0 and 61: 23.931716918945312. +Interpolating between 0 and 61 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2813 0.9082 0.8712 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2382 0.9062 0.8689 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2333 0.9082 0.8712 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2693 0.9102 0.8763 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3234 0.8906 0.8600 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3313 0.8613 0.8322 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2762 0.8867 0.8592 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2330 0.8984 0.8660 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2437 0.8984 0.8610 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 61 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .ZWYHHU74FEU5AFYN80FK, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-62 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-62.pt +Euclidean distance between 0 and 62: 21.479890823364258. +Interpolating between 0 and 62 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2495 0.9199 0.8871 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2408 0.9180 0.8852 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2386 0.9141 0.8798 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2411 0.9121 0.8767 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2447 0.9043 0.8672 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2467 0.8984 0.8587 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2474 0.8965 0.8556 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2508 0.8945 0.8525 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2615 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 62 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .6BBCWB7SZ9S75X8HPRLD, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-63 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-63.pt +Euclidean distance between 0 and 63: 23.6658992767334. +Interpolating between 0 and 63 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2743 0.9102 0.8736 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2287 0.9121 0.8767 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2164 0.9062 0.8710 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2384 0.9023 0.8677 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2667 0.9023 0.8724 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2613 0.9062 0.8763 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2344 0.9062 0.8756 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2290 0.9023 0.8677 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2496 0.8984 0.8587 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 63 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .ECJI2WOW9PVH5FWN529P, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-64 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-64.pt +Euclidean distance between 0 and 64: 21.382226943969727. +Interpolating between 0 and 64 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2747 0.9043 0.8635 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2582 0.9043 0.8650 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2497 0.9062 0.8689 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2473 0.9082 0.8726 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2493 0.9102 0.8757 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2513 0.9082 0.8733 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2529 0.9023 0.8656 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2579 0.8984 0.8587 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2674 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 64 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .ZGCAL2A7UZI5GLM2SH1M, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-65 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-65.pt +Euclidean distance between 0 and 65: 21.383861541748047. +Interpolating between 0 and 65 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2909 0.9062 0.8659 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2667 0.9121 0.8753 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2545 0.9043 0.8658 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2525 0.9062 0.8681 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2553 0.9043 0.8658 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2580 0.9004 0.8603 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2591 0.9004 0.8603 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2613 0.8984 0.8571 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2686 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 65 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .XCUH2E9J6VXBXKK90WR9, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-66 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-66.pt +Euclidean distance between 0 and 66: 21.261234283447266. +Interpolating between 0 and 66 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2915 0.9023 0.8611 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2773 0.8984 0.8571 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2688 0.8965 0.8540 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2680 0.8984 0.8571 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2682 0.8984 0.8571 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2686 0.8945 0.8525 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2686 0.8965 0.8548 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2685 0.8965 0.8548 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2719 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 66 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .F3JDXQXE9128ZOW0YGW5, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-67 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-67.pt +Euclidean distance between 0 and 67: 21.330480575561523. +Interpolating between 0 and 67 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2840 0.9121 0.8767 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2617 0.9121 0.8760 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2503 0.9102 0.8729 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2463 0.9102 0.8729 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2476 0.9004 0.8618 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2490 0.9023 0.8649 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2485 0.8984 0.8587 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2519 0.8965 0.8548 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2623 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 67 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .Z6RO5XU8SN8TI02IUIVU, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-68 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-68.pt +Euclidean distance between 0 and 68: 23.92933464050293. +Interpolating between 0 and 68 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2661 0.9004 0.8603 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2279 0.9023 0.8634 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2216 0.9062 0.8681 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2482 0.9043 0.8658 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2935 0.9062 0.8710 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3029 0.8984 0.8673 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2548 0.9004 0.8702 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2204 0.9043 0.8707 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2369 0.8965 0.8564 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 68 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .UR839Q98F5U6VQ5MK588, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-69 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-69.pt +Euclidean distance between 0 and 69: 23.900989532470703. +Interpolating between 0 and 69 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2586 0.9199 0.8889 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2241 0.9141 0.8778 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2242 0.9160 0.8809 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2586 0.9062 0.8659 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3127 0.9043 0.8672 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3252 0.8887 0.8593 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2720 0.8789 0.8495 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2300 0.9043 0.8740 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2400 0.9043 0.8693 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 69 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .9FHQVUX7FJPBC00L575L, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-70 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-70.pt +Euclidean distance between 0 and 70: 23.17896270751953. +Interpolating between 0 and 70 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2865 0.8984 0.8556 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2394 0.9102 0.8743 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2201 0.9121 0.8787 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2222 0.9141 0.8824 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2303 0.9082 0.8760 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2334 0.9043 0.8714 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2361 0.9004 0.8640 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2438 0.8984 0.8595 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2593 0.8984 0.8579 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 70 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .7BWNB0LGEXFFGLUI8AHA, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-71 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-71.pt +Euclidean distance between 0 and 71: 21.161962509155273. +Interpolating between 0 and 71 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2573 0.9141 0.8778 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2510 0.9102 0.8722 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2476 0.9102 0.8722 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2468 0.9102 0.8722 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2472 0.9043 0.8650 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2478 0.9043 0.8643 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2488 0.9023 0.8626 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2531 0.9004 0.8610 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2635 0.8984 0.8579 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 71 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .2JZKG0C94NVWNFF64Y8O, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-72 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-72.pt +Euclidean distance between 0 and 72: 21.06609344482422. +Interpolating between 0 and 72 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2905 0.9102 0.8736 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2636 0.9121 0.8767 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2513 0.9062 0.8696 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2489 0.9043 0.8686 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2496 0.9023 0.8663 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2492 0.9004 0.8633 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2484 0.9023 0.8649 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2515 0.9004 0.8618 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2622 0.9004 0.8610 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 72 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .1HRR341Z78RDOBQWPV2L, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-73 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-73.pt +Euclidean distance between 0 and 73: 21.130163192749023. +Interpolating between 0 and 73 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2681 0.9062 0.8674 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2534 0.9082 0.8705 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2458 0.9023 0.8641 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2439 0.9023 0.8656 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2457 0.9004 0.8625 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2482 0.8965 0.8571 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2509 0.8945 0.8541 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2550 0.8945 0.8533 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2644 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 73 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .PDSJBA0LEPRAZJK58LR4, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-74 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-74.pt +Euclidean distance between 0 and 74: 21.47856330871582. +Interpolating between 0 and 74 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2635 0.9102 0.8729 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2566 0.9043 0.8643 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2553 0.9043 0.8658 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2561 0.9062 0.8689 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2614 0.9043 0.8650 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2672 0.9023 0.8619 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2712 0.8984 0.8571 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2727 0.9004 0.8603 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2753 0.9004 0.8603 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 74 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .ZLA4PQPFXFX4UY25HDRN, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-75 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-75.pt +Euclidean distance between 0 and 75: 21.534923553466797. +Interpolating between 0 and 75 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2969 0.9102 0.8729 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2833 0.9043 0.8643 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2746 0.8965 0.8532 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2690 0.8926 0.8485 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2667 0.8906 0.8462 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2678 0.8926 0.8501 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2678 0.8984 0.8579 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2658 0.9023 0.8619 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2693 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 75 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .HTDCL6KJ0RNKSAB2KID2, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-76 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-76.pt +Euclidean distance between 0 and 76: 21.855499267578125. +Interpolating between 0 and 76 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2524 0.9102 0.8736 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2368 0.9141 0.8804 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2316 0.9102 0.8750 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2341 0.9062 0.8717 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2378 0.9043 0.8693 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2396 0.9043 0.8686 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2407 0.9062 0.8710 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2463 0.8984 0.8587 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2597 0.9023 0.8634 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 76 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .VGEL1Y2TRA3BDWTRTVE2, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-77 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-77.pt +Euclidean distance between 0 and 77: 21.20987319946289. +Interpolating between 0 and 77 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2750 0.9043 0.8672 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2668 0.9062 0.8710 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2636 0.9004 0.8633 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2639 0.8984 0.8610 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2659 0.8965 0.8579 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2669 0.8965 0.8571 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2667 0.8984 0.8595 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2681 0.8965 0.8564 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2728 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 77 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .2JX98VH6TIUUYHZWK7G9, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-78 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-78.pt +Euclidean distance between 0 and 78: 23.707151412963867. +Interpolating between 0 and 78 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2846 0.9004 0.8618 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2372 0.9043 0.8672 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2224 0.9082 0.8740 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2361 0.9062 0.8730 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2580 0.8945 0.8615 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2580 0.8965 0.8658 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2400 0.9062 0.8763 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2324 0.9043 0.8707 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2483 0.9004 0.8625 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 78 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .DQNKB9Z5D9IEQ35VVRDV, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-79 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-79.pt +Euclidean distance between 0 and 79: 21.256675720214844. +Interpolating between 0 and 79 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2527 0.9180 0.8846 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2441 0.9160 0.8815 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2404 0.9199 0.8877 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2414 0.9180 0.8852 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2452 0.9160 0.8828 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2495 0.9082 0.8712 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2526 0.9023 0.8634 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2571 0.8984 0.8571 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2657 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 79 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .E3CJ415GLLHEDYA9HV0M, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-80 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-80.pt +Euclidean distance between 0 and 80: 21.262279510498047. +Interpolating between 0 and 80 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2608 0.9180 0.8833 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2493 0.9199 0.8871 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2436 0.9219 0.8901 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2437 0.9199 0.8889 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2482 0.9141 0.8811 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2527 0.9062 0.8703 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2552 0.9004 0.8603 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2587 0.9004 0.8603 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2670 0.9004 0.8603 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 80 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .P5Y4TIMQXFBSZPCD62S2, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-81 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-81.pt +Euclidean distance between 0 and 81: 21.337547302246094. +Interpolating between 0 and 81 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2687 0.9062 0.8681 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2562 0.9082 0.8698 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2492 0.9043 0.8650 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2476 0.9023 0.8619 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2495 0.8984 0.8564 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2521 0.8965 0.8540 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2526 0.8984 0.8571 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2559 0.8965 0.8556 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2655 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 81 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .IZMF1XRW1AJ1ZZPOXJO1, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-82 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-82.pt +Euclidean distance between 0 and 82: 23.339637756347656. +Interpolating between 0 and 82 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2408 0.9121 0.8760 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2116 0.9160 0.8828 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2046 0.9121 0.8794 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2187 0.9121 0.8806 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2365 0.9102 0.8796 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2414 0.9102 0.8796 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2385 0.9043 0.8707 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2442 0.9043 0.8686 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2596 0.8965 0.8556 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 82 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .51VFC6G5W2XHBPT2KUL8, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-83 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-83.pt +Euclidean distance between 0 and 83: 21.052045822143555. +Interpolating between 0 and 83 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2618 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2496 0.9121 0.8767 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2435 0.9043 0.8672 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2410 0.9043 0.8672 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2407 0.9023 0.8649 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2403 0.9023 0.8649 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2408 0.9023 0.8649 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2465 0.9004 0.8603 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2596 0.9004 0.8603 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 83 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .0FWGBLF1PQ9Q6V72PAMB, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-84 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-84.pt +Euclidean distance between 0 and 84: 21.553007125854492. +Interpolating between 0 and 84 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2776 0.9160 0.8815 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2570 0.9238 0.8937 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2479 0.9141 0.8817 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2473 0.9160 0.8859 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2514 0.9121 0.8806 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2559 0.9023 0.8663 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2583 0.9004 0.8633 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2606 0.9004 0.8618 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2676 0.9004 0.8610 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 84 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .RQIKTETADSLM95U58XFG, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-85 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-85.pt +Euclidean distance between 0 and 85: 21.261850357055664. +Interpolating between 0 and 85 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2756 0.9102 0.8729 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2655 0.9102 0.8736 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2591 0.9141 0.8804 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2560 0.9160 0.8835 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2552 0.9121 0.8787 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2544 0.9102 0.8757 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2530 0.9023 0.8649 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2543 0.9004 0.8603 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2628 0.9004 0.8595 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 85 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .Z1CR2V2NR01D4VZ6SW0J, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-86 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-86.pt +Euclidean distance between 0 and 86: 21.922229766845703. +Interpolating between 0 and 86 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2847 0.9004 0.8587 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2615 0.9023 0.8611 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2465 0.9023 0.8611 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2421 0.9023 0.8619 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2440 0.9043 0.8665 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2449 0.9004 0.8610 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2452 0.9004 0.8610 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2504 0.8965 0.8548 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2630 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 86 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .PANUS6MXUWQDNHFOB9PX, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-87 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-87.pt +Euclidean distance between 0 and 87: 21.259294509887695. +Interpolating between 0 and 87 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2546 0.9023 0.8603 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2484 0.9004 0.8579 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2480 0.9023 0.8619 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2526 0.9023 0.8626 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2575 0.9004 0.8603 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2632 0.8984 0.8579 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2668 0.9004 0.8603 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2684 0.8984 0.8579 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2721 0.9004 0.8595 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 87 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .IMG3OJQ9G9O8SMX8SZW4, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-88 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-88.pt +Euclidean distance between 0 and 88: 21.476964950561523. +Interpolating between 0 and 88 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2486 0.9160 0.8815 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2396 0.9141 0.8791 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2367 0.9141 0.8791 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2395 0.9062 0.8689 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2432 0.9043 0.8672 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2451 0.9023 0.8641 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2451 0.9062 0.8689 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2482 0.9082 0.8712 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2596 0.9023 0.8626 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 88 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .TD1ONE42RI8CFKX40EVJ, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-89 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-89.pt +Euclidean distance between 0 and 89: 21.515295028686523. +Interpolating between 0 and 89 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2795 0.9062 0.8689 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2673 0.9062 0.8681 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2611 0.9082 0.8719 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2598 0.9043 0.8665 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2614 0.9004 0.8595 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2626 0.8984 0.8571 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2605 0.8984 0.8571 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2595 0.8984 0.8571 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2659 0.9004 0.8595 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 89 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .WMF6UZR5Y4NLD7A3YOFP, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-90 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-90.pt +Euclidean distance between 0 and 90: 21.159460067749023. +Interpolating between 0 and 90 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2574 0.9102 0.8722 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2478 0.9141 0.8778 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2434 0.9121 0.8760 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2432 0.9082 0.8705 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2463 0.9062 0.8681 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2504 0.9043 0.8650 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2540 0.9023 0.8619 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2585 0.9004 0.8595 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2671 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 90 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .YZKAID6AMOA3A3IEBS4R, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-91 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-91.pt +Euclidean distance between 0 and 91: 20.98208999633789. +Interpolating between 0 and 91 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2774 0.9141 0.8791 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2609 0.9102 0.8743 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2502 0.9082 0.8719 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2446 0.9043 0.8672 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2431 0.9062 0.8710 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2425 0.9043 0.8679 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2431 0.9062 0.8703 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2487 0.9023 0.8634 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2612 0.9004 0.8603 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 91 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .QKV4PEA571WGHZ6BFLKQ, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-92 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-92.pt +Euclidean distance between 0 and 92: 22.774333953857422. +Interpolating between 0 and 92 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2933 0.9043 0.8635 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2541 0.9082 0.8705 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2373 0.9082 0.8712 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2339 0.9121 0.8787 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2392 0.9082 0.8740 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2455 0.9004 0.8640 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2502 0.8965 0.8587 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2564 0.9004 0.8625 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2667 0.8965 0.8556 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 92 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .L6BW08PD1WW0G4IWLHNM, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-93 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-93.pt +Euclidean distance between 0 and 93: 21.491504669189453. +Interpolating between 0 and 93 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2684 0.9121 0.8739 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2553 0.9043 0.8627 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2488 0.9023 0.8611 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2481 0.8965 0.8556 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2504 0.9023 0.8649 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2502 0.9004 0.8625 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2490 0.8965 0.8571 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2520 0.9004 0.8610 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2626 0.9004 0.8603 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 93 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .TWEYI7R0P1D9MXTWLL5N, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-94 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-94.pt +Euclidean distance between 0 and 94: 23.846912384033203. +Interpolating between 0 and 94 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2751 0.9121 0.8739 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2310 0.9062 0.8644 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2247 0.9082 0.8653 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2588 0.9004 0.8555 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3082 0.9043 0.8672 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3099 0.9004 0.8689 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2571 0.8945 0.8629 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2277 0.9004 0.8654 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2422 0.8906 0.8486 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 94 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .SEFM6L0DZ8IUACZPUO6Y, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-95 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-95.pt +Euclidean distance between 0 and 95: 21.164628982543945. +Interpolating between 0 and 95 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2586 0.9180 0.8840 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2544 0.9102 0.8736 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2524 0.9102 0.8750 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2516 0.9062 0.8710 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2529 0.9062 0.8710 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2558 0.9102 0.8770 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2580 0.9023 0.8656 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2618 0.8984 0.8595 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2686 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 95 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .YJHF1GJGSJF5MUNRH9SU, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-96 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-96.pt +Euclidean distance between 0 and 96: 21.18340301513672. +Interpolating between 0 and 96 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2750 0.9199 0.8871 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2612 0.9141 0.8798 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2541 0.9121 0.8774 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2515 0.9102 0.8750 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2533 0.9043 0.8672 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2543 0.9004 0.8618 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2539 0.9004 0.8610 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2564 0.8984 0.8571 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2654 0.8965 0.8548 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 96 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .5HBRJN8TYMEN384GC8DQ, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-97 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-97.pt +Euclidean distance between 0 and 97: 21.652006149291992. +Interpolating between 0 and 97 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2718 0.9043 0.8650 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2521 0.9023 0.8626 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2435 0.9062 0.8689 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2437 0.9004 0.8610 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2469 0.9004 0.8610 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2499 0.8965 0.8556 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2512 0.8965 0.8548 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2556 0.8965 0.8548 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2663 0.8984 0.8571 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 97 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .VY78YWVY0YJFRXJW79KU, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-98 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-98.pt +Euclidean distance between 0 and 98: 21.460596084594727. +Interpolating between 0 and 98 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2615 0.9043 0.8643 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2446 0.9062 0.8681 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2370 0.9121 0.8767 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2366 0.9082 0.8712 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2399 0.9023 0.8641 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2431 0.9043 0.8679 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2454 0.9062 0.8703 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2513 0.9023 0.8641 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2628 0.8984 0.8579 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 98 +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Encountered Error: connectivity/bert_ft_qqp-0 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-0.pt +Creating .922XP9LT4MFL05ELLUYE, for loading in git data +Encountered Error: connectivity/bert_ft_qqp-99 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-99.pt +Euclidean distance between 0 and 99: 23.25368309020996. +Interpolating between 0 and 99 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2525 0.9121 0.8747 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2218 0.9082 0.8698 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2123 0.9141 0.8798 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2192 0.9141 0.8817 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2304 0.9043 0.8714 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2339 0.9023 0.8684 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2322 0.9062 0.8730 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2395 0.9023 0.8649 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2569 0.8965 0.8556 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2819 0.8965 0.8548 +Completed interpolation from 0 to 99 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Euclidean distance between 1 and 2: 21.429046630859375. +Interpolating between 1 and 2 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2856 0.9102 0.8729 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2674 0.9121 0.8760 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2586 0.9102 0.8736 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2543 0.9141 0.8798 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2510 0.9121 0.8774 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2484 0.9141 0.8804 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2478 0.9121 0.8774 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2520 0.9082 0.8712 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2620 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 2 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-3 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-3.pt +Euclidean distance between 1 and 3: 21.079143524169922. +Interpolating between 1 and 3 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2570 0.9160 0.8815 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2461 0.9160 0.8822 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2400 0.9141 0.8804 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2379 0.9121 0.8780 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2375 0.9082 0.8719 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2407 0.9062 0.8689 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2431 0.9062 0.8696 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2496 0.9102 0.8743 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2614 0.9141 0.8785 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 3 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-4 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-4.pt +Euclidean distance between 1 and 4: 22.38309097290039. +Interpolating between 1 and 4 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2649 0.9102 0.8736 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2414 0.9102 0.8736 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2330 0.9121 0.8774 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2382 0.9082 0.8719 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2478 0.9102 0.8770 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2506 0.9043 0.8686 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2495 0.9062 0.8710 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2527 0.9062 0.8703 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2620 0.9102 0.8743 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 4 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-5 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-5.pt +Euclidean distance between 1 and 5: 21.41653060913086. +Interpolating between 1 and 5 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2900 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2740 0.9102 0.8729 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2633 0.9102 0.8743 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2571 0.9082 0.8719 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2545 0.9062 0.8696 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2533 0.9062 0.8696 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2534 0.9062 0.8696 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2556 0.9062 0.8696 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2623 0.9102 0.8736 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 5 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-6 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-6.pt +Euclidean distance between 1 and 6: 21.191505432128906. +Interpolating between 1 and 6 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2830 0.9043 0.8635 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2670 0.9082 0.8705 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2581 0.9062 0.8689 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2518 0.9062 0.8689 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2475 0.9062 0.8696 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2451 0.9102 0.8757 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2447 0.9102 0.8750 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2493 0.9102 0.8743 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2593 0.9160 0.8815 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 6 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-7 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-7.pt +Euclidean distance between 1 and 7: 24.265121459960938. +Interpolating between 1 and 7 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2917 0.9160 0.8828 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2345 0.9102 0.8743 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2320 0.9043 0.8658 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.3049 0.9004 0.8571 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.4459 0.8848 0.8460 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.4854 0.7637 0.7474 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.3532 0.8359 0.8073 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2472 0.9004 0.8709 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2345 0.9023 0.8677 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 7 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-8 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-8.pt +Euclidean distance between 1 and 8: 21.487340927124023. +Interpolating between 1 and 8 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2796 0.9102 0.8736 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2700 0.9043 0.8665 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2677 0.9004 0.8625 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2692 0.8965 0.8587 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2703 0.9023 0.8677 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2669 0.9004 0.8647 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2621 0.8984 0.8617 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2592 0.9023 0.8656 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2633 0.9102 0.8743 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 8 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-9 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-9.pt +Euclidean distance between 1 and 9: 21.067447662353516. +Interpolating between 1 and 9 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2856 0.9121 0.8760 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2622 0.9082 0.8712 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2487 0.9062 0.8696 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2426 0.9082 0.8719 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2408 0.9062 0.8696 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2410 0.9062 0.8696 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2421 0.9121 0.8767 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2472 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2586 0.9160 0.8815 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 9 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-10 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-10.pt +Euclidean distance between 1 and 10: 21.733047485351562. +Interpolating between 1 and 10 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2707 0.9160 0.8828 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2594 0.9121 0.8767 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2548 0.9121 0.8780 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2560 0.9082 0.8726 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2552 0.9082 0.8733 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2529 0.9141 0.8817 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2522 0.9121 0.8787 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2560 0.9141 0.8804 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2639 0.9141 0.8791 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 10 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-11 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-11.pt +Euclidean distance between 1 and 11: 24.022069931030273. +Interpolating between 1 and 11 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2755 0.9062 0.8681 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2281 0.9043 0.8665 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2256 0.9121 0.8780 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2723 0.9082 0.8740 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3208 0.8984 0.8680 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2954 0.8809 0.8479 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2491 0.8926 0.8601 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2319 0.9082 0.8760 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2435 0.9121 0.8780 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 11 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-12 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-12.pt +Euclidean distance between 1 and 12: 23.957796096801758. +Interpolating between 1 and 12 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2858 0.8984 0.8595 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2298 0.9062 0.8703 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2208 0.9062 0.8703 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2550 0.9043 0.8693 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2836 0.8984 0.8667 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2677 0.8965 0.8645 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2455 0.8965 0.8638 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2384 0.9082 0.8766 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2484 0.9102 0.8757 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 12 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-13 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-13.pt +Euclidean distance between 1 and 13: 22.911296844482422. +Interpolating between 1 and 13 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2493 0.9062 0.8667 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2307 0.9082 0.8698 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2265 0.9082 0.8698 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2338 0.9102 0.8736 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2414 0.9043 0.8686 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2412 0.9062 0.8723 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2399 0.9062 0.8717 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2439 0.9082 0.8733 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2559 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 13 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-14 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-14.pt +Euclidean distance between 1 and 14: 21.19967269897461. +Interpolating between 1 and 14 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2803 0.9043 0.8650 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2697 0.9004 0.8603 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2664 0.9004 0.8618 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2662 0.9062 0.8710 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2656 0.9023 0.8649 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2617 0.9062 0.8703 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2572 0.9043 0.8672 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2569 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2648 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 14 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-15 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-15.pt +Euclidean distance between 1 and 15: 21.178808212280273. +Interpolating between 1 and 15 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2780 0.9141 0.8804 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2606 0.9160 0.8835 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2491 0.9102 0.8750 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2422 0.9121 0.8774 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2401 0.9102 0.8763 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2405 0.9102 0.8763 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2430 0.9082 0.8733 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2478 0.9121 0.8774 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2582 0.9141 0.8791 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 15 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-16 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-16.pt +Euclidean distance between 1 and 16: 21.871509552001953. +Interpolating between 1 and 16 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2572 0.9121 0.8760 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2497 0.9082 0.8705 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2507 0.9082 0.8712 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2528 0.9082 0.8719 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2520 0.9102 0.8750 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2498 0.9102 0.8750 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2490 0.9121 0.8780 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2518 0.9121 0.8774 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2603 0.9141 0.8791 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 16 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-17 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-17.pt +Euclidean distance between 1 and 17: 24.189420700073242. +Interpolating between 1 and 17 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2750 0.9062 0.8681 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2272 0.9043 0.8650 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2298 0.9023 0.8603 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.3086 0.8926 0.8415 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.4334 0.8945 0.8622 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.4347 0.7793 0.7559 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.3255 0.8496 0.8213 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2565 0.8965 0.8665 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2456 0.9023 0.8670 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 17 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-18 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-18.pt +Euclidean distance between 1 and 18: 21.365942001342773. +Interpolating between 1 and 18 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2570 0.9102 0.8729 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2400 0.9121 0.8760 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2307 0.9062 0.8689 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2287 0.9062 0.8703 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2303 0.9043 0.8686 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2322 0.9082 0.8747 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2342 0.9102 0.8770 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2402 0.9102 0.8743 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2545 0.9141 0.8791 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 18 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-19 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-19.pt +Euclidean distance between 1 and 19: 21.547237396240234. +Interpolating between 1 and 19 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2572 0.9219 0.8901 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2435 0.9199 0.8877 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2364 0.9199 0.8877 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2353 0.9180 0.8859 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2376 0.9121 0.8780 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2400 0.9121 0.8774 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2427 0.9121 0.8774 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2480 0.9141 0.8791 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2584 0.9180 0.8840 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 19 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-20 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-20.pt +Euclidean distance between 1 and 20: 21.669565200805664. +Interpolating between 1 and 20 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.3024 0.9004 0.8610 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2775 0.9023 0.8649 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2638 0.9043 0.8679 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2608 0.9082 0.8733 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2588 0.9062 0.8710 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2551 0.9043 0.8693 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2526 0.9043 0.8679 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2544 0.9121 0.8780 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2622 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 20 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-21 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-21.pt +Euclidean distance between 1 and 21: 21.626928329467773. +Interpolating between 1 and 21 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2693 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2697 0.9121 0.8767 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2764 0.9082 0.8733 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2848 0.9082 0.8740 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2899 0.9062 0.8717 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2822 0.9082 0.8747 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2693 0.9062 0.8717 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2627 0.9121 0.8780 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2659 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 21 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-22 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-22.pt +Euclidean distance between 1 and 22: 24.178495407104492. +Interpolating between 1 and 22 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2642 0.9082 0.8719 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2251 0.9082 0.8719 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2246 0.9121 0.8767 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2708 0.9062 0.8674 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3394 0.9004 0.8647 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3304 0.8770 0.8460 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2584 0.8926 0.8642 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2267 0.9102 0.8808 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2393 0.9102 0.8770 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 22 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-23 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-23.pt +Euclidean distance between 1 and 23: 23.581863403320312. +Interpolating between 1 and 23 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2711 0.8984 0.8587 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2287 0.9062 0.8696 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2167 0.9082 0.8726 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2323 0.9082 0.8753 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2526 0.9043 0.8714 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2524 0.9004 0.8661 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2413 0.8984 0.8632 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2391 0.9082 0.8747 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2518 0.9102 0.8750 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 23 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-24 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-24.pt +Euclidean distance between 1 and 24: 21.682104110717773. +Interpolating between 1 and 24 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2786 0.8984 0.8556 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2749 0.9062 0.8681 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2749 0.9062 0.8689 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2788 0.9004 0.8618 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2797 0.8984 0.8602 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2721 0.9004 0.8640 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2646 0.9004 0.8633 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2600 0.9082 0.8726 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2626 0.9121 0.8774 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 24 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-25 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-25.pt +Euclidean distance between 1 and 25: 21.47683334350586. +Interpolating between 1 and 25 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2752 0.9102 0.8722 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2749 0.9102 0.8729 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2825 0.9102 0.8743 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2958 0.9121 0.8767 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3012 0.9102 0.8736 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2891 0.9121 0.8767 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2717 0.9102 0.8743 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2624 0.9102 0.8743 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2654 0.9141 0.8791 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 25 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-26 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-26.pt +Euclidean distance between 1 and 26: 21.331809997558594. +Interpolating between 1 and 26 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2601 0.9141 0.8771 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2444 0.9141 0.8791 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2366 0.9082 0.8726 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2362 0.9062 0.8710 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2384 0.9121 0.8794 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2401 0.9102 0.8770 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2417 0.9102 0.8757 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2458 0.9121 0.8774 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2579 0.9141 0.8791 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 26 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-27 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-27.pt +Euclidean distance between 1 and 27: 21.693477630615234. +Interpolating between 1 and 27 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2369 0.9199 0.8864 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2233 0.9180 0.8846 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2185 0.9160 0.8828 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2205 0.9160 0.8841 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2259 0.9141 0.8817 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2311 0.9102 0.8777 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2350 0.9121 0.8800 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2411 0.9160 0.8841 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2549 0.9141 0.8791 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 27 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-28 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-28.pt +Euclidean distance between 1 and 28: 21.12590980529785. +Interpolating between 1 and 28 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2705 0.9062 0.8681 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2632 0.9062 0.8681 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2584 0.9082 0.8705 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2556 0.9141 0.8791 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2546 0.9141 0.8804 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2516 0.9121 0.8780 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2488 0.9160 0.8828 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2511 0.9121 0.8767 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2614 0.9180 0.8840 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 28 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-29 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-29.pt +Euclidean distance between 1 and 29: 21.22467041015625. +Interpolating between 1 and 29 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2667 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2651 0.9082 0.8719 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2672 0.9102 0.8750 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2687 0.9121 0.8774 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2656 0.9141 0.8804 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2606 0.9160 0.8828 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2570 0.9141 0.8798 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2579 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2653 0.9160 0.8809 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 29 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-30 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-30.pt +Euclidean distance between 1 and 30: 21.651891708374023. +Interpolating between 1 and 30 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2733 0.9062 0.8674 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2521 0.9102 0.8729 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2410 0.9082 0.8726 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2375 0.9062 0.8710 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2377 0.9062 0.8723 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2381 0.9102 0.8770 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2382 0.9121 0.8794 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2427 0.9121 0.8774 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2555 0.9141 0.8791 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 30 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-31 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-31.pt +Euclidean distance between 1 and 31: 24.15460968017578. +Interpolating between 1 and 31 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2781 0.9062 0.8674 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2301 0.9102 0.8736 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2332 0.9023 0.8603 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.3015 0.8867 0.8324 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.4086 0.8965 0.8579 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.4230 0.8008 0.7783 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.3221 0.8555 0.8279 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2464 0.9004 0.8702 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2390 0.9043 0.8700 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 31 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-32 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-32.pt +Euclidean distance between 1 and 32: 21.09274673461914. +Interpolating between 1 and 32 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2753 0.9043 0.8658 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2637 0.9023 0.8634 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2562 0.9023 0.8641 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2515 0.9082 0.8733 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2486 0.9062 0.8710 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2468 0.9043 0.8679 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2467 0.9082 0.8726 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2507 0.9082 0.8712 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2606 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 32 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-33 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-33.pt +Euclidean distance between 1 and 33: 24.003156661987305. +Interpolating between 1 and 33 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2708 0.9062 0.8652 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2234 0.9082 0.8691 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2157 0.9141 0.8798 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2442 0.9043 0.8665 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2777 0.8926 0.8579 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2690 0.8926 0.8608 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2418 0.9004 0.8689 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2318 0.9102 0.8783 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2444 0.9102 0.8757 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 33 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-34 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-34.pt +Euclidean distance between 1 and 34: 21.17512321472168. +Interpolating between 1 and 34 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2721 0.9023 0.8619 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2571 0.9043 0.8658 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2480 0.9062 0.8689 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2440 0.9062 0.8689 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2425 0.9082 0.8719 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2414 0.9082 0.8719 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2415 0.9102 0.8750 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2456 0.9121 0.8774 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2568 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 34 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-35 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-35.pt +Euclidean distance between 1 and 35: 20.994709014892578. +Interpolating between 1 and 35 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2786 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2654 0.9062 0.8681 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2553 0.9062 0.8689 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2480 0.9062 0.8689 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2439 0.9082 0.8712 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2421 0.9102 0.8743 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2423 0.9121 0.8767 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2467 0.9121 0.8760 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2585 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 35 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-36 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-36.pt +Euclidean distance between 1 and 36: 21.214418411254883. +Interpolating between 1 and 36 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2945 0.9141 0.8791 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2707 0.9121 0.8774 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2555 0.9121 0.8780 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2478 0.9141 0.8811 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2446 0.9141 0.8811 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2437 0.9102 0.8763 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2443 0.9082 0.8726 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2476 0.9102 0.8743 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2581 0.9102 0.8743 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 36 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-37 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-37.pt +Euclidean distance between 1 and 37: 21.501747131347656. +Interpolating between 1 and 37 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2673 0.9121 0.8760 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2504 0.9082 0.8712 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2437 0.9062 0.8681 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2435 0.9004 0.8603 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2448 0.9082 0.8726 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2440 0.9102 0.8750 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2443 0.9102 0.8750 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2475 0.9141 0.8798 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2588 0.9160 0.8815 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 37 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-38 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-38.pt +Euclidean distance between 1 and 38: 21.343961715698242. +Interpolating between 1 and 38 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2651 0.9102 0.8729 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2541 0.9082 0.8712 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2464 0.9082 0.8719 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2424 0.9121 0.8780 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2406 0.9102 0.8757 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2402 0.9121 0.8787 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2412 0.9121 0.8780 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2463 0.9102 0.8743 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2576 0.9141 0.8791 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 38 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-39 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-39.pt +Euclidean distance between 1 and 39: 21.142162322998047. +Interpolating between 1 and 39 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2638 0.9219 0.8907 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2574 0.9238 0.8932 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2536 0.9141 0.8785 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2525 0.9121 0.8760 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2511 0.9121 0.8760 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2487 0.9121 0.8767 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2474 0.9180 0.8846 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2508 0.9160 0.8815 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2613 0.9160 0.8809 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 39 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-40 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-40.pt +Euclidean distance between 1 and 40: 21.93994140625. +Interpolating between 1 and 40 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2763 0.9160 0.8815 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2507 0.9160 0.8828 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2375 0.9160 0.8828 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2350 0.9102 0.8757 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2370 0.9141 0.8817 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2381 0.9082 0.8747 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2389 0.9102 0.8763 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2437 0.9121 0.8780 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2560 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 40 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-41 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-41.pt +Euclidean distance between 1 and 41: 21.281192779541016. +Interpolating between 1 and 41 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2713 0.9082 0.8712 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2673 0.9062 0.8689 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2674 0.9062 0.8696 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2686 0.9062 0.8703 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2647 0.9023 0.8649 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2576 0.9004 0.8618 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2550 0.9023 0.8641 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2568 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2638 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 41 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-42 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-42.pt +Euclidean distance between 1 and 42: 21.56145668029785. +Interpolating between 1 and 42 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2910 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2780 0.9023 0.8626 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2708 0.9004 0.8603 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2666 0.9004 0.8610 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2642 0.8984 0.8595 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2616 0.9023 0.8656 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2596 0.9023 0.8656 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2595 0.9023 0.8649 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2638 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 42 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-43 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-43.pt +Euclidean distance between 1 and 43: 21.23941993713379. +Interpolating between 1 and 43 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2748 0.9141 0.8785 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2577 0.9121 0.8760 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2459 0.9082 0.8712 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2392 0.9141 0.8798 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2364 0.9160 0.8822 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2357 0.9121 0.8774 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2378 0.9102 0.8743 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2449 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2574 0.9141 0.8785 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 43 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-44 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-44.pt +Euclidean distance between 1 and 44: 21.350278854370117. +Interpolating between 1 and 44 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2833 0.9023 0.8603 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2630 0.9043 0.8650 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2513 0.9062 0.8681 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2469 0.9062 0.8696 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2460 0.9004 0.8625 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2457 0.9023 0.8649 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2462 0.9082 0.8726 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2504 0.9082 0.8719 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2598 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 44 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-45 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-45.pt +Euclidean distance between 1 and 45: 21.16754913330078. +Interpolating between 1 and 45 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2410 0.9219 0.8901 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2278 0.9219 0.8913 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2213 0.9199 0.8889 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2206 0.9160 0.8841 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2229 0.9121 0.8794 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2259 0.9121 0.8787 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2298 0.9082 0.8726 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2378 0.9082 0.8712 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2540 0.9180 0.8840 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 45 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-46 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-46.pt +Euclidean distance between 1 and 46: 21.54477882385254. +Interpolating between 1 and 46 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2648 0.9102 0.8722 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2496 0.9121 0.8760 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2411 0.9102 0.8743 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2367 0.9082 0.8719 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2365 0.9043 0.8672 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2377 0.9043 0.8679 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2396 0.9023 0.8656 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2451 0.9043 0.8672 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2555 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 46 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-47 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-47.pt +Euclidean distance between 1 and 47: 22.69899559020996. +Interpolating between 1 and 47 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2680 0.9121 0.8760 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2483 0.9082 0.8719 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2414 0.9062 0.8689 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2450 0.9082 0.8733 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2495 0.9082 0.8740 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2500 0.9023 0.8670 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2468 0.9062 0.8723 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2477 0.9102 0.8770 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2566 0.9141 0.8798 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 47 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-48 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-48.pt +Euclidean distance between 1 and 48: 21.718921661376953. +Interpolating between 1 and 48 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2645 0.9199 0.8864 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2486 0.9102 0.8743 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2442 0.9141 0.8817 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2477 0.9082 0.8753 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2524 0.9082 0.8766 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2517 0.9062 0.8737 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2496 0.9043 0.8700 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2506 0.9062 0.8717 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2584 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 48 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-49 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-49.pt +Euclidean distance between 1 and 49: 21.436481475830078. +Interpolating between 1 and 49 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2938 0.9062 0.8659 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2758 0.9043 0.8650 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2623 0.9082 0.8698 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2541 0.9062 0.8689 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2508 0.9082 0.8719 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2484 0.9082 0.8726 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2465 0.9121 0.8787 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2489 0.9082 0.8719 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2581 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 49 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-50 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-50.pt +Euclidean distance between 1 and 50: 21.103185653686523. +Interpolating between 1 and 50 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2784 0.9141 0.8798 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2638 0.9062 0.8696 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2535 0.9062 0.8703 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2443 0.9062 0.8703 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2389 0.9102 0.8757 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2364 0.9141 0.8804 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2373 0.9141 0.8791 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2429 0.9160 0.8815 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2561 0.9160 0.8809 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 50 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-51 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-51.pt +Euclidean distance between 1 and 51: 21.542879104614258. +Interpolating between 1 and 51 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2795 0.9062 0.8681 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2636 0.9062 0.8681 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2552 0.9023 0.8634 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2513 0.9043 0.8672 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2495 0.9004 0.8625 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2483 0.9043 0.8686 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2469 0.9082 0.8733 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2481 0.9102 0.8757 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2576 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 51 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-52 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-52.pt +Euclidean distance between 1 and 52: 21.469635009765625. +Interpolating between 1 and 52 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2842 0.9121 0.8753 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2641 0.9121 0.8753 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2518 0.9082 0.8705 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2467 0.9023 0.8626 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2454 0.9004 0.8603 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2437 0.9043 0.8672 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2425 0.9062 0.8703 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2454 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2571 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 52 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-53 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-53.pt +Euclidean distance between 1 and 53: 24.128726959228516. +Interpolating between 1 and 53 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2750 0.9082 0.8712 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2291 0.9062 0.8689 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2263 0.9004 0.8603 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2722 0.9043 0.8643 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3354 0.8965 0.8616 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3134 0.8848 0.8557 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2583 0.8867 0.8550 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2320 0.9141 0.8854 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2409 0.9082 0.8740 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 53 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-54 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-54.pt +Euclidean distance between 1 and 54: 21.128639221191406. +Interpolating between 1 and 54 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2850 0.9141 0.8791 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2702 0.9180 0.8852 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2610 0.9160 0.8835 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2556 0.9160 0.8835 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2521 0.9160 0.8835 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2498 0.9141 0.8804 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2495 0.9121 0.8774 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2535 0.9082 0.8712 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2633 0.9141 0.8791 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 54 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-55 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-55.pt +Euclidean distance between 1 and 55: 21.25243377685547. +Interpolating between 1 and 55 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2653 0.9141 0.8778 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2472 0.9121 0.8753 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2359 0.9141 0.8785 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2316 0.9141 0.8785 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2312 0.9102 0.8736 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2324 0.9102 0.8757 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2360 0.9121 0.8780 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2432 0.9141 0.8798 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2565 0.9160 0.8815 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 55 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-56 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-56.pt +Euclidean distance between 1 and 56: 21.39999008178711. +Interpolating between 1 and 56 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2727 0.9082 0.8676 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2517 0.9121 0.8747 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2418 0.9121 0.8753 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2391 0.9082 0.8719 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2374 0.9043 0.8679 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2366 0.9062 0.8710 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2377 0.9062 0.8710 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2432 0.9102 0.8750 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2569 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 56 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-57 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-57.pt +Euclidean distance between 1 and 57: 21.728809356689453. +Interpolating between 1 and 57 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2734 0.9062 0.8667 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2495 0.9043 0.8650 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2382 0.9082 0.8719 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2366 0.9023 0.8649 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2390 0.9023 0.8649 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2399 0.9043 0.8672 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2404 0.9043 0.8679 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2443 0.9121 0.8780 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2566 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 57 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-58 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-58.pt +Euclidean distance between 1 and 58: 21.471343994140625. +Interpolating between 1 and 58 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2916 0.9023 0.8641 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2889 0.9004 0.8618 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2918 0.9043 0.8672 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2943 0.9023 0.8649 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2877 0.9023 0.8649 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2782 0.9043 0.8672 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2703 0.9004 0.8610 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2671 0.9082 0.8712 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2698 0.9082 0.8705 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 58 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-59 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-59.pt +Euclidean distance between 1 and 59: 21.254114151000977. +Interpolating between 1 and 59 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2812 0.9102 0.8722 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2627 0.9082 0.8705 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2521 0.9082 0.8705 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2480 0.9062 0.8681 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2463 0.9062 0.8696 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2451 0.9062 0.8696 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2453 0.9082 0.8719 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2495 0.9141 0.8798 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2607 0.9160 0.8809 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 59 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-60 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-60.pt +Euclidean distance between 1 and 60: 21.601146697998047. +Interpolating between 1 and 60 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2689 0.9121 0.8747 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2595 0.9102 0.8715 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2546 0.9082 0.8698 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2527 0.9102 0.8729 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2517 0.9043 0.8650 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2497 0.9062 0.8681 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2492 0.9082 0.8712 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2523 0.9121 0.8767 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2619 0.9141 0.8785 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 60 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-61 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-61.pt +Euclidean distance between 1 and 61: 24.263704299926758. +Interpolating between 1 and 61 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2813 0.9082 0.8712 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2341 0.9102 0.8743 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2384 0.9062 0.8674 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.3107 0.9082 0.8698 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.4191 0.8535 0.8092 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.4119 0.8008 0.7733 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.3025 0.8574 0.8274 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2426 0.9102 0.8814 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2429 0.9062 0.8710 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 61 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-62 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-62.pt +Euclidean distance between 1 and 62: 21.590381622314453. +Interpolating between 1 and 62 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2495 0.9199 0.8871 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2400 0.9160 0.8835 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2378 0.9160 0.8841 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2405 0.9082 0.8747 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2450 0.9043 0.8700 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2466 0.9043 0.8700 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2467 0.9043 0.8693 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2489 0.9082 0.8733 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2570 0.9121 0.8774 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 62 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-63 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-63.pt +Euclidean distance between 1 and 63: 23.985374450683594. +Interpolating between 1 and 63 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2743 0.9102 0.8736 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2261 0.9121 0.8767 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2195 0.9102 0.8750 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2555 0.9043 0.8693 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2942 0.8965 0.8645 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2758 0.8945 0.8629 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2416 0.8965 0.8630 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2305 0.9102 0.8783 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2448 0.9141 0.8798 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 63 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-64 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-64.pt +Euclidean distance between 1 and 64: 21.547588348388672. +Interpolating between 1 and 64 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2747 0.9043 0.8635 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2556 0.9023 0.8619 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2452 0.9062 0.8681 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2411 0.9062 0.8681 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2382 0.9082 0.8705 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2350 0.9102 0.8736 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2331 0.9102 0.8750 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2377 0.9141 0.8798 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2526 0.9180 0.8840 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 64 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-65 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-65.pt +Euclidean distance between 1 and 65: 21.488224029541016. +Interpolating between 1 and 65 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2909 0.9062 0.8659 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2643 0.9121 0.8747 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2499 0.9082 0.8712 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2451 0.9023 0.8649 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2448 0.9102 0.8763 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2444 0.9121 0.8794 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2446 0.9102 0.8763 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2485 0.9141 0.8804 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2592 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 65 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-66 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-66.pt +Euclidean distance between 1 and 66: 21.203304290771484. +Interpolating between 1 and 66 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2915 0.9023 0.8611 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2715 0.9043 0.8650 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2572 0.9082 0.8705 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2488 0.9043 0.8658 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2447 0.9043 0.8658 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2438 0.9082 0.8712 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2441 0.9102 0.8743 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2485 0.9141 0.8791 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2592 0.9160 0.8815 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 66 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-67 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-67.pt +Euclidean distance between 1 and 67: 21.419713973999023. +Interpolating between 1 and 67 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2840 0.9121 0.8767 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2640 0.9121 0.8767 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2519 0.9121 0.8767 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2463 0.9121 0.8774 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2432 0.9082 0.8719 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2421 0.9062 0.8689 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2434 0.9141 0.8804 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2480 0.9121 0.8774 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2592 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 67 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-68 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-68.pt +Euclidean distance between 1 and 68: 24.20501136779785. +Interpolating between 1 and 68 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2661 0.9004 0.8603 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2276 0.9023 0.8626 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2247 0.9004 0.8571 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2632 0.8867 0.8324 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3216 0.8809 0.8252 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3076 0.8926 0.8564 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2441 0.8965 0.8645 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2218 0.9082 0.8760 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2375 0.9082 0.8733 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 68 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-69 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-69.pt +Euclidean distance between 1 and 69: 24.186431884765625. +Interpolating between 1 and 69 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2586 0.9199 0.8889 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2200 0.9121 0.8747 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2266 0.9121 0.8753 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2858 0.8984 0.8514 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3724 0.9023 0.8641 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3730 0.8477 0.8194 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2902 0.8809 0.8530 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2373 0.9023 0.8724 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2391 0.9082 0.8747 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 69 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-70 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-70.pt +Euclidean distance between 1 and 70: 23.545297622680664. +Interpolating between 1 and 70 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2865 0.8984 0.8556 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2340 0.9062 0.8689 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2197 0.9043 0.8672 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2359 0.9102 0.8770 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2528 0.9082 0.8760 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2475 0.9082 0.8766 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2380 0.9082 0.8766 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2385 0.9062 0.8723 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2514 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 70 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-71 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-71.pt +Euclidean distance between 1 and 71: 21.209918975830078. +Interpolating between 1 and 71 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2573 0.9141 0.8778 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2494 0.9160 0.8815 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2437 0.9141 0.8791 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2416 0.9160 0.8828 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2409 0.9141 0.8798 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2404 0.9141 0.8798 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2413 0.9180 0.8852 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2461 0.9160 0.8815 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2585 0.9160 0.8809 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 71 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-72 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-72.pt +Euclidean distance between 1 and 72: 21.26264190673828. +Interpolating between 1 and 72 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2905 0.9102 0.8736 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2735 0.9102 0.8736 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2647 0.9141 0.8804 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2589 0.9121 0.8774 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2574 0.9062 0.8696 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2561 0.9082 0.8719 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2558 0.9082 0.8712 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2588 0.9082 0.8712 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2659 0.9141 0.8791 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 72 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-73 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-73.pt +Euclidean distance between 1 and 73: 21.004480361938477. +Interpolating between 1 and 73 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2681 0.9062 0.8674 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2537 0.9102 0.8736 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2437 0.9102 0.8736 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2374 0.9062 0.8689 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2349 0.9062 0.8696 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2350 0.9062 0.8696 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2377 0.9121 0.8780 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2440 0.9121 0.8774 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2570 0.9180 0.8840 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 73 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-74 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-74.pt +Euclidean distance between 1 and 74: 21.318246841430664. +Interpolating between 1 and 74 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2635 0.9102 0.8729 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2512 0.9102 0.8729 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2445 0.9082 0.8719 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2420 0.9082 0.8726 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2411 0.9043 0.8679 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2410 0.9043 0.8679 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2416 0.9082 0.8726 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2456 0.9102 0.8743 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2569 0.9160 0.8815 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 74 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-75 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-75.pt +Euclidean distance between 1 and 75: 21.4948787689209. +Interpolating between 1 and 75 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2969 0.9102 0.8729 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2778 0.9062 0.8667 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2650 0.9023 0.8626 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2574 0.9004 0.8603 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2554 0.9023 0.8641 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2528 0.9004 0.8618 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2507 0.9023 0.8641 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2532 0.9062 0.8689 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2598 0.9102 0.8736 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 75 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-76 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-76.pt +Euclidean distance between 1 and 76: 22.20606803894043. +Interpolating between 1 and 76 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2524 0.9102 0.8736 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2388 0.9141 0.8804 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2388 0.9082 0.8733 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2508 0.9043 0.8700 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2561 0.9043 0.8707 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2522 0.9004 0.8661 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2488 0.9043 0.8700 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2506 0.9121 0.8787 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2585 0.9141 0.8791 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 76 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-77 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-77.pt +Euclidean distance between 1 and 77: 21.34046745300293. +Interpolating between 1 and 77 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2750 0.9043 0.8672 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2617 0.9043 0.8672 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2542 0.9062 0.8696 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2514 0.9043 0.8672 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2499 0.9062 0.8696 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2469 0.9102 0.8743 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2447 0.9102 0.8743 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2472 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2586 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 77 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-78 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-78.pt +Euclidean distance between 1 and 78: 24.02570152282715. +Interpolating between 1 and 78 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2846 0.9004 0.8618 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2342 0.9043 0.8672 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2227 0.9102 0.8763 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2478 0.9062 0.8730 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2833 0.8945 0.8643 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2799 0.8789 0.8473 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2548 0.8984 0.8667 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2407 0.9062 0.8743 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2482 0.9102 0.8763 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 78 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-79 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-79.pt +Euclidean distance between 1 and 79: 21.332983016967773. +Interpolating between 1 and 79 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2527 0.9180 0.8846 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2407 0.9180 0.8846 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2354 0.9199 0.8877 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2385 0.9121 0.8767 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2419 0.9082 0.8726 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2440 0.9062 0.8696 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2452 0.9082 0.8726 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2491 0.9141 0.8798 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2592 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 79 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-80 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-80.pt +Euclidean distance between 1 and 80: 21.38728141784668. +Interpolating between 1 and 80 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2608 0.9180 0.8833 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2561 0.9219 0.8895 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2573 0.9180 0.8840 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2609 0.9180 0.8840 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2599 0.9160 0.8815 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2553 0.9180 0.8846 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2514 0.9160 0.8822 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2530 0.9180 0.8846 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2623 0.9160 0.8815 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 80 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-81 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-81.pt +Euclidean distance between 1 and 81: 21.394317626953125. +Interpolating between 1 and 81 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2687 0.9062 0.8681 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2580 0.9062 0.8681 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2520 0.9062 0.8689 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2499 0.9004 0.8618 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2500 0.9062 0.8710 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2502 0.9082 0.8747 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2497 0.9082 0.8740 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2515 0.9141 0.8804 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2596 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 81 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-82 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-82.pt +Euclidean distance between 1 and 82: 23.621313095092773. +Interpolating between 1 and 82 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2408 0.9121 0.8760 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2097 0.9121 0.8774 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2055 0.9082 0.8733 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2275 0.9121 0.8806 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2488 0.9043 0.8721 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2521 0.8984 0.8646 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2446 0.9043 0.8707 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2423 0.9102 0.8777 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2523 0.9102 0.8743 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 82 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-83 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-83.pt +Euclidean distance between 1 and 83: 21.204790115356445. +Interpolating between 1 and 83 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2618 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2515 0.9082 0.8705 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2455 0.9023 0.8634 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2433 0.9023 0.8634 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2434 0.9043 0.8665 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2430 0.9043 0.8665 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2436 0.9082 0.8719 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2477 0.9082 0.8712 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2595 0.9160 0.8809 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 83 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-84 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-84.pt +Euclidean distance between 1 and 84: 21.722042083740234. +Interpolating between 1 and 84 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2776 0.9160 0.8815 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2585 0.9180 0.8846 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2491 0.9160 0.8822 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2449 0.9121 0.8767 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2419 0.9141 0.8791 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2381 0.9160 0.8822 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2377 0.9180 0.8852 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2429 0.9141 0.8798 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2558 0.9160 0.8815 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 84 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-85 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-85.pt +Euclidean distance between 1 and 85: 21.191692352294922. +Interpolating between 1 and 85 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2756 0.9102 0.8729 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2665 0.9102 0.8736 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2603 0.9102 0.8743 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2566 0.9082 0.8726 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2539 0.9102 0.8750 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2516 0.9082 0.8719 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2504 0.9102 0.8743 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2527 0.9121 0.8760 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2614 0.9160 0.8815 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 85 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-86 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-86.pt +Euclidean distance between 1 and 86: 22.03456687927246. +Interpolating between 1 and 86 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2847 0.9004 0.8587 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2563 0.9023 0.8619 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2386 0.9082 0.8705 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2328 0.9062 0.8703 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2344 0.9102 0.8770 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2354 0.9062 0.8723 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2360 0.9082 0.8747 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2402 0.9082 0.8733 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2533 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 86 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-87 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-87.pt +Euclidean distance between 1 and 87: 21.140167236328125. +Interpolating between 1 and 87 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2546 0.9023 0.8603 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2412 0.9043 0.8635 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2339 0.9082 0.8705 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2327 0.9062 0.8681 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2334 0.9082 0.8712 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2344 0.9102 0.8743 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2367 0.9102 0.8729 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2429 0.9102 0.8729 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2564 0.9160 0.8809 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 87 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-88 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-88.pt +Euclidean distance between 1 and 88: 21.582763671875. +Interpolating between 1 and 88 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2486 0.9160 0.8815 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2393 0.9160 0.8822 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2370 0.9141 0.8791 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2401 0.9102 0.8757 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2442 0.9043 0.8679 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2449 0.9043 0.8679 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2443 0.9062 0.8703 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2466 0.9102 0.8743 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2572 0.9141 0.8785 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 88 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-89 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-89.pt +Euclidean distance between 1 and 89: 21.51993751525879. +Interpolating between 1 and 89 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2795 0.9062 0.8689 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2633 0.9102 0.8750 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2541 0.9082 0.8733 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2508 0.9082 0.8733 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2505 0.9102 0.8763 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2498 0.9082 0.8740 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2483 0.9082 0.8740 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2498 0.9023 0.8649 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2581 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 89 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-90 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-90.pt +Euclidean distance between 1 and 90: 21.045759201049805. +Interpolating between 1 and 90 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2574 0.9102 0.8722 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2422 0.9141 0.8785 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2339 0.9141 0.8791 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2308 0.9160 0.8822 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2312 0.9102 0.8736 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2330 0.9121 0.8767 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2372 0.9121 0.8760 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2450 0.9102 0.8729 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2580 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 90 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-91 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-91.pt +Euclidean distance between 1 and 91: 21.120847702026367. +Interpolating between 1 and 91 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2774 0.9141 0.8791 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2674 0.9102 0.8743 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2614 0.9121 0.8774 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2585 0.9121 0.8774 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2566 0.9082 0.8719 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2554 0.9043 0.8672 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2549 0.9102 0.8743 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2579 0.9141 0.8791 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2651 0.9160 0.8815 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 91 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-92 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-92.pt +Euclidean distance between 1 and 92: 23.0483455657959. +Interpolating between 1 and 92 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2933 0.9043 0.8635 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2572 0.9062 0.8667 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2471 0.9043 0.8658 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2487 0.9082 0.8719 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2515 0.9082 0.8726 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2489 0.9121 0.8794 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2454 0.9102 0.8770 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2466 0.9160 0.8841 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2568 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 92 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-93 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-93.pt +Euclidean distance between 1 and 93: 21.852203369140625. +Interpolating between 1 and 93 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2684 0.9121 0.8739 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2626 0.9043 0.8643 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2637 0.9062 0.8674 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2706 0.9062 0.8696 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2689 0.9062 0.8703 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2605 0.9062 0.8696 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2534 0.9102 0.8757 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2534 0.9062 0.8696 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2612 0.9160 0.8815 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 93 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-94 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-94.pt +Euclidean distance between 1 and 94: 24.137758255004883. +Interpolating between 1 and 94 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2751 0.9121 0.8739 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2292 0.9062 0.8644 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2289 0.9082 0.8661 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2842 0.9004 0.8530 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3658 0.9023 0.8649 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3494 0.8672 0.8373 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2701 0.8848 0.8550 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2324 0.9082 0.8779 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2384 0.9121 0.8794 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 94 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-95 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-95.pt +Euclidean distance between 1 and 95: 21.012401580810547. +Interpolating between 1 and 95 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2586 0.9180 0.8840 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2528 0.9102 0.8736 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2487 0.9102 0.8736 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2459 0.9121 0.8767 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2442 0.9102 0.8743 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2432 0.9082 0.8719 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2438 0.9082 0.8719 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2488 0.9082 0.8712 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2602 0.9160 0.8815 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 95 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-96 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-96.pt +Euclidean distance between 1 and 96: 21.3961124420166. +Interpolating between 1 and 96 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2750 0.9199 0.8871 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2661 0.9180 0.8852 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2651 0.9121 0.8774 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2705 0.9082 0.8726 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2712 0.9082 0.8719 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2651 0.9102 0.8750 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2602 0.9082 0.8719 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2599 0.9121 0.8767 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2659 0.9160 0.8815 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 96 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-97 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-97.pt +Euclidean distance between 1 and 97: 21.960588455200195. +Interpolating between 1 and 97 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2718 0.9043 0.8650 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2492 0.9043 0.8658 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2397 0.9062 0.8703 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2404 0.9062 0.8710 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2443 0.9062 0.8717 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2462 0.9102 0.8777 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2470 0.9102 0.8770 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2507 0.9082 0.8733 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2602 0.9102 0.8743 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 97 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-98 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-98.pt +Euclidean distance between 1 and 98: 21.466402053833008. +Interpolating between 1 and 98 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2615 0.9043 0.8643 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2431 0.9082 0.8705 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2352 0.9102 0.8757 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2354 0.9043 0.8686 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2381 0.9023 0.8663 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2399 0.9023 0.8670 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2421 0.9043 0.8686 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2460 0.9004 0.8633 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2570 0.9102 0.8743 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 98 +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-1 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-1.pt +Encountered Error: connectivity/bert_ft_qqp-99 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-99.pt +Euclidean distance between 1 and 99: 23.61553955078125. +Interpolating between 1 and 99 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2525 0.9121 0.8747 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2208 0.9141 0.8785 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2140 0.9141 0.8804 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2295 0.9199 0.8901 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2455 0.9121 0.8813 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2411 0.9102 0.8783 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2344 0.9082 0.8747 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2374 0.9082 0.8747 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2513 0.9141 0.8791 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2787 0.9141 0.8778 +Completed interpolation from 1 to 99 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-3 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-3.pt +Euclidean distance between 2 and 3: 21.316783905029297. +Interpolating between 2 and 3 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2570 0.9160 0.8815 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2487 0.9180 0.8859 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2440 0.9199 0.8883 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2440 0.9199 0.8889 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2466 0.9141 0.8798 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2516 0.9160 0.8822 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2547 0.9141 0.8798 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2575 0.9082 0.8705 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2652 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 3 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-4 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-4.pt +Euclidean distance between 2 and 4: 21.814388275146484. +Interpolating between 2 and 4 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2649 0.9102 0.8736 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2428 0.9082 0.8712 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2329 0.9121 0.8774 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2340 0.9102 0.8750 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2411 0.9102 0.8763 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2470 0.9102 0.8763 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2500 0.9082 0.8726 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2544 0.9082 0.8719 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2648 0.9102 0.8736 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 4 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-5 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-5.pt +Euclidean distance between 2 and 5: 21.800466537475586. +Interpolating between 2 and 5 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2900 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2735 0.9102 0.8729 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2616 0.9141 0.8785 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2551 0.9121 0.8753 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2529 0.9102 0.8729 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2532 0.9082 0.8698 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2528 0.9102 0.8729 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2545 0.9102 0.8729 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2634 0.9082 0.8698 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 5 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-6 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-6.pt +Euclidean distance between 2 and 6: 21.572214126586914. +Interpolating between 2 and 6 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2830 0.9043 0.8635 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2720 0.9043 0.8658 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2670 0.9004 0.8610 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2641 0.9082 0.8726 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2640 0.9102 0.8750 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2654 0.9121 0.8774 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2662 0.9121 0.8767 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2654 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2698 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 6 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-7 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-7.pt +Euclidean distance between 2 and 7: 23.88957977294922. +Interpolating between 2 and 7 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2917 0.9160 0.8828 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2442 0.9082 0.8719 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2307 0.9004 0.8603 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2631 0.8926 0.8433 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3319 0.8672 0.7964 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3561 0.8945 0.8475 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2809 0.8965 0.8645 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2307 0.8965 0.8630 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2386 0.9141 0.8824 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 7 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-8 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-8.pt +Euclidean distance between 2 and 8: 21.603002548217773. +Interpolating between 2 and 8 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2796 0.9102 0.8736 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2653 0.9082 0.8712 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2558 0.9062 0.8681 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2506 0.9082 0.8712 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2496 0.9102 0.8736 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2495 0.9062 0.8681 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2470 0.9062 0.8681 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2468 0.9082 0.8705 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2570 0.9082 0.8698 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 8 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-9 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-9.pt +Euclidean distance between 2 and 9: 21.274782180786133. +Interpolating between 2 and 9 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2856 0.9121 0.8760 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2663 0.9082 0.8719 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2546 0.9102 0.8743 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2494 0.9121 0.8767 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2492 0.9121 0.8780 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2513 0.9141 0.8804 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2538 0.9102 0.8743 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2581 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2673 0.9082 0.8705 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 9 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-10 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-10.pt +Euclidean distance between 2 and 10: 21.393543243408203. +Interpolating between 2 and 10 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2707 0.9160 0.8828 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2524 0.9160 0.8822 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2419 0.9082 0.8719 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2390 0.9082 0.8733 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2407 0.9082 0.8733 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2432 0.9082 0.8733 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2461 0.9121 0.8780 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2517 0.9082 0.8712 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2635 0.9082 0.8705 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 10 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-11 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-11.pt +Euclidean distance between 2 and 11: 23.451417922973633. +Interpolating between 2 and 11 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2755 0.9062 0.8681 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2324 0.9043 0.8658 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2191 0.9121 0.8780 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2341 0.9141 0.8817 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2588 0.9062 0.8750 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2552 0.9082 0.8779 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2329 0.9043 0.8721 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2257 0.9121 0.8800 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2448 0.9121 0.8774 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 11 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-12 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-12.pt +Euclidean distance between 2 and 12: 23.48259735107422. +Interpolating between 2 and 12 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2858 0.8984 0.8595 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2395 0.9004 0.8610 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2237 0.9062 0.8696 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2339 0.9102 0.8743 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2490 0.9102 0.8770 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2471 0.9062 0.8717 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2343 0.9102 0.8777 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2337 0.9082 0.8733 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2499 0.9102 0.8736 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 12 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-13 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-13.pt +Euclidean distance between 2 and 13: 22.293556213378906. +Interpolating between 2 and 13 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2493 0.9062 0.8667 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2318 0.9062 0.8674 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2234 0.9062 0.8674 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2262 0.9082 0.8712 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2349 0.9082 0.8726 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2403 0.9082 0.8733 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2430 0.9121 0.8787 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2487 0.9160 0.8828 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2613 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 13 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-14 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-14.pt +Euclidean distance between 2 and 14: 21.16035270690918. +Interpolating between 2 and 14 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2803 0.9043 0.8650 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2618 0.8984 0.8579 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2499 0.8965 0.8571 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2438 0.9043 0.8679 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2416 0.9043 0.8679 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2413 0.9062 0.8710 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2426 0.9121 0.8780 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2475 0.9082 0.8705 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2603 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 14 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-15 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-15.pt +Euclidean distance between 2 and 15: 21.637361526489258. +Interpolating between 2 and 15 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2780 0.9141 0.8804 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2668 0.9160 0.8835 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2600 0.9141 0.8811 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2581 0.9102 0.8757 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2583 0.9082 0.8733 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2592 0.9043 0.8672 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2601 0.9082 0.8712 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2622 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2684 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 15 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-16 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-16.pt +Euclidean distance between 2 and 16: 21.463531494140625. +Interpolating between 2 and 16 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2572 0.9121 0.8760 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2454 0.9102 0.8736 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2397 0.9102 0.8743 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2396 0.9102 0.8743 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2427 0.9141 0.8804 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2449 0.9141 0.8804 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2458 0.9141 0.8804 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2499 0.9141 0.8804 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2620 0.9141 0.8791 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 16 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-17 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-17.pt +Euclidean distance between 2 and 17: 23.79086685180664. +Interpolating between 2 and 17 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2750 0.9062 0.8681 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2348 0.9043 0.8650 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2264 0.9043 0.8635 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2562 0.8965 0.8507 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3119 0.9004 0.8587 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3281 0.8945 0.8643 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2761 0.8809 0.8501 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2403 0.9004 0.8696 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2420 0.9141 0.8830 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 17 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-18 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-18.pt +Euclidean distance between 2 and 18: 21.493953704833984. +Interpolating between 2 and 18 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2570 0.9102 0.8729 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2431 0.9102 0.8729 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2352 0.9121 0.8760 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2335 0.9102 0.8729 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2360 0.9082 0.8712 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2386 0.9062 0.8681 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2409 0.9121 0.8767 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2474 0.9102 0.8729 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2609 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 18 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-19 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-19.pt +Euclidean distance between 2 and 19: 21.66390037536621. +Interpolating between 2 and 19 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2572 0.9219 0.8901 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2426 0.9238 0.8926 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2344 0.9219 0.8907 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2336 0.9141 0.8798 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2379 0.9121 0.8774 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2435 0.9141 0.8798 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2474 0.9043 0.8643 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2523 0.9102 0.8729 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2631 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 19 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-20 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-20.pt +Euclidean distance between 2 and 20: 21.326929092407227. +Interpolating between 2 and 20 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.3024 0.9004 0.8610 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2747 0.9043 0.8672 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2579 0.9062 0.8703 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2523 0.9062 0.8703 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2514 0.9043 0.8679 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2495 0.9043 0.8672 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2468 0.9121 0.8767 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2493 0.9121 0.8760 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2607 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 20 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-21 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-21.pt +Euclidean distance between 2 and 21: 21.626405715942383. +Interpolating between 2 and 21 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2693 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2588 0.9121 0.8767 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2534 0.9121 0.8780 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2494 0.9121 0.8787 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2472 0.9121 0.8794 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2468 0.9102 0.8763 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2451 0.9141 0.8811 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2465 0.9121 0.8767 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2582 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 21 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-22 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-22.pt +Euclidean distance between 2 and 22: 23.7064151763916. +Interpolating between 2 and 22 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2642 0.9082 0.8719 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2277 0.9102 0.8743 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2207 0.9121 0.8767 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2469 0.9121 0.8767 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2888 0.9082 0.8753 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2955 0.9062 0.8782 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2541 0.8965 0.8672 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2279 0.9082 0.8773 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2386 0.9121 0.8794 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 22 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-23 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-23.pt +Euclidean distance between 2 and 23: 23.022140502929688. +Interpolating between 2 and 23 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2711 0.8984 0.8587 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2327 0.9043 0.8672 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2170 0.9082 0.8733 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2196 0.9141 0.8817 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2303 0.9141 0.8824 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2336 0.9082 0.8747 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2314 0.9082 0.8747 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2358 0.9121 0.8787 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2522 0.9141 0.8798 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 23 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-24 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-24.pt +Euclidean distance between 2 and 24: 21.739818572998047. +Interpolating between 2 and 24 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2786 0.8984 0.8556 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2601 0.8984 0.8556 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2497 0.9043 0.8643 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2474 0.9082 0.8712 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2491 0.9082 0.8719 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2492 0.9082 0.8719 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2462 0.9043 0.8665 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2459 0.9082 0.8705 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2572 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 24 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-25 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-25.pt +Euclidean distance between 2 and 25: 21.459524154663086. +Interpolating between 2 and 25 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2752 0.9102 0.8722 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2688 0.9082 0.8712 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2660 0.9082 0.8719 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2634 0.9121 0.8767 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2623 0.9141 0.8798 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2611 0.9102 0.8736 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2594 0.9102 0.8736 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2599 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2668 0.9082 0.8705 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 25 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-26 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-26.pt +Euclidean distance between 2 and 26: 21.422061920166016. +Interpolating between 2 and 26 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2601 0.9141 0.8771 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2415 0.9160 0.8815 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2301 0.9121 0.8767 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2277 0.9160 0.8828 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2312 0.9180 0.8859 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2351 0.9160 0.8835 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2382 0.9141 0.8804 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2449 0.9141 0.8791 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2594 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 26 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-27 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-27.pt +Euclidean distance between 2 and 27: 21.786890029907227. +Interpolating between 2 and 27 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2369 0.9199 0.8864 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2269 0.9160 0.8815 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2244 0.9141 0.8791 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2295 0.9141 0.8791 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2375 0.9121 0.8774 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2425 0.9102 0.8743 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2433 0.9102 0.8743 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2468 0.9160 0.8828 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2591 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 27 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-28 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-28.pt +Euclidean distance between 2 and 28: 21.34850311279297. +Interpolating between 2 and 28 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2705 0.9062 0.8681 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2623 0.9082 0.8712 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2553 0.9082 0.8712 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2540 0.9102 0.8750 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2555 0.9160 0.8841 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2556 0.9160 0.8841 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2546 0.9121 0.8787 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2564 0.9141 0.8798 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2657 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 28 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-29 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-29.pt +Euclidean distance between 2 and 29: 21.165679931640625. +Interpolating between 2 and 29 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2667 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2548 0.9102 0.8743 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2473 0.9102 0.8743 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2448 0.9121 0.8774 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2452 0.9141 0.8798 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2453 0.9102 0.8750 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2468 0.9043 0.8665 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2517 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2633 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 29 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-30 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-30.pt +Euclidean distance between 2 and 30: 21.79997444152832. +Interpolating between 2 and 30 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2733 0.9062 0.8674 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2560 0.9141 0.8778 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2466 0.9102 0.8722 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2442 0.9004 0.8595 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2461 0.9062 0.8681 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2479 0.9062 0.8681 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2485 0.9062 0.8674 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2539 0.9082 0.8705 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2654 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 30 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-31 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-31.pt +Euclidean distance between 2 and 31: 23.74976921081543. +Interpolating between 2 and 31 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2781 0.9062 0.8674 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2393 0.9082 0.8712 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2297 0.9121 0.8753 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2532 0.9004 0.8587 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2963 0.8867 0.8389 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3138 0.9043 0.8734 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2727 0.8926 0.8628 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2397 0.8984 0.8673 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2443 0.9082 0.8753 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 31 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-32 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-32.pt +Euclidean distance between 2 and 32: 21.417821884155273. +Interpolating between 2 and 32 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2753 0.9043 0.8658 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2637 0.9062 0.8696 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2566 0.9004 0.8625 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2532 0.9043 0.8686 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2521 0.9043 0.8693 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2515 0.9102 0.8763 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2507 0.9160 0.8835 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2525 0.9082 0.8712 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2623 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 32 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-33 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-33.pt +Euclidean distance between 2 and 33: 23.517972946166992. +Interpolating between 2 and 33 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2708 0.9062 0.8652 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2273 0.9121 0.8753 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2154 0.9141 0.8811 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2298 0.9082 0.8747 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2548 0.9023 0.8698 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2576 0.8945 0.8629 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2414 0.8984 0.8653 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2346 0.9062 0.8730 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2487 0.9141 0.8804 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 33 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-34 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-34.pt +Euclidean distance between 2 and 34: 21.36301040649414. +Interpolating between 2 and 34 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2721 0.9023 0.8619 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2603 0.9102 0.8743 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2526 0.9102 0.8743 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2490 0.9043 0.8658 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2493 0.9043 0.8658 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2514 0.9082 0.8719 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2542 0.9043 0.8665 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2590 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2680 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 34 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-35 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-35.pt +Euclidean distance between 2 and 35: 21.447059631347656. +Interpolating between 2 and 35 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2786 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2686 0.9062 0.8689 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2622 0.9004 0.8625 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2589 0.9023 0.8656 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2584 0.9004 0.8633 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2591 0.9062 0.8703 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2588 0.9082 0.8726 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2602 0.9141 0.8804 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2674 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 35 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-36 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-36.pt +Euclidean distance between 2 and 36: 21.508197784423828. +Interpolating between 2 and 36 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2945 0.9141 0.8791 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2776 0.9121 0.8774 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2660 0.9141 0.8804 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2606 0.9082 0.8726 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2593 0.9062 0.8689 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2586 0.9102 0.8743 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2598 0.9082 0.8712 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2640 0.9082 0.8705 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2713 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 36 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-37 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-37.pt +Euclidean distance between 2 and 37: 21.267223358154297. +Interpolating between 2 and 37 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2673 0.9121 0.8760 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2541 0.9082 0.8705 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2469 0.9062 0.8689 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2448 0.9062 0.8696 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2471 0.9043 0.8672 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2458 0.9102 0.8750 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2492 0.9121 0.8767 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2537 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2644 0.9102 0.8736 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 37 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-38 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-38.pt +Euclidean distance between 2 and 38: 21.684696197509766. +Interpolating between 2 and 38 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2651 0.9102 0.8729 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2594 0.9062 0.8696 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2549 0.9043 0.8672 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2540 0.9004 0.8618 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2536 0.9004 0.8618 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2532 0.9023 0.8641 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2520 0.9023 0.8634 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2529 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2618 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 38 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-39 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-39.pt +Euclidean distance between 2 and 39: 21.34866714477539. +Interpolating between 2 and 39 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2638 0.9219 0.8907 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2560 0.9238 0.8943 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2516 0.9219 0.8919 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2507 0.9219 0.8913 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2514 0.9141 0.8811 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2523 0.9160 0.8835 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2539 0.9141 0.8804 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2581 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2674 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 39 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-40 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-40.pt +Euclidean distance between 2 and 40: 21.67462921142578. +Interpolating between 2 and 40 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2763 0.9160 0.8815 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2531 0.9160 0.8828 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2406 0.9141 0.8804 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2396 0.9062 0.8696 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2438 0.9082 0.8719 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2458 0.9082 0.8719 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2461 0.9082 0.8719 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2510 0.9121 0.8767 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2629 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 40 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-41 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-41.pt +Euclidean distance between 2 and 41: 21.292133331298828. +Interpolating between 2 and 41 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2713 0.9082 0.8712 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2533 0.9043 0.8672 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2443 0.9082 0.8733 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2419 0.9062 0.8710 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2428 0.9062 0.8710 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2427 0.9062 0.8703 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2416 0.9102 0.8750 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2450 0.9102 0.8743 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2585 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 41 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-42 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-42.pt +Euclidean distance between 2 and 42: 21.833642959594727. +Interpolating between 2 and 42 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2910 0.9082 0.8705 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2786 0.9004 0.8595 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2696 0.9004 0.8595 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2635 0.9004 0.8595 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2612 0.9023 0.8634 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2598 0.9062 0.8689 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2564 0.9082 0.8705 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2550 0.9102 0.8729 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2628 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 42 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-43 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-43.pt +Euclidean distance between 2 and 43: 21.44988250732422. +Interpolating between 2 and 43 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2748 0.9141 0.8785 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2592 0.9121 0.8760 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2477 0.9102 0.8736 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2411 0.9121 0.8767 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2397 0.9121 0.8767 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2408 0.9141 0.8791 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2431 0.9102 0.8743 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2482 0.9121 0.8767 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2599 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 43 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-44 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-44.pt +Euclidean distance between 2 and 44: 21.58970069885254. +Interpolating between 2 and 44 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2833 0.9023 0.8603 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2662 0.9062 0.8667 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2547 0.9102 0.8729 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2498 0.9121 0.8760 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2493 0.9102 0.8729 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2505 0.9121 0.8760 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2517 0.9082 0.8705 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2545 0.9082 0.8705 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2636 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 44 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-45 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-45.pt +Euclidean distance between 2 and 45: 21.22669219970703. +Interpolating between 2 and 45 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2410 0.9219 0.8901 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2355 0.9199 0.8877 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2330 0.9141 0.8804 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2332 0.9102 0.8750 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2368 0.9082 0.8712 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2412 0.9062 0.8681 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2460 0.9082 0.8705 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2525 0.9082 0.8705 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2644 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 45 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-46 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-46.pt +Euclidean distance between 2 and 46: 21.830341339111328. +Interpolating between 2 and 46 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2648 0.9102 0.8722 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2513 0.9121 0.8753 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2431 0.9121 0.8753 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2426 0.9102 0.8736 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2473 0.9121 0.8767 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2533 0.9102 0.8736 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2584 0.9062 0.8681 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2626 0.9082 0.8705 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2695 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 46 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-47 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-47.pt +Euclidean distance between 2 and 47: 22.150577545166016. +Interpolating between 2 and 47 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2680 0.9121 0.8760 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2467 0.9062 0.8689 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2363 0.9062 0.8696 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2364 0.9102 0.8757 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2409 0.9102 0.8757 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2445 0.9102 0.8770 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2463 0.9121 0.8794 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2495 0.9082 0.8726 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2596 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 47 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-48 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-48.pt +Euclidean distance between 2 and 48: 21.78257179260254. +Interpolating between 2 and 48 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2645 0.9199 0.8864 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2435 0.9141 0.8791 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2345 0.9141 0.8791 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2374 0.9121 0.8774 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2454 0.9102 0.8743 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2467 0.9043 0.8672 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2426 0.9121 0.8774 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2434 0.9121 0.8767 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2561 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 48 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-49 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-49.pt +Euclidean distance between 2 and 49: 21.66859245300293. +Interpolating between 2 and 49 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2938 0.9062 0.8659 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2794 0.9023 0.8619 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2688 0.9004 0.8595 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2631 0.8984 0.8564 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2601 0.8984 0.8571 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2596 0.9043 0.8650 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2587 0.8984 0.8556 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2583 0.9062 0.8659 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2643 0.9082 0.8698 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 49 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-50 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-50.pt +Euclidean distance between 2 and 50: 21.600414276123047. +Interpolating between 2 and 50 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2784 0.9141 0.8798 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2679 0.9082 0.8726 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2611 0.9043 0.8672 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2555 0.9023 0.8649 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2517 0.9082 0.8726 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2513 0.9082 0.8726 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2530 0.9102 0.8750 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2568 0.9121 0.8767 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2658 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 50 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-51 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-51.pt +Euclidean distance between 2 and 51: 21.728193283081055. +Interpolating between 2 and 51 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2795 0.9062 0.8681 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2648 0.9062 0.8681 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2559 0.9043 0.8658 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2529 0.9043 0.8658 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2535 0.9043 0.8658 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2538 0.9062 0.8689 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2532 0.9082 0.8719 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2553 0.9082 0.8719 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2641 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 51 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-52 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-52.pt +Euclidean distance between 2 and 52: 21.663394927978516. +Interpolating between 2 and 52 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2842 0.9121 0.8753 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2657 0.9102 0.8722 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2526 0.9121 0.8753 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2464 0.9141 0.8785 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2473 0.9102 0.8729 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2487 0.9082 0.8698 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2504 0.9121 0.8753 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2569 0.9102 0.8722 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2682 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 52 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-53 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-53.pt +Euclidean distance between 2 and 53: 23.62122917175293. +Interpolating between 2 and 53 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2750 0.9082 0.8712 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2350 0.9082 0.8719 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2251 0.9043 0.8672 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2426 0.9023 0.8626 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2720 0.9043 0.8679 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2746 0.9160 0.8889 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2445 0.9043 0.8753 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2251 0.9043 0.8727 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2377 0.9141 0.8817 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 53 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-54 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-54.pt +Euclidean distance between 2 and 54: 21.347999572753906. +Interpolating between 2 and 54 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2850 0.9141 0.8791 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2644 0.9180 0.8852 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2512 0.9121 0.8780 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2452 0.9141 0.8811 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2440 0.9141 0.8811 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2441 0.9141 0.8811 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2449 0.9160 0.8828 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2493 0.9160 0.8822 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2614 0.9141 0.8791 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 54 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-55 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-55.pt +Euclidean distance between 2 and 55: 21.539613723754883. +Interpolating between 2 and 55 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2653 0.9141 0.8778 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2509 0.9121 0.8753 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2423 0.9102 0.8722 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2398 0.9102 0.8750 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2419 0.9102 0.8750 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2457 0.9062 0.8689 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2495 0.9082 0.8719 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2542 0.9082 0.8712 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2643 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 55 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-56 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-56.pt +Euclidean distance between 2 and 56: 21.379619598388672. +Interpolating between 2 and 56 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2727 0.9082 0.8676 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2532 0.9102 0.8715 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2449 0.9141 0.8785 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2441 0.9121 0.8760 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2461 0.9102 0.8743 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2478 0.9102 0.8743 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2498 0.9102 0.8743 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2548 0.9102 0.8729 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2652 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 56 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-57 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-57.pt +Euclidean distance between 2 and 57: 21.598670959472656. +Interpolating between 2 and 57 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2734 0.9062 0.8667 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2551 0.9023 0.8619 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2445 0.9062 0.8681 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2406 0.9082 0.8719 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2402 0.9082 0.8726 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2412 0.9121 0.8780 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2440 0.9141 0.8804 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2509 0.9141 0.8791 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2641 0.9102 0.8729 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 57 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-58 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-58.pt +Euclidean distance between 2 and 58: 21.42827606201172. +Interpolating between 2 and 58 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2916 0.9023 0.8641 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2788 0.9004 0.8625 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2695 0.8984 0.8595 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2633 0.9023 0.8656 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2603 0.9043 0.8686 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2574 0.9082 0.8740 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2544 0.9102 0.8757 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2546 0.9102 0.8750 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2640 0.9102 0.8736 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 58 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-59 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-59.pt +Euclidean distance between 2 and 59: 21.480709075927734. +Interpolating between 2 and 59 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2812 0.9102 0.8722 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2649 0.9082 0.8705 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2559 0.9062 0.8689 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2537 0.9023 0.8626 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2546 0.9043 0.8658 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2555 0.9062 0.8681 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2571 0.9062 0.8681 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2608 0.9062 0.8674 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2686 0.9082 0.8698 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 59 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-60 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-60.pt +Euclidean distance between 2 and 60: 21.256059646606445. +Interpolating between 2 and 60 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2689 0.9121 0.8747 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2508 0.9121 0.8747 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2412 0.9121 0.8753 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2394 0.9141 0.8791 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2424 0.9102 0.8743 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2445 0.9082 0.8719 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2456 0.9102 0.8750 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2496 0.9121 0.8767 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2617 0.9121 0.8760 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 60 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-61 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-61.pt +Euclidean distance between 2 and 61: 23.7866153717041. +Interpolating between 2 and 61 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2813 0.9082 0.8712 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2410 0.9062 0.8689 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2318 0.9062 0.8674 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2567 0.9062 0.8696 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.3025 0.9004 0.8682 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.3180 0.8594 0.8269 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2753 0.8730 0.8418 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2377 0.8945 0.8608 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2416 0.9121 0.8787 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 61 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-62 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-62.pt +Euclidean distance between 2 and 62: 21.6926326751709. +Interpolating between 2 and 62 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2495 0.9199 0.8871 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2385 0.9199 0.8877 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2334 0.9160 0.8828 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2342 0.9082 0.8719 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2383 0.9082 0.8719 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2411 0.9121 0.8774 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2417 0.9102 0.8743 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2452 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2573 0.9082 0.8698 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 62 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-63 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-63.pt +Euclidean distance between 2 and 63: 23.45232391357422. +Interpolating between 2 and 63 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2743 0.9102 0.8736 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2316 0.9141 0.8791 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2181 0.9082 0.8747 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2335 0.9121 0.8813 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2570 0.9062 0.8763 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2559 0.9043 0.8753 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2344 0.9043 0.8721 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2284 0.9102 0.8783 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2467 0.9121 0.8774 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 63 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-64 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-64.pt +Euclidean distance between 2 and 64: 21.3994140625. +Interpolating between 2 and 64 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2747 0.9043 0.8635 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2562 0.9043 0.8650 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2455 0.9043 0.8665 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2436 0.9062 0.8703 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2467 0.9082 0.8733 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2499 0.9102 0.8757 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2515 0.9102 0.8757 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2546 0.9141 0.8804 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2641 0.9121 0.8767 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 64 +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-2 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-2.pt +Encountered Error: connectivity/bert_ft_qqp-65 does not appear to have a file named flax_model.msgpack. +Trying to load model from connectivity/bert_ft_qqp-65.pt +Euclidean distance between 2 and 65: 21.346921920776367. +Interpolating between 2 and 65 on qqp +[0.0, 1.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 0 0.2909 0.9062 0.8659 +[0.1111111111111111, 0.8888888888888888] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 1 0.2679 0.9102 0.8722 +[0.2222222222222222, 0.7777777777777778] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 2 0.2543 0.9062 0.8674 +[0.3333333333333333, 0.6666666666666667] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 3 0.2491 0.9082 0.8726 +[0.4444444444444444, 0.5555555555555556] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 4 0.2487 0.9102 0.8757 +[0.5555555555555556, 0.4444444444444444] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 5 0.2489 0.9121 0.8780 +[0.6666666666666666, 0.33333333333333337] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 6 0.2487 0.9121 0.8767 +[0.7777777777777777, 0.22222222222222232] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 7 0.2520 0.9102 0.8736 +[0.8888888888888888, 0.11111111111111116] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 8 0.2640 0.9082 0.8705 +[1.0, 0.0] + point_num loss accuracy f1 +----------- -------- ---------- -------- + 9 0.2856 0.9102 0.8729 +Completed interpolation from 2 to 65 +Wrote the values to ../logs/NLI/qqp_berts/qqp_interpol@34110steps/interpol_qqp_validation0.pkl!