Hugging Face's logo

Spaces:
TIGER-Lab
/
GenAI-Arena
Running on Zero

App Files Community
16
DongfuJiang commited on
Commit
c2bb004
·
1 Parent(s): f218623

Auto Daily Leaderboard udpate Sun Dec 15 12:00:29 PM EST 2024

Browse files
Files changed (12) hide show
  1. arena_elo/results/20241215/clean_battle_t2i_generation.json +0 -0
  2. arena_elo/results/20241215/clean_battle_video_generation.json +0 -0
  3. arena_elo/results/20241215/elo_results_t2i_generation.pkl +3 -0
  4. arena_elo/results/20241215/elo_results_video_generation.pkl +3 -0
  5. arena_elo/results/20241215/t2i_generation_leaderboard.csv +18 -0
  6. arena_elo/results/20241215/video_generation_leaderboard.csv +15 -0
  7. arena_elo/results/latest/clean_battle_t2i_generation.json +70 -0
  8. arena_elo/results/latest/clean_battle_video_generation.json +84 -0
  9. arena_elo/results/latest/elo_results_t2i_generation.pkl +1 -1
  10. arena_elo/results/latest/elo_results_video_generation.pkl +2 -2
  11. arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -17
  12. arena_elo/results/latest/video_generation_leaderboard.csv +14 -14
arena_elo/results/20241215/clean_battle_t2i_generation.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20241215/clean_battle_video_generation.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20241215/elo_results_t2i_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1772d93d6e4c5bcd4f7e1803c0c3593277063a905686e9032e90bf3f8d8f701
3
+ size 88249
arena_elo/results/20241215/elo_results_video_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ba447bb5eb35662cdb14f916bce0f6c464d1ad129456987616a0ad472713b28
3
+ size 78094
arena_elo/results/20241215/t2i_generation_leaderboard.csv ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ FLUX.1-dev,FLUX.1-dev,1118.4261712413786,1124.6178774406,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
3
+ PlayGround V2.5,PlayGround V2.5,1116.150592623697,1116.3176424305295,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
4
+ FLUX.1-schnell,FLUX.1-schnell,1086.0434182905278,1093.356062123008,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1073.5302091423907,1072.8600128451499,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1056.1479922818771,1055.2696660572337,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ StableCascade,StableCascade,1041.4226120618569,1044.1012087323631,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
+ HunyuanDiT,HunyuanDiT,1024.4010630924136,1018.3989423037106,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
+ PixArtAlpha,PixArtAlpha,1021.0706774421757,1013.139222379682,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
10
+ SDXL-Lightning,SDXL-Lightning,1019.8479030656084,1023.9192140686632,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
11
+ PixArtSigma,PixArtSigma,1018.4898060443733,1018.7085269916804,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
+ SD3,SD3,1013.3396497506059,1015.5308327913142,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
+ AuraFlow,AuraFlow,995.1188623966748,991.7324156630227,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
+ SDXL,SDXL,968.644283260192,969.2861545691736,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,915.3935892507325,913.7115058341568,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),906.2680424040407,900.2866168072478,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,833.7683645692085,828.8141553866691,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,791.9367630822388,806.3463086080154,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/20241215/video_generation_leaderboard.csv ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ CogVideoX-5B,CogVideoX-5B,1155.1242487301374,1149.940196275879,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
3
+ Pyramid Flow,Pyramid Flow,1146.4159682943312,1148.9251789763025,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
4
+ StableVideoDiffusion,StableVideoDiffusion,1129.7970675880274,1132.0428122987362,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
5
+ CogVideoX-2B,CogVideoX-2B,1074.103501022486,1070.026099029368,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
6
+ T2V-Turbo,T2V-Turbo,1063.4084294886686,1063.1632366108738,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
7
+ AnimateDiff,AnimateDiff,1048.818817477058,1048.6759453056034,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
8
+ VideoCrafter2,VideoCrafter2,1047.6538437813047,1048.0826336644975,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
9
+ Allegro,Allegro,999.6515680922292,1004.9362271276727,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
10
+ LaVie,LaVie,975.7057528572167,975.8225276144419,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
11
+ LTXVideo,LTXVideo,930.4497371812339,932.3534101906998,Apache 2.0,Lightricks,https://github.com/Lightricks/LTX-Video
12
+ OpenSora,OpenSora,891.9062117065749,891.6343023538814,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
13
+ OpenSora v1.2,OpenSora v1.2,852.6848699181537,850.3899635877558,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
14
+ AnimateDiff Turbo,AnimateDiff Turbo,842.4410069408768,840.939776792034,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
15
+ ModelScope,ModelScope,841.838976921697,843.0676901722497,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
arena_elo/results/latest/clean_battle_t2i_generation.json CHANGED
@@ -112330,5 +112330,75 @@
112330
  "judge": "arena_user_10.16.30.109",
112331
  "anony": false,
112332
  "tstamp": 1734192899.5895
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
112333
  }
112334
  ]
 
112330
  "judge": "arena_user_10.16.30.109",
112331
  "anony": false,
112332
  "tstamp": 1734192899.5895
112333
+ },
112334
+ {
112335
+ "model_a_conv_id": "a2c91a7d00474f25a6983289931be4a9",
112336
+ "model_b_conv_id": "73c3ffa1d1cc41ed8730fc205703bc5e",
112337
+ "inputs": {
112338
+ "prompt": "a beautifull white cast futuristic biomechanical humanoid woman side portrait with pretty face in intricate detailed color smashing fluid oilpaint, melting wax, thin fractal tendrils, futuristic digital painting, cyberpunk, 8 k, hyper detailed, octane render, concept art, by peter mohrbacher, by wlop, by ruan jia "
112339
+ },
112340
+ "model_a": "OpenJourney",
112341
+ "model_b": "Kolors",
112342
+ "vote_type": "tievote",
112343
+ "winner": "tie",
112344
+ "judge": "arena_user_10.16.30.109",
112345
+ "anony": true,
112346
+ "tstamp": 1734216593.5934
112347
+ },
112348
+ {
112349
+ "model_a_conv_id": "f5ca49f7e6c143b8bdf085f5d6f18b68",
112350
+ "model_b_conv_id": "b0ee68c0569c492fa17dd881ebe6c493",
112351
+ "inputs": {
112352
+ "prompt": "A futuristic hopeful busy city, purple and green color scheme"
112353
+ },
112354
+ "model_a": "FLUX.1-schnell",
112355
+ "model_b": "FLUX.1-dev",
112356
+ "vote_type": "rightvote",
112357
+ "winner": "model_b",
112358
+ "judge": "arena_user_10.20.26.107",
112359
+ "anony": true,
112360
+ "tstamp": 1734219178.5328
112361
+ },
112362
+ {
112363
+ "model_a_conv_id": "a110700e999f47e2aa8cfc3976e3b757",
112364
+ "model_b_conv_id": "b0288f13b533407d85cb653f5bc1a7c5",
112365
+ "inputs": {
112366
+ "prompt": "Cat"
112367
+ },
112368
+ "model_a": "FLUX.1-schnell",
112369
+ "model_b": "SDXL-Lightning",
112370
+ "vote_type": "leftvote",
112371
+ "winner": "model_a",
112372
+ "judge": "arena_user_10.16.19.14",
112373
+ "anony": true,
112374
+ "tstamp": 1734231602.2123
112375
+ },
112376
+ {
112377
+ "model_a_conv_id": "0bd25ff13ae8437da8871cbb8166b252",
112378
+ "model_b_conv_id": "136ca858b5ff4753a128ed2fe2b2000e",
112379
+ "inputs": {
112380
+ "prompt": "Four dogs on the street."
112381
+ },
112382
+ "model_a": "SDXL-Lightning",
112383
+ "model_b": "PixArtAlpha",
112384
+ "vote_type": "leftvote",
112385
+ "winner": "model_a",
112386
+ "judge": "arena_user_10.16.30.109",
112387
+ "anony": true,
112388
+ "tstamp": 1734235983.5294
112389
+ },
112390
+ {
112391
+ "model_a_conv_id": "4d50e0a7ee2f45af86bbc324407d68d6",
112392
+ "model_b_conv_id": "b9b8d485984848f7b711f5988c3b0ea1",
112393
+ "inputs": {
112394
+ "prompt": "golden Gustav Klimt painting of realistic semen cumshot on naked nude pretty open mouthed cocksuckerwoman, nippled pornhappy pretty messy squirty drippy cumwhite-translucentcum spermsemen cumming penis sucking pretty-eyed pornsexual gorgeous semenwoman with nude pornographic boobs, messydrippy BW semen cumshot pornphoto, erect nipples"
112395
+ },
112396
+ "model_a": "AuraFlow",
112397
+ "model_b": "SDXL-Lightning",
112398
+ "vote_type": "rightvote",
112399
+ "winner": "model_b",
112400
+ "judge": "arena_user_10.20.38.195",
112401
+ "anony": true,
112402
+ "tstamp": 1734273663.8806
112403
  }
112404
  ]
arena_elo/results/latest/clean_battle_video_generation.json CHANGED
@@ -34648,5 +34648,89 @@
34648
  "judge": "arena_user_10.20.26.107",
34649
  "anony": true,
34650
  "tstamp": 1734170958.6779
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34651
  }
34652
  ]
 
34648
  "judge": "arena_user_10.20.26.107",
34649
  "anony": true,
34650
  "tstamp": 1734170958.6779
34651
+ },
34652
+ {
34653
+ "model_a_conv_id": "c0017ccd8bcd41038a1d688992512b5d",
34654
+ "model_b_conv_id": "990ea891a8a04ba7a7e280299de17103",
34655
+ "inputs": {
34656
+ "prompt": "A person is barbequing"
34657
+ },
34658
+ "model_a": "AnimateDiff",
34659
+ "model_b": "AnimateDiff Turbo",
34660
+ "vote_type": "leftvote",
34661
+ "winner": "model_a",
34662
+ "judge": "arena_user_10.16.9.166",
34663
+ "anony": false,
34664
+ "tstamp": 1734257767.1337
34665
+ },
34666
+ {
34667
+ "model_a_conv_id": "0a5d8e66da9646789cbcbab955a7ab36",
34668
+ "model_b_conv_id": "d2d4caa13d494d89bcdde26d61ec91d3",
34669
+ "inputs": {
34670
+ "prompt": "food court"
34671
+ },
34672
+ "model_a": "VideoCrafter2",
34673
+ "model_b": "T2V-Turbo",
34674
+ "vote_type": "leftvote",
34675
+ "winner": "model_a",
34676
+ "judge": "arena_user_10.16.9.166",
34677
+ "anony": true,
34678
+ "tstamp": 1734257798.5737
34679
+ },
34680
+ {
34681
+ "model_a_conv_id": "98da1ddba7ce4bc38a2db48adf5659b2",
34682
+ "model_b_conv_id": "3adcb1533537417aa3779552b3a3a151",
34683
+ "inputs": {
34684
+ "prompt": "a potted plant and a tv"
34685
+ },
34686
+ "model_a": "AnimateDiff",
34687
+ "model_b": "LTXVideo",
34688
+ "vote_type": "rightvote",
34689
+ "winner": "model_b",
34690
+ "judge": "arena_user_10.16.19.14",
34691
+ "anony": true,
34692
+ "tstamp": 1734257813.5346
34693
+ },
34694
+ {
34695
+ "model_a_conv_id": "174e2e8824e94caba26ea9f5c7aa11cd",
34696
+ "model_b_conv_id": "7ae2bb5dbc404c49b73a1c1930b06c98",
34697
+ "inputs": {
34698
+ "prompt": "a baseball glove"
34699
+ },
34700
+ "model_a": "Pyramid Flow",
34701
+ "model_b": "StableVideoDiffusion",
34702
+ "vote_type": "leftvote",
34703
+ "winner": "model_a",
34704
+ "judge": "arena_user_10.16.19.14",
34705
+ "anony": true,
34706
+ "tstamp": 1734257840.4495
34707
+ },
34708
+ {
34709
+ "model_a_conv_id": "1303a96de6cb4d27b7f826c1f5c98ba3",
34710
+ "model_b_conv_id": "182fcf97b1c1466d83a513dc7a2a44e3",
34711
+ "inputs": {
34712
+ "prompt": "a person and a toothbrush"
34713
+ },
34714
+ "model_a": "OpenSora v1.2",
34715
+ "model_b": "Allegro",
34716
+ "vote_type": "rightvote",
34717
+ "winner": "model_b",
34718
+ "judge": "arena_user_10.16.9.166",
34719
+ "anony": true,
34720
+ "tstamp": 1734257859.2555
34721
+ },
34722
+ {
34723
+ "model_a_conv_id": "c6ce1caf5bd64a9e89e3fb5938863756",
34724
+ "model_b_conv_id": "fe255f349ebd4486981e9b27eaf96991",
34725
+ "inputs": {
34726
+ "prompt": "a giraffe bending down to drink water from a river"
34727
+ },
34728
+ "model_a": "CogVideoX-5B",
34729
+ "model_b": "StableVideoDiffusion",
34730
+ "vote_type": "leftvote",
34731
+ "winner": "model_a",
34732
+ "judge": "arena_user_10.16.0.161",
34733
+ "anony": true,
34734
+ "tstamp": 1734257899.1009
34735
  }
34736
  ]
arena_elo/results/latest/elo_results_t2i_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:be60ca1b9308a6af85a2efc8d583d9143a95c72acdaab5e2fd9fe5e3bc1bc33e
3
  size 88249
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1772d93d6e4c5bcd4f7e1803c0c3593277063a905686e9032e90bf3f8d8f701
3
  size 88249
arena_elo/results/latest/elo_results_video_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dbe687402ce9c7ed8313de0cd2f894738048971c70997ed4bccf199fe64c08cc
3
- size 78093
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ba447bb5eb35662cdb14f916bce0f6c464d1ad129456987616a0ad472713b28
3
+ size 78094
arena_elo/results/latest/t2i_generation_leaderboard.csv CHANGED
@@ -1,18 +1,18 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- FLUX.1-dev,FLUX.1-dev,1117.1496380551703,1123.8038869591062,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
3
- PlayGround V2.5,PlayGround V2.5,1116.0802172775936,1116.1865847738488,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
4
- FLUX.1-schnell,FLUX.1-schnell,1086.2097495117348,1093.3541853821805,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
- PlayGround V2,PlayGround V2,1073.4576030856347,1072.776787204697,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
- Kolors,Kolors,1057.04115824463,1056.1735555380913,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
- StableCascade,StableCascade,1041.3532265433435,1044.0172701826884,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
- HunyuanDiT,HunyuanDiT,1024.3918545166368,1018.3888882657631,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
- PixArtAlpha,PixArtAlpha,1021.2511098627413,1013.2653052697874,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
10
- SDXL-Lightning,SDXL-Lightning,1019.4018690711999,1023.5237178594579,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
11
- PixArtSigma,PixArtSigma,1018.4289398987756,1018.6370855350852,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
- SD3,SD3,1013.3333388631331,1015.4897231037064,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
- AuraFlow,AuraFlow,996.3880003652768,992.9177968106289,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
- SDXL,SDXL,968.5850563572295,969.2089125414929,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
- SDXLTurbo,SDXLTurbo,915.3309733758067,913.6353418579702,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
- LCM(v1.5/XL),LCM(v1.5/XL),906.1720589441443,900.1780335774104,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
- OpenJourney,OpenJourney,833.5548488760422,828.6083298184228,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
- LCM,LCM,791.8703571509124,806.2696842820928,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ FLUX.1-dev,FLUX.1-dev,1118.4261712413786,1124.6178774406,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
3
+ PlayGround V2.5,PlayGround V2.5,1116.150592623697,1116.3176424305295,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
4
+ FLUX.1-schnell,FLUX.1-schnell,1086.0434182905278,1093.356062123008,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1073.5302091423907,1072.8600128451499,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1056.1479922818771,1055.2696660572337,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ StableCascade,StableCascade,1041.4226120618569,1044.1012087323631,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
+ HunyuanDiT,HunyuanDiT,1024.4010630924136,1018.3989423037106,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
+ PixArtAlpha,PixArtAlpha,1021.0706774421757,1013.139222379682,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
10
+ SDXL-Lightning,SDXL-Lightning,1019.8479030656084,1023.9192140686632,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
11
+ PixArtSigma,PixArtSigma,1018.4898060443733,1018.7085269916804,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
+ SD3,SD3,1013.3396497506059,1015.5308327913142,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
+ AuraFlow,AuraFlow,995.1188623966748,991.7324156630227,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
+ SDXL,SDXL,968.644283260192,969.2861545691736,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,915.3935892507325,913.7115058341568,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),906.2680424040407,900.2866168072478,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,833.7683645692085,828.8141553866691,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,791.9367630822388,806.3463086080154,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/latest/video_generation_leaderboard.csv CHANGED
@@ -1,15 +1,15 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- CogVideoX-5B,CogVideoX-5B,1153.6617034690923,1148.407174956258,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
3
- Pyramid Flow,Pyramid Flow,1144.103407806249,1146.7082643090869,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
4
- StableVideoDiffusion,StableVideoDiffusion,1135.349359523591,1137.60836784517,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
5
- CogVideoX-2B,CogVideoX-2B,1077.6966098869807,1073.5713550194907,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
6
- T2V-Turbo,T2V-Turbo,1068.4707037033033,1068.1632722573684,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
7
- AnimateDiff,AnimateDiff,1053.6463119291313,1053.3213100377081,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
8
- VideoCrafter2,VideoCrafter2,1051.3000622781203,1051.7641328340794,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
9
- Allegro,Allegro,997.4328949910187,1002.4842304049891,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
10
- LaVie,LaVie,980.1092680307136,980.2660785042808,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
11
- OpenSora,OpenSora,896.2166054518555,896.0570781266404,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
12
- LTXVideo,LTXVideo,891.4369608200279,893.3896969367887,Apache 2.0,Lightricks,https://github.com/Lightricks/LTX-Video
13
- OpenSora v1.2,OpenSora v1.2,857.8559037268219,855.5092013211156,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
14
- AnimateDiff Turbo,AnimateDiff Turbo,846.5032172793499,845.2431339638415,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
15
- ModelScope,ModelScope,846.2169911037425,847.5067034831791,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ CogVideoX-5B,CogVideoX-5B,1155.1242487301374,1149.940196275879,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
3
+ Pyramid Flow,Pyramid Flow,1146.4159682943312,1148.9251789763025,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
4
+ StableVideoDiffusion,StableVideoDiffusion,1129.7970675880274,1132.0428122987362,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
5
+ CogVideoX-2B,CogVideoX-2B,1074.103501022486,1070.026099029368,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
6
+ T2V-Turbo,T2V-Turbo,1063.4084294886686,1063.1632366108738,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
7
+ AnimateDiff,AnimateDiff,1048.818817477058,1048.6759453056034,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
8
+ VideoCrafter2,VideoCrafter2,1047.6538437813047,1048.0826336644975,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
9
+ Allegro,Allegro,999.6515680922292,1004.9362271276727,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
10
+ LaVie,LaVie,975.7057528572167,975.8225276144419,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
11
+ LTXVideo,LTXVideo,930.4497371812339,932.3534101906998,Apache 2.0,Lightricks,https://github.com/Lightricks/LTX-Video
12
+ OpenSora,OpenSora,891.9062117065749,891.6343023538814,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
13
+ OpenSora v1.2,OpenSora v1.2,852.6848699181537,850.3899635877558,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
14
+ AnimateDiff Turbo,AnimateDiff Turbo,842.4410069408768,840.939776792034,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
15
+ ModelScope,ModelScope,841.838976921697,843.0676901722497,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571