Rankings by IoU

AR

  Team name IoU ρ
1 MSA 0.669976 0.648751
2 UCSC 0.659394 0.632802
3 smurfcat 0.627384 0.586435
4 Deloitte 0.60432 0.604568
5 ccnu 0.599486 0.658322
6 Cantharellus 0.580441 0.588639
7 DeepPavlov 0.562797 0.575385
8 BlueToad 0.546958 0.505765
9 NCL-UoR 0.538962 0.571027
10 HalluSearch 0.536196 0.525796
11 LCTeam 0.533466 0.553711
12 UZH 0.525308 0.487074
13 AILSNTUA 0.513965 0.57513
14 TUM-MiKaNi 0.477832 0.511441
15 nsu-ai 0.475634 0.423632
16 tsotsalab 0.467336 0.476535
17 REFIND 0.374268 0.18179
18 keepitsimple 0.363055 0.249909
  Baseline (mark all) 0.361354 0.00666667
19 UMUTEAM 0.343636 0.421136
20 TrustAI 0.342822 0.237962
21 CUET_SSTM 0.341338 0.224179
22 Swushroomsia 0.309703 0.287353
23 uir-cis 0.272152 0.447737
24 TU Munich 0.252743 0.319988
25 Go Bison 0.213832 0.384405
26 CIMAT_NLP 0.204396 0.0775488
27 HalluciSeekers 0.118015 0.0572297
28 Hallucination Detectives 0.0759731 0.0274831
29 FENJI 0.0466667 0.00666667
  Baseline (mark none) 0.0466667 0.00666667
  Baseline (neural) 0.0418214 0.119044

CA

  Team name IoU ρ
1 UCSC 0.721111 0.777887
2 ccnu 0.669404 0.74788
3 smurfcat 0.66813 0.71269
4 AILSNTUA 0.666354 0.698585
5 NCL-UoR 0.660233 0.720283
6 MSA 0.654489 0.712569
7 TUM-MiKaNi 0.597131 0.555095
8 UZH 0.585719 0.641962
9 Deloitte 0.529532 0.557116
10 Cantharellus 0.523118 0.572738
11 HalluSearch 0.521545 0.570404
12 LCTeam 0.492352 0.491676
13 nsu-ai 0.468213 0.53457
14 uir-cis 0.464404 0.543165
15 tsotsalab 0.460743 0.518747
16 UMUTEAM 0.430108 0.429528
17 DeepPavlov 0.417948 0.674159
18 keepitsimple 0.316082 0.337705
19 Go Bison 0.273122 0.374884
  Baseline (mark all) 0.242314 0.06
20 FENJI 0.179567 0.06
21 CIMAT_NLP 0.140966 0.0690446
  Baseline (mark none) 0.08 0.06
  Baseline (neural) 0.0523675 0.064522

CS

  Team name IoU ρ
1 AILSNTUA 0.542931 0.55604
2 UCSC 0.53926 0.57625
3 MSA 0.507274 0.551628
4 HalluSearch 0.491134 0.49418
5 ccnu 0.485157 0.554119
6 smurfcat 0.460795 0.467561
7 Deloitte 0.442753 0.48076
8 NCL-UoR 0.440913 0.528544
9 LCTeam 0.405129 0.435664
10 Cantharellus 0.393568 0.423898
11 UZH 0.393113 0.409798
12 TUM-MiKaNi 0.387368 0.373759
13 tsotsalab 0.361273 0.366823
14 BlueToad 0.351392 0.362768
15 DeepPavlov 0.34217 0.319167
16 UMUTEAM 0.337978 0.360041
17 uir-cis 0.305957 0.26954
18 nsu-ai 0.305105 0.294812
19 Go Bison 0.297839 0.306569
20 keepitsimple 0.289479 0.242256
21 REFIND 0.276148 0.0924161
  Baseline (mark all) 0.263164 0.1
22 CIMAT_NLP 0.220116 0.144966
  Baseline (mark none) 0.13 0.1
23 FENJI 0.107279 0.1
  Baseline (neural) 0.0957349 0.0533101

DE

  Team name IoU ρ
1 UCSC 0.623612 0.650701
2 MSA 0.613297 0.610729
3 ccnu 0.591716 0.608866
4 AILSNTUA 0.582003 0.636736
5 ATLANTIS 0.577384 0.0133333
6 Deloitte 0.565526 0.549333
7 Cantharellus 0.563885 0.536146
8 LCTeam 0.563418 0.503102
9 smurfcat 0.560824 0.572107
10 TUM-MiKaNi 0.55689 0.508814
11 NCL-UoR 0.547259 0.586023
12 BlueToad 0.543932 0.524323
13 HalluSearch 0.518707 0.505648
14 UZH 0.512345 0.502754
15 Swushroomsia 0.509296 0.491364
16 DeepPavlov 0.504009 0.612572
17 nsu-ai 0.484104 0.458364
18 UMUTEAM 0.409277 0.440333
19 tsotsalab 0.396933 0.361389
20 REFIND 0.386198 0.353026
21 keepitsimple 0.365058 0.2199
22 TU Munich 0.347555 -0.00591711
  Baseline (mark all) 0.345082 0.0133333
23 uir-cis 0.340033 0.406593
24 TrustAI 0.332266 0.512082
25 Go Bison 0.252222 0.276369
26 FENJI 0.162442 0.0133333
27 HalluciSeekers 0.0573379 0.0439964
  Baseline (neural) 0.0318306 0.107339
  Baseline (mark none) 0.0266667 0.0133333
28 S1mT5v-FMI 0.0266667 0.010897

EN

  Team name IoU ρ
1 iai_MSU 0.650899 0.629443
2 UCSC 0.614601 0.546121
3 ATLANTIS 0.569817 0
4 HalluSearch 0.565555 0.535951
5 ccnu 0.539414 0.550857
6 MSA 0.531359 0.519963
7 AILSNTUA 0.530816 0.63806
8 TUM-MiKaNi 0.524919 0.53633
9 smurfcat 0.524084 0.59627
10 Deloitte 0.523424 0.56078
11 NCL-UoR 0.519506 0.547665
12 Swushroomsia 0.503036 0.463154
13 DeepPavlov 0.498937 0.602133
14 UZH 0.485035 0.482369
15 YNU-HPCC 0.480748 0.407526
16 LCTeam 0.472496 0.553785
17 Cantharellus 0.472125 0.461348
18 BlueToad 0.46881 0.450891
19 GIL-IIMAS UNAM 0.460714 0.501453
20 CIMAT_NLP 0.457742 0.370728
21 tsotsalab 0.445433 0.394551
22 advacheck 0.44425 0.343241
23 nsu-ai 0.443577 0.457807
24 uir-cis 0.402539 0.478107
25 VerbaNexAI 0.380997 0.364264
26 UMUTEAM 0.366717 0.496598
27 keepitsimple 0.365959 0.210418
28 TU Munich 0.364593 0.216408
29 REFIND 0.352507 0.108239
  Baseline (mark all) 0.348926 0
30 MALTO 0.326882 0.310399
31 RaggedyFive 0.315072 0.303801
32 COGUMELO 0.310653 0.227748
33 HalluRAG-RUG 0.309315 0.083251
34 TrustAI 0.298035 0.564236
35 FunghiFunghi 0.294294 0.0115548
36 Hallucination Detectives 0.214243 0.168161
37 FENJI 0.185616 0
38 Go Bison 0.132535 0.275188
39 DUTJBD 0.0570927 -0.188262
40 HalluciSeekers 0.0541527 0.153026
41 HausaNLP 0.0324675 0.422565
  Baseline (mark none) 0.0324675 0
  Baseline (neural) 0.0310306 0.118962

ES

  Team name IoU ρ
1 ATLANTIS 0.531131 0.0131579
2 CIMAT_NLP 0.520894 0.52368
3 NCL-UoR 0.51464 0.546429
4 ccnu 0.512509 0.541495
5 AILSNTUA 0.500397 0.564764
6 UCSC 0.479384 0.602325
7 LCTeam 0.44345 0.433458
8 smurfcat 0.434212 0.440615
9 MSA 0.416183 0.545031
10 Deloitte 0.406493 0.585294
11 UZH 0.405104 0.508468
12 HalluSearch 0.388304 0.44556
13 Cantharellus 0.386874 0.423556
14 TUM-MiKaNi 0.373943 0.502674
15 uir-cis 0.34471 0.310446
16 UMUTEAM 0.298022 0.415235
17 nsu-ai 0.28542 0.396598
18 GIL-IIMAS UNAM 0.280706 0.324301
19 BlueToad 0.278685 0.426741
20 TrustAI 0.268268 0.498297
21 DeepPavlov 0.261357 0.398897
22 TU Munich 0.257843 0.32288
23 Swushroomsia 0.246567 0.247989
24 REFIND 0.234757 0.130775
25 keepitsimple 0.21312 0.233523
  Baseline (mark all) 0.185334 0.0131579
26 tsotsalab 0.185334 0.0131579
27 FunghiFunghi 0.161561 -0.098563
28 Go Bison 0.134148 0.364261
29 FENJI 0.132475 0.0131579
30 COGUMELO 0.132137 0.101349
  Baseline (mark none) 0.0855263 0.0131579
31 S1mT5v-FMI 0.0855263 0.0131579
  Baseline (neural) 0.0723782 0.0358945
32 HalluciSeekers 0.0519325 0.0265825

EU

  Team name IoU ρ
1 MSA 0.612919 0.620171
2 UCSC 0.589363 0.582635
3 ccnu 0.57845 0.612061
4 AILSNTUA 0.555038 0.580486
5 Cantharellus 0.533928 0.503753
6 HalluSearch 0.525141 0.478856
7 TUM-MiKaNi 0.523727 0.470895
8 Deloitte 0.521802 0.515714
9 smurfcat 0.519526 0.469678
10 NCL-UoR 0.510467 0.597423
11 UZH 0.507146 0.51084
12 BlueToad 0.506068 0.457055
13 LCTeam 0.480416 0.549901
14 nsu-ai 0.436818 0.420974
15 keepitsimple 0.419268 0.35247
16 REFIND 0.407419 0.271262
17 DeepPavlov 0.38725 0.321352
  Baseline (mark all) 0.36709 0
18 tsotsalab 0.352359 0
19 UMUTEAM 0.327194 0.392456
20 uir-cis 0.291573 0.398855
21 Go Bison 0.246096 0.170669
22 CIMAT_NLP 0.175533 0.0521636
23 FENJI 0.132604 0
  Baseline (neural) 0.0208128 0.100423
  Baseline (mark none) 0.010101 0

FA

  Team name IoU ρ
1 AILSNTUA 0.710956 0.69889
2 UCSC 0.694861 0.695521
3 MSA 0.669311 0.679483
4 ccnu 0.659977 0.671036
5 NCL-UoR 0.65857 0.673225
6 Cantharellus 0.65514 0.686447
7 smurfcat 0.637503 0.628097
8 LCTeam 0.601757 0.455896
9 Deloitte 0.575401 0.519105
10 BlueToad 0.571086 0.578781
11 TUM-MiKaNi 0.546476 0.423777
12 UZH 0.510767 0.498991
13 UMUTEAM 0.467708 0.393932
14 HalluSearch 0.444267 0.473408
15 nsu-ai 0.372886 0.387544
16 keepitsimple 0.313204 0.357009
17 DeepPavlov 0.240507 0.18591
  Baseline (mark all) 0.202808 0.01
18 tsotsalab 0.202808 0.01
19 uir-cis 0.166122 0.39462
20 Go Bison 0.118995 0.0661229
21 HalluciSeekers 0.112631 0.0743606
22 CIMAT_NLP 0.0315723 0.394861
23 FENJI 0.00280303 0.01
  Baseline (neural) 0.000133333 0.107759
  Baseline (mark none) 0 0.01

FI

  Team name IoU ρ
1 UCSC 0.648264 0.649756
2 MSA 0.642205 0.546673
3 smurfcat 0.631009 0.553483
4 Deloitte 0.63073 0.63557
5 TUM-MiKaNi 0.626698 0.575089
6 AILSNTUA 0.623496 0.620406
7 UZH 0.601414 0.473568
8 nsu-ai 0.587385 0.492204
9 DeepPavlov 0.584469 0.482142
10 Cantharellus 0.571418 0.564578
11 BlueToad 0.569368 0.490576
12 HalluSearch 0.568077 0.529663
13 ccnu 0.511671 0.563066
14 NCL-UoR 0.509552 0.496454
15 REFIND 0.506054 0.196531
16 Swushroomsia 0.495474 0.429834
  Baseline (mark all) 0.4857 0
17 tsotsalab 0.4857 0
18 TU Munich 0.485699 0.00318833
19 UMUTEAM 0.456276 0.512588
20 keepitsimple 0.455409 0.332279
21 LCTeam 0.422118 0.530004
22 Go Bison 0.399602 0.343294
23 CIMAT_NLP 0.37418 0.0309647
24 TrustAI 0.295512 0.177681
25 uir-cis 0.245949 0.336595
26 FENJI 0.0940742 0
  Baseline (neural) 0.00418271 0.0924184
27 S1mT5v-FMI 0 0.00143156
  Baseline (mark none) 0 0

FR

  Team name IoU ρ
1 Deloitte 0.646867 0.618707
2 TUM-MiKaNi 0.631443 0.515746
3 MSA 0.61946 0.55531
4 Swushroomsia 0.59367 0.542922
5 UCSC 0.58683 0.559161
6 smurfcat 0.583796 0.515464
7 DeepPavlov 0.583096 0.543978
8 AILSNTUA 0.581152 0.61026
9 UZH 0.576516 0.441051
10 LCTeam 0.56336 0.488321
11 ATLANTIS 0.518961 0.411668
12 nsu-ai 0.518122 0.433876
13 Cantharellus 0.514708 0.531731
14 tsotsalab 0.48963 0.457537
15 ccnu 0.482309 0.572353
16 REFIND 0.473446 0.0752446
17 keepitsimple 0.465062 0.275619
18 TU Munich 0.454651 0.00962203
  Baseline (mark all) 0.454341 0
19 BlueToad 0.438527 0.37965
20 HalluSearch 0.436638 0.336523
21 Go Bison 0.416434 0.399039
22 NCL-UoR 0.405806 0.41872
23 TrustAI 0.379873 0.499211
24 CIMAT_NLP 0.353299 0.0710875
25 UMUTEAM 0.319957 0.411692
26 FunghiFunghi 0.309466 -0.152109
27 uir-cis 0.22862 0.287342
28 FENJI 0.0843731 0
29 HalluciSeekers 0.0500358 0.0447022
  Baseline (neural) 0.00220218 0.0207713
  Baseline (mark none) 0 0
30 S1mT5v-FMI 0 0

HI

  Team name IoU ρ
1 ccnu 0.746571 0.78466
2 UCSC 0.744119 0.76251
3 AILSNTUA 0.725948 0.760167
4 smurfcat 0.716411 0.596429
5 MSA 0.684241 0.725217
6 LCTeam 0.660057 0.51215
7 Cantharellus 0.65719 0.690939
8 BlueToad 0.644655 0.684394
9 UZH 0.637742 0.668682
10 Deloitte 0.632193 0.639149
11 NCL-UoR 0.628631 0.683031
12 TUM-MiKaNi 0.583496 0.496408
13 HalluSearch 0.526485 0.519489
14 DeepPavlov 0.511659 0.731983
15 nsu-ai 0.477141 0.443828
16 Swushroomsia 0.453368 0.478873
17 UMUTEAM 0.451005 0.438582
18 keepitsimple 0.359799 0.350802
19 TrustAI 0.314378 0.504983
20 TU Munich 0.280676 0.329729
  Baseline (mark all) 0.271096 0
21 tsotsalab 0.271096 0
22 Go Bison 0.258627 0.321685
23 uir-cis 0.0612541 0.558552
  Baseline (neural) 0.00290509 0.142871
24 FENJI 0 0
  Baseline (mark none) 0 0

IT

  Team name IoU ρ
1 UCSC 0.787248 0.787321
2 AILSNTUA 0.765999 0.819506
3 smurfcat 0.747821 0.623093
4 MSA 0.736875 0.756815
5 Swushroomsia 0.727417 0.729207
6 NCL-UoR 0.712266 0.761393
7 ccnu 0.706025 0.744131
8 Deloitte 0.705884 0.614367
9 LCTeam 0.701254 0.548709
10 Cantharellus 0.690693 0.711849
11 UZH 0.683283 0.701611
12 TUM-MiKaNi 0.678692 0.538808
13 BlueToad 0.638831 0.667483
14 HalluSearch 0.54836 0.560364
15 DeepPavlov 0.527982 0.552877
16 UMUTEAM 0.441297 0.460141
17 nsu-ai 0.439614 0.440155
18 keepitsimple 0.40092 0.386033
19 uir-cis 0.396664 0.499055
20 TrustAI 0.344079 0.282686
21 TU Munich 0.331916 0.420967
22 REFIND 0.325471 0.242343
  Baseline (mark all) 0.282615 0
23 tsotsalab 0.282615 0
24 FENJI 0.276521 0
25 Go Bison 0.267502 0.402096
26 FunghiFunghi 0.211097 -0.211589
27 CIMAT_NLP 0.189927 0.0455724
28 HalluciSeekers 0.0349619 0.0241904
  Baseline (neural) 0.0104172 0.0799714
  Baseline (mark none) 0 0

SV

  Team name IoU ρ
1 UCSC 0.642303 0.520398
2 MSA 0.6364 0.422442
3 Deloitte 0.622029 0.537399
4 smurfcat 0.617439 0.500708
5 AILSNTUA 0.600937 0.5622
6 TUM-MiKaNi 0.588608 0.392963
7 BlueToad 0.585413 0.426741
8 HalluSearch 0.562213 0.428993
9 UZH 0.561198 0.412469
10 NCL-UoR 0.554692 0.458706
11 nsu-ai 0.547839 0.344154
12 DeepPavlov 0.538018 0.414687
  Baseline (mark all) 0.537275 0.0136054
13 TU Munich 0.537184 0.00539165
14 tsotsalab 0.534936 0.0136054
15 ccnu 0.504466 0.505832
16 UMUTEAM 0.439337 0.393618
17 LCTeam 0.418341 0.370023
18 FunghiFunghi 0.415579 -0.117725
19 keepitsimple 0.396724 0.217007
20 Swushroomsia 0.354929 0.226542
21 uir-cis 0.307967 0.365493
22 TrustAI 0.248385 0.255068
23 CIMAT_NLP 0.238781 0.0546808
24 FENJI 0.115419 0.0136054
25 Go Bison 0.110986 0.0668742
26 HalluciSeekers 0.0574943 0.0855806
  Baseline (neural) 0.0307729 0.0968112
  Baseline (mark none) 0.0204082 0.0136054
27 S1mT5v-FMI 0.0204082 0.0136054

ZH

  Team name IoU ρ
1 YNU-HPCC 0.553971 0.351808
2 LCTeam 0.523231 0.517056
3 nsu-ai 0.493722 0.381261
4 DeepPavlov 0.490002 0.252852
5 smurfcat 0.484193 0.252852
6 UZH 0.478979 0.178303
  Baseline (mark all) 0.477155 0
7 tsotsalab 0.477155 0
8 TUM-MiKaNi 0.473541 0.409461
9 UCSC 0.470737 0.396642
10 keepitsimple 0.47033 0.160073
11 MSA 0.463093 0.436328
12 Deloitte 0.45997 0.298623
13 HalluSearch 0.453449 0.423154
14 TrustAI 0.430444 0.250302
15 Cantharellus 0.401066 0.406336
16 UMUTEAM 0.387513 0.491649
17 AILSNTUA 0.386608 0.456384
18 ccnu 0.383428 0.404245
19 NCL-UoR 0.360621 0.353968
20 BlueToad 0.278315 0.226195
21 TU Munich 0.216047 0.0769163
22 Go Bison 0.215245 0.111916
23 Swushroomsia 0.205396 0.09661
24 uir-cis 0.191315 0.304748
25 S1mT5v-FMI 0.061894 -0.020898
26 FENJI 0.0371131 0
  Baseline (neural) 0.0235879 0.0883699
  Baseline (mark none) 0.02 0