Pretrained Benchmark

Hover over the headings for more information
Model ID Size Speed Score DA NO SV IS FO NER POS DEP CLF DaNE DDT-POS DDT-DEP AngryTweets TwitterSent Europarl LCC DKHate NorNE-NB NorNE-NN NDT-NB-POS NDT-NN-POS NDT-NB-DEP NDT-NN-DEP NoReC NorDial SUC3 SDT-POS SDT-DEP DaLaJ ABSAbank-Imm MIM-GOLD-NER IDT-POS IDT-DEP NoReC-IS WikiANN-FO FDT-POS FDT-DEP NoReC-FO Version
Maltehb/aelaectra-danish-electra-small-cased 55 25.25 ± 1.26 76.87 ± 1.92 / 79.18 ± 2.11 98.04 ± 0.08 62.10 ± 1.15 / 64.22 ± 1.06 60.17 ± 4.27 44.50 ± 3.14 61.14 ± 5.20 62.60 ± 4.49 76.04 ± 2.28 79.38 ± 0.91 / 81.24 ± 0.83 76.95 ± 0.76 / 80.76 ± 0.67 98.03 ± 0.09 97.28 ± 0.12 80.29 ± 0.85 / 82.57 ± 0.82 76.63 ± 0.89 / 79.69 ± 0.92 53.28 ± 2.43 68.06 ± 3.57 78.50 ± 0.56 / 82.71 ± 0.42 96.28 ± 0.14 56.71 ± 1.57 / 60.50 ± 1.52 41.15 ± 4.09 46.34 ± 1.31 73.53 ± 0.42 / 77.73 ± 0.42 98.61 ± 0.11 74.39 ± 1.41 / 77.89 ± 1.38 38.27 ± 0.75 85.68 ± 0.98 95.52 ± 0.29 41.93 ± 2.37 / 44.91 ± 2.39 38.53 ± 0.78 3.0.0
KB/electra-base-swedish-cased-discriminator 476 72.00 ± 1.63 / 75.04 ± 1.59 96.70 ± 0.06 55.27 ± 1.21 / 58.30 ± 1.28 47.73 ± 6.11 38.68 ± 3.27 22.94 ± 1.74 33.55 ± 2.72 70.25 ± 5.77 80.08 ± 0.60 / 82.23 ± 0.47 78.39 ± 0.78 / 82.32 ± 0.54 97.64 ± 0.08 97.23 ± 0.07 79.20 ± 0.82 / 81.73 ± 0.83 76.32 ± 0.79 / 79.34 ± 0.81 58.56 ± 1.34 65.40 ± 1.73 85.65 ± 0.65 / 89.06 ± 0.56 98.27 ± 0.11 66.90 ± 1.24 / 69.15 ± 1.21 61.87 ± 3.20 53.75 ± 1.88 72.94 ± 1.56 / 77.00 ± 1.57 96.79 ± 0.18 76.01 ± 3.48 / 79.04 ± 2.97 42.31 ± 2.97 83.79 ± 0.74 94.66 ± 0.27 37.52 ± 2.04 / 40.50 ± 2.13 39.78 ± 1.75 3.0.0
KBLab/sentence-bert-swedish-cased 476 73.21 ± 2.02 / 74.68 ± 1.80 96.40 ± 0.17 59.60 ± 0.94 / 62.68 ± 0.93 59.16 ± 2.77 42.30 ± 5.62 37.19 ± 8.00 53.56 ± 3.68 71.29 ± 3.89 81.22 ± 1.08 / 82.96 ± 1.11 81.55 ± 0.49 / 85.21 ± 0.67 97.66 ± 0.11 97.28 ± 0.09 81.24 ± 0.38 / 83.68 ± 0.41 78.81 ± 0.81 / 81.71 ± 0.79 63.38 ± 1.45 67.00 ± 2.68 86.69 ± 0.47 / 89.73 ± 0.41 98.48 ± 0.09 72.88 ± 0.91 / 75.03 ± 0.91 51.60 ± 4.19 56.72 ± 1.63 75.17 ± 1.26 / 78.99 ± 1.17 96.99 ± 0.14 81.10 ± 1.90 / 83.57 ± 1.62 45.61 ± 2.05 86.55 ± 0.73 94.85 ± 0.27 44.43 ± 1.63 / 47.73 ± 1.60 45.62 ± 1.60 3.0.0
KBLab/megatron-bert-large-swedish-cased-110k 707 80.39 ± 1.31 / 82.47 ± 1.45 96.81 ± 0.27 53.91 ± 1.76 / 56.62 ± 1.71 63.19 ± 0.88 52.97 ± 4.78 43.88 ± 8.56 43.75 ± 5.36 75.79 ± 1.98 85.96 ± 0.93 / 87.48 ± 0.83 85.78 ± 0.88 / 88.40 ± 0.87 98.02 ± 0.08 97.62 ± 0.09 81.26 ± 1.64 / 83.43 ± 1.61 77.58 ± 1.35 / 80.21 ± 1.33 66.36 ± 0.94 64.86 ± 2.39 87.57 ± 0.31 / 90.62 ± 0.32 98.65 ± 0.13 67.73 ± 1.95 / 69.40 ± 1.95 69.37 ± 2.04 55.43 ± 1.61 78.84 ± 0.97 / 82.24 ± 0.82 98.77 ± 0.17 77.56 ± 3.48 / 80.10 ± 3.13 48.56 ± 1.83 85.90 ± 1.32 95.72 ± 0.28 36.59 ± 2.25 / 39.22 ± 2.23 48.90 ± 2.13 3.0.0
KBLab/megatron-bert-base-swedish-cased-600k 516 78.41 ± 1.28 / 80.52 ± 1.16 96.61 ± 0.19 53.76 ± 1.18 / 56.59 ± 1.14 63.05 ± 0.87 52.03 ± 4.53 34.78 ± 8.56 49.30 ± 4.01 71.81 ± 4.58 83.67 ± 0.97 / 85.38 ± 0.90 85.75 ± 0.67 / 88.65 ± 0.48 97.91 ± 0.10 97.31 ± 0.06 80.43 ± 1.46 / 82.91 ± 1.44 78.31 ± 0.85 / 81.09 ± 0.78 64.03 ± 1.41 64.01 ± 3.54 87.34 ± 0.36 / 90.51 ± 0.34 98.60 ± 0.06 68.58 ± 1.19 / 70.35 ± 1.20 65.18 ± 2.49 55.83 ± 1.71 78.21 ± 0.65 / 81.47 ± 0.74 98.85 ± 0.10 83.49 ± 0.99 / 85.50 ± 0.83 46.25 ± 2.85 85.40 ± 0.63 95.36 ± 0.24 39.00 ± 1.67 / 41.75 ± 1.67 47.80 ± 1.95 3.0.0
KBLab/megatron-bert-base-swedish-cased-125k 516 77.40 ± 0.96 / 79.83 ± 1.12 96.23 ± 0.15 50.30 ± 0.96 / 53.24 ± 1.09 61.54 ± 1.32 52.17 ± 5.79 26.23 ± 4.86 43.16 ± 4.62 66.23 ± 4.82 81.25 ± 0.69 / 83.11 ± 0.76 82.20 ± 0.80 / 85.28 ± 0.80 97.74 ± 0.09 97.08 ± 0.10 79.67 ± 0.53 / 82.27 ± 0.49 76.46 ± 0.78 / 79.32 ± 0.78 60.80 ± 1.28 61.68 ± 1.92 86.71 ± 0.27 / 89.72 ± 0.29 98.52 ± 0.05 64.29 ± 1.42 / 66.23 ± 1.41 64.21 ± 2.80 53.90 ± 0.96 76.27 ± 0.85 / 79.73 ± 0.83 98.76 ± 0.12 82.20 ± 1.48 / 84.60 ± 1.28 45.12 ± 2.45 85.45 ± 0.89 95.22 ± 0.29 34.72 ± 1.67 / 37.48 ± 1.64 46.03 ± 1.85 3.0.0
KBLab/bert-base-swedish-cased-new 516 80.52 ± 1.43 / 81.54 ± 1.16 97.28 ± 0.12 61.89 ± 0.88 / 64.68 ± 0.85 61.62 ± 1.67 56.90 ± 3.85 31.07 ± 9.13 52.03 ± 3.88 70.09 ± 4.81 85.82 ± 0.92 / 87.13 ± 0.92 84.91 ± 1.14 / 87.95 ± 0.73 98.08 ± 0.10 97.76 ± 0.10 82.94 ± 0.80 / 85.19 ± 0.75 81.46 ± 1.01 / 83.92 ± 0.98 61.99 ± 1.38 66.15 ± 2.63 88.77 ± 0.32 / 91.54 ± 0.30 98.82 ± 0.04 74.89 ± 1.09 / 76.70 ± 1.05 68.85 ± 3.45 55.44 ± 2.11 79.87 ± 0.93 / 82.94 ± 0.64 98.98 ± 0.08 83.58 ± 1.87 / 85.86 ± 1.48 45.03 ± 2.82 88.30 ± 0.78 96.40 ± 0.29 48.72 ± 1.67 / 51.80 ± 1.75 47.91 ± 2.28 3.0.0
KBLab/roberta-base-swedish-cased 481 74.57 ± 1.70 / 76.84 ± 1.55 96.12 ± 0.18 52.77 ± 1.18 / 55.89 ± 1.21 56.46 ± 1.91 50.69 ± 2.92 30.56 ± 5.12 36.74 ± 3.93 67.44 ± 3.45 80.49 ± 1.04 / 82.21 ± 0.88 80.00 ± 1.19 / 83.85 ± 1.18 97.78 ± 0.11 97.26 ± 0.10 75.42 ± 1.67 / 78.04 ± 1.61 74.78 ± 1.28 / 77.68 ± 1.27 57.29 ± 1.77 62.16 ± 4.06 85.71 ± 0.62 / 89.09 ± 0.48 98.61 ± 0.09 66.49 ± 1.10 / 68.45 ± 1.09 61.60 ± 2.36 49.49 ± 1.66 76.73 ± 0.71 / 80.54 ± 0.72 98.64 ± 0.09 80.97 ± 1.23 / 82.52 ± 1.09 46.82 ± 1.92 85.21 ± 1.02 95.26 ± 0.18 33.12 ± 1.03 / 35.82 ± 0.94 48.18 ± 2.47 3.0.0
KB/bert-base-swedish-cased-alpha 475 75.71 ± 1.95 / 77.88 ± 2.15 95.13 ± 0.16 53.66 ± 0.91 / 56.91 ± 0.90 52.82 ± 1.88 46.43 ± 3.06 25.12 ± 2.94 37.97 ± 3.39 66.02 ± 1.17 81.11 ± 0.65 / 82.88 ± 0.52 81.90 ± 0.75 / 85.24 ± 0.71 96.69 ± 0.11 96.68 ± 0.11 77.74 ± 0.70 / 80.58 ± 0.68 76.81 ± 0.75 / 79.90 ± 0.72 61.72 ± 1.49 65.88 ± 1.54 87.69 ± 0.27 / 90.53 ± 0.21 98.62 ± 0.09 72.33 ± 0.78 / 74.36 ± 0.76 70.61 ± 1.57 54.87 ± 1.49 53.67 ± 0.81 / 57.09 ± 0.90 92.02 ± 0.30 79.36 ± 0.86 / 82.39 ± 0.76 47.85 ± 1.38 77.12 ± 1.07 84.45 ± 0.34 34.46 ± 1.52 / 38.86 ± 1.70 47.95 ± 1.31 3.0.0
KB/electra-small-swedish-cased-discriminator 61 69.20 ± 0.48 / 71.57 ± 0.53 95.74 ± 0.03 40.57 ± 0.42 / 43.57 ± 0.42 40.60 ± 0.30 36.23 ± 0.63 21.96 ± 0.16 32.26 ± 1.48 63.71 ± 0.86 76.84 ± 0.19 / 78.87 ± 0.19 76.00 ± 0.28 / 79.91 ± 0.26 97.16 ± 0.02 97.00 ± 0.03 69.85 ± 0.15 / 72.87 ± 0.16 67.77 ± 0.32 / 70.95 ± 0.33 43.59 ± 0.23 62.36 ± 0.90 82.35 ± 0.13 / 86.87 ± 0.11 98.26 ± 0.02 54.78 ± 0.61 / 57.16 ± 0.62 68.19 ± 0.34 41.54 ± 0.55 68.65 ± 0.27 / 73.17 ± 0.26 94.41 ± 0.22 48.67 ± 0.40 / 52.57 ± 0.40 37.14 ± 0.26 84.33 ± 0.23 94.52 ± 0.07 26.55 ± 0.34 / 28.70 ± 0.36 38.08 ± 0.25 2.3.0
vesteinn/ScandiBERT 475 4.63 ± 0.19 82.50 ± 1.39 / 84.57 ± 1.40 98.47 ± 0.13 67.24 ± 1.20 / 69.57 ± 1.17 67.88 ± 1.10 61.78 ± 4.39 71.64 ± 3.66 68.92 ± 2.51 76.11 ± 3.38 91.11 ± 0.50 / 92.53 ± 0.42 88.63 ± 0.74 / 92.27 ± 0.64 98.79 ± 0.08 98.65 ± 0.07 87.21 ± 0.64 / 88.92 ± 0.60 85.82 ± 0.64 / 87.75 ± 0.64 72.24 ± 1.24 70.59 ± 4.96 86.69 ± 0.36 / 89.69 ± 0.32 98.78 ± 0.07 73.97 ± 1.08 / 75.92 ± 1.07 62.78 ± 2.99 52.37 ± 1.59 88.91 ± 0.77 / 90.96 ± 0.68 99.44 ± 0.07 87.21 ± 2.66 / 88.49 ± 2.42 57.38 ± 1.94 89.76 ± 0.68 98.68 ± 0.08 49.55 ± 1.87 / 51.34 ± 1.86 59.39 ± 1.48 3.0.0
Maltehb/danish-bert-botxo 424 4.62 ± 0.10 74.29 ± 0.34 / 77.94 ± 0.41 97.72 ± 0.03 61.06 ± 0.19 / 63.55 ± 0.19 65.93 ± 0.30 60.18 ± 0.50 64.02 ± 0.64 59.19 ± 0.80 70.56 ± 0.57 77.27 ± 0.22 / 79.72 ± 0.15 75.54 ± 0.27 / 78.42 ± 0.28 97.32 ± 0.04 96.47 ± 0.03 79.99 ± 0.36 / 82.25 ± 0.35 71.15 ± 0.28 / 74.16 ± 0.28 57.47 ± 2.35 68.74 ± 1.16 71.37 ± 0.15 / 74.52 ± 0.17 91.57 ± 0.05 44.38 ± 0.21 / 48.61 ± 0.19 33.14 ± 0.12 30.75 ± 0.51 46.98 ± 0.15 / 50.04 ± 0.13 90.79 ± 0.12 77.13 ± 0.31 / 80.53 ± 0.27 36.81 ± 1.31 76.60 ± 0.28 82.71 ± 0.09 29.60 ± 0.29 / 33.56 ± 0.29 30.50 ± 0.55 2.3.0
flax-community/roberta-base-danish 476 2.82 ± 0.10 79.19 ± 0.54 / 81.66 ± 0.46 98.00 ± 0.03 60.49 ± 0.30 / 63.15 ± 0.29 62.07 ± 1.93 44.87 ± 1.71 22.01 ± 0.25 29.55 ± 2.12 56.94 ± 1.06 85.14 ± 0.16 / 86.76 ± 0.20 80.39 ± 0.47 / 84.13 ± 0.53 98.19 ± 0.02 97.40 ± 0.03 83.12 ± 0.18 / 85.51 ± 0.17 77.85 ± 0.18 / 80.99 ± 0.17 57.19 ± 0.74 65.78 ± 0.52 81.22 ± 0.09 / 85.10 ± 0.09 97.57 ± 0.03 59.49 ± 0.62 / 62.83 ± 0.63 41.48 ± 1.66 26.97 ± 1.21 76.64 ± 0.22 / 79.94 ± 0.21 98.54 ± 0.10 78.33 ± 0.30 / 80.55 ± 0.28 39.58 ± 1.41 83.11 ± 0.27 95.66 ± 0.12 29.59 ± 0.29 / 32.39 ± 0.31 34.91 ± 0.81 2.3.0
flax-community/roberta-base-scandinavian 476 2.84 ± 0.10 81.94 ± 0.35 / 84.90 ± 0.30 97.93 ± 0.04 55.61 ± 0.25 / 58.31 ± 0.26 57.74 ± 0.58 37.63 ± 0.55 23.78 ± 1.83 23.62 ± 0.25 46.94 ± 0.05 86.52 ± 0.17 / 87.97 ± 0.16 85.29 ± 0.25 / 88.47 ± 0.24 98.52 ± 0.02 98.29 ± 0.03 82.83 ± 0.26 / 85.18 ± 0.25 78.38 ± 0.24 / 81.03 ± 0.24 53.70 ± 0.69 66.83 ± 0.42 82.71 ± 0.06 / 86.28 ± 0.06 98.31 ± 0.03 61.95 ± 0.50 / 64.64 ± 0.52 43.17 ± 1.45 27.05 ± 1.37 76.09 ± 0.11 / 79.84 ± 0.13 98.83 ± 0.03 70.12 ± 2.78 / 72.91 ± 2.67 26.02 ± 0.48 82.50 ± 0.41 96.20 ± 0.06 30.09 ± 0.28 / 33.93 ± 0.30 27.85 ± 1.05 2.3.0
Maltehb/aelaectra-danish-electra-small-uncased 55 24.91 ± 1.46 75.72 ± 1.48 / 78.49 ± 1.86 97.98 ± 0.10 63.02 ± 0.90 / 65.16 ± 0.94 63.36 ± 0.66 47.07 ± 3.83 58.16 ± 5.89 57.52 ± 3.73 78.08 ± 2.54 75.36 ± 0.82 / 77.71 ± 0.73 69.76 ± 0.87 / 73.47 ± 0.88 97.16 ± 0.10 96.57 ± 0.15 80.76 ± 0.89 / 83.19 ± 0.88 76.66 ± 0.74 / 79.81 ± 0.73 55.74 ± 3.97 65.05 ± 2.36 73.99 ± 1.20 / 78.20 ± 1.06 96.12 ± 0.16 59.64 ± 0.63 / 63.31 ± 0.58 37.71 ± 3.30 46.06 ± 1.98 70.03 ± 0.91 / 74.52 ± 0.68 98.50 ± 0.11 73.50 ± 2.02 / 76.84 ± 1.84 38.49 ± 0.69 84.18 ± 0.90 94.57 ± 0.34 43.36 ± 2.79 / 46.19 ± 2.76 38.70 ± 0.64 3.0.0
alexanderfalk/danbert-small-cased 321 5.46 ± 0.15 57.20 ± 0.50 / 59.12 ± 0.55 95.48 ± 0.04 42.94 ± 0.13 / 46.20 ± 0.13 51.20 ± 0.30 45.73 ± 0.69 22.73 ± 1.56 45.58 ± 0.89 70.53 ± 0.85 63.79 ± 0.29 / 66.42 ± 0.28 59.64 ± 0.32 / 62.66 ± 0.26 95.17 ± 0.04 94.05 ± 0.04 64.59 ± 0.09 / 68.21 ± 0.09 58.54 ± 2.15 / 62.84 ± 2.12 50.21 ± 0.49 64.26 ± 0.42 66.64 ± 0.14 / 70.92 ± 0.15 92.25 ± 0.04 38.70 ± 0.12 / 42.98 ± 0.13 47.24 ± 0.27 44.43 ± 0.35 59.71 ± 0.16 / 63.28 ± 0.16 97.75 ± 0.05 80.15 ± 0.27 / 81.30 ± 0.25 38.42 ± 0.20 76.28 ± 0.18 91.28 ± 0.10 27.94 ± 0.27 / 30.67 ± 0.27 40.22 ± 0.31 2.3.0
Geotrend/bert-base-da-cased 396 2.62 ± 0.07 82.86 ± 0.50 / 85.01 ± 0.57 97.32 ± 0.03 59.99 ± 0.47 / 62.54 ± 0.47 58.83 ± 0.22 47.76 ± 0.58 22.73 ± 2.14 54.11 ± 0.96 64.71 ± 0.83 86.82 ± 0.16 / 88.18 ± 0.15 85.65 ± 0.15 / 88.92 ± 0.13 98.16 ± 0.03 97.88 ± 0.02 81.89 ± 0.14 / 84.02 ± 0.13 80.01 ± 0.09 / 82.54 ± 0.10 60.48 ± 0.60 74.18 ± 1.56 84.78 ± 0.05 / 88.11 ± 0.06 97.71 ± 0.03 66.30 ± 0.35 / 68.89 ± 0.35 48.26 ± 0.41 49.53 ± 0.43 83.95 ± 0.14 / 85.93 ± 0.15 99.12 ± 0.03 80.51 ± 1.10 / 82.37 ± 0.99 43.96 ± 0.29 89.91 ± 0.14 97.19 ± 0.06 46.68 ± 0.39 / 48.90 ± 0.40 47.80 ± 0.52 2.3.0
Geotrend/distilbert-base-da-cased 234 5.53 ± 0.39 80.79 ± 0.33 / 82.67 ± 0.33 96.79 ± 0.04 54.81 ± 0.21 / 57.76 ± 0.20 54.90 ± 0.26 51.65 ± 0.44 51.71 ± 0.87 44.15 ± 1.25 64.63 ± 0.60 81.33 ± 0.18 / 83.18 ± 0.16 83.71 ± 0.22 / 87.39 ± 0.17 97.73 ± 0.02 97.42 ± 0.03 78.77 ± 0.12 / 81.42 ± 0.12 72.74 ± 0.19 / 75.74 ± 0.19 58.39 ± 0.38 74.04 ± 1.29 82.51 ± 0.08 / 86.13 ± 0.09 96.81 ± 0.03 55.80 ± 0.33 / 59.04 ± 0.33 48.33 ± 0.28 47.82 ± 0.57 79.48 ± 0.13 / 82.35 ± 0.11 98.92 ± 0.02 81.92 ± 0.31 / 83.59 ± 0.29 43.54 ± 0.41 88.92 ± 0.15 96.99 ± 0.04 41.06 ± 0.34 / 43.38 ± 0.35 40.88 ± 0.23 2.3.0
KB/bert-base-swedish-cased 478 4.38 ± 0.08 81.18 ± 0.45 / 82.93 ± 0.51 96.95 ± 0.03 58.08 ± 0.17 / 60.99 ± 0.16 62.27 ± 0.32 57.52 ± 0.71 54.15 ± 1.34 46.08 ± 0.51 71.45 ± 0.87 84.97 ± 0.15 / 86.35 ± 0.17 83.98 ± 0.14 / 87.70 ± 0.17 97.77 ± 0.02 97.45 ± 0.02 84.09 ± 0.07 / 86.32 ± 0.07 79.84 ± 0.10 / 82.35 ± 0.10 63.96 ± 0.18 66.55 ± 0.77 89.11 ± 0.06 / 91.77 ± 0.06 98.57 ± 0.02 75.07 ± 0.12 / 76.82 ± 0.12 70.99 ± 0.53 54.00 ± 0.32 76.61 ± 0.08 / 80.24 ± 0.08 97.32 ± 0.04 80.00 ± 1.03 / 83.22 ± 0.82 52.27 ± 0.32 86.92 ± 0.16 95.52 ± 0.03 45.56 ± 0.32 / 48.92 ± 0.33 51.98 ± 0.39 2.3.0
flax-community/nordic-roberta-wiki 476 2.62 ± 0.07 77.32 ± 0.28 / 81.12 ± 0.32 97.38 ± 0.02 58.13 ± 0.24 / 60.85 ± 0.23 57.78 ± 0.82 43.62 ± 0.33 24.70 ± 1.70 47.33 ± 0.83 68.87 ± 0.78 85.09 ± 0.25 / 86.81 ± 0.24 83.69 ± 0.29 / 87.47 ± 0.24 98.26 ± 0.03 97.67 ± 0.02 81.51 ± 0.19 / 83.80 ± 0.19 76.05 ± 0.36 / 79.05 ± 0.34 60.02 ± 0.63 63.72 ± 0.49 85.10 ± 0.06 / 88.27 ± 0.06 98.09 ± 0.0 63.74 ± 0.12 / 66.19 ± 0.12 50.54 ± 0.36 45.54 ± 0.30 77.58 ± 0.10 / 80.55 ± 0.12 98.52 ± 0.04 81.21 ± 0.35 / 82.97 ± 0.29 48.21 ± 0.34 86.55 ± 0.12 95.92 ± 0.05 37.16 ± 0.39 / 39.87 ± 0.40 49.37 ± 0.28 2.3.0
flax-community/swe-roberta-wiki-oscar 476 2.63 ± 0.20 78.74 ± 0.36 / 81.28 ± 0.34 96.41 ± 0.04 60.27 ± 0.15 / 63.29 ± 0.15 59.30 ± 0.51 40.30 ± 0.57 22.63 ± 1.55 40.51 ± 1.24 62.45 ± 0.87 82.54 ± 0.23 / 83.76 ± 0.24 83.16 ± 0.22 / 85.93 ± 0.19 97.64 ± 0.13 96.94 ± 0.03 84.26 ± 0.08 / 86.57 ± 0.08 74.90 ± 0.13 / 77.97 ± 0.13 61.14 ± 0.36 62.76 ± 0.59 87.07 ± 0.24 / 89.73 ± 0.18 98.31 ± 0.03 71.32 ± 0.10 / 73.19 ± 0.11 54.33 ± 1.37 48.84 ± 0.61 79.93 ± 0.14 / 82.98 ± 0.14 98.08 ± 0.08 80.92 ± 1.05 / 83.04 ± 0.93 48.92 ± 0.51 80.24 ± 0.84 95.24 ± 0.06 40.85 ± 0.50 / 43.49 ± 0.51 37.40 ± 1.46 2.3.0
KB/albert-base-swedish-cased-alpha 54 2.64 ± 0.09 69.88 ± 0.41 / 71.89 ± 0.45 94.50 ± 0.05 51.10 ± 0.44 / 54.44 ± 0.46 46.83 ± 1.21 39.69 ± 0.44 22.58 ± 1.23 29.37 ± 1.07 47.60 ± 0.43 75.07 ± 0.24 / 76.97 ± 0.26 77.02 ± 0.35 / 80.70 ± 0.39 96.49 ± 0.04 96.03 ± 0.05 77.26 ± 0.14 / 80.40 ± 0.15 65.67 ± 1.95 / 69.37 ± 1.92 50.35 ± 1.59 62.84 ± 0.54 77.63 ± 0.09 / 81.36 ± 0.10 94.12 ± 0.04 56.42 ± 0.13 / 59.37 ± 0.14 44.57 ± 0.52 30.21 ± 1.73 65.78 ± 0.59 / 69.94 ± 0.57 95.91 ± 0.32 67.40 ± 1.31 / 70.61 ± 1.27 28.16 ± 0.58 82.25 ± 0.14 89.95 ± 0.11 29.67 ± 0.43 / 32.64 ± 0.45 37.61 ± 0.75 2.3.0
ltgoslo/norbert 427 4.28 ± 0.08 79.05 ± 0.43 / 80.88 ± 0.39 97.39 ± 0.03 52.93 ± 0.34 / 55.33 ± 0.33 59.74 ± 0.29 45.91 ± 1.47 22.63 ± 0.72 56.12 ± 0.96 46.94 ± 0.05 90.21 ± 0.15 / 91.12 ± 0.16 87.48 ± 0.23 / 90.80 ± 0.19 98.51 ± 0.03 98.45 ± 0.02 81.89 ± 0.28 / 83.80 ± 0.27 35.50 ± 0.93 / 37.40 ± 0.93 30.68 ± 0.62 67.17 ± 0.36 82.18 ± 0.09 / 85.79 ± 0.08 55.13 ± 1.05 1.52 ± 0.05 / 7.63 ± 0.09 48.91 ± 1.08 42.96 ± 0.42 75.18 ± 0.40 / 79.13 ± 0.40 92.06 ± 0.06 31.77 ± 0.88 / 36.26 ± 0.81 22.44 ± 0.10 85.90 ± 0.17 94.31 ± 0.09 22.38 ± 0.56 / 25.15 ± 0.57 24.82 ± 0.46 2.3.0
NbAiLab/nb-bert-base 681 4.38 ± 0.10 84.66 ± 0.26 / 86.32 ± 0.28 98.42 ± 0.03 64.53 ± 0.28 / 66.99 ± 0.28 64.64 ± 0.41 65.68 ± 0.65 71.70 ± 0.66 58.73 ± 1.54 79.61 ± 0.85 92.47 ± 0.11 / 93.92 ± 0.11 89.75 ± 0.11 / 93.09 ± 0.09 98.80 ± 0.02 98.90 ± 0.01 85.83 ± 0.06 / 87.43 ± 0.06 83.74 ± 0.04 / 85.51 ± 0.05 76.68 ± 0.41 76.51 ± 1.08 87.23 ± 0.05 / 90.40 ± 0.06 98.30 ± 0.02 73.31 ± 0.11 / 75.32 ± 0.11 43.99 ± 0.91 48.06 ± 0.77 83.67 ± 0.10 / 86.23 ± 0.11 99.22 ± 0.02 84.34 ± 0.75 / 86.15 ± 0.64 54.96 ± 0.29 91.39 ± 0.10 96.78 ± 0.05 52.45 ± 0.41 / 54.94 ± 0.40 56.40 ± 0.24 2.3.0
NbAiLab/nb-bert-large 1330 1.41 ± 0.02 83.17 ± 0.27 / 85.65 ± 0.22 98.65 ± 0.02 66.50 ± 0.23 / 68.67 ± 0.24 66.81 ± 0.40 68.67 ± 0.42 74.88 ± 0.58 58.92 ± 1.69 81.16 ± 0.62 91.70 ± 0.11 / 93.53 ± 0.11 88.77 ± 0.18 / 91.30 ± 0.16 98.56 ± 0.02 98.51 ± 0.02 89.11 ± 0.26 / 90.67 ± 0.25 87.46 ± 0.08 / 89.24 ± 0.08 77.84 ± 0.30 76.64 ± 1.45 86.18 ± 0.05 / 89.42 ± 0.07 98.76 ± 0.03 69.30 ± 0.60 / 71.04 ± 0.60 58.12 ± 0.70 53.28 ± 0.48 78.04 ± 0.17 / 80.59 ± 0.18 98.09 ± 0.04 82.53 ± 0.86 / 84.70 ± 0.77 48.76 ± 0.44 88.82 ± 0.32 97.65 ± 0.04 45.93 ± 0.52 / 48.05 ± 0.52 54.30 ± 0.30 2.3.0
Geotrend/bert-base-no-cased 397 2.59 ± 0.07 82.22 ± 0.26 / 85.55 ± 0.29 97.22 ± 0.03 63.63 ± 0.15 / 66.28 ± 0.16 58.46 ± 0.29 49.46 ± 0.60 22.73 ± 2.10 53.54 ± 0.92 69.05 ± 0.72 87.83 ± 0.13 / 89.09 ± 0.14 86.57 ± 0.25 / 89.18 ± 0.19 98.21 ± 0.03 97.99 ± 0.02 82.17 ± 0.19 / 84.24 ± 0.20 80.41 ± 0.17 / 82.86 ± 0.16 61.88 ± 0.28 69.43 ± 0.97 85.26 ± 0.07 / 88.23 ± 0.06 97.77 ± 0.03 64.25 ± 0.68 / 66.84 ± 0.65 47.80 ± 0.39 47.25 ± 0.60 83.38 ± 0.25 / 85.84 ± 0.26 99.11 ± 0.02 82.03 ± 0.82 / 83.72 ± 0.73 51.78 ± 0.31 89.23 ± 0.16 97.28 ± 0.05 43.74 ± 0.41 / 45.88 ± 0.40 46.55 ± 0.37 2.3.0
Geotrend/distilbert-base-no-cased 235 8.67 ± 0.26 79.62 ± 0.34 / 81.75 ± 0.34 96.70 ± 0.05 55.48 ± 0.25 / 58.52 ± 0.24 55.52 ± 0.31 40.56 ± 0.46 23.67 ± 1.66 37.13 ± 0.49 58.93 ± 0.81 81.83 ± 0.21 / 83.96 ± 0.20 85.75 ± 0.26 / 89.06 ± 0.21 97.72 ± 0.02 97.45 ± 0.03 78.25 ± 0.11 / 80.92 ± 0.10 73.10 ± 0.36 / 76.13 ± 0.36 55.38 ± 0.48 69.34 ± 0.85 82.83 ± 0.12 / 86.26 ± 0.10 96.84 ± 0.05 54.59 ± 0.14 / 57.66 ± 0.14 46.44 ± 0.25 45.09 ± 0.50 79.81 ± 0.16 / 82.57 ± 0.12 98.95 ± 0.02 83.81 ± 0.59 / 85.18 ± 0.51 48.36 ± 0.28 89.82 ± 0.15 97.03 ± 0.03 42.58 ± 0.30 / 45.13 ± 0.30 40.91 ± 0.97 2.3.0
ViktorAlm/electra-base-norwegian-uncased-discriminator 416 4.38 ± 0.10 61.70 ± 0.40 / 59.20 ± 0.44 94.73 ± 0.05 58.10 ± 0.25 / 61.70 ± 0.24 60.46 ± 0.27 44.62 ± 0.31 59.79 ± 0.74 60.94 ± 1.19 69.12 ± 1.00 69.53 ± 0.24 / 70.65 ± 0.24 69.34 ± 0.38 / 71.08 ± 0.41 96.70 ± 0.03 96.00 ± 0.02 83.71 ± 0.08 / 86.09 ± 0.07 80.25 ± 0.22 / 83.17 ± 0.21 73.00 ± 0.24 64.82 ± 0.47 61.72 ± 0.17 / 65.39 ± 0.17 95.22 ± 0.04 60.04 ± 0.22 / 64.32 ± 0.23 47.67 ± 1.13 48.93 ± 0.60 29.60 ± 1.53 / 32.15 ± 1.58 93.90 ± 0.06 77.98 ± 0.61 / 81.32 ± 0.49 41.08 ± 1.03 69.74 ± 0.42 87.11 ± 0.10 38.55 ± 0.34 / 42.45 ± 0.36 41.46 ± 0.49 2.3.0
sarnikowski/electra-small-discriminator-da-256-cased 51 19.76 ± 1.28 74.84 ± 0.55 / 77.51 ± 0.53 97.76 ± 0.03 55.55 ± 0.29 / 58.10 ± 0.27 49.54 ± 0.28 41.20 ± 0.45 49.08 ± 0.53 57.99 ± 1.02 65.16 ± 0.92 78.90 ± 0.22 / 80.72 ± 0.21 76.09 ± 0.28 / 79.38 ± 0.26 97.77 ± 0.03 97.18 ± 0.02 77.71 ± 0.17 / 80.49 ± 0.16 72.56 ± 0.28 / 76.16 ± 0.27 45.04 ± 0.15 69.09 ± 0.86 73.44 ± 0.14 / 77.33 ± 0.13 90.89 ± 0.06 43.75 ± 0.38 / 48.39 ± 0.40 39.00 ± 0.25 30.21 ± 1.18 45.16 ± 0.12 / 48.02 ± 0.14 90.78 ± 0.11 66.85 ± 0.41 / 73.86 ± 0.32 38.78 ± 0.36 78.36 ± 0.15 83.93 ± 0.09 31.23 ± 0.31 / 35.34 ± 0.33 37.20 ± 0.41 2.3.0
setu4993/LaBSE 1750 5.07 ± 0.11 83.38 ± 0.33 / 85.41 ± 0.42 98.09 ± 0.02 66.08 ± 0.41 / 68.80 ± 0.39 66.53 ± 0.33 71.12 ± 0.53 68.69 ± 0.59 67.68 ± 0.79 74.77 ± 0.62 88.88 ± 0.14 / 90.49 ± 0.15 91.19 ± 0.18 / 93.62 ± 0.19 98.67 ± 0.02 98.19 ± 0.03 86.36 ± 0.07 / 88.23 ± 0.06 82.11 ± 0.48 / 84.31 ± 0.47 71.02 ± 0.34 65.74 ± 0.38 85.33 ± 0.06 / 88.36 ± 0.06 98.66 ± 0.03 70.23 ± 0.26 / 72.31 ± 0.26 56.56 ± 0.32 52.66 ± 0.33 88.51 ± 0.10 / 88.84 ± 0.15 99.54 ± 0.01 88.61 ± 0.17 / 89.73 ± 0.16 59.71 ± 0.23 90.13 ± 0.18 98.21 ± 0.03 51.99 ± 0.42 / 54.14 ± 0.43 60.67 ± 0.35 2.3.0
vesteinn/IceBERT 622 3.32 ± 0.07 71.38 ± 0.49 / 74.11 ± 0.49 95.48 ± 0.07 61.19 ± 0.35 / 65.05 ± 0.37 53.47 ± 0.32 38.99 ± 0.27 23.66 ± 0.78 36.69 ± 1.24 46.94 ± 0.05 80.43 ± 0.22 / 81.95 ± 0.23 78.67 ± 0.29 / 83.42 ± 0.19 97.36 ± 0.02 97.21 ± 0.02 83.40 ± 0.21 / 86.26 ± 0.20 80.86 ± 0.23 / 84.00 ± 0.22 41.94 ± 0.61 60.57 ± 0.39 77.98 ± 0.10 / 81.44 ± 0.10 96.08 ± 0.05 66.97 ± 0.10 / 71.06 ± 0.12 33.17 ± 0.12 46.76 ± 0.37 90.91 ± 0.09 / 92.76 ± 0.09 99.46 ± 0.02 90.32 ± 0.45 / 91.64 ± 0.41 53.50 ± 0.29 89.38 ± 0.14 97.94 ± 0.03 47.45 ± 0.41 / 49.52 ± 0.41 51.14 ± 0.42 2.3.0
jonfd/convbert-small-igc-is 82 12.99 ± 2.24 69.40 ± 4.27 / 73.29 ± 4.61 94.43 ± 0.46 46.94 ± 3.18 / 50.91 ± 3.16 41.16 ± 0.65 33.81 ± 0.37 21.96 ± 1.57 34.83 ± 7.99 57.63 ± 15.95 75.48 ± 3.28 / 78.23 ± 3.11 75.10 ± 2.78 / 78.91 ± 2.68 96.86 ± 0.35 96.66 ± 0.34 72.41 ± 0.94 / 76.04 ± 0.92 67.38 ± 4.16 / 71.42 ± 3.84 40.22 ± 1.26 62.99 ± 3.89 77.09 ± 0.95 / 81.56 ± 0.86 95.01 ± 0.44 48.94 ± 2.45 / 53.68 ± 2.35 46.53 ± 8.93 46.72 ± 3.40 86.81 ± 1.02 / 89.65 ± 1.11 99.43 ± 0.17 80.90 ± 4.34 / 82.05 ± 4.14 46.03 ± 11.45 88.12 ± 1.29 97.04 ± 0.46 39.12 ± 3.58 / 41.44 ± 3.69 44.66 ± 8.07 2.3.0
vesteinn/XLMR-ENIS 475 3.61 ± 0.13 79.24 ± 3.32 / 81.32 ± 3.30 97.13 ± 0.40 62.40 ± 1.98 / 65.34 ± 2.06 52.85 ± 2.46 48.81 ± 24.30 24.74 ± 6.35 36.05 ± 18.55 73.56 ± 5.56 82.51 ± 2.56 / 83.79 ± 2.80 79.64 ± 3.14 / 83.52 ± 2.53 97.93 ± 0.38 97.62 ± 0.22 82.27 ± 5.47 / 84.82 ± 5.29 77.38 ± 8.44 / 80.24 ± 8.18 58.98 ± 3.00 68.87 ± 3.66 83.02 ± 0.78 / 86.07 ± 0.72 98.00 ± 0.22 67.68 ± 4.76 / 70.32 ± 4.64 48.80 ± 10.47 33.10 ± 6.08 88.00 ± 1.42 / 90.01 ± 1.38 99.44 ± 0.16 81.95 ± 29.08 / 83.49 ± 28.69 57.55 ± 2.50 53.48 ± 17.57 97.93 ± 0.36 49.64 ± 5.20 / 51.71 ± 5.24 53.48 ± 17.57 2.3.0
neurocode/IsRoBERTa 319 8.58 ± 0.26 59.80 ± 0.38 / 61.70 ± 0.43 93.17 ± 0.11 36.29 ± 0.24 / 40.29 ± 0.26 49.21 ± 0.23 45.35 ± 0.45 21.96 ± 0.16 35.67 ± 0.97 67.93 ± 0.82 71.63 ± 0.27 / 73.30 ± 0.26 70.76 ± 0.26 / 73.74 ± 0.29 96.16 ± 0.03 95.89 ± 0.02 67.45 ± 0.25 / 71.42 ± 0.24 63.78 ± 0.22 / 67.94 ± 0.21 48.47 ± 0.26 62.56 ± 0.49 73.90 ± 0.15 / 77.64 ± 0.15 93.51 ± 0.06 39.58 ± 0.15 / 44.06 ± 0.17 33.17 ± 0.12 42.12 ± 0.41 76.57 ± 0.13 / 80.66 ± 0.11 99.27 ± 0.02 84.35 ± 0.23 / 85.39 ± 0.22 50.53 ± 0.19 82.16 ± 0.18 96.76 ± 0.04 33.22 ± 0.27 / 35.32 ± 0.27 50.45 ± 0.15 2.3.0
jonfd/electra-small-nordic 84 25.25 ± 1.26 78.75 ± 0.36 / 80.72 ± 0.39 98.06 ± 0.02 60.97 ± 0.15 / 63.12 ± 0.15 64.38 ± 0.28 42.15 ± 0.44 47.39 ± 1.11 58.43 ± 1.69 68.18 ± 0.94 87.42 ± 0.14 / 89.41 ± 0.17 85.49 ± 0.27 / 89.06 ± 0.24 98.59 ± 0.02 98.52 ± 0.02 82.74 ± 0.12 / 84.55 ± 0.12 80.42 ± 0.16 / 82.49 ± 0.16 66.83 ± 0.37 69.06 ± 0.91 84.62 ± 0.07 / 87.88 ± 0.07 98.42 ± 0.02 67.40 ± 0.27 / 69.65 ± 0.28 68.93 ± 0.34 50.51 ± 0.42 86.10 ± 0.16 / 89.00 ± 0.16 99.40 ± 0.02 84.93 ± 0.29 / 86.25 ± 0.28 48.20 ± 1.32 89.45 ± 0.18 97.70 ± 0.05 45.02 ± 0.41 / 47.05 ± 0.42 53.16 ± 1.12 2.3.0
xlm-roberta-base 1040 4.23 ± 0.07 82.92 ± 1.51 / 84.47 ± 1.66 98.30 ± 0.13 71.93 ± 1.34 / 74.32 ± 1.36 67.41 ± 1.25 52.21 ± 4.26 70.06 ± 2.83 71.71 ± 3.31 73.79 ± 2.68 89.98 ± 0.55 / 90.99 ± 0.44 88.58 ± 0.86 / 91.45 ± 0.75 98.64 ± 0.09 98.44 ± 0.09 87.05 ± 0.47 / 88.87 ± 0.43 85.52 ± 1.08 / 87.67 ± 1.01 72.06 ± 1.37 67.65 ± 1.11 86.85 ± 0.51 / 89.81 ± 0.36 98.70 ± 0.04 75.72 ± 1.59 / 77.71 ± 1.59 48.76 ± 8.27 52.74 ± 1.59 85.56 ± 0.68 / 87.77 ± 0.59 99.37 ± 0.07 85.45 ± 1.78 / 86.97 ± 1.61 55.27 ± 1.15 89.80 ± 1.00 97.88 ± 0.08 54.20 ± 1.90 / 56.47 ± 1.89 58.29 ± 1.37 3.0.0
xlm-roberta-large 2090 1.16 ± 0.01 85.91 ± 0.41 / 87.89 ± 0.35 98.66 ± 0.03 71.42 ± 0.50 / 73.62 ± 0.50 54.22 ± 3.73 55.75 ± 0.35 73.56 ± 0.73 59.85 ± 2.71 80.22 ± 0.76 91.19 ± 0.10 / 92.08 ± 0.09 90.42 ± 0.28 / 92.61 ± 0.23 98.67 ± 0.03 98.59 ± 0.02 85.32 ± 0.27 / 86.86 ± 0.27 86.22 ± 0.28 / 88.02 ± 0.28 75.52 ± 0.33 66.82 ± 0.41 88.07 ± 0.11 / 90.63 ± 0.11 98.83 ± 0.02 74.41 ± 0.84 / 76.01 ± 0.86 36.80 ± 2.11 55.36 ± 0.44 89.77 ± 0.21 / 89.66 ± 0.26 99.45 ± 0.02 88.55 ± 0.42 / 89.64 ± 0.38 56.63 ± 0.27 91.09 ± 0.11 98.45 ± 0.02 47.89 ± 0.94 / 49.53 ± 0.93 59.50 ± 0.35 2.3.0
bert-base-multilingual-cased 681 4.28 ± 0.08 81.71 ± 0.26 / 83.91 ± 0.29 97.38 ± 0.02 61.38 ± 0.38 / 63.90 ± 0.36 62.19 ± 0.21 43.16 ± 0.69 22.73 ± 2.03 56.44 ± 0.89 69.46 ± 0.72 86.93 ± 0.19 / 88.22 ± 0.18 88.07 ± 0.18 / 90.82 ± 0.17 98.25 ± 0.02 98.03 ± 0.03 84.30 ± 0.05 / 86.33 ± 0.05 77.38 ± 1.79 / 79.90 ± 1.82 62.48 ± 0.27 67.65 ± 0.96 85.65 ± 0.09 / 88.63 ± 0.08 98.01 ± 0.03 67.09 ± 0.49 / 69.57 ± 0.48 48.27 ± 0.79 47.01 ± 0.49 83.39 ± 0.36 / 85.54 ± 0.33 99.27 ± 0.02 78.05 ± 0.98 / 79.63 ± 0.91 52.67 ± 0.65 90.39 ± 0.22 97.67 ± 0.05 46.37 ± 0.44 / 48.64 ± 0.43 45.07 ± 0.36 2.3.0
distilbert-base-multilingual-cased 517 8.76 ± 0.23 81.24 ± 0.35 / 83.51 ± 0.34 96.87 ± 0.04 54.55 ± 0.32 / 57.46 ± 0.33 56.12 ± 0.24 51.44 ± 0.49 38.20 ± 1.21 55.61 ± 1.03 72.95 ± 1.09 82.57 ± 0.16 / 84.47 ± 0.15 83.23 ± 0.29 / 86.74 ± 0.21 97.81 ± 0.02 97.52 ± 0.04 79.53 ± 0.15 / 82.15 ± 0.14 71.50 ± 0.25 / 74.49 ± 0.25 54.25 ± 0.55 67.53 ± 0.54 83.30 ± 0.08 / 86.79 ± 0.08 97.25 ± 0.04 60.97 ± 0.25 / 64.07 ± 0.26 47.59 ± 0.47 46.56 ± 0.50 81.27 ± 0.15 / 84.11 ± 0.13 99.13 ± 0.02 80.07 ± 0.75 / 81.48 ± 0.70 48.69 ± 1.06 88.91 ± 0.17 96.73 ± 0.06 41.22 ± 0.37 / 43.60 ± 0.38 41.14 ± 0.60 2.3.0
cardiffnlp/twitter-xlm-roberta-base 1040 4.04 ± 0.07 78.07 ± 0.34 / 79.48 ± 0.37 98.06 ± 0.03 68.97 ± 0.46 / 71.42 ± 0.45 68.39 ± 0.43 47.23 ± 0.56 66.05 ± 0.75 67.40 ± 1.25 76.83 ± 0.64 87.70 ± 0.15 / 88.97 ± 0.13 84.27 ± 0.25 / 87.28 ± 0.23 98.43 ± 0.03 98.22 ± 0.02 86.21 ± 0.09 / 88.12 ± 0.09 84.23 ± 0.27 / 86.46 ± 0.27 71.13 ± 0.22 66.87 ± 0.40 85.40 ± 0.05 / 88.54 ± 0.06 98.60 ± 0.02 71.69 ± 0.44 / 73.76 ± 0.45 48.68 ± 2.53 50.16 ± 0.37 82.05 ± 0.12 / 85.15 ± 0.09 99.40 ± 0.02 85.40 ± 0.45 / 86.88 ± 0.43 48.89 ± 0.71 89.17 ± 0.19 97.49 ± 0.06 52.51 ± 0.40 / 54.86 ± 0.41 58.93 ± 0.24 2.3.0
Geotrend/bert-base-en-da-cased 424 4.38 ± 0.09 83.73 ± 0.29 / 86.41 ± 0.25 97.36 ± 0.03 61.89 ± 0.20 / 64.39 ± 0.20 57.80 ± 0.35 50.14 ± 1.12 22.73 ± 2.12 54.04 ± 0.88 63.65 ± 1.29 86.19 ± 0.15 / 87.76 ± 0.13 86.74 ± 0.20 / 89.79 ± 0.17 98.15 ± 0.02 98.05 ± 0.03 81.23 ± 0.17 / 83.35 ± 0.18 76.46 ± 0.38 / 78.98 ± 0.38 62.44 ± 0.26 72.99 ± 1.46 84.48 ± 0.05 / 87.56 ± 0.06 97.48 ± 0.03 65.76 ± 0.31 / 68.38 ± 0.30 46.87 ± 0.43 47.93 ± 0.42 83.74 ± 0.14 / 86.18 ± 0.14 99.21 ± 0.02 81.07 ± 0.75 / 82.84 ± 0.68 49.54 ± 0.28 90.45 ± 0.11 97.30 ± 0.04 46.95 ± 0.47 / 49.25 ± 0.48 41.70 ± 0.39 2.3.0
Geotrend/bert-base-25lang-cased 578 4.41 ± 0.09 81.87 ± 0.36 / 84.11 ± 0.40 97.46 ± 0.03 62.43 ± 0.41 / 64.95 ± 0.40 59.62 ± 0.39 57.33 ± 0.59 54.04 ± 0.88 49.78 ± 0.82 67.19 ± 0.85 88.02 ± 0.12 / 89.15 ± 0.12 86.32 ± 0.28 / 89.03 ± 0.24 98.24 ± 0.03 98.03 ± 0.02 82.68 ± 0.17 / 84.75 ± 0.17 80.35 ± 0.21 / 82.82 ± 0.20 62.97 ± 0.29 70.33 ± 1.59 84.97 ± 0.05 / 88.25 ± 0.05 97.90 ± 0.03 64.69 ± 0.56 / 67.21 ± 0.56 45.02 ± 0.50 47.82 ± 0.46 81.22 ± 0.23 / 83.87 ± 0.23 99.22 ± 0.02 77.49 ± 0.93 / 79.44 ± 0.86 44.78 ± 1.11 90.50 ± 0.14 97.47 ± 0.03 47.52 ± 0.33 / 49.57 ± 0.34 43.65 ± 0.20 2.3.0
Geotrend/bert-base-en-fr-de-no-da-cased 451 4.31 ± 0.09 80.89 ± 0.42 / 83.33 ± 0.35 97.21 ± 0.03 60.58 ± 0.44 / 63.06 ± 0.44 59.17 ± 0.21 52.27 ± 0.55 22.73 ± 1.88 53.72 ± 1.05 65.85 ± 0.87 86.80 ± 0.27 / 88.42 ± 0.20 86.17 ± 0.12 / 89.40 ± 0.15 98.21 ± 0.02 98.05 ± 0.02 82.23 ± 0.22 / 84.34 ± 0.22 79.07 ± 0.21 / 81.52 ± 0.21 64.61 ± 0.37 74.97 ± 1.34 85.62 ± 0.17 / 88.58 ± 0.17 97.69 ± 0.03 63.44 ± 0.13 / 65.91 ± 0.13 46.55 ± 0.36 45.34 ± 0.47 82.55 ± 0.29 / 84.92 ± 0.29 99.20 ± 0.02 78.93 ± 0.89 / 80.93 ± 0.82 40.66 ± 0.70 90.35 ± 0.16 96.83 ± 0.04 47.75 ± 0.38 / 49.79 ± 0.38 46.52 ± 0.45 2.3.0
Geotrend/distilbert-base-25lang-cased 415 8.67 ± 0.30 81.23 ± 0.36 / 83.28 ± 0.35 96.68 ± 0.07 55.91 ± 0.31 / 58.84 ± 0.31 57.27 ± 0.25 46.32 ± 1.02 56.26 ± 0.85 45.45 ± 0.89 67.78 ± 1.37 83.89 ± 0.25 / 85.67 ± 0.27 84.81 ± 0.23 / 88.09 ± 0.19 97.81 ± 0.02 97.54 ± 0.03 78.19 ± 0.11 / 80.77 ± 0.11 74.40 ± 0.38 / 77.42 ± 0.39 55.33 ± 0.51 73.66 ± 1.40 82.69 ± 0.90 / 86.39 ± 0.88 97.08 ± 0.04 57.13 ± 0.37 / 60.24 ± 0.37 47.74 ± 0.31 49.64 ± 0.38 80.48 ± 0.19 / 83.14 ± 0.16 99.09 ± 0.02 83.18 ± 0.26 / 84.80 ± 0.23 49.50 ± 0.29 89.16 ± 0.13 96.99 ± 0.05 40.24 ± 0.40 / 42.63 ± 0.42 30.02 ± 0.24 2.3.0
Geotrend/distilbert-base-en-fr-de-no-da-cased 288 8.66 ± 0.23 79.12 ± 0.49 / 81.49 ± 0.51 96.83 ± 0.03 54.67 ± 0.30 / 57.54 ± 0.31 56.08 ± 0.32 44.89 ± 1.08 36.83 ± 1.10 38.31 ± 1.28 67.79 ± 0.94 81.87 ± 0.23 / 83.94 ± 0.23 83.06 ± 0.25 / 86.77 ± 0.21 97.79 ± 0.02 97.57 ± 0.03 78.77 ± 0.20 / 81.32 ± 0.19 71.62 ± 0.29 / 74.70 ± 0.29 55.86 ± 0.59 67.32 ± 0.38 83.00 ± 0.10 / 86.35 ± 0.09 96.70 ± 0.04 56.76 ± 0.16 / 59.79 ± 0.16 48.10 ± 0.38 48.25 ± 0.57 79.25 ± 0.15 / 82.03 ± 0.12 99.00 ± 0.02 86.00 ± 0.17 / 87.16 ± 0.16 36.33 ± 0.89 89.67 ± 0.12 96.73 ± 0.06 43.24 ± 0.32 / 45.72 ± 0.32 47.48 ± 0.79 2.3.0
Geotrend/bert-base-en-no-cased 425 4.18 ± 0.11 82.55 ± 0.45 / 85.83 ± 0.36 97.25 ± 0.02 59.86 ± 0.30 / 62.61 ± 0.29 56.68 ± 0.31 52.82 ± 0.46 22.53 ± 2.05 50.65 ± 0.76 67.40 ± 0.99 87.90 ± 0.16 / 89.17 ± 0.16 88.18 ± 0.23 / 91.19 ± 0.19 98.28 ± 0.03 98.01 ± 0.03 82.55 ± 0.15 / 84.59 ± 0.15 78.79 ± 0.13 / 81.23 ± 0.13 63.64 ± 0.29 67.17 ± 1.15 84.78 ± 0.05 / 87.83 ± 0.05 97.76 ± 0.03 63.43 ± 0.36 / 65.98 ± 0.37 46.25 ± 0.79 49.62 ± 0.38 81.76 ± 0.29 / 84.27 ± 0.29 99.06 ± 0.02 80.02 ± 1.07 / 81.93 ± 0.97 40.16 ± 0.62 89.05 ± 0.23 97.39 ± 0.04 48.27 ± 0.53 / 50.55 ± 0.54 47.04 ± 0.34 2.3.0
Geotrend/distilbert-base-en-no-cased 263 8.71 ± 0.50 77.16 ± 0.54 / 79.64 ± 0.54 96.71 ± 0.05 54.13 ± 0.18 / 57.10 ± 0.19 53.32 ± 0.32 47.63 ± 0.77 35.70 ± 1.30 38.24 ± 2.38 71.04 ± 0.56 82.05 ± 0.21 / 84.09 ± 0.21 84.19 ± 0.28 / 87.81 ± 0.23 97.83 ± 0.02 97.56 ± 0.02 78.28 ± 0.08 / 80.80 ± 0.08 74.23 ± 0.21 / 77.25 ± 0.20 57.58 ± 0.60 67.21 ± 0.54 83.45 ± 0.10 / 86.68 ± 0.09 97.01 ± 0.04 57.46 ± 0.33 / 60.64 ± 0.33 47.25 ± 0.38 47.72 ± 0.37 80.10 ± 0.12 / 83.07 ± 0.11 98.90 ± 0.02 80.03 ± 0.63 / 81.79 ± 0.57 40.85 ± 0.31 89.10 ± 0.16 96.95 ± 0.04 40.88 ± 0.43 / 43.26 ± 0.43 44.39 ± 0.59 2.3.0
Geotrend/distilbert-base-en-da-cased 262 8.63 ± 0.24 80.18 ± 0.40 / 82.02 ± 0.42 96.72 ± 0.05 55.99 ± 0.27 / 58.92 ± 0.28 57.03 ± 0.28 46.49 ± 0.89 41.29 ± 1.31 39.43 ± 1.62 67.34 ± 0.91 80.46 ± 0.31 / 82.47 ± 0.26 83.60 ± 0.27 / 86.67 ± 0.23 97.73 ± 0.02 97.54 ± 0.03 77.77 ± 0.18 / 80.50 ± 0.17 74.58 ± 0.29 / 77.55 ± 0.27 56.33 ± 0.40 74.07 ± 1.01 82.56 ± 0.11 / 85.93 ± 0.12 96.71 ± 0.04 56.60 ± 0.30 / 59.68 ± 0.31 34.30 ± 0.68 46.37 ± 0.44 78.13 ± 0.13 / 81.05 ± 0.10 99.08 ± 0.02 82.52 ± 0.93 / 84.03 ± 0.83 46.88 ± 0.15 89.90 ± 0.13 97.01 ± 0.05 42.44 ± 0.36 / 44.96 ± 0.37 41.63 ± 0.46 2.3.0
sarnikowski/convbert-medium-small-da-cased 94 8.78 ± 1.35 78.89 ± 0.59 / 81.62 ± 0.56 97.85 ± 0.02 57.47 ± 0.49 / 60.10 ± 0.49 64.64 ± 0.25 47.45 ± 0.42 55.58 ± 1.70 63.00 ± 0.88 70.98 ± 0.71 82.56 ± 0.21 / 84.46 ± 0.19 76.86 ± 0.25 / 80.40 ± 0.27 97.81 ± 0.03 97.45 ± 0.02 76.24 ± 0.24 / 78.91 ± 0.24 72.74 ± 0.18 / 76.12 ± 0.18 61.32 ± 0.30 64.94 ± 0.54 76.31 ± 0.12 / 79.38 ± 0.12 91.44 ± 0.05 43.46 ± 0.10 / 47.95 ± 0.11 40.69 ± 0.53 44.44 ± 0.54 48.06 ± 0.13 / 51.23 ± 0.14 91.15 ± 0.10 73.65 ± 0.38 / 78.31 ± 0.32 43.75 ± 1.14 79.08 ± 0.15 84.06 ± 0.10 31.00 ± 0.34 / 35.01 ± 0.35 40.56 ± 0.82 2.3.0
sarnikowski/convbert-small-da-cased 50 15.84 ± 0.77 75.17 ± 0.44 / 77.59 ± 0.53 97.63 ± 0.02 52.11 ± 0.44 / 54.86 ± 0.45 63.19 ± 0.20 41.65 ± 0.43 42.15 ± 2.21 54.51 ± 0.69 72.36 ± 0.61 79.48 ± 0.23 / 81.52 ± 0.22 75.73 ± 0.34 / 79.22 ± 0.31 97.54 ± 0.03 97.15 ± 0.02 72.15 ± 0.53 / 75.04 ± 0.51 66.47 ± 0.22 / 69.89 ± 0.23 46.62 ± 0.19 64.23 ± 0.54 72.70 ± 0.18 / 76.56 ± 0.17 90.55 ± 0.05 42.09 ± 0.13 / 46.88 ± 0.12 40.00 ± 0.59 43.73 ± 0.84 47.73 ± 0.15 / 50.93 ± 0.15 90.69 ± 0.11 70.97 ± 0.48 / 76.04 ± 0.38 41.29 ± 1.01 78.15 ± 0.28 84.54 ± 0.10 27.97 ± 0.33 / 31.87 ± 0.37 35.59 ± 0.26 2.3.0
birgermoell/roberta-swedish-scandi 476 4.39 ± 0.08 73.92 ± 0.44 / 76.76 ± 0.40 96.54 ± 0.04 53.75 ± 0.61 / 57.27 ± 0.58 57.58 ± 0.28 39.10 ± 0.49 22.01 ± 0.19 45.33 ± 1.32 65.66 ± 0.90 78.65 ± 0.20 / 79.96 ± 0.23 77.93 ± 0.28 / 81.75 ± 0.27 97.88 ± 0.03 96.99 ± 0.04 82.84 ± 0.25 / 85.65 ± 0.23 79.13 ± 0.09 / 82.42 ± 0.08 45.58 ± 0.91 68.27 ± 1.00 85.15 ± 0.05 / 88.35 ± 0.04 98.26 ± 0.02 68.61 ± 0.18 / 71.47 ± 0.16 49.41 ± 0.27 49.26 ± 0.22 77.22 ± 0.11 / 80.62 ± 0.12 98.40 ± 0.05 77.74 ± 0.60 / 79.80 ± 0.54 47.56 ± 0.25 85.38 ± 0.19 95.28 ± 0.08 32.99 ± 0.34 / 36.30 ± 0.35 39.25 ± 0.16 2.3.0
random-roberta 478 3.22 ± 0.05 32.65 ± 0.30 / 30.70 ± 0.33 81.92 ± 0.09 22.57 ± 0.14 / 27.23 ± 0.14 37.85 ± 0.21 24.04 ± 0.81 21.96 ± 0.16 23.80 ± 0.25 46.94 ± 0.05 48.36 ± 0.20 / 52.13 ± 0.18 42.55 ± 0.26 / 45.53 ± 0.24 93.31 ± 0.05 91.64 ± 0.10 59.44 ± 0.10 / 64.07 ± 0.10 50.52 ± 0.36 / 55.78 ± 0.35 39.07 ± 0.49 52.94 ± 2.74 56.13 ± 0.84 / 59.51 ± 0.94 81.88 ± 0.06 23.21 ± 0.17 / 28.43 ± 0.17 33.17 ± 0.12 29.03 ± 0.69 54.68 ± 0.20 / 57.96 ± 0.16 95.71 ± 0.07 76.12 ± 0.27 / 77.50 ± 0.26 38.68 ± 0.35 70.74 ± 0.31 85.33 ± 0.09 18.58 ± 0.19 / 22.14 ± 0.20 38.67 ± 0.21 2.3.0