Pretrained Benchmark

Model ID Size Speed Score DA NO SV IS FO NER POS DEP CLF DaNE DDT-POS DDT-DEP AngryTweets TwitterSent Europarl LCC DKHate NorNE-NB NorNE-NN NDT-NB-POS NDT-NN-POS NDT-NB-DEP NDT-NN-DEP NoReC NorDial SUC3 SDT-POS SDT-DEP DaLaJ ABSAbank-Imm MIM-GOLD-NER IDT-POS IDT-DEP NoReC-IS WikiANN-FO FDT-POS FDT-DEP NoReC-FO
Maltehb/danish-bert-botxo 424 4.62 ± 0.10 74.29 ± 0.34 / 77.94 ± 0.41 97.72 ± 0.03 61.06 ± 0.19 / 63.55 ± 0.19 65.93 ± 0.30 60.18 ± 0.50 64.02 ± 0.64 59.19 ± 0.80 70.56 ± 0.57 77.27 ± 0.22 / 79.72 ± 0.15 75.54 ± 0.27 / 78.42 ± 0.28 97.32 ± 0.04 96.47 ± 0.03 79.99 ± 0.36 / 82.25 ± 0.35 71.15 ± 0.28 / 74.16 ± 0.28 57.47 ± 2.35 68.74 ± 1.16 71.37 ± 0.15 / 74.52 ± 0.17 91.57 ± 0.05 44.38 ± 0.21 / 48.61 ± 0.19 33.14 ± 0.12 30.75 ± 0.51 46.98 ± 0.15 / 50.04 ± 0.13 90.79 ± 0.12 77.13 ± 0.31 / 80.53 ± 0.27 36.81 ± 1.31 76.60 ± 0.28 82.71 ± 0.09 29.60 ± 0.29 / 33.56 ± 0.29 30.50 ± 0.55
Maltehb/aelaectra-danish-electra-small-cased 55 25.25 ± 1.26 75.62 ± 0.55 / 78.12 ± 0.59 98.04 ± 0.02 61.14 ± 0.36 / 63.24 ± 0.36 60.92 ± 0.56 44.08 ± 0.36 59.35 ± 1.89 58.34 ± 1.57 76.90 ± 0.91 79.51 ± 0.19 / 81.41 ± 0.19 77.21 ± 0.27 / 80.87 ± 0.27 98.11 ± 0.02 97.42 ± 0.03 80.68 ± 0.22 / 82.96 ± 0.21 76.37 ± 0.18 / 79.48 ± 0.18 58.23 ± 0.92 66.66 ± 0.38 78.35 ± 0.12 / 83.03 ± 0.10 96.29 ± 0.04 58.72 ± 0.41 / 62.47 ± 0.41 42.60 ± 0.39 48.78 ± 0.47 73.33 ± 0.25 / 77.37 ± 0.25 98.32 ± 0.05 74.64 ± 0.37 / 78.04 ± 0.36 37.83 ± 0.21 85.99 ± 0.19 95.01 ± 0.06 41.32 ± 0.64 / 44.23 ± 0.66 37.39 ± 0.23
flax-community/roberta-base-danish 476 2.82 ± 0.10 79.19 ± 0.54 / 81.66 ± 0.46 98.00 ± 0.03 60.49 ± 0.30 / 63.15 ± 0.29 62.07 ± 1.93 44.87 ± 1.71 22.01 ± 0.25 29.55 ± 2.12 56.94 ± 1.06 85.14 ± 0.16 / 86.76 ± 0.20 80.39 ± 0.47 / 84.13 ± 0.53 98.19 ± 0.02 97.40 ± 0.03 83.12 ± 0.18 / 85.51 ± 0.17 77.85 ± 0.18 / 80.99 ± 0.17 57.19 ± 0.74 65.78 ± 0.52 81.22 ± 0.09 / 85.10 ± 0.09 97.57 ± 0.03 59.49 ± 0.62 / 62.83 ± 0.63 41.48 ± 1.66 26.97 ± 1.21 76.64 ± 0.22 / 79.94 ± 0.21 98.54 ± 0.10 78.33 ± 0.30 / 80.55 ± 0.28 39.58 ± 1.41 83.11 ± 0.27 95.66 ± 0.12 29.59 ± 0.29 / 32.39 ± 0.31 34.91 ± 0.81
flax-community/roberta-base-scandinavian 476 2.84 ± 0.10 81.94 ± 0.35 / 84.90 ± 0.30 97.93 ± 0.04 55.61 ± 0.25 / 58.31 ± 0.26 57.74 ± 0.58 37.63 ± 0.55 23.78 ± 1.83 23.62 ± 0.25 46.94 ± 0.05 86.52 ± 0.17 / 87.97 ± 0.16 85.29 ± 0.25 / 88.47 ± 0.24 98.52 ± 0.02 98.29 ± 0.03 82.83 ± 0.26 / 85.18 ± 0.25 78.38 ± 0.24 / 81.03 ± 0.24 53.70 ± 0.69 66.83 ± 0.42 82.71 ± 0.06 / 86.28 ± 0.06 98.31 ± 0.03 61.95 ± 0.50 / 64.64 ± 0.52 43.17 ± 1.45 27.05 ± 1.37 76.09 ± 0.11 / 79.84 ± 0.13 98.83 ± 0.03 70.12 ± 2.78 / 72.91 ± 2.67 26.02 ± 0.48 82.50 ± 0.41 96.20 ± 0.06 30.09 ± 0.28 / 33.93 ± 0.30 27.85 ± 1.05
Maltehb/aelaectra-danish-electra-small-uncased 55 24.91 ± 1.46 75.77 ± 0.38 / 78.51 ± 0.49 98.03 ± 0.02 63.82 ± 0.30 / 65.98 ± 0.30 64.13 ± 0.25 44.41 ± 0.99 57.42 ± 1.60 51.74 ± 1.21 81.53 ± 0.87 75.27 ± 0.19 / 77.71 ± 0.19 70.40 ± 0.29 / 73.88 ± 0.30 97.15 ± 0.03 96.66 ± 0.03 80.10 ± 0.24 / 82.54 ± 0.23 75.28 ± 0.16 / 78.50 ± 0.17 51.88 ± 1.28 64.96 ± 0.38 72.24 ± 1.09 / 76.99 ± 0.84 96.14 ± 0.03 56.85 ± 0.13 / 60.60 ± 0.13 49.63 ± 1.14 38.84 ± 1.86 68.89 ± 0.32 / 73.14 ± 0.34 98.22 ± 0.04 72.40 ± 0.45 / 75.73 ± 0.43 37.48 ± 0.17 84.09 ± 0.18 94.40 ± 0.06 42.53 ± 0.43 / 45.26 ± 0.44 38.70 ± 0.23
alexanderfalk/danbert-small-cased 321 5.46 ± 0.15 57.20 ± 0.50 / 59.12 ± 0.55 95.48 ± 0.04 42.94 ± 0.13 / 46.20 ± 0.13 51.20 ± 0.30 45.73 ± 0.69 22.73 ± 1.56 45.58 ± 0.89 70.53 ± 0.85 63.79 ± 0.29 / 66.42 ± 0.28 59.64 ± 0.32 / 62.66 ± 0.26 95.17 ± 0.04 94.05 ± 0.04 64.59 ± 0.09 / 68.21 ± 0.09 58.54 ± 2.15 / 62.84 ± 2.12 50.21 ± 0.49 64.26 ± 0.42 66.64 ± 0.14 / 70.92 ± 0.15 92.25 ± 0.04 38.70 ± 0.12 / 42.98 ± 0.13 47.24 ± 0.27 44.43 ± 0.35 59.71 ± 0.16 / 63.28 ± 0.16 97.75 ± 0.05 80.15 ± 0.27 / 81.30 ± 0.25 38.42 ± 0.20 76.28 ± 0.18 91.28 ± 0.10 27.94 ± 0.27 / 30.67 ± 0.27 40.22 ± 0.31
Geotrend/bert-base-da-cased 396 2.62 ± 0.07 82.86 ± 0.50 / 85.01 ± 0.57 97.32 ± 0.03 59.99 ± 0.47 / 62.54 ± 0.47 58.83 ± 0.22 47.76 ± 0.58 22.73 ± 2.14 54.11 ± 0.96 64.71 ± 0.83 86.82 ± 0.16 / 88.18 ± 0.15 85.65 ± 0.15 / 88.92 ± 0.13 98.16 ± 0.03 97.88 ± 0.02 81.89 ± 0.14 / 84.02 ± 0.13 80.01 ± 0.09 / 82.54 ± 0.10 60.48 ± 0.60 74.18 ± 1.56 84.78 ± 0.05 / 88.11 ± 0.06 97.71 ± 0.03 66.30 ± 0.35 / 68.89 ± 0.35 48.26 ± 0.41 49.53 ± 0.43 83.95 ± 0.14 / 85.93 ± 0.15 99.12 ± 0.03 80.51 ± 1.10 / 82.37 ± 0.99 43.96 ± 0.29 89.91 ± 0.14 97.19 ± 0.06 46.68 ± 0.39 / 48.90 ± 0.40 47.80 ± 0.52
Geotrend/distilbert-base-da-cased 234 5.53 ± 0.39 80.79 ± 0.33 / 82.67 ± 0.33 96.79 ± 0.04 54.81 ± 0.21 / 57.76 ± 0.20 54.90 ± 0.26 51.65 ± 0.44 51.71 ± 0.87 44.15 ± 1.25 64.63 ± 0.60 81.33 ± 0.18 / 83.18 ± 0.16 83.71 ± 0.22 / 87.39 ± 0.17 97.73 ± 0.02 97.42 ± 0.03 78.77 ± 0.12 / 81.42 ± 0.12 72.74 ± 0.19 / 75.74 ± 0.19 58.39 ± 0.38 74.04 ± 1.29 82.51 ± 0.08 / 86.13 ± 0.09 96.81 ± 0.03 55.80 ± 0.33 / 59.04 ± 0.33 48.33 ± 0.28 47.82 ± 0.57 79.48 ± 0.13 / 82.35 ± 0.11 98.92 ± 0.02 81.92 ± 0.31 / 83.59 ± 0.29 43.54 ± 0.41 88.92 ± 0.15 96.99 ± 0.04 41.06 ± 0.34 / 43.38 ± 0.35 40.88 ± 0.23
KB/bert-base-swedish-cased 478 4.38 ± 0.08 81.18 ± 0.45 / 82.93 ± 0.51 96.95 ± 0.03 58.08 ± 0.17 / 60.99 ± 0.16 62.27 ± 0.32 57.52 ± 0.71 54.15 ± 1.34 46.08 ± 0.51 71.45 ± 0.87 84.97 ± 0.15 / 86.35 ± 0.17 83.98 ± 0.14 / 87.70 ± 0.17 97.77 ± 0.02 97.45 ± 0.02 84.09 ± 0.07 / 86.32 ± 0.07 79.84 ± 0.10 / 82.35 ± 0.10 63.96 ± 0.18 66.55 ± 0.77 89.11 ± 0.06 / 91.77 ± 0.06 98.57 ± 0.02 75.07 ± 0.12 / 76.82 ± 0.12 70.99 ± 0.53 54.00 ± 0.32 76.61 ± 0.08 / 80.24 ± 0.08 97.32 ± 0.04 80.00 ± 1.03 / 83.22 ± 0.82 52.27 ± 0.32 86.92 ± 0.16 95.52 ± 0.03 45.56 ± 0.32 / 48.92 ± 0.33 51.98 ± 0.39
flax-community/nordic-roberta-wiki 476 2.62 ± 0.07 77.32 ± 0.28 / 81.12 ± 0.32 97.38 ± 0.02 58.13 ± 0.24 / 60.85 ± 0.23 57.78 ± 0.82 43.62 ± 0.33 24.70 ± 1.70 47.33 ± 0.83 68.87 ± 0.78 85.09 ± 0.25 / 86.81 ± 0.24 83.69 ± 0.29 / 87.47 ± 0.24 98.26 ± 0.03 97.67 ± 0.02 81.51 ± 0.19 / 83.80 ± 0.19 76.05 ± 0.36 / 79.05 ± 0.34 60.02 ± 0.63 63.72 ± 0.49 85.10 ± 0.06 / 88.27 ± 0.06 98.09 ± 0.0 63.74 ± 0.12 / 66.19 ± 0.12 50.54 ± 0.36 45.54 ± 0.30 77.58 ± 0.10 / 80.55 ± 0.12 98.52 ± 0.04 81.21 ± 0.35 / 82.97 ± 0.29 48.21 ± 0.34 86.55 ± 0.12 95.92 ± 0.05 37.16 ± 0.39 / 39.87 ± 0.40 49.37 ± 0.28
flax-community/swe-roberta-wiki-oscar 476 2.63 ± 0.20 78.74 ± 0.36 / 81.28 ± 0.34 96.41 ± 0.04 60.27 ± 0.15 / 63.29 ± 0.15 59.30 ± 0.51 40.30 ± 0.57 22.63 ± 1.55 40.51 ± 1.24 62.45 ± 0.87 82.54 ± 0.23 / 83.76 ± 0.24 83.16 ± 0.22 / 85.93 ± 0.19 97.64 ± 0.13 96.94 ± 0.03 84.26 ± 0.08 / 86.57 ± 0.08 74.90 ± 0.13 / 77.97 ± 0.13 61.14 ± 0.36 62.76 ± 0.59 87.07 ± 0.24 / 89.73 ± 0.18 98.31 ± 0.03 71.32 ± 0.10 / 73.19 ± 0.11 54.33 ± 1.37 48.84 ± 0.61 79.93 ± 0.14 / 82.98 ± 0.14 98.08 ± 0.08 80.92 ± 1.05 / 83.04 ± 0.93 48.92 ± 0.51 80.24 ± 0.84 95.24 ± 0.06 40.85 ± 0.50 / 43.49 ± 0.51 37.40 ± 1.46
KB/albert-base-swedish-cased-alpha 54 2.64 ± 0.09 69.88 ± 0.41 / 71.89 ± 0.45 94.50 ± 0.05 51.10 ± 0.44 / 54.44 ± 0.46 46.83 ± 1.21 39.69 ± 0.44 22.58 ± 1.23 29.37 ± 1.07 47.60 ± 0.43 75.07 ± 0.24 / 76.97 ± 0.26 77.02 ± 0.35 / 80.70 ± 0.39 96.49 ± 0.04 96.03 ± 0.05 77.26 ± 0.14 / 80.40 ± 0.15 65.67 ± 1.95 / 69.37 ± 1.92 50.35 ± 1.59 62.84 ± 0.54 77.63 ± 0.09 / 81.36 ± 0.10 94.12 ± 0.04 56.42 ± 0.13 / 59.37 ± 0.14 44.57 ± 0.52 30.21 ± 1.73 65.78 ± 0.59 / 69.94 ± 0.57 95.91 ± 0.32 67.40 ± 1.31 / 70.61 ± 1.27 28.16 ± 0.58 82.25 ± 0.14 89.95 ± 0.11 29.67 ± 0.43 / 32.64 ± 0.45 37.61 ± 0.75
ltgoslo/norbert 427 4.28 ± 0.08 79.05 ± 0.43 / 80.88 ± 0.39 97.39 ± 0.03 52.93 ± 0.34 / 55.33 ± 0.33 59.74 ± 0.29 45.91 ± 1.47 22.63 ± 0.72 56.12 ± 0.96 46.94 ± 0.05 90.21 ± 0.15 / 91.12 ± 0.16 87.48 ± 0.23 / 90.80 ± 0.19 98.51 ± 0.03 98.45 ± 0.02 81.89 ± 0.28 / 83.80 ± 0.27 35.50 ± 0.93 / 37.40 ± 0.93 30.68 ± 0.62 67.17 ± 0.36 82.18 ± 0.09 / 85.79 ± 0.08 55.13 ± 1.05 1.52 ± 0.05 / 7.63 ± 0.09 48.91 ± 1.08 42.96 ± 0.42 75.18 ± 0.40 / 79.13 ± 0.40 92.06 ± 0.06 31.77 ± 0.88 / 36.26 ± 0.81 22.44 ± 0.10 85.90 ± 0.17 94.31 ± 0.09 22.38 ± 0.56 / 25.15 ± 0.57 24.82 ± 0.46
NbAiLab/nb-bert-base 681 4.38 ± 0.10 84.66 ± 0.26 / 86.32 ± 0.28 98.42 ± 0.03 64.53 ± 0.28 / 66.99 ± 0.28 64.64 ± 0.41 65.68 ± 0.65 71.70 ± 0.66 58.73 ± 1.54 79.61 ± 0.85 92.47 ± 0.11 / 93.92 ± 0.11 89.75 ± 0.11 / 93.09 ± 0.09 98.80 ± 0.02 98.90 ± 0.01 85.83 ± 0.06 / 87.43 ± 0.06 83.74 ± 0.04 / 85.51 ± 0.05 76.68 ± 0.41 76.51 ± 1.08 87.23 ± 0.05 / 90.40 ± 0.06 98.30 ± 0.02 73.31 ± 0.11 / 75.32 ± 0.11 43.99 ± 0.91 48.06 ± 0.77 83.67 ± 0.10 / 86.23 ± 0.11 99.22 ± 0.02 84.34 ± 0.75 / 86.15 ± 0.64 54.96 ± 0.29 91.39 ± 0.10 96.78 ± 0.05 52.45 ± 0.41 / 54.94 ± 0.40 56.40 ± 0.24
NbAiLab/nb-bert-large 1330 1.41 ± 0.02 83.17 ± 0.27 / 85.65 ± 0.22 98.65 ± 0.02 66.50 ± 0.23 / 68.67 ± 0.24 66.81 ± 0.40 68.67 ± 0.42 74.88 ± 0.58 58.92 ± 1.69 81.16 ± 0.62 91.70 ± 0.11 / 93.53 ± 0.11 88.77 ± 0.18 / 91.30 ± 0.16 98.56 ± 0.02 98.51 ± 0.02 89.11 ± 0.26 / 90.67 ± 0.25 87.46 ± 0.08 / 89.24 ± 0.08 77.84 ± 0.30 76.64 ± 1.45 86.18 ± 0.05 / 89.42 ± 0.07 98.76 ± 0.03 69.30 ± 0.60 / 71.04 ± 0.60 58.12 ± 0.70 53.28 ± 0.48 78.04 ± 0.17 / 80.59 ± 0.18 98.09 ± 0.04 82.53 ± 0.86 / 84.70 ± 0.77 48.76 ± 0.44 88.82 ± 0.32 97.65 ± 0.04 45.93 ± 0.52 / 48.05 ± 0.52 54.30 ± 0.30
Geotrend/bert-base-no-cased 397 2.59 ± 0.07 82.22 ± 0.26 / 85.55 ± 0.29 97.22 ± 0.03 63.63 ± 0.15 / 66.28 ± 0.16 58.46 ± 0.29 49.46 ± 0.60 22.73 ± 2.10 53.54 ± 0.92 69.05 ± 0.72 87.83 ± 0.13 / 89.09 ± 0.14 86.57 ± 0.25 / 89.18 ± 0.19 98.21 ± 0.03 97.99 ± 0.02 82.17 ± 0.19 / 84.24 ± 0.20 80.41 ± 0.17 / 82.86 ± 0.16 61.88 ± 0.28 69.43 ± 0.97 85.26 ± 0.07 / 88.23 ± 0.06 97.77 ± 0.03 64.25 ± 0.68 / 66.84 ± 0.65 47.80 ± 0.39 47.25 ± 0.60 83.38 ± 0.25 / 85.84 ± 0.26 99.11 ± 0.02 82.03 ± 0.82 / 83.72 ± 0.73 51.78 ± 0.31 89.23 ± 0.16 97.28 ± 0.05 43.74 ± 0.41 / 45.88 ± 0.40 46.55 ± 0.37
Geotrend/distilbert-base-no-cased 235 8.67 ± 0.26 79.62 ± 0.34 / 81.75 ± 0.34 96.70 ± 0.05 55.48 ± 0.25 / 58.52 ± 0.24 55.52 ± 0.31 40.56 ± 0.46 23.67 ± 1.66 37.13 ± 0.49 58.93 ± 0.81 81.83 ± 0.21 / 83.96 ± 0.20 85.75 ± 0.26 / 89.06 ± 0.21 97.72 ± 0.02 97.45 ± 0.03 78.25 ± 0.11 / 80.92 ± 0.10 73.10 ± 0.36 / 76.13 ± 0.36 55.38 ± 0.48 69.34 ± 0.85 82.83 ± 0.12 / 86.26 ± 0.10 96.84 ± 0.05 54.59 ± 0.14 / 57.66 ± 0.14 46.44 ± 0.25 45.09 ± 0.50 79.81 ± 0.16 / 82.57 ± 0.12 98.95 ± 0.02 83.81 ± 0.59 / 85.18 ± 0.51 48.36 ± 0.28 89.82 ± 0.15 97.03 ± 0.03 42.58 ± 0.30 / 45.13 ± 0.30 40.91 ± 0.97
ViktorAlm/electra-base-norwegian-uncased-discriminator 416 4.38 ± 0.10 61.70 ± 0.40 / 59.20 ± 0.44 94.73 ± 0.05 58.10 ± 0.25 / 61.70 ± 0.24 60.46 ± 0.27 44.62 ± 0.31 59.79 ± 0.74 60.94 ± 1.19 69.12 ± 1.00 69.53 ± 0.24 / 70.65 ± 0.24 69.34 ± 0.38 / 71.08 ± 0.41 96.70 ± 0.03 96.00 ± 0.02 83.71 ± 0.08 / 86.09 ± 0.07 80.25 ± 0.22 / 83.17 ± 0.21 73.00 ± 0.24 64.82 ± 0.47 61.72 ± 0.17 / 65.39 ± 0.17 95.22 ± 0.04 60.04 ± 0.22 / 64.32 ± 0.23 47.67 ± 1.13 48.93 ± 0.60 29.60 ± 1.53 / 32.15 ± 1.58 93.90 ± 0.06 77.98 ± 0.61 / 81.32 ± 0.49 41.08 ± 1.03 69.74 ± 0.42 87.11 ± 0.10 38.55 ± 0.34 / 42.45 ± 0.36 41.46 ± 0.49
sarnikowski/electra-small-discriminator-da-256-cased 51 19.76 ± 1.28 74.84 ± 0.55 / 77.51 ± 0.53 97.76 ± 0.03 55.55 ± 0.29 / 58.10 ± 0.27 49.54 ± 0.28 41.20 ± 0.45 49.08 ± 0.53 57.99 ± 1.02 65.16 ± 0.92 78.90 ± 0.22 / 80.72 ± 0.21 76.09 ± 0.28 / 79.38 ± 0.26 97.77 ± 0.03 97.18 ± 0.02 77.71 ± 0.17 / 80.49 ± 0.16 72.56 ± 0.28 / 76.16 ± 0.27 45.04 ± 0.15 69.09 ± 0.86 73.44 ± 0.14 / 77.33 ± 0.13 90.89 ± 0.06 43.75 ± 0.38 / 48.39 ± 0.40 39.00 ± 0.25 30.21 ± 1.18 45.16 ± 0.12 / 48.02 ± 0.14 90.78 ± 0.11 66.85 ± 0.41 / 73.86 ± 0.32 38.78 ± 0.36 78.36 ± 0.15 83.93 ± 0.09 31.23 ± 0.31 / 35.34 ± 0.33 37.20 ± 0.41
setu4993/LaBSE 1750 5.07 ± 0.11 83.38 ± 0.33 / 85.41 ± 0.42 98.09 ± 0.02 66.08 ± 0.41 / 68.80 ± 0.39 66.53 ± 0.33 71.12 ± 0.53 68.69 ± 0.59 67.68 ± 0.79 74.77 ± 0.62 88.88 ± 0.14 / 90.49 ± 0.15 91.19 ± 0.18 / 93.62 ± 0.19 98.67 ± 0.02 98.19 ± 0.03 86.36 ± 0.07 / 88.23 ± 0.06 82.11 ± 0.48 / 84.31 ± 0.47 71.02 ± 0.34 65.74 ± 0.38 85.33 ± 0.06 / 88.36 ± 0.06 98.66 ± 0.03 70.23 ± 0.26 / 72.31 ± 0.26 56.56 ± 0.32 52.66 ± 0.33 88.51 ± 0.10 / 88.84 ± 0.15 99.54 ± 0.01 88.61 ± 0.17 / 89.73 ± 0.16 59.71 ± 0.23 90.13 ± 0.18 98.21 ± 0.03 51.99 ± 0.42 / 54.14 ± 0.43 60.67 ± 0.35
vesteinn/IceBERT 622 3.32 ± 0.07 71.38 ± 0.49 / 74.11 ± 0.49 95.48 ± 0.07 61.19 ± 0.35 / 65.05 ± 0.37 53.47 ± 0.32 38.99 ± 0.27 23.66 ± 0.78 36.69 ± 1.24 46.94 ± 0.05 80.43 ± 0.22 / 81.95 ± 0.23 78.67 ± 0.29 / 83.42 ± 0.19 97.36 ± 0.02 97.21 ± 0.02 83.40 ± 0.21 / 86.26 ± 0.20 80.86 ± 0.23 / 84.00 ± 0.22 41.94 ± 0.61 60.57 ± 0.39 77.98 ± 0.10 / 81.44 ± 0.10 96.08 ± 0.05 66.97 ± 0.10 / 71.06 ± 0.12 33.17 ± 0.12 46.76 ± 0.37 90.91 ± 0.09 / 92.76 ± 0.09 99.46 ± 0.02 90.32 ± 0.45 / 91.64 ± 0.41 53.50 ± 0.29 89.38 ± 0.14 97.94 ± 0.03 47.45 ± 0.41 / 49.52 ± 0.41 51.14 ± 0.42
jonfd/convbert-small-igc-is 82 12.99 ± 2.24 69.40 ± 4.27 / 73.29 ± 4.61 94.43 ± 0.46 46.94 ± 3.18 / 50.91 ± 3.16 41.16 ± 0.65 33.81 ± 0.37 21.96 ± 1.57 34.83 ± 7.99 57.63 ± 15.95 75.48 ± 3.28 / 78.23 ± 3.11 75.10 ± 2.78 / 78.91 ± 2.68 96.86 ± 0.35 96.66 ± 0.34 72.41 ± 0.94 / 76.04 ± 0.92 67.38 ± 4.16 / 71.42 ± 3.84 40.22 ± 1.26 62.99 ± 3.89 77.09 ± 0.95 / 81.56 ± 0.86 95.01 ± 0.44 48.94 ± 2.45 / 53.68 ± 2.35 46.53 ± 8.93 46.72 ± 3.40 86.81 ± 1.02 / 89.65 ± 1.11 99.43 ± 0.17 80.90 ± 4.34 / 82.05 ± 4.14 46.03 ± 11.45 88.12 ± 1.29 97.04 ± 0.46 39.12 ± 3.58 / 41.44 ± 3.69 44.66 ± 8.07
vesteinn/XLMR-ENIS 475 3.61 ± 0.13 79.24 ± 3.32 / 81.32 ± 3.30 97.13 ± 0.40 62.40 ± 1.98 / 65.34 ± 2.06 52.85 ± 2.46 48.81 ± 24.30 24.74 ± 6.35 36.05 ± 18.55 73.56 ± 5.56 82.51 ± 2.56 / 83.79 ± 2.80 79.64 ± 3.14 / 83.52 ± 2.53 97.93 ± 0.38 97.62 ± 0.22 82.27 ± 5.47 / 84.82 ± 5.29 77.38 ± 8.44 / 80.24 ± 8.18 58.98 ± 3.00 68.87 ± 3.66 83.02 ± 0.78 / 86.07 ± 0.72 98.00 ± 0.22 67.68 ± 4.76 / 70.32 ± 4.64 48.80 ± 10.47 33.10 ± 6.08 88.00 ± 1.42 / 90.01 ± 1.38 99.44 ± 0.16 81.95 ± 29.08 / 83.49 ± 28.69 57.55 ± 2.50 53.48 ± 17.57 97.93 ± 0.36 49.64 ± 5.20 / 51.71 ± 5.24 53.48 ± 17.57
neurocode/IsRoBERTa 319 8.58 ± 0.26 59.80 ± 0.38 / 61.70 ± 0.43 93.17 ± 0.11 36.29 ± 0.24 / 40.29 ± 0.26 49.21 ± 0.23 45.35 ± 0.45 21.96 ± 0.16 35.67 ± 0.97 67.93 ± 0.82 71.63 ± 0.27 / 73.30 ± 0.26 70.76 ± 0.26 / 73.74 ± 0.29 96.16 ± 0.03 95.89 ± 0.02 67.45 ± 0.25 / 71.42 ± 0.24 63.78 ± 0.22 / 67.94 ± 0.21 48.47 ± 0.26 62.56 ± 0.49 73.90 ± 0.15 / 77.64 ± 0.15 93.51 ± 0.06 39.58 ± 0.15 / 44.06 ± 0.17 33.17 ± 0.12 42.12 ± 0.41 76.57 ± 0.13 / 80.66 ± 0.11 99.27 ± 0.02 84.35 ± 0.23 / 85.39 ± 0.22 50.53 ± 0.19 82.16 ± 0.18 96.76 ± 0.04 33.22 ± 0.27 / 35.32 ± 0.27 50.45 ± 0.15
xlm-roberta-base 1040 4.23 ± 0.07 84.45 ± 0.35 / 85.39 ± 0.28 98.29 ± 0.03 71.33 ± 0.31 / 73.87 ± 0.33 68.42 ± 0.29 58.71 ± 1.25 44.91 ± 4.54 70.42 ± 0.98 72.53 ± 0.82 90.72 ± 0.16 / 91.45 ± 0.16 88.63 ± 0.15 / 91.74 ± 0.13 98.57 ± 0.03 98.28 ± 0.03 87.32 ± 0.08 / 89.16 ± 0.07 86.65 ± 0.10 / 88.79 ± 0.10 71.69 ± 0.31 69.00 ± 0.52 87.30 ± 0.08 / 89.97 ± 0.06 98.73 ± 0.02 75.94 ± 0.56 / 77.88 ± 0.56 57.07 ± 0.40 49.57 ± 0.28 85.96 ± 0.14 / 88.23 ± 0.13 99.38 ± 0.02 86.89 ± 0.70 / 88.23 ± 0.64 55.45 ± 0.26 89.32 ± 0.17 97.77 ± 0.06 55.18 ± 0.56 / 57.49 ± 0.57 54.12 ± 0.50
xlm-roberta-large 2090 1.16 ± 0.01 85.91 ± 0.41 / 87.89 ± 0.35 98.66 ± 0.03 71.42 ± 0.50 / 73.62 ± 0.50 54.22 ± 3.73 55.75 ± 0.35 73.56 ± 0.73 59.85 ± 2.71 80.22 ± 0.76 91.19 ± 0.10 / 92.08 ± 0.09 90.42 ± 0.28 / 92.61 ± 0.23 98.67 ± 0.03 98.59 ± 0.02 85.32 ± 0.27 / 86.86 ± 0.27 86.22 ± 0.28 / 88.02 ± 0.28 75.52 ± 0.33 66.82 ± 0.41 88.07 ± 0.11 / 90.63 ± 0.11 98.83 ± 0.02 74.41 ± 0.84 / 76.01 ± 0.86 36.80 ± 2.11 55.36 ± 0.44 89.77 ± 0.21 / 89.66 ± 0.26 99.45 ± 0.02 88.55 ± 0.42 / 89.64 ± 0.38 56.63 ± 0.27 91.09 ± 0.11 98.45 ± 0.02 47.89 ± 0.94 / 49.53 ± 0.93 59.50 ± 0.35
bert-base-multilingual-cased 681 4.28 ± 0.08 81.71 ± 0.26 / 83.91 ± 0.29 97.38 ± 0.02 61.38 ± 0.38 / 63.90 ± 0.36 62.19 ± 0.21 43.16 ± 0.69 22.73 ± 2.03 56.44 ± 0.89 69.46 ± 0.72 86.93 ± 0.19 / 88.22 ± 0.18 88.07 ± 0.18 / 90.82 ± 0.17 98.25 ± 0.02 98.03 ± 0.03 84.30 ± 0.05 / 86.33 ± 0.05 77.38 ± 1.79 / 79.90 ± 1.82 62.48 ± 0.27 67.65 ± 0.96 85.65 ± 0.09 / 88.63 ± 0.08 98.01 ± 0.03 67.09 ± 0.49 / 69.57 ± 0.48 48.27 ± 0.79 47.01 ± 0.49 83.39 ± 0.36 / 85.54 ± 0.33 99.27 ± 0.02 78.05 ± 0.98 / 79.63 ± 0.91 52.67 ± 0.65 90.39 ± 0.22 97.67 ± 0.05 46.37 ± 0.44 / 48.64 ± 0.43 45.07 ± 0.36
distilbert-base-multilingual-cased 517 8.76 ± 0.23 81.24 ± 0.35 / 83.51 ± 0.34 96.87 ± 0.04 54.55 ± 0.32 / 57.46 ± 0.33 56.12 ± 0.24 51.44 ± 0.49 38.20 ± 1.21 55.61 ± 1.03 72.95 ± 1.09 82.57 ± 0.16 / 84.47 ± 0.15 83.23 ± 0.29 / 86.74 ± 0.21 97.81 ± 0.02 97.52 ± 0.04 79.53 ± 0.15 / 82.15 ± 0.14 71.50 ± 0.25 / 74.49 ± 0.25 54.25 ± 0.55 67.53 ± 0.54 83.30 ± 0.08 / 86.79 ± 0.08 97.25 ± 0.04 60.97 ± 0.25 / 64.07 ± 0.26 47.59 ± 0.47 46.56 ± 0.50 81.27 ± 0.15 / 84.11 ± 0.13 99.13 ± 0.02 80.07 ± 0.75 / 81.48 ± 0.70 48.69 ± 1.06 88.91 ± 0.17 96.73 ± 0.06 41.22 ± 0.37 / 43.60 ± 0.38 41.14 ± 0.60
cardiffnlp/twitter-xlm-roberta-base 1040 4.04 ± 0.07 78.07 ± 0.34 / 79.48 ± 0.37 98.06 ± 0.03 68.97 ± 0.46 / 71.42 ± 0.45 68.39 ± 0.43 47.23 ± 0.56 66.05 ± 0.75 67.40 ± 1.25 76.83 ± 0.64 87.70 ± 0.15 / 88.97 ± 0.13 84.27 ± 0.25 / 87.28 ± 0.23 98.43 ± 0.03 98.22 ± 0.02 86.21 ± 0.09 / 88.12 ± 0.09 84.23 ± 0.27 / 86.46 ± 0.27 71.13 ± 0.22 66.87 ± 0.40 85.40 ± 0.05 / 88.54 ± 0.06 98.60 ± 0.02 71.69 ± 0.44 / 73.76 ± 0.45 48.68 ± 2.53 50.16 ± 0.37 82.05 ± 0.12 / 85.15 ± 0.09 99.40 ± 0.02 85.40 ± 0.45 / 86.88 ± 0.43 48.89 ± 0.71 89.17 ± 0.19 / 89.17 ± 0.19 97.49 ± 0.06 52.51 ± 0.40 / 54.86 ± 0.41 58.93 ± 0.24
Geotrend/bert-base-en-da-cased 424 4.38 ± 0.09 83.73 ± 0.29 / 86.41 ± 0.25 97.36 ± 0.03 61.89 ± 0.20 / 64.39 ± 0.20 57.80 ± 0.35 50.14 ± 1.12 22.73 ± 2.12 54.04 ± 0.88 63.65 ± 1.29 86.19 ± 0.15 / 87.76 ± 0.13 86.74 ± 0.20 / 89.79 ± 0.17 98.15 ± 0.02 98.05 ± 0.03 81.23 ± 0.17 / 83.35 ± 0.18 76.46 ± 0.38 / 78.98 ± 0.38 62.44 ± 0.26 72.99 ± 1.46 84.48 ± 0.05 / 87.56 ± 0.06 97.48 ± 0.03 65.76 ± 0.31 / 68.38 ± 0.30 46.87 ± 0.43 47.93 ± 0.42 83.74 ± 0.14 / 86.18 ± 0.14 99.21 ± 0.02 81.07 ± 0.75 / 82.84 ± 0.68 49.54 ± 0.28 90.45 ± 0.11 97.30 ± 0.04 46.95 ± 0.47 / 49.25 ± 0.48 41.70 ± 0.39
Geotrend/bert-base-25lang-cased 578 4.41 ± 0.09 81.87 ± 0.36 / 84.11 ± 0.40 97.46 ± 0.03 62.43 ± 0.41 / 64.95 ± 0.40 59.62 ± 0.39 57.33 ± 0.59 54.04 ± 0.88 49.78 ± 0.82 67.19 ± 0.85 88.02 ± 0.12 / 89.15 ± 0.12 86.32 ± 0.28 / 89.03 ± 0.24 98.24 ± 0.03 98.03 ± 0.02 82.68 ± 0.17 / 84.75 ± 0.17 80.35 ± 0.21 / 82.82 ± 0.20 62.97 ± 0.29 70.33 ± 1.59 84.97 ± 0.05 / 88.25 ± 0.05 97.90 ± 0.03 64.69 ± 0.56 / 67.21 ± 0.56 45.02 ± 0.50 47.82 ± 0.46 81.22 ± 0.23 / 83.87 ± 0.23 99.22 ± 0.02 77.49 ± 0.93 / 79.44 ± 0.86 44.78 ± 1.11 90.50 ± 0.14 97.47 ± 0.03 47.52 ± 0.33 / 49.57 ± 0.34 43.65 ± 0.20
Geotrend/bert-base-en-fr-de-no-da-cased 451 4.31 ± 0.09 80.89 ± 0.42 / 83.33 ± 0.35 97.21 ± 0.03 60.58 ± 0.44 / 63.06 ± 0.44 59.17 ± 0.21 52.27 ± 0.55 22.73 ± 1.88 53.72 ± 1.05 65.85 ± 0.87 86.80 ± 0.27 / 88.42 ± 0.20 86.17 ± 0.12 / 89.40 ± 0.15 98.21 ± 0.02 98.05 ± 0.02 82.23 ± 0.22 / 84.34 ± 0.22 79.07 ± 0.21 / 81.52 ± 0.21 64.61 ± 0.37 74.97 ± 1.34 85.62 ± 0.17 / 88.58 ± 0.17 97.69 ± 0.03 63.44 ± 0.13 / 65.91 ± 0.13 46.55 ± 0.36 45.34 ± 0.47 82.55 ± 0.29 / 84.92 ± 0.29 99.20 ± 0.02 78.93 ± 0.89 / 80.93 ± 0.82 40.66 ± 0.70 90.35 ± 0.16 96.83 ± 0.04 47.75 ± 0.38 / 49.79 ± 0.38 46.52 ± 0.45
Geotrend/distilbert-base-25lang-cased 415 8.67 ± 0.30 81.23 ± 0.36 / 83.28 ± 0.35 96.68 ± 0.07 55.91 ± 0.31 / 58.84 ± 0.31 57.27 ± 0.25 46.32 ± 1.02 56.26 ± 0.85 45.45 ± 0.89 67.78 ± 1.37 83.89 ± 0.25 / 85.67 ± 0.27 84.81 ± 0.23 / 88.09 ± 0.19 97.81 ± 0.02 97.54 ± 0.03 78.19 ± 0.11 / 80.77 ± 0.11 74.40 ± 0.38 / 77.42 ± 0.39 55.33 ± 0.51 73.66 ± 1.40 82.69 ± 0.90 / 86.39 ± 0.88 97.08 ± 0.04 57.13 ± 0.37 / 60.24 ± 0.37 47.74 ± 0.31 49.64 ± 0.38 80.48 ± 0.19 / 83.14 ± 0.16 99.09 ± 0.02 83.18 ± 0.26 / 84.80 ± 0.23 49.50 ± 0.29 89.16 ± 0.13 96.99 ± 0.05 40.24 ± 0.40 / 42.63 ± 0.42 30.02 ± 0.24
Geotrend/distilbert-base-en-fr-de-no-da-cased 288 8.66 ± 0.23 79.12 ± 0.49 / 81.49 ± 0.51 96.83 ± 0.03 54.67 ± 0.30 / 57.54 ± 0.31 56.08 ± 0.32 44.89 ± 1.08 36.83 ± 1.10 38.31 ± 1.28 67.79 ± 0.94 81.87 ± 0.23 / 83.94 ± 0.23 83.06 ± 0.25 / 86.77 ± 0.21 97.79 ± 0.02 97.57 ± 0.03 78.77 ± 0.20 / 81.32 ± 0.19 71.62 ± 0.29 / 74.70 ± 0.29 55.86 ± 0.59 67.32 ± 0.38 83.00 ± 0.10 / 86.35 ± 0.09 96.70 ± 0.04 56.76 ± 0.16 / 59.79 ± 0.16 48.10 ± 0.38 48.25 ± 0.57 79.25 ± 0.15 / 82.03 ± 0.12 99.00 ± 0.02 86.00 ± 0.17 / 87.16 ± 0.16 36.33 ± 0.89 89.67 ± 0.12 96.73 ± 0.06 43.24 ± 0.32 / 45.72 ± 0.32 47.48 ± 0.79
Geotrend/bert-base-en-no-cased 425 4.18 ± 0.11 82.55 ± 0.45 / 85.83 ± 0.36 97.25 ± 0.02 59.86 ± 0.30 / 62.61 ± 0.29 56.68 ± 0.31 52.82 ± 0.46 22.53 ± 2.05 50.65 ± 0.76 67.40 ± 0.99 87.90 ± 0.16 / 89.17 ± 0.16 88.18 ± 0.23 / 91.19 ± 0.19 98.28 ± 0.03 98.01 ± 0.03 82.55 ± 0.15 / 84.59 ± 0.15 78.79 ± 0.13 / 81.23 ± 0.13 63.64 ± 0.29 67.17 ± 1.15 84.78 ± 0.05 / 87.83 ± 0.05 97.76 ± 0.03 63.43 ± 0.36 / 65.98 ± 0.37 46.25 ± 0.79 49.62 ± 0.38 81.76 ± 0.29 / 84.27 ± 0.29 99.06 ± 0.02 80.02 ± 1.07 / 81.93 ± 0.97 40.16 ± 0.62 89.05 ± 0.23 97.39 ± 0.04 48.27 ± 0.53 / 50.55 ± 0.54 47.04 ± 0.34
Geotrend/distilbert-base-en-no-cased 263 8.71 ± 0.50 77.16 ± 0.54 / 79.64 ± 0.54 96.71 ± 0.05 54.13 ± 0.18 / 57.10 ± 0.19 53.32 ± 0.32 47.63 ± 0.77 35.70 ± 1.30 38.24 ± 2.38 71.04 ± 0.56 82.05 ± 0.21 / 84.09 ± 0.21 84.19 ± 0.28 / 87.81 ± 0.23 97.83 ± 0.02 97.56 ± 0.02 78.28 ± 0.08 / 80.80 ± 0.08 74.23 ± 0.21 / 77.25 ± 0.20 57.58 ± 0.60 67.21 ± 0.54 83.45 ± 0.10 / 86.68 ± 0.09 97.01 ± 0.04 57.46 ± 0.33 / 60.64 ± 0.33 47.25 ± 0.38 47.72 ± 0.37 80.10 ± 0.12 / 83.07 ± 0.11 98.90 ± 0.02 80.03 ± 0.63 / 81.79 ± 0.57 40.85 ± 0.31 89.10 ± 0.16 96.95 ± 0.04 40.88 ± 0.43 / 43.26 ± 0.43 44.39 ± 0.59
Geotrend/distilbert-base-en-da-cased 262 8.63 ± 0.24 80.18 ± 0.40 / 82.02 ± 0.42 96.72 ± 0.05 55.99 ± 0.27 / 58.92 ± 0.28 57.03 ± 0.28 46.49 ± 0.89 41.29 ± 1.31 39.43 ± 1.62 67.34 ± 0.91 80.46 ± 0.31 / 82.47 ± 0.26 83.60 ± 0.27 / 86.67 ± 0.23 97.73 ± 0.02 97.54 ± 0.03 77.77 ± 0.18 / 80.50 ± 0.17 74.58 ± 0.29 / 77.55 ± 0.27 56.33 ± 0.40 74.07 ± 1.01 82.56 ± 0.11 / 85.93 ± 0.12 96.71 ± 0.04 56.60 ± 0.30 / 59.68 ± 0.31 34.30 ± 0.68 46.37 ± 0.44 78.13 ± 0.13 / 81.05 ± 0.10 99.08 ± 0.02 82.52 ± 0.93 / 84.03 ± 0.83 46.88 ± 0.15 89.90 ± 0.13 97.01 ± 0.05 42.44 ± 0.36 / 44.96 ± 0.37 41.63 ± 0.46
sarnikowski/convbert-medium-small-da-cased 94 8.78 ± 1.35 78.89 ± 0.59 / 81.62 ± 0.56 97.85 ± 0.02 57.47 ± 0.49 / 60.10 ± 0.49 64.64 ± 0.25 47.45 ± 0.42 55.58 ± 1.70 63.00 ± 0.88 70.98 ± 0.71 82.56 ± 0.21 / 84.46 ± 0.19 76.86 ± 0.25 / 80.40 ± 0.27 97.81 ± 0.03 97.45 ± 0.02 76.24 ± 0.24 / 78.91 ± 0.24 72.74 ± 0.18 / 76.12 ± 0.18 61.32 ± 0.30 64.94 ± 0.54 76.31 ± 0.12 / 79.38 ± 0.12 91.44 ± 0.05 43.46 ± 0.10 / 47.95 ± 0.11 40.69 ± 0.53 44.44 ± 0.54 48.06 ± 0.13 / 51.23 ± 0.14 91.15 ± 0.10 73.65 ± 0.38 / 78.31 ± 0.32 43.75 ± 1.14 79.08 ± 0.15 84.06 ± 0.10 31.00 ± 0.34 / 35.01 ± 0.35 40.56 ± 0.82
sarnikowski/convbert-small-da-cased 50 15.84 ± 0.77 75.17 ± 0.44 / 77.59 ± 0.53 97.63 ± 0.02 52.11 ± 0.44 / 54.86 ± 0.45 63.19 ± 0.20 41.65 ± 0.43 42.15 ± 2.21 54.51 ± 0.69 72.36 ± 0.61 79.48 ± 0.23 / 81.52 ± 0.22 75.73 ± 0.34 / 79.22 ± 0.31 97.54 ± 0.03 97.15 ± 0.02 72.15 ± 0.53 / 75.04 ± 0.51 66.47 ± 0.22 / 69.89 ± 0.23 46.62 ± 0.19 64.23 ± 0.54 72.70 ± 0.18 / 76.56 ± 0.17 90.55 ± 0.05 42.09 ± 0.13 / 46.88 ± 0.12 40.00 ± 0.59 43.73 ± 0.84 47.73 ± 0.15 / 50.93 ± 0.15 90.69 ± 0.11 70.97 ± 0.48 / 76.04 ± 0.38 41.29 ± 1.01 78.15 ± 0.28 84.54 ± 0.10 27.97 ± 0.33 / 31.87 ± 0.37 35.59 ± 0.26
birgermoell/roberta-swedish-scandi 476 4.39 ± 0.08 73.92 ± 0.44 / 76.76 ± 0.40 96.54 ± 0.04 53.75 ± 0.61 / 57.27 ± 0.58 57.58 ± 0.28 39.10 ± 0.49 22.01 ± 0.19 45.33 ± 1.32 65.66 ± 0.90 78.65 ± 0.20 / 79.96 ± 0.23 77.93 ± 0.28 / 81.75 ± 0.27 97.88 ± 0.03 96.99 ± 0.04 82.84 ± 0.25 / 85.65 ± 0.23 79.13 ± 0.09 / 82.42 ± 0.08 45.58 ± 0.91 68.27 ± 1.00 85.15 ± 0.05 / 88.35 ± 0.04 98.26 ± 0.02 68.61 ± 0.18 / 71.47 ± 0.16 49.41 ± 0.27 49.26 ± 0.22 77.22 ± 0.11 / 80.62 ± 0.12 98.40 ± 0.05 77.74 ± 0.60 / 79.80 ± 0.54 47.56 ± 0.25 85.38 ± 0.19 95.28 ± 0.08 32.99 ± 0.34 / 36.30 ± 0.35 39.25 ± 0.16
random-roberta 478 3.22 ± 0.05 32.65 ± 0.30 / 30.70 ± 0.33 81.92 ± 0.09 22.57 ± 0.14 / 27.23 ± 0.14 37.85 ± 0.21 24.04 ± 0.81 21.96 ± 0.16 23.80 ± 0.25 46.94 ± 0.05 48.36 ± 0.20 / 52.13 ± 0.18 42.55 ± 0.26 / 45.53 ± 0.24 93.31 ± 0.05 91.64 ± 0.10 59.44 ± 0.10 / 64.07 ± 0.10 50.52 ± 0.36 / 55.78 ± 0.35 39.07 ± 0.49 52.94 ± 2.74 56.13 ± 0.84 / 59.51 ± 0.94 81.88 ± 0.06 23.21 ± 0.17 / 28.43 ± 0.17 33.17 ± 0.12 29.03 ± 0.69 54.68 ± 0.20 / 57.96 ± 0.16 95.71 ± 0.07 76.12 ± 0.27 / 77.50 ± 0.26 38.68 ± 0.35 70.74 ± 0.31 85.33 ± 0.09 18.58 ± 0.19 / 22.14 ± 0.20 38.67 ± 0.21