Supported metrics

Supported metrics#

Supported metrics are listed below.

Note

All metric classes can be imported from mbrs.metrics

List of supported metrics#

Metric

CLI name --metric=<name>

Class

Reference

BLEU

bleu

MetricBLEU

(Papineni et al., 2002)

TER

ter

MetricTER

(Snover et al., 2006)

chrF

chrf

MetricChrF

(Popović et al., 2015)

COMET

comet

MetricCOMET

(Rei et al., 2020)

COMETkiwi

cometkiwi

MetricCOMETkiwi

(Rei et al., 2022)

XCOMET

xcomet

MetricXCOMET

(Guerreiro et al., 2023)

XCOMET-lite

xcomet

MetricXCOMET

(Larionov et al., 2024)

BLEURT

bleurt

MetricBLEURT

(Sellam et al., 2020)

MetricX

metricx

MetricMetricX

(Juraska et al., 2023) (Juraska et al., 2024)

BERTScore

bertscore

MetricBERTScore

(Zhang et al., 2020)