Computer scienceData scienceNLPNLP metricsClassic NLP metrics

BLEU

Modified precision

Report a typo

Suppose there is a synthetic system with a single reference and a prediction:

Model's prediction

This coffee is a delicious, smooth blend of beans from Central and South America. It has a rich, full-bodied flavor with a hint of sweetness.

Reference

This coffee is a rich, full-bodied blend of beans from Central and South America. It has a smooth, chocolatey flavor with a hint of sweetness.

Calculate the geometric mean of the bigram modified precision. Round the answer up to the second decimal.

Note: you might experiment with the max_order parameter of bleu.compute() and carefully look at the returned dictionaries.

Enter a number
___

Create a free account to access the full topic