Computer scienceData scienceNLPNLP metricsClassic NLP metrics

BLEU

Obtaining brevity penalty

Report a typo

Suppose there is a synthetic system that has the following list of references and predictions:

References

There are many different ways to enjoy coffee, such as iced, sweetened, or with milk.
A cup of coffee is a delicious way to start the day.

Predictions

Coffee can be enjoyed in many different ways.
Coffee is a great way to wake up in the morning.

Calculate the BLEU score with the evaluate package. The answer should contain the value of the brevity penalty from the returned dictionary, rounded up to the second decimal.

Enter a number

Create a free account to access the full topic