Computer scienceData scienceNLPText processingText normalization

Tokenization implementation

The tokenization result

Report a typo

Choose the right output for the following code.

text = "My favourite city is Lond0n."
print(regexp_tokenize((text), "[a-z]+"))

Select one option from the list

['My', 'favourite', 'city', 'is', 'London']

['y', 'favourite', 'city', 'is', 'ond', 'n']

['My', 'favourite', 'city', 'is', 'Lond', 'n']

['My', 'favourite', 'city', 'is', 'Lond0n']

___

Create a free account to access the full topic