Computer scienceData scienceNLPLanguage representation

Language models before Transformers

Multi-layer RNN LM

Report a typo

Choose the main hypothesis behind using multiple layers in multi-layer RNN LM:

Select one option from the list

Lower layers capture local phenomena, while higher layers capture longer dependencies.

Multiple layers are not used in RNN LMs.

Lower layers capture longer dependencies, while higher layers capture local phenomena.

All layers capture both local phenomena and longer dependencies equally.

___

Create a free account to access the full topic