Abstract: In recent years, various types of recurrent neural networks (RNN s) have been developed and applied in natural language processing (NLP), which have shown significant advantages in modeling ...