Recurrent Neural Networks

Recurrent Neural Networks

1. What is it?

   • Direct cycles
   • Prior input
   • Rolled/Unrolled RNNs
   • Parameters across layers
   • Data
     • Sequential/timed data
     • Training data

2. Background

   • Types
     • One-to-one
     • One-to-many
     • Many-to-many
   • Bidirectional RNNs (BRNN)
   • Long short-term memory

3. Application

   • Natural language processing
     • Speech recognition
   • Handwriting identification
   • Machine translations
   • Image captioning