: Classic puzzles involving trains catching up to each other or the angle between clock hands. Top Resources for Preparation MBZUAI Online Entry Exam Guidelines
Why do vanilla RNNs struggle to learn long-range dependencies (e.g., the subject-verb agreement across 20+ words)? a) The softmax activation saturates. b) Repeated multiplication by the same weight matrix leads to gradients approaching zero. c) The loss function is non-convex. d) Dropout destroys the recurrent connections.