Visualizing memorization in RNNs

Inspecting gradient magnitudes in context can be a powerful tool to see when recurrent units use short-term or long-term contextual understanding.

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top