All apps
Attention Visualiser
About this app
Self-attention made visible: query, keys, softmax(QKᵀ/√d)·V, five specialised heads, a matrix heat map with causal mask, a second layer and a by-hand calculation with three tokens.
Subject: Neural networks
More from Neural networks
- Agent loop
- Backpropagation — blame in reverse
- Basin of Attraction
- Your job under AI
- The temperature dial
- Diffusion model — images from noise (3D)
- Embedding Space Explorer (3D)
- Gradient Descent (3D)
A VisuApp by heyprof: interactive, free in your browser, no sign-up. What is a VisuApp? · All apps