This media is not supported in your browser
VIEW IN TELEGRAM
A demo of the attention mechanism of DeepMind's AlphaCode as it completes a coding question.
Each colored piece of text shows what the model is looking at when it makes its prediction for the next code to write. The opacity of the colored background represents how much weight that piece of text gets overall.
Each colored piece of text shows what the model is looking at when it makes its prediction for the next code to write. The opacity of the colored background represents how much weight that piece of text gets overall.