Attention Mechanism - What is the attention mechanism in Gru?

In Gru, the attention mechanism is made up of an encoder that takes the input and makes an attention vector, and a decoder that makes a hidden state. The decoder does this by treating the encoder's output as input.