Question about Attention Map #62
Description
Hello @franciszzj , this is such a great idea.
I am trying to implement your approach to visualize the attention map in Figure 2.
However, you said to take the average along attention heads resulting in an average A at 1 size, but how do you take the average of attention maps when they have different spatial sizes? For example, if one attention map is at 1/16 the resolution of the original image and another is at 1/32, how can they be averaged?