2020年11月1日星期日

Attention mechanism of human eyes

The structure of human eyes

The front end of the human eye is the sclera (white of the eye), the pupil (the black circle in the middle), and the iris (the brown part between the pupil and the sclera)

The rear photosensitive part is divided into photosensitive cells and ganglion cells;

Photoreceptor cells are divided into rod-shaped cells (receiving the brightness of light) and cone-shaped cells (receiving color, divided into R, G, and B cone-shaped cells).

Ganglion cells are responsible for delivering stimuli to the optic nerve.


The reason for the attention mechanism

Source: Professor's PPT


As shown in the figure above, the distribution of cone-shaped cells on the retina with angle is not uniform. The yellow dot (that is, the 0 degree range) is the center of our field of vision, which is always moving. Therefore, the human eye has the strongest ability to discern color in the center of the field of vision, which is the attention mechanism. However, there is no visual cell in the blind spot, so there is no vision, but the compensation mechanism of the human eye will compensate it.

Eagle eyes have good vision because there are more cones. Because cone-shaped cells mainly perceive color, rod-shaped cells can only sense intensity, and more rod-shaped cells cannot identify objects such as snakes and voles. Therefore, the good vision of eagle eyes is mainly due to the large number of cone-shaped cells. In addition, the eagle eye has two centers, that is, two attentions.


Application of attention mechanism

Using eye movement experiments, you can see where the information is seen first, and the results are shown in the figure:
Source: Professor's PPT


Among them, the size of the circle represents the staying time, the color of the circle represents the time sequence of observation, the warm color represents first, and the cool color represents later.

The visual focus is on the center, label, and legend.

Therefore, when visualizing, we can mark titles and useful information where people are more likely to pay attention; legends and table examples should be as detailed as possible. Specific to the layout of the paper, you can try to put nice charts on it, especially the upper left.

In addition, the attention mechanism is also widely used in AI-related technologies such as CNN and GAN.

没有评论:

发表评论