You can’t, you are basically using clues about head and body orientation but do not have enough perception to see if the eyes are truly staring at you.
The sensitivity itself comes from millennia of evolution and ability to recognize potential threats.
Latest Answers