For example North, East, South, West for me. I have to think for a solid 10 seconds to remember where exactly each of them points (up, right, down, left) no matter how many times i actually use it.
I have the same trouble with music notes. I know where they are and what note makes what noise on the piano but i need a long time to actually recall that memory. Much longer than most other things. Is it just not enough focused practice to get those things stuck in the brain?