I think they know how to read it and at least Im must have visited it. It feels weird that for 800 years something that can cause so much havoc for them is hidden from them.
I feel what's on the island or island itself can't be destroyed by Im's powers. Like poneglyfs.