I suppose you could cast see invisibility or true seeing first? But... yeah if I'm GMing you can just target the invisible wall, fuck that. Same goes for how RAW it's nearly impossible to destroy the red layer of a prismatic wall because every spell that deals cold damage explicitly only targets creatures