While I was on the upper level at the Ancient Ruins, by an archway near the fountain in the area that has puddle and tabby slimes, I fell into a hole passing under the archway that sent me down to the ground level.
I think the Ancient Ruins have their own phasing issues besides the quantum slimes and phase lemons.
(Second time falling, but managed to jetpack'd my way up)