Pete, that is literally the point!
It's a trick. I used to love that, the ride keeps on giving and giving and then you step back out and see the apparently tiny creepy house you started at. For first time riders it was kind of surprising and cool, because you'd never see the real building.
The ride was meant to be a kind of nightmarish fantasy with dramatic surprises. That's why inside it began as an intimate realistic house interior and then took off into all sorts of surreal scenes. Was a great idea, before the ride was badly fiddled with over many years.