There's something in my walls!?

I think all your suspicions are right, and you should move at the earliest convenience, whenever your lease expires.