If you rent out your un-permitted structure, and your renters constantly have crazy parties, then you will have a problem.
-
The city will eventually catch wind of this and start asking questions about your structure.
-
Worse case scenario, they make you tear down the entire un-permitted structure.
