Regulation and suppression of illegal "conversion" is more a matter of public participation in monitoring and enforcement, and as long as the conversion does not disturb the public and meets the conditions, it should be allowed to operate.
The practice of people or organizations with some kind of influence roughing up the interests of the people concerned generally refers to noise nuisance.