Eventually calamity will come calling. Either an accidental impact of a drone with an aircraft that downs the aircraft with loss of life or a deliberate terrorist attack using a drone.
When either of the above finally happens, there will be a huge outcry to limit the use of drones. The most effective preventive measure would be to take them out of the hands of amateurs and hobbyists, since that is where most problems today are coming from.