Controlling ramification in number fields