Towards Fairness in the Wild: Controlling Disparities in Machine Learning Systems with Human Interaction