Cosmology with robust galaxy cluster weak lensing mass measurements