Challenges for dark energy science : color gradients and blended objects