Ultrafast dynamics beyond the average response : a case study of KTaO3 and SrTiO3