Confident prediction and generalizable inference in modern data paradigms