Learn More by Starting at the Bottom