New problems and perspectives on learning with limited memory