Building versatile reinforcement learning agents with offline data