Dynamical constraints on the galaxy-halo connection