From Reinforcement Learning to Robot Learning: Leveraging Prior Data and Shared Evaluation