An Empirical Study Of Model-Free Exploration For Deep Reinforcement Learning