Efficient Sequential Decision Making