Adapting to the Long Tail in Language Understanding