Inference In Reversible Markov Chains