Concentration And Sequential Decision Making In Markovian Environments