Advances in decision-making under uncertainty: inference, finite-time analysis, and health applications