Combinatorial and probabilistic methods in biodiversity theory