Leveraging network structures in understanding node predictions and fairness