"I'm really not clear how many ordinary Dixingren he knows (outside of the palace) or how much time he spends down there. He seems surprised by the state of things early in canon ("Dixing has become a prison of torment" /quoting from memory). :-/"

I figure he knows some things from, like, the times where he has to bring back innocent people (and secretly releases them), but yeah, he probably doesn't know many ordinary people on a personal level.