I figure he knows some things from, like, the times where he has to bring back innocent people (and secretly releases them)

Ha, but any Dixingren who's been to Haixing by definition isn't completely ordinary. Or, at least, not typical. :D

But yeah, he definitely has some contacts among the populace, like Wu Tian'en for one.