The way I see it, it's not wild fantasies in general, it's wild fantasies for Zhao Yunlan specifically, who is just good enough and not the right person to do that in his father's opinion. Kinda like wanting to be an Olympic athlete or something - it's not that people don't do that, it's that HE shouldn't even try, but fiiine, his father is going to indulge him.