I agree with you, math is the most abstract study and therefore the most impenetrable. Anyway, for the sake of argument here's a counterexample: https://en.wikipedia.org/wiki/Courcelle%27s_theorem

Something like TCP is an engineering concept rather than a CS concept. It's not entirely surprising that it's easier to grok. There's also certainly no shortage of hard to understand stuff in eg. Physics