The flu mutates. The common cold isn't a single virus, but one of hundreds lumped together, that also mutate. So there's no long term herd immunity for either.