You tend to get what you value, so if you believe that your legacy is more important than your close personal relationships, there's nothing anyone on Hacker News could say that will make that "wrong".
Just remember that everybody's legacy is fleeting. In a generation, Steve Jobs will probably be remembered like the Duesenberg brothers.
I guess legacy is the wrong word - as it implies a level of vanity that is uninteresting in my opinion. Rather, lets call it impact.
For example Leo Szilard I feel had a much broader and deeper impact on the world than did Einstein, but with significantly less fame. Same with Woz vs Jobs etc...
Just remember that everybody's legacy is fleeting. In a generation, Steve Jobs will probably be remembered like the Duesenberg brothers.