Metabolism: The chemical processes inside a body that turn food or nutrients into energy. LLM's do not spontaneously do this, they are powered by plugging them into the wall.
Growth: The ability to get larger and develop over time. LLMs are fixed in size (and in fact don't really have a size, because it's a computer program) and do not grow or change over time.
Reproduction: The ability to create new organisms. LLM's do not reproduce themselves.
Response to Stimuli: The ability to react to changes in the environment. LLM's do not have an environment. Their environment is a man-made, theoretical structure of logical operations implemented in silicon.
Evolution: The capacity of a genetic system to change and adapt across generations. LLMs do not change or evolve over time.
I think Tao correctly sees the problem with AI. It’s not that it is ineffective or has weaknesses. It’s that it’s not human.
Like, it ought to be enough to say that the problem with AI is that it’s not human. Unfortunately, we live in a world where many (most?) people have willingly put away the childish things, so as to achieve some goal.
The problem is that the point of life is to explore and have fun and have human to human experiences. I think math is probably fun because you’re working on hard problems with your collaborators.
It should be obvious to everyone, as it is to children, that the point of life isn’t the goal, the point is the experience one has of living. They say that when you die the only thing you lose is the current moment. The problem with AI is that it doesn’t have a current moment to live in or to lose, it’s an inanimate thing. So, it should be obvious to everyone that the problem with the AI is that it’s not human. Alas.
I think everyone wants the experience of living, but it's not a great one without money, and money commonly requires full-time work until financial freedom. But that point usually comes at 65.
So it's not that only children appreciate life, it's just that adults have to deal with that whole money problem, while children don't.
I take a 8 hour work day over being subjected to more or less random weirdness from "adults" every day. IOW, not everyone has this rose-tinted view of their childhood. I still remember adults saying "you will once look back at your childhood and miss the times". Turns out that was totally and utterly wrong. I even have bad dreams about my school/childhood time every few months. I am sooooo glad that time of being subjected to the will of others is over.
I think the problem is that some people do genuinely have a great childhood, or another phase of life (university is another one), while others have a terrible childhood or another phase of life, and people who have one fail to understand those who have the other.
To add to that I think people can have a rose-tinted view and deny what they felt at the time.
I agree that AI isn't human, but why does that necessarily mean it's a problem? The analogy I use is watching an octopus juggle - just because it's better than a human can ever be, definitionally, doesn't mean it's a problem or replacing people.
I think the impulse to use AI to replace human effort in cases where it's not drudgery, like art, math, etc is the issue, more than the fact that AI isn't human. Let AI do AI things, and humans do human things. I honestly hope that when everything shakes out we have a lot more room in the world for people doing things that are uniquely human, or amazing new collaborations that let humans do things they've never been able to do before.
Isn't the problem that without exploration we won't actually get new goals e.g. can AI come up with new math conjectures instead of "just" solving existing ones.
Yeah - I think he’s worried that we have a tool that’s almost an oracle that can just get straight to the heart of a given problem.
The problems aren’t always that interesting in their own right. But the quest to solve them is often what drives the invention of new techniques.
We ultimately got the Langlands program and a large amount of algebraic number theory out of attempts to solve fermat’s last theorem. A “clever” approach using techniques from the 1800s wouldn’t have been anywhere near as fruitful for mathematics as a discipline.
To be human is like being the training so much more than the execution. Like the parallel post's game where the speed of light is 5km/h, we always try to but never reach true "perfection" (setting aside the discourse what that even would be). Some overfit, some stop short of being good...
> the point of life is to explore and have fun and have human to human experiences
Not really. The point of life is successful reproduction. Because without it, we cease to exist. It wasn't that long ago when humans spent their entire lives struggling to live and protect their children.
To do the first one perhaps, although how many have really explored locally in full. To have fun is all dependent on your view on life and have human to human experiences can be had any time you step outside the door. Just talk to people and be friendly.
These affairs remind me of A Timbered Choir by Wendell Berry, and your comment strikes a similar chord.
Excerpts:
Even while I dreamed I prayed that what I saw was only fear and no foretelling,
for I saw the last known landscape destroyed for the sake
of the objective, the soil bludgeoned, the rock blasted.
Those who had wanted to go home would never get there now.
...
The races and the sexes now intermingled perfectly in pursuit of the objective.
the once-enslaved, the once-oppressed were now free
to sell themselves to the highest bidder
and to enter the best paying prisons
in pursuit of the objective, which was the destruction of all enemies,
which was the destruction of all obstacles, which was the destruction of all objects,
which was to clear the way to victory, which was to clear the way to promotion, to salvation, to progress,
to the completed sale, to the signature
on the contract, which was to clear the way
to self-realization, to self-creation, from which nobody who ever wanted to go home
would ever get there now, for every remembered place
had been displaced; the signposts had been bent to the ground and covered over.
Every place had been displaced, every love
unloved, every vow unsworn, every word unmeant
to make way for the passage of the crowd
of the individuated, the autonomous, the self-actuated, the homeless
with their many eyes opened toward the objective
which they did not yet perceive in the far distance,
having never known where they were going,
having never known where they came from
"The problem with dogs is that they're not human."
You can make this case for pretty much anything? Are cars human? Are excavators human? The universe does not exist to cater to the human experience, it just is. Not everything we do in it has to be for the greater enlightenment or whatnot, sometimes you just need to get something done.
This is like unphysical gibberish. I’m not even kidding. There are such things as the Landauer Limit and the earth has a finite surface area to absorb solar radiation. For crying out loud these are smart people but at the end of the day the singularity is not actually singular.
It’s just silly talk. My dad works for Nintendo and he can give me a gold foil pikachu any time he wants, also, he can delete your Pokémon any time he wants because he has admin access on the Nintendo server. And also he can beat up your dad because he has a black belt. Oh your dad has a black belt? Well actually I lied, he has a rainbow belt which means he can beat up your dad still.
Like this is silly right? It’s insulting. We both know that there are live nuclear weapons whose coordinates point at my city and at your city and the only thing that stops them is two keys and a button. Nuclear weapons, you know those things that have killed hundreds of thousands of living men women and children? There is no room for speculation in that regard: my city has a navy base and there is a live nuclear weapon pointed at it, myself and my entire family will die if it goes off. Now contrast: ahem.
Oh sorry my dad also has like a super secret rainbow STEALTH powers that could actually totally insulate my house from nukes. If you think about it, I actually have no reason to be concerned.
Yes a couple of elite mathematicians working on the problem for a year, which AGI solved in a fraction of the time. What about everyone else 100IQ? What about as the models are even better 1 year from now, 2 years? The trajectory hasn't abated.
I don't know one way or another but there is a credible allegation that the "AGI" was training on the (very extensive) test set that these two mathematicians produced.
If that is true then this seems to be, again, a case of AI producing an interpolation over data it has seen before. Everything about openAI's behavior indicates that they were using the transcripts as input. Why not have the AGI choose a different Millenium prize problem?
If ~~someone gives you a hint about an approach~~ you steal someone’s notes about a promising approach, and then you hire 10,000 people to brute force the problem basically everyone would consider that “shitty behaviour”, “theft”, and “poor form”.
Well if you do the math, the number of agent-compute time in total, given the insane number of agents thrown at the problem, might end up being comparable in time, if not for the budget.
Every version of the AI aligned future where the AI provides “meaning and fulfillment” to humanity also involves Sam Altman wearing a 1.5 million dollar Patek and driving a McLaren.
Is the only wealth represented in money? If that was the case than the vast majority of these people could have wrapped it up and left the game years ago.
Again, this misses the point. Why did he turn down an equity stake that likely would have been worth hundreds of billions? It's not like it would have jeopardized the power you're talking about.
Nowhere did I ever say anything is not a real issue or that people don't have reasons to be upset or any of the things you people seem to be putting in my mouth. By PR problem I literally mean that people have to discover and spread that your product is genuinely not a violation of privacy, which of course requires that your product genuinely not be a violation of privacy. Nowhere did I ever say that the problem is that people have a problem with it. The problem is that people don't know you don't do it until they know. For business that is a struggle because you can't necessarily control what people know like that. All you can do is make the same claims everybody else makes and hope that someone will independently investigate and discover that yours are claims that actually hold up.
The relationship between the West and Asia in its current form (Asia as a manufacturing powerhouse, the West as hub of global finance, outsourcing all over the world, JIT manufacturing) all this stuff is totally dependent on instant communication over the internet.
We would not be able to coordinate the world's production activity from Manhattan without the internet. Capital would be far less accumulated and allocated in a way less granular way. Demand signal would be completely different, based way more on brick and mortar. Feedback loops between capital and demand would be constrained to different geographic areas which would make basically all markets way more segregated...
So it changes labor, production, demand, markets, culture, media... I think that's basically everything!
I'll tell you. I would have a different job, my city would have a different population, I would spend my time after work differently, I would shop differently, I would watch different movies and listen to different music.
Humans already come out aligned basically the vast majority of the time. Our whole system is run on a spectacular amount of just “I trust you not to screw me over.”
Metabolism: The chemical processes inside a body that turn food or nutrients into energy. LLM's do not spontaneously do this, they are powered by plugging them into the wall.
Growth: The ability to get larger and develop over time. LLMs are fixed in size (and in fact don't really have a size, because it's a computer program) and do not grow or change over time.
Reproduction: The ability to create new organisms. LLM's do not reproduce themselves.
Response to Stimuli: The ability to react to changes in the environment. LLM's do not have an environment. Their environment is a man-made, theoretical structure of logical operations implemented in silicon.
Evolution: The capacity of a genetic system to change and adapt across generations. LLMs do not change or evolve over time.
So... 0/5! Big fat goose egg for LLM's.
reply