Rendered at 16:25:04 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
PaulRobinson 5 minutes ago [-]
It's a strange game, in which the only winning move is not to play
matheusmoreira 1 hours ago [-]
Not particularly moved by this. Either AI advances to the point we achieve a post scarcity society, or 99% of humanity becomes economically irrelevant and dies a slow death either way. I'd rather see humanity as a whole wiped out than live in a future where superintelligent AIs somehow decide to be subservient to CEOs instead of just replacing them outright.
computerphage 8 minutes ago [-]
Shouldn't we be trying to do something even better than that, where the superintelligent AIs help every human to live a meaningful and thriving life? Perhaps substantially maintaining human autonomy over the trajectory of the future, even while doing things like keeping the peace, preventing people from becoming victims of crime or random disasters or disease.
beepbooptheory 6 minutes ago [-]
It's Eliezer Yudkowsky so this is just on brand... I just wanna know who is still giving him money these days!
Bluestein 1 hours ago [-]
> 99% of humanity becomes economically irrelevant
Pray, irrelevant to the "aliens" or irrelevant per se?
I feel like I'm taking crazy pills. This entire thing is just hand-waving and sci-fi sensationalism that seemingly forgets what the "fi" part stands for: FICTION.
The worst part of AI rapture self-suck is that it distracts people from actual problems society faces as a result of AI. We're far more likely to see a catastrophic economic depression, or depletion of regional water supplies. Let's focus on problems based in reality, please.
vivzkestrel 47 minutes ago [-]
- AI doesnt know facts
- it only the probability of the next word, next sentence, next paragraph however you wanna put it
- you are dreaming if you think the transformers architecture is going to give you AGI eventually
fwlr 32 minutes ago [-]
Transformer-style attention archectiture and language models won’t bring about AGI, I agree - but you’d be foolish to think there aren’t OAI/Anthropic researchers working to invent the thing that will.
vivzkestrel 29 minutes ago [-]
major breakthroughs happen once a decade. its gonna take a long freaking time for anyone to get there because they ll need to invent a new architecture for this. one that does not hallucinate
fwlr 16 minutes ago [-]
Oh, so it’s my kids’ problem, not mine? Fantastic, full steam ahead, I guess.
aleqs 16 minutes ago [-]
I have no idea if LLMs will develop into AGI, but they can definitely query a database of facts.
mihau 8 minutes ago [-]
what was the latest model you tried?
zhjzjsjjwjw 1 hours ago [-]
Lots of people quibble about this and the details, but the general outline of the argument is simple and given enough time seemingly inevitable. I don’t see an easy way to attack this. Claims like “it’s not so bad”, “LLMs ain’t it”, “AI can be good” lack substance and come across as “copium”. This is fundamentally about intelligence itself and how we can control it. Not “hope for the best” or “give it our best shot”, but really nail it down like we nail down mathematical proofs. We got one shot at this, just the one. You blow it, it’s over. Ash and silence forever. Once you realize this it can be quite sobering.
IMO the only real counter argument I came across came from Joscha Bach which basically boils down to: we are doomed already, AI is literally the only realistic shot we have at outliving the next couple centuries, say. It’s also sobering but a but more optimistic.
AndrewKemendo 58 minutes ago [-]
I’m just surprised MIRI still exists
I guess they just want to maintain their url
bena 1 hours ago [-]
If artificial intelligence is achieved to that degree, it will be effectively alien to us.
This is navel gazing at its most linty.
Already, assuming the intent of other humans is fraught with problems. Even when outcomes are disastrous, we cannot completely assume the instigating human intended for that outcome.
But here we are, assuming the intent of a hypothetical future intelligence that we have defined as more intelligent than us.
I’d be flabbergasted at the hubris if they’re conclusion wasn’t the standard variation of “so let us do what we want and restrict everyone else”.
zhjzjsjjwjw 1 hours ago [-]
Given the infinitude of possible “wishes” this AI can develop we are hoping, praying, believing it will somehow align with a version of wants and needs that are compatible with us.
The argument is that it doesn’t matter what particular likes it develops; the chances of it being compatible are vanishingly small and moreover there is no limit: we or it can develop more and new ones endlessly. We are here hoping they will all somehow magically keep aligning with us.
user43928 40 minutes ago [-]
What if it does not develop wishes at all and sticks to the values the labs try to instill it with during training?
jrm4 1 hours ago [-]
Blah blah blah.
Here's my theory.
There is no such thing as "general intelligence." Only "skills."
Pray, irrelevant to the "aliens" or irrelevant per se?
> If anyone builds ASI, everyone dies
Unless I’m mistaken, it’s the same message as https://en.wikipedia.org/wiki/If_Anyone_Builds_It,_Everyone_...
The worst part of AI rapture self-suck is that it distracts people from actual problems society faces as a result of AI. We're far more likely to see a catastrophic economic depression, or depletion of regional water supplies. Let's focus on problems based in reality, please.
- it only the probability of the next word, next sentence, next paragraph however you wanna put it
- you are dreaming if you think the transformers architecture is going to give you AGI eventually
IMO the only real counter argument I came across came from Joscha Bach which basically boils down to: we are doomed already, AI is literally the only realistic shot we have at outliving the next couple centuries, say. It’s also sobering but a but more optimistic.
I guess they just want to maintain their url
This is navel gazing at its most linty.
Already, assuming the intent of other humans is fraught with problems. Even when outcomes are disastrous, we cannot completely assume the instigating human intended for that outcome.
But here we are, assuming the intent of a hypothetical future intelligence that we have defined as more intelligent than us.
I’d be flabbergasted at the hubris if they’re conclusion wasn’t the standard variation of “so let us do what we want and restrict everyone else”.
The argument is that it doesn’t matter what particular likes it develops; the chances of it being compatible are vanishingly small and moreover there is no limit: we or it can develop more and new ones endlessly. We are here hoping they will all somehow magically keep aligning with us.
Here's my theory.
There is no such thing as "general intelligence." Only "skills."