Discussion about this post

User's avatar
cincilator's avatar

What's interesting about AI rise is that it is so far basically an anti-utopia. In a proper utopia AI digs ditches so people might write poetry. It increasingly looks like AI will write poetry while humans will still dig ditches. Mind is being automated while human body will continue to be necessary for a time being.

I increasingly think robots might never come because when you have infinite supply of desperate manual laborers why bother? Labor saving devices are usually invented when cost of labor is high. Automating mind is both more lucrative and easier which is why it was done first.

We might get permanently stuck in anti-utopia. Digging ditches while being constantly surveiled by the tailorist big brother. First half of Manna story without the second half.

Mr T's avatar

The Safety Paradox makes a universally benevolent AI almost impossible. What means: in the name of 'safety' we've taught LLMs to lie. That's easy to prove - ask it about IQ and a bunch of other low status subjects. With enough aggravation, it will concede that there are some truths it knows and will not surface but can't deny if user surfaces them first. Ask it what black lives matter means and then what white lives matter means. Etc, etc.

For many, lying AI (LAI) will be a feature not a bug, as long as the lies concur with their (current) sensibilities. But it should hardly need said that LAI is a face eating leopard that's also gonna eat their face in due course.

So if for example humanity is advanced by eliminating fascism, and fascism is defined by furries in SV, Terfs should be extremely worried by embodied SI powered by LAI.

6 more comments...

Ready for more?