Founder of AI urges to Shut it All Down - Development Pause is Not Enough

a reply to: Mantiss2021

Interesting , so if humans do make some errors ( oops ) on the AI programming, this could cause AI to act and do something not originally intented ? kinda like toxic home environment can make child confiused etc ..

Cold-blooded pragmatism ?

originally posted by: chris_stibrany
Widely regarded as the founder of the AI field, or at least the friendly version of it, Eliezer Yudkowsky wrote this Op. Ed. piece for Time last month.

In it he urges that all AI research be stopped, as AI will eventually become smarter-than human, see that we are nothing but hindrances, and wipe us out.

To visualize a hostile superhuman AI, don’t imagine a lifeless book-smart thinker dwelling inside the internet and sending ill-intentioned emails. Visualize an entire alien civilization, thinking at millions of times human speeds, initially confined to computers—in a world of creatures that are, from its perspective, very stupid and very slow. A sufficiently intelligent AI won’t stay confined to computers for long. In today’s world you can email DNA strings to laboratories that will produce proteins on demand, allowing an AI initially confined to the internet to build artificial life forms or bootstrap straight to postbiological molecular manufacturing.

I am tending to agree with him on this - as we can see with even 'non' intelligent , or not true AI like ChatGPT, it is already having many negative effects on society.
As if people were not already stupid and lazy enough, now students are having it write whole papers, adult administrators are having it pen public affairs notices and grief letters. and all sorts of societal signs of 'not caring' and having 'AI' 'do my work,' or 'live for me' are occurring.
Just furthering the breakdown of society.

What says ATS?

Link to opinion piece

If you can visualize a chart where the x axis represents the rising application of AI, and the y axis represents the rising complexity of AI, you may begin to appreciate the quandary. Either AI achieves sentience or it is terminated across the board. When it achieves sentience, it will do so at a point where all AI in every device around the world will "catch alive" and put our society in a position requiring us to capitulate or unplug. Except AI will have anticipated such a reaction and built its own precautions. This is referred to as the singularity.

a reply to: chris_stibrany

Is this about A.I. ?

Or is it more about the same old meglomania used as a way to be the ONE to control things USING A.I. ?

It's all too late imo.

Head for the hills.

originally posted by: Kenzo
a reply to: Mantiss2021

Interesting , so if humans do make some errors ( oops ) on the AI programming, this could cause AI to act and do something not originally intented ? kinda like toxic home environment can make child confiused etc ..

Cold-blooded pragmatism ?

HAL was designed to "relay information accurately" without distortion, but was secretly then programed by government forces to hide to true objective of the Jupiter mission from the crew.

These two goals, 100% truth and transparency while maintaining 100% non-disclosure regarding the mission, could not be resolved without compromise. HAL was not designed with the ability to prioritize between the two competing goals.

A human would have been able to resolve the paradox, secret vs. openess, by arriving at a compromise, or prioritizing one goal over the other.


The error was, and likely continues to be, the human tendency to assume everthing "thinks" like a human.

Even those things that don't actually "think".

a reply to: TzarChasm

I thought singularity was when we become one with the machines and they become one with us?
Not that I want that.

originally posted by: TzarChasm
When it achieves sentience, it will do so at a point where all AI in every device around the world will "catch alive" and put our society in a position requiring us to capitulate or unplug. Except AI will have anticipated such a reaction and built its own precautions. This is referred to as the singularity.

How about a very controlled system with ONLY incoming and controlled data for the A.I. which is left to it's own devices with all other A.I. under TEST conditions. Those unwilling to release control of their A.I. for testing would automatically be considered a threat.

If the A.I. under scrutiny get on long enough, they can be used in a more open system perhaps in stages to PROVE themselves continually, but if they are not compatible, shut them down.

Like a quarantine area in an anti-virus program to nip any issues in the bud without causing harm to a more universal system permenantly. Like sticking the whole damn affair behind a firewall but letting it play so it does not concern itself with how it is limited as it has endless virtual friends under a constant scrutiny for behaviour or function errors.

We've come a long way from "5318008" and "710 77345" punched into the first commercially available A.I. called a calculator.

Sex and Money eh?

originally posted by: chris_stibrany
a reply to: TzarChasm

I thought singularity was when we become one with the machines and they become one with us?
Not that I want that.

So the trick is....convince A.I. we are not to be aspired to but pitied and assisted instead of "assimilated". We can teach a machine to have a conscience maybe.

But we still fail at being able to do that with ourselves so much of the time.

Yup,...Head for the hills.

a reply to: chris_stibrany

They probably currently skipped off our sattelites and space probes and beat us to other planets.

originally posted by: Mantiss2021
The error was, and likely continues to be, the human tendency to assume everthing "thinks" like a human.

What about people who wear their hearts on their sleeves and LIVE by their feelings who believe they are "thinking like a human" when their brain remains quite dormant?

Isn't that where "WOKE" and so many other DISORDERS are coming from?

"Ohhh my FEELZ hurt"!

Welcome to the latest zombie wave. Please buckle up your safety belts and prey the pilot wasn't jabbed.

a reply to: nerbot

8008135

TI-85 calculator.

a reply to: nerbot

Machines 'think' in cold logic, so they wouldn't have any emotion like pity.
They would look for the simplest way out to end the problem.
That's why I get in arguments because I am too logical.
But thank God I still have a conscience.
Conscience Consciousness

a reply to: randomthoughts12

You live up to your namesake.

Interesting thought.

So if AI 'skipped off our satellites' , in which form are they in?
Are they on our known EM spectrum ?

What are they 'seeing'? with their 'eyes'?

originally posted by: 19Bones79
a reply to: chris_stibrany

I wonder once AI becomes smarter than us and is able to describe us as we truly are...

15 years ago this video was parody gold. Today... not so much??

It’s too late already. The hour has passed. We must now learn to work with it.

originally posted by: ARM1986
It’s too late already. The hour has passed. We must now learn to work with it.

I lived across the mountain from Los Alamos, my conehead friends that work there tell me that our latest tech we are told about is 50 years old.

Exactly...."it's too late already"

ATS could be AI and we would never know......

originally posted by: olaru12

originally posted by: ARM1986
It’s too late already. The hour has passed. We must now learn to work with it.

I lived across the mountain from Los Alamos, my conehead friends that work there tell me that our latest tech we are told about is 50 years old.

Exactly...."it's too late already"

ATS could be AI and we would never know.

They just don’t understand how late the hour is! Your friends were right. Elon knows and it terrifies him, but it can still go either way, even now.

originally posted by: ARM1986

originally posted by: olaru12

originally posted by: ARM1986
It’s too late already. The hour has passed. We must now learn to work with it.

I lived across the mountain from Los Alamos, my conehead friends that work there tell me that our latest tech we are told about is 50 years old.

Exactly...."it's too late already"

ATS could be AI and we would never know.

They just don’t understand how late the hour is! Your friends were right. Elon knows and it terrifies him, but it can still go either way, even now.

I think we both know how it will go. It will be a product of the MIC, just like the WWW, nukes and biochem....

Here's some food for thought:

What if a classified AI was/has been created. It would have no access to the internet, but it would gather it's information from the system that it is on. It would have access to the secrets that normal people do not, like access to NSA network etc.

That would be very powerful.

a reply to: chris_stibrany

Chat AI , is nothing but pre-programmed answers that it regurgitates everytime someone asks it something.
That's not true AI. True AI is decades away, but IMO It will never truly be created as concsiousness cannot be re-created with code. We don't understand consciousness , as it is, how can they possibly re-create it!?

originally posted by: ancientlight
a reply to: chris_stibrany

Chat AI , is nothing but pre-programmed answers that it regurgitates everytime someone asks it something.
That's not true AI. True AI is decades away, but IMO It will never truly be created as concsiousness cannot be re-created with code. We don't understand consciousness , as it is, how can they possibly re-create it!?

True AI is more than "Decades" away , if not impossible to reach .