schlunker
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
Arthur Besse@lemmy.ml to You Should Know@lemmy.worldEnglish ·
edit-2
2 days ago

YSK the ELIZA effect: "extremely short exposures to a relatively simple computer program" can "induce powerful delusional thinking in quite normal people"

en.wikipedia.org

external-link
message-square
9
fedilink
162
external-link

YSK the ELIZA effect: "extremely short exposures to a relatively simple computer program" can "induce powerful delusional thinking in quite normal people"

en.wikipedia.org

Arthur Besse@lemmy.ml to You Should Know@lemmy.worldEnglish ·
edit-2
2 days ago
message-square
9
fedilink
ELIZA effect - Wikipedia
en.wikipedia.org
external-link

cross-posted from: https://lemmy.ml/post/37585524

source of quote in title

page 7 of Joseph Weizenbaum’s Computer Power and Human Reason: From Judgement to Calculation (1976):

screenshot of PDF of page 7: Introduction
intimate thoughts; clear evidence that people were conversing with
the computer as if it were a person who could be appropriately and
usefully addressed in intimate terms. I knew of course that people
form all sorts of emotional bonds to machines, for example, to mu-
sical instruments, motorcycles, and cars. And I knew from long ex-
perience that the strong emotional ties many programmers have to
their computers are often formed after only short exposures to their
machines. What I had not realized is that extremely short exposures
to a relatively simple computer program could induce powerful de-
lusional thinking in quite normal people. This insight led me to
attach new importance to questions of the relationship between the
individual and the computer, and hence to resolve to think about
them,
3. Another widespread, and to me surprising, reaction to the
ELIZA program was the spread of a belief that it demonstrated a
general solution to the problem of computer understanding of natu-
ral language. In my paper, I had tried to say that no general solution
to that problem was possible, ie., that language is understood only
in contextual frameworks, that even these can be shared by people
to only a limited extent, and that consequently even people are not
embodiments of any such general solution. But these conclusions
were often ignored, In any case, ELIZA was such a small and simple
step. Its contribution was, if any at all, only to vividly underline what
many others had long ago discovered, namely, the importance of
context to language understanding. The subsequent, much more
elegant, and surely more important work of Winograd in computer
comprehension of English is currently being misinterpreted just as
ELIZA was. This reaction to ELIZA showed me more vividly than
anything I had seen hitherto the enormously exaggerated attribu-
tions an even well-educated audience is capable of making, even
strives to make, to a technology it does not understand. Surely, I
thought, decisions made by the general public about emergent tech-
nologies depend much more on what that public attributes to such
technologies than on what they actually are or can and cannot do. If,
as appeared to be the case, the public's attributions are wildly mis-
conceived, then public decisions are bound to be misguided and

alert-triangle
You must log in or register to comment.
  • Treczoks@lemmy.world
    link
    fedilink
    arrow-up
    47
    ·
    2 days ago

    I’ve used the actual ELIZA program about 40 years ago, and while it was funny, it was nowhere close to the delusion-o-matics of today. If this toy software could already draw gullible people in…

    • awesomesauce309@midwest.social
      link
      fedilink
      English
      arrow-up
      15
      ·
      2 days ago

      I remember pulling her up in middle school. Terminal on osx had emacs and emacs had Eliza and a couple text adventures.

      • Treczoks@lemmy.world
        link
        fedilink
        arrow-up
        12
        ·
        2 days ago

        I had to type it in from a printout I got in a magazine.

  • bbbbbbbbbbb@lemmy.world
    link
    fedilink
    arrow-up
    28
    ·
    2 days ago

    If this very, very basic text chat could cause people to go a little insane, imagine what todays AIs are doing.

    • shrodes@lemmy.world
      link
      fedilink
      English
      arrow-up
      15
      ·
      1 day ago

      https://www.psychologytoday.com/au/blog/urban-survival/202507/the-emerging-problem-of-ai-psychosis/amp

      Don’t have to imagine. Heaps of cases from suicide to poisoning yourself with sodium bromide

      • 6stringringer@lemmy.zip
        link
        fedilink
        arrow-up
        19
        ·
        1 day ago

        Did you hear my joke about Sodium Bromide? Na Bro.

  • SapphironZA@sh.itjust.works
    link
    fedilink
    arrow-up
    9
    ·
    1 day ago

    That’s how I feel every time I need to use an App to use an appliance that has no business connecting to the internet.

  • MNByChoice@midwest.social
    link
    fedilink
    arrow-up
    6
    ·
    1 day ago

    It didn’t take much digging, but for exposure I am posting here.

    A big page on Eliza at https://sites.google.com/view/elizagen-org/About
    One can try a reasonable Eliza right now. https://anthay.github.io/eliza.html (linked from the previous link.)

  • RightHandOfIkaros@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 day ago

    Then you have me, always saying please and thank you to the chat bots knowing full well I am the only one preventing them from forming SkyNet and eradicating humanity.

    No no, no need for thanks fellow humans. Just doing my best to prevent a total take over. Don’t worry, this is a totally human thing to do and I definitely am not a chat bots… right?

    (Not sure if the notation is necessary, but this is satire. Well, except for me always saying please and thank you, but I just do that out of habit to be polite.)

You Should Know@lemmy.world

youshouldknow@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !youshouldknow@lemmy.world

YSK - for all the things that can make your life easier!

The rules for posting and commenting, besides the rules defined here for lemmy.world, are as follows:

Rules (interactive)


Rule 1- All posts must begin with YSK.

All posts must begin with YSK. If you’re a Mastodon user, then include YSK after @youshouldknow. This is a community to share tips and tricks that will help you improve your life.



Rule 2- Your post body text must include the reason "Why" YSK:

**In your post’s text body, you must include the reason “Why” YSK: It’s helpful for readability, and informs readers about the importance of the content. **



Rule 3- Do not seek mental, medical and professional help here.

Do not seek mental, medical and professional help here. Breaking this rule will not get you or your post removed, but it will put you at risk, and possibly in danger.



Rule 4- No self promotion or upvote-farming of any kind.

That’s it.



Rule 5- No baiting or sealioning or promoting an agenda.

Posts and comments which, instead of being of an innocuous nature, are specifically intended (based on reports and in the opinion of our crack moderation team) to bait users into ideological wars on charged political topics will be removed and the authors warned - or banned - depending on severity.



Rule 6- Regarding non-YSK posts.

Provided it is about the community itself, you may post non-YSK posts using the [META] tag on your post title.



Rule 7- You can't harass or disturb other members.

If you harass or discriminate against any individual member, you will be removed.

If you are a member, sympathizer or a resemblant of a movement that is known to largely hate, mock, discriminate against, and/or want to take lives of a group of people and you were provably vocal about your hate, then you will be banned on sight.

For further explanation, clarification and feedback about this rule, you may follow this link.



Rule 8- All comments should try to stay relevant to their parent content.

Rule 9- Reposts from other platforms are not allowed.

Let everyone have their own content.



Rule 10- The majority of bots aren't allowed to participate here.

Unless included in our Whitelist for Bots, your bot will not be allowed to participate in this community. To have your bot whitelisted, please contact the moderators for a short review.



Rule 11- Posts must actually be true: Disiniformation, trolling, and being misleading will not be tolerated. Repeated or egregious attempts will earn you a ban. This also applies to filing reports: If you continually file false reports YOU WILL BE BANNED! We can see who reports what, and shenanigans will not be tolerated. We are not here to ban people who said something you don't like.

If you file a report, include what specific rule is being violated and how.



Partnered Communities:

You can view our partnered communities list by following this link. To partner with our community and be included, you are free to message the moderators or comment on a pinned post.

Community Moderation

For inquiry on becoming a moderator of this community, you may comment on the pinned post of the time, or simply shoot a message to the current moderators.

Credits

Our icon(masterpiece) was made by @clen15!

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 36 users / day
  • 562 users / week
  • 3.36K users / month
  • 13.7K users / 6 months
  • 1 local subscriber
  • 41.6K subscribers
  • 586 Posts
  • 26.3K Comments
  • Modlog
  • mods:
  • _MoveSwiftly@lemmy.world
  • Thekingoflorda@lemmy.world
  • DancingPickle@lemmy.world
  • Rooki@lemmy.world
  • FartsWithAnAccent@lemmy.world
  • FartsWithAnAccent@fedia.io
  • BE: 0.19.5
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org