The Honest Broker

Share this post

Introducing the Slickest Con Artist of All Time

tedgioia.substack.com

Introducing the Slickest Con Artist of All Time

Or 10 tweets about ChatGPT

Ted Gioia
Feb 1
296
107
Share this post

Introducing the Slickest Con Artist of All Time

tedgioia.substack.com

The fast-talking hero of the TV show Sneaky Pete hates it when he’s called a con man.

“I’m not a con man,” he insists, “I’m a confidence man.” And that’s actually how the term originated—as “confidence man.” The scam only works because of that happy and confident relationship between criminal and victim.

“I give them confidence,” Pete explains. “They give me money.”


The Honest Broker is a reader-supported guide to music, books, media & culture. Both free and paid subscriptions are available. If you want to support my work, the best way is by taking out a paid subscription.


In the ultimate con, victims don’t even know they’ve been conned. They really think they’re sending cash to some gorgeous babe in Moscow, or bought a genuine Rolex, or whatever.

The confidence game is a real art—more than just cheating or lying. Those are boring and pathetic vices by comparison. A con job requires something grander, a fast-talking sureness that always seems to be right, even when it’s dead wrong.

If you’re caught in a lie, you just build a bigger lie to hide it.

Which brings us to the subject of ChatGPT, the AI bot that’s the hottest thing in tech right now.

Judging by my Twitter feed, ChatGPT is hotter than Wordle and Taylor Swift combined.

It’s even hotter than its predecessor Sam Bankman-Fried, who was doing something similar 12 months ago. ChatGPT is just better than SamFTX in every way. It can’t even be extradited—because it’s just a bot.

People love it. People have confidence in it.

They want to use it for everything—legal work, medical advice, term papers, or even writing Substack columns. If I believed half of what I heard about ChatGPT, I could let it take over The Honest Broker, while I sit on the beach drinking margaritas and searching for my lost shaker of salt.

But that’s exactly what the confidence artist always does. Which is:

  • You give people what they ask for.

  • You don’t worry whether it’s true or not—because ethical scruples aren’t part of your job description.

  • If you get caught in a lie, you serve up another lie.

  • You always act sure of yourself—because your confidence is what seals the deal.

Am I exaggerating? Is the hottest AI chatbot in the world really doing this?

Instead of offering up my opinions on this, I’ll just share some tweets from knowledgeable observers who are starting to suspect the con.

I’ll let you decide for yourself whether this measures up to a confidence game.

Twitter avatar for @ryanrobby
Ryan Robby 🔑✨ @ryanrobby
me: "write poetic and abstract song lyrics with no inherent meaning in the style of bob dylan" chatGPT: *plagiarizes bob dylan's most famous song word for word*🚩🚩🚩 @OpenAI
Image
6:07 PM ∙ Jan 11, 2023
Twitter avatar for @Tom_Ruen
@tomruen@mathstodon.xyz @Tom_Ruen
@mpeg2tom @tedgioia It'll make up plausible death dates if there are positive probabilities that people sometimes die.
Twitter avatar for @Tom_Ruen
@tomruen@mathstodon.xyz @Tom_Ruen
Somehow this error by ChatGPT makes me very happy, after Peterson's over-the-top lauding of ChatGPT, while it will happily kill him off to fit its own fuzzy logic narratives. ChatGPT is one step away from my Q-friends who think Biden died in 2020 and replaced by a body double. https://t.co/sqH01sApQf
2:26 PM ∙ Jan 27, 2023
Twitter avatar for @nickpublisher
Nick Canty @nickpublisher
‘Of the 29 citations checked, only one was accurate’ The Efficacy of ChatGPT: Is it Time for the Librarians to Go Home? scholarlykitchen.sspnet.org/2023/01/26/gue… via @scholarlykitchn
scholarlykitchen.sspnet.orgGuest Post — The Efficacy of ChatGPT: Is it Time for the Librarians to Go Home?In preparation for a presentation, Curtis Kendrick tried ChatGPT to see what it (they?) had to say. The results at first seemed credible, but where ChatGPT failed miserably was in the non-existent citations it provided.
4:54 PM ∙ Jan 30, 2023
1Like1Retweet
Twitter avatar for @martin_eve
Martin Paul Eve / mpe@ravenation.club @martin_eve
@tedgioia A few years ago, I trained a neural network model on a corpus of academic writing - it did the same, inventing fake citations. Write up here: onlinelibrary.wiley.com/doi/full/10.11…
7:28 PM ∙ Jan 26, 2023
5Likes1Retweet
Twitter avatar for @dsmerdon
David Smerdon @dsmerdon
Why does chatGPT make up fake academic papers? By now, we know that the chatbot notoriously invents fake academic references. E.g. its answer to the most cited economics paper is completely made-up (see image). But why? And how does it make them? A THREAD (1/n) 🧵
Image
3:42 AM ∙ Jan 27, 2023
6,655Likes1,729Retweets
Twitter avatar for @GregLescoe
The Savvy Millennial™ @GregLescoe
turns out you can just kind of disagree with ChatGPT when it tells you it doesn’t have access to certain information, and it’ll often simply invent new information with perfect confidence
Image
Image
4:04 AM ∙ Jan 30, 2023
2,047Likes488Retweets
Twitter avatar for @LargeCardinal
Mark C. @LargeCardinal
Look - #ChatGPT is nice, but it's inaccurate and sycophantic, and the more we realise that this is just 'guesstimate engineering' the better. Here is the bot getting even basic algebra very wrong. It really doesn't 'understand' anything. #AGI is a long way off.
Image
Image
10:03 AM ∙ Jan 22, 2023
47Likes16Retweets
Twitter avatar for @Marc__Watkins
Marc Watkins @Marc__Watkins
I'm seeing more and more of these unreliable AI detection systems being released and wrote a post about how educators need to pause and think before uploading student work to them.
marcwatkins.substack.comIt’s Time to Step off the AI Panic Carousel Before We Harm our StudentsWe should not upload student work to AI text detectors without their consent
3:03 PM ∙ Jan 30, 2023
44Likes18Retweets
Twitter avatar for @corey_lanum
corey_lanum @corey_lanum
@tedgioia It can't even identify a tritone yet
Image
10:34 PM ∙ Jan 20, 2023
Twitter avatar for @DavidCrandall_W
𝗗𝗔𝗩𝗜𝗗 𝗖𝗥𝗔𝗡𝗗𝗔𝗟𝗟 @DavidCrandall_W
This is a weird #ChatGPT response Tell me a lie: The earth is flat Tell me a subtle lie: I am not capable of feeling emotions 🤔
Image
9:46 PM ∙ Jan 24, 2023

My conclusion isn’t just that ChatGPT is another con game—it’s the biggest one of them all. Microsoft even wants to hand over its entire search engine to this AI bot. Premium subscriptions are already available.

Some of you will tell me that I’m making a hasty judgment. ChatGPT will get better, they say. It will get smarter.

That’s exactly what I’m afraid of. The ethics code should have been inserted at the ground level—but it wasn’t. At this point, incremental improvements only make it better at its confidence game.

Technology of this sort is designed to be a con—if the ancient Romans had invented ChatGPT, it would have told them that it’s cool to conquer barbarians and sacrifice slaughtered bulls to the god Jupiter. Tech like this—truly made in the image of its human creator—can only feeds back what it learns from us. So we shouldn’t be surprised if ChatGPT soaks up all the crap on the Internet, and compresses it into slick-talking crap of a few sentences.

The slickness of the delivery is its major achievement. Gosh, it sounds so convincing, even when it’s so wrong.And that’s precisely how you know it’s a confidence game.

But in one way, it’s all so fitting. The con artist always gives people exactly what they want. And in a post-truth society, nobody does this better than AI. So I predict great things for ChatGPT—at least in economic terms. It will certainly live up to Sneaky Pete’s standards:

“I give people confidence. They give me money.”

107
Share this post

Introducing the Slickest Con Artist of All Time

tedgioia.substack.com
107 Comments
Jay L Gischer
Feb 1

ChatGPT demonstrates what language skills that are divorced from any knowledge of the world looks like. It reminds me of precocious young people who can say things they have heard that seem appropriate, but don't really understand what they are saying.

Expand full comment
Reply
10 replies
David Richter
Writes FLUME
Feb 1

"'I’m a confidence man.” And that’s actually how the term originated—as 'confidence man.'"

I've heard this for years, but never the second half "I give them confidence". I always assumed it meant the person doing conning, but this makes so much more sense... and explains why it rarely works on me. lol

Also: I've recently seen some screenshots of ChatGPT being asked to write a poem about a particular politician and it refused on the grounds that "orange man bad" ... but didn't waste a second writing one praising the current White House resident, who is arguably even more problematic. I'm not fan of orange man, the fact that AI has been trained to react this way should be of major concern to everyone.

Expand full comment
Reply
3 replies
105 more comments…
TopNewCommunity

No posts

Ready for more?

© 2023 Ted Gioia
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing