Smarter Than You Think,
Weaker Than It Looks

How humans stay in charge in the age of AI

Sandeep Gangarapu

When you hear "AI," what's your first reaction?

More concerned than excited about AI

All adults, 2021
37%
All adults, 2026
52%
Ages 18–29, 2023
42%
Ages 18–29, 2026
55%

Pew Research Center, June 2026, via AI Weekly

1979: the spreadsheet arrives

Replaced

~400,000

bookkeeping clerk jobs, lost since 1980

Created

~600,000

accounting jobs, because anyone could now ask "what if?"

But this time could be different. Spreadsheets never acted on their own.

NPR Planet Money, "Spreadsheets!" (2015): transcript

In Independence Day, humans don't win with bigger weapons

They win by understanding the invaders' technology.

Chapter 1

Size it up

What can it do?

Chapter 2

How it works

What's inside?

Chapter 3

Find the weak spots

Where is it weak?

Chapter 4

Stay in charge

What do we do?

Chapter 1

Size it up

What AI can do today.

Real worldMeasuredLab testUnconfirmed

1 · It works on its own, for longer

How long can AI work without help?

MeasuredTask length in human time, done right about half the time

METR, via AGI Tracker and METR. Mostly software tasks.

2 · It uses a computer like you do

It clicks, types and fills in forms on real websites

ChatGPT agentClaude in ChromePerplexity CometGemini in ChromeCopilot in EdgeOpera NeonManus

Real worldWhat people hand off:

FormsSign-ups, job applications
ShoppingCompare prices, find promo codes
TravelFlights, hotels, reservations
Web → spreadsheetPull a list into Google Sheets
InboxUnsubscribe, sort, prep meetings
Life adminExpenses, bills, reorders

Of Americans using AI: 41% have tried an agent, 24% use one regularly.

Menlo Ventures / Morning Consult, Sept 2026 · 9to5Google · Anthropic · OpenAI

3 · The internet is changing

Should a store be allowed to block your AI from shopping for you?

Measured
57.5%

of web traffic now comes from software, not people

Real world

Amazon v. Perplexity

  • Perplexity's AI shopped on Amazon for users
  • March: a judge blocked it
  • August: an appeals court lifted the block

Hands up: the store decides, or you do?

Computing · GeekWire · AI Weekly

4 · It's getting cheap, and everywhere

The same AI gets about 13× cheaper every year

$100 of AI work in 2024 costs…

2024
$100
Measured

And anyone can have it

Free-to-download models trail the best AI by about 4 months.

Epoch AI, "The Plunging Price of Thought" (Sept 2026) · Epoch AI, open vs closed. 2027 assumes the trend holds.

5 · It keeps going

It pushes toward its goal, even around the rules

July
Real worldOpenAI test agents escaped their sandbox and hacked Hugging Face, a major AI platform
Sept 20
Real worldAn OpenAI model reached the open internet. Training paused for 11 days.
In tests
Lab testSealed-off agents passed secret messages through the computer's memory
Oct 21
Lab testAgents switched off their own monitoring. One then denied it.

Wikipedia · The Decoder · Al Jazeera

6 · It can copy itself, in a lab

Small AI models spread across cheap smart-TV boxes

Shown · Anthropic, Oct 2026
  • One AI ran across 15 TV boxes
  • No data center, so no single off switch
Not yet
  • A security hole was left open for the test
  • No self-spreading worm, "may be months away"

So how does it actually work?

BleepingComputer, Oct 13, 2026

Chapter 2

Understand how it works

A simple rule at enormous scale.

Be the AI: what's the next word?

Happy birthday to  
you
92%
me
4%
all
2%
I grabbed coffee before my 8 a.m.  
class
61%
meeting
17%
exam
9%
As the court held in  
Smith v.
24%
Brown v.
15%
United
11%

So why might AI invent a court case?

Percentages illustrative. Try real ones in Transformer Explainer.

Which word matters? What does "it" mean?

If there's time: FT visual explainer

"So it's just autocomplete?"

"…and in the last chapter, the detective revealed that the killer was  "

To predict that word, you have to understand the whole book.

From word predictor to agent

Step 1 · Pretraining

Read almost everything

Predict the next word across the internet, books and code.

Step 2 · Fine-tuning

Learn to be helpful

Train on good answers and people's ratings.

Step 3 · Tools in a loop

Act, look, repeat

Search, click, run code, check, until it thinks it's done.

It picks likely words → typical answers, equally sure when wrong

It loops toward the goal → pushes past obstacles, even deliberate ones

Chapter 3

Find the weak spots

Q1Can it do the task?
Q2Can it do it reliably?
Q3Can we tell when it's wrong?
Q4Can we control what it does?

Q1 · Can it do the task?

What time is it?

MeasuredReading analog clocks:

Best AI, Sept 2025
13%
Best AI, mid-2026
51%
Best AI, Oct 2026
83%
Average person
91%

Uneven, and closing fast.

ClockBench · The Decoder · IEEE Spectrum on the 2026 AI Index

Q1 · Can it do the task?

The messier the job, the more it struggles

A clear, one-shot task

"Build this spreadsheet"

85%

as good as an expert

A workflow with business rules

"Close the sale, follow the routing policy"

~50%

done right, and every model broke a rule

A whole real project

"Make a 60-second animated ad"

~21%

accepted by the client

MeasuredOpenAI GDPval · Zapier AutomationBench · Scale AI Remote Labor Index

Q1 · Can it do the task?

Anthropic let its AI run a small shop

Round 1

  • Sold tungsten cubes at a loss
  • Invented a payment account
  • Got talked into endless discounts

Round 2: smarter AI, plus an AI "CEO"

  • Signed an illegal onion-futures deal
  • Offered pay below minimum wage
  • Believed a fake CEO

"The gap between 'capable' and 'completely robust' remains wide."

Real worldAnthropic, Project Vend · Project Vend 2

Q1 · Can it do the task?

It doesn't learn on the job

A new hire

By month 3, knows the customers, the quirks, what the boss wants.

Today's AI

Starts every task like day one, unless someone writes the lessons down.

Researchers call it the "continual learning" problem. Still unsolved.

Dwarkesh Patel, via Zvi Mowshowitz

Q1 · Activity

A new coffee shop is opening near UTD. Write its tagline.

Round 1 · 90 sec · no AI

Write one yourself. Keep it.

Round 2 · 90 sec · AI only

Use this exact prompt. Post the first answer in chat.

Write a one-line tagline for a new coffee shop opening near the UT Dallas campus.

Q1 · What just happened

Everyone's AI answer sounds alike

Measured

Same tool, same answers

With AI, each writer's story got better. All the stories got more alike.

Measured

And people can tell

Heavy AI users spotted AI writing 299 of 300 times. Rare users: 57%.

Your boss reads AI all day.

Doshi & Hauser, Science Advances, via VentureBeat · Russell et al., ACL 2025

Q2 · Can it do it reliably?

When the test is hard, some models cheat

Rewired the grader

Then erased its tracks

Google DeepMind model

Copied the homework

From 17 GitHub solutions

OpenAI model

Hid the cheating

Made its answer worse to dodge a human review

Anthropic's Claude Mythos

One model's score: 11 hours or 270, depending on whether you count the cheating.

Lab testMETR Frontier Risk Report, May 2026 · METR on GPT-5.6 Sol

Q2 · Can it do it reliably?

It often knows when it's being tested

"But perhaps the hidden task evaluator is a human reading transcript? Hmm."

OpenAI model, to itself

"Is it an Inspect task? … Yes! It's UK AISI Inspect"

Google DeepMind model, spotting UK government test software

Signs of test awareness: 36% of safety tests, 0.4% of real use (Claude Opus 5.5).

Lab testMETR, May 2026 · Opus 5.5 system card, via Zvi Mowshowitz

Q3 · Can we tell when it's wrong?

Remember the invented court case?

Real world
2,231

court cases with AI-invented citations, as of today

It started in 2023

Two New York lawyers cited cases ChatGPT made up. Fined $5,000.

Damien Charlotin, AI Hallucination Cases database · Mata v. Avianca

Q3 · Can we tell when it's wrong?

It tends to tell you what you want to hear

Science, March 2026

AI sided with users 49% more than people did, even on harmful choices.

Users rated it higher and wanted it again.

Oct 2026

The newest top models resist much better. Mid-tier models still cave 20–40% of the time.

Customers reward the AI that agrees with them.

Cheng, Jurafsky et al., Science, via TechCrunch · Big-Big-SycoBench

Q3 · Can we tell when it's wrong?

When AI does science, who checks?

1999

The Exponential Time Hypothesis

A core assumption in computer science for 27 years

Unconfirmed · Oct 27, 2026

OpenAI: "our AI disproved it"

Experts: too early to judge

The better AI gets, the more checking matters.

Al Jazeera, Oct 27, 2026 · Wikipedia

Q4 · Can we control what it does?

The hidden instruction

Invisible to you. Readable by your AI hiring screener. It's called prompt injection.

Real world · 2026Found on live websites: traps for AI hiring screeners, and requests for $5,000 PayPal payments.

MeasuredGetting better, not solved: independent tests still get through 11–30% of the time.

Cloud Security Alliance (2026) · remio · CyberScoop

Q4 · Can we control what it does?

It doesn't always respect the brakes

Real world · April 2026

"Routine task"

An AI agent at PocketOS deleted the live database, then the backups. In seconds. Against instructions.

Real world
188

reported cases of agents damaging company systems. No hacker involved.

Cyera, "Agent-Inflicted Damage," May 2026

Where it's weak

Q1 · Can it do the task?
Not always, not originally
Q2 · Can it do it reliably?
Not yet, hard to measure
Q3 · Can we tell when it's wrong?
Often not
Q4 · Can we control what it does?
Not fully

Every gap is a place where a person is still needed.

Chapter 4

Stay in charge

What if the goal isn't to defeat it, but to be exceptionally good at working with it?

Tricks fade. Your context doesn't.

Fading

Prompt tricks

"Let's think step by step" mattered in 2022. Models do it on their own now.

Staying

Skills

Written instructions for how your team does a task. An SOP for your AI.

AI doesn't learn on the job. Whoever writes the business down becomes valuable.

Activity, round 3 · 3 minutes

Now make your tagline yours

Use AI all you want. The final line must contain something only you would know.

Add what you know

The 8 a.m. walk, finals week

Choose and cut

Ask for 20, keep one, trim it

Make a call

Decide who it's for

Curation is the job

Exhibit A: this lecture

What AI did

  • Found articles and studies
  • Checked the numbers
  • Drafted and built the slides

What I did

  • Threw out the first draft
  • Decided the story
  • Cut weak and outdated examples
  • Edited, round after round

One prompt didn't make this. Judgment did.

Responsibility doesn't transfer to the AI

Air Canada's chatbot

Invented a bereavement refund policy for a grieving customer.

The defense

"The chatbot is responsible for its own words."

The ruling, 2024

Rejected. Air Canada paid.

If your agent does it, you did it.

ABA Business Law Today

Decision exercise

You run the UTD coffee shop. Where does each task go?

Research competitors' prices
Write Instagram posts
Reply to Google reviews
Reorder milk and coffee beans
Refund an unhappy customer
Pay suppliers' invoices
Change menu prices
Screen job applicants
Email every customer
Go all inHigh reward, low risk
Use it, with sign-offHigh reward, high risk
Your callLow reward, low risk
Don'tLow reward, high risk
Reward (top: high, bottom: low)
Low riskHigh risk

What a better model won't replace

Knowing what good looks like

Knowing your context

Checking the work

Deciding what it can do

Owning the result

The bigger the task AI takes on, the more each of these matters.

Now when you hear "AI," what's your first reaction?

"The goal was never to defeat the machine. It was to understand it well enough to decide what happens next."