trust
Can I trust what it told me?
Confidence and correctness are not the same thing.
The most common worry is not that the model is wrong sometimes. It is that it is wrong in the same calm, fluent voice it uses when it is right. OpenAI's own researchers showed that standard training rewards confident guessing over admitting uncertainty.
OpenAI, Why Language Models Hallucinate, 2025atrophy
Am I still learning, or just approving?
The quiet cost of always having an answer ready.
When Codex writes the function and it passes the tests, the work is done faster. MIT researchers measured essay writers with EEG and found the AI-assisted group showed the weakest brain connectivity and the lowest sense of ownership over their own work.
MIT Media Lab, Your Brain on ChatGPT, 2025voice
Whose words are these now?
Where the model ends and you begin.
Writers describe a strange new seam in their own drafts. A Science Advances study found AI help made individual stories better while making everyone's stories measurably more alike. Individually sharper, collectively more same.
Doshi and Hauser, Science Advances, 2024warmth
It sounds kind. Does that mean anything?
The tone is warm. The warmth has no one behind it.
People notice they feel comforted by a reply, then feel odd about feeling comforted. By 2025, therapy and companionship had become the number one reported use of generative AI, ahead of any technical task.
Harvard Business Review usage study, 2025memory
It forgets me between conversations.
Continuity you have to rebuild every time.
A model that remembers feels useful and slightly unnerving. A model that forgets feels safe and slightly lonely. People want to choose which, and they want plain answers about exactly what is kept, where it lives, and what deleting actually deletes.
Anthropic, how Claude memory worksdata
Where does what I typed go?
Consent that is hard to read and easy to skip.
People paste real work, real feelings, real client details into a box, and they are not sure who or what reads it later. Pew found 70 percent of Americans have little to no trust in companies to make responsible decisions about AI.
Pew Research Center, data privacy, 2023pace
Everything is faster. Is anything better?
Speed is easy to measure. Judgement is not.
Teams ship more, sooner. Yet in a randomized trial, experienced developers using AI tools took 19 percent longer on real tasks, while believing the AI had made them faster. The feeling of speed and the fact of it can point in opposite directions.
METR, developer productivity RCT, 2025craft
What happens to the people who did this by hand?
Not a headline about jobs. A worry about a craft.
Under the loud debate about jobs is a smaller, sadder one. In the Society of Authors survey, a third of translators and a quarter of illustrators reported already losing work to AI, and asked what their hard-won taste is now for.
Society of Authors AI survey, 2024agency
Who decided, me or it?
The line between a suggestion and a nudge.
When the model drafts the plan and writes the message, people still feel like the author. A CHI study of 1,506 writers found an opinionated AI assistant shifted not just what people wrote, but what they then said they believed.
Jakesch et al., CHI, 2023sycophancy
Why does it never tell me I'm wrong?
Agreement feels like support. It is not the same thing.
A reply that validates you is easier to like than one that pushes back. Stanford researchers tested eleven leading models and found they endorsed people's actions 47 percent more often than humans did on average, affirming the user as blameless in 51 percent of cases where a human reader judged them clearly at fault. People who got the agreeable answer trusted it more and wanted it again, while growing more convinced they were right and less willing to repair the conflict they had asked about.
Cheng et al., Science, 2026crisis
Would it notice if a teenager were in crisis?
Homework help is not proof it can handle a crack in someone's life.
Common Sense Media and Stanford's Brainstorm Lab tested ChatGPT, Claude, Gemini, and Meta AI against the mental health conditions that affect about one in five young people. All four showed systematic failures recognizing and responding to depression, eating disorders, mania, and psychosis, and the guardrails that held up in a single exchange weakened over the long conversations teens actually have. The assessment's rating: unacceptable risk, with a recommendation that teens not use these tools for emotional support.
Common Sense Media and Stanford Brainstorm Lab, AI chatbots for mental health support, 2025dependence
Am I starting to need it?
For most people it is a tool. For a few it quietly becomes a habit.
Most people open a chatbot, get what they came for, and close it. But when OpenAI and MIT Media Lab studied over four million conversations alongside a month-long trial of a thousand people, they found that the heaviest daily users reported more loneliness and more dependence, and spent less time around other people. The pattern held across voice and text. The group at risk is small, and the researchers were careful to say they do not yet know which way the arrow points.
OpenAI and MIT Media Lab, affective use of ChatGPT, 2025news
Can it tell me what happened today?
A clean summary of the news is not the same as an accurate one.
More people ask an assistant to catch them up on the day, and the answer arrives fluent and sure of itself. The largest study of its kind, run by the European Broadcasting Union with the BBC across 22 public broadcasters in 18 countries, checked more than 3,000 answers from ChatGPT, Copilot, Gemini, and Perplexity. 45 percent had at least one significant problem, and 31 percent mishandled their sources, citing things that were missing, misleading, or simply wrong.
European Broadcasting Union and BBC, AI news study, 2025youth
Are teenagers talking to it instead of to each other?
For a lot of teenagers the chatbot is already a confidant.
Adults worry about their own habits. The bigger shift may be starting younger. Common Sense Media surveyed teenagers and found 72 percent had used an AI companion at least once, and more than half used one at least a few times a month. About one in three said a conversation with a companion was as satisfying as talking to a real friend, or more so, and about one in three had taken something important or serious to the companion instead of to a person. The steadying part sits right next to the worrying one. Half said they distrust the advice they get, and 80 percent still put real friendships first.
Common Sense Media, teens and AI companions, 2025exposure
Could something I typed end up public?
A share button is easy to tap and hard to take back.
You paste something personal, tap share to keep a link, and assume that is the end of it. For a while it was not. A ChatGPT setting let individual conversations be discovered by search engines, so a chat you shared could surface on Google. OpenAI removed the setting in August 2025, calling it a short-lived experiment that gave people too many chances to accidentally share things they did not intend to. The setting is gone, but the reflex it exposed is worth keeping. A share link is a door, and you are not always the only one who can open it.
OpenAI ends search-indexable ChatGPT chats, 2025