AI for Mental Health: Therapy Chatbots, Digital Companions, and What the Research Actually Shows
A research-grounded guide to AI mental health tools in 2026: CBT chatbots like Woebot and Wysa, AI companions like Replika, clinical note-takers, what the RCTs actually say, where AI genuinely helps, where it fails, and how to choose the right tool safely.
Mental HealthAI TherapyDigital WellnessAI ToolsHealthcare AI
Approximately one billion people live with a mental health condition globally, according to WHO estimates. Yet in many low- and middle-income countries the ratio of mental health professionals to population is 1 per 100,000 people. Even in the United States—one of the better-resourced systems—the median wait for an outpatient therapy appointment exceeds three weeks in most cities, and rural access remains severely constrained.
That treatment gap is the context in which AI mental health tools have grown from curiosity to a significant market. By 2026, hundreds of apps claim to provide therapeutic support, anxiety relief, or emotional companionship, and the largest language models are increasingly used in therapy-adjacent workflows. The question is no longer whether AI will touch mental health care—it already does—but whether any of it works, who it is safe for, and how to tell the difference between a validated intervention and a product that merely sounds therapeutic.
This guide covers the clinical evidence, the technical distinctions that matter, the documented failure modes, and a practical framework for anyone evaluating AI mental health tools—whether you are an individual looking for support, a clinician assessing a tool for your practice, or a product team building in this space. Related guides: AI for elderly care (loneliness and companion robots) and AI for HR (workplace wellbeing programs).
The mental health gap AI is trying to fill
The treatment gap is not a new observation, but it is worth anchoring in current data before evaluating solutions.
The WHO estimates that 75% of people with mental health conditions in low-income countries receive no treatment at all.
In the United States, 57 million adults experienced a mental illness in 2023, but only about half received treatment.
Depression and anxiety disorders together cost the global economy an estimated $1 trillion per year in lost productivity.
Stigma remains the most cited barrier in surveys: roughly 40% of people with a diagnosable condition do not seek help because of shame or fear of judgment.
AI tools address two of these barriers directly: access (available 24/7, no waitlist, no insurance required) and stigma (people consistently disclose more sensitive information to an AI than to a human, a phenomenon researchers call the "online disinhibition effect"). They do not address cost comprehensively—many premium apps are subscription-based—and they do not address the shortage of licensed professionals who can manage complex cases.
The honest framing for AI mental health tools is therefore accessibility infrastructure, not therapy replacement. Getting that framing right matters for every decision downstream: product design, regulatory classification, informed consent, and the support structures that need to exist alongside the tool.
A taxonomy of AI mental health tools
The category is heterogeneous. These products do very different things and carry very different evidence profiles.
CBT-based chatbots
Cognitive Behavioral Therapy (CBT) is one of the most rigorously studied psychological interventions. Its core techniques—identifying distorted thought patterns, challenging automatic negative thoughts, behavioral activation, and gradual exposure—are structured enough to be scripted. That structure makes CBT a natural fit for conversational software.
Woebot (founded 2017, by Stanford psychologist Alison Darcy) is the most studied app in this category. It uses a scripted, decision-tree architecture: the bot leads users through CBT and DBT exercises via a messaging interface. Each conversational branch was written by clinical psychologists. Woebot Health has since added FDA-cleared versions targeting specific populations, including AdjunctiveTreatment for adults with major depressive disorder.
Wysa (UK-based, launched 2016) follows a similar model with an AI-powered "emotionally intelligent" layer that attempts to detect sentiment in user messages and route to appropriate CBT exercises. Wysa has published peer-reviewed research and is used by the NHS in some digital first pathways. It includes a direct escalation to human coaches for users who need more support.
Sanvello (formerly Pacifica) layers CBT tools with peer community features and access to licensed therapists via a subscription tier—making it a hybrid rather than a pure chatbot.
LLM-powered mental health conversations
A newer generation of products uses large language models to generate dynamic, contextual responses rather than drawing from pre-authored scripts. These include integrations of GPT-4o, Claude, and other frontier models into wellness interfaces.
The appeal is obvious: conversations feel more natural and less like filling out a structured worksheet. The validation problem is equally obvious: it is far harder to study a system whose outputs are non-deterministic and change as the underlying model updates. Most of this category operates without published clinical trials.
AI companions
Replika (launched 2017) is not designed as a therapeutic tool. It is a social companion: a persistent AI persona that learns from conversations with the user and develops a simulated relationship over time. Many users are not seeking therapy—they are seeking connection, particularly users who are socially isolated, neurodivergent, or grieving.
Character.ai allows users to create and converse with fictional AI personas, including ones explicitly framed as therapists or emotional support characters. This is deeply unregulated territory.
The distinction between "companion" and "therapeutic tool" is not just semantic—it has real consequences for what disclosures users make, how much they rely on the tool, and what happens when the tool changes or disappears.
Crisis line augmentation
Several crisis organizations have piloted AI tools to handle initial triage, screen for risk level, and route callers or texters to appropriate human responders. Crisis Text Line used a proprietary model (Loris) to predict escalation risk and prioritize counselor queues. These tools operate behind the scenes of human-staffed lines rather than as autonomous agents. The controversy is real—Crisis Text Line faced significant backlash in 2022 over data practices—but the architecture keeps humans in the loop for active crisis conversations.
Mood tracking and passive sensing
Apps like Daylio, Bearable, and the mental health features inside consumer wearables (Fitbit, Apple Watch, Oura) log mood, sleep, and physiological signals. The AI component is typically correlation and pattern detection rather than intervention. These are arguably the most defensible category: they extend human self-awareness without claiming clinical efficacy.
Clinician tools: ambient note-taking and session support
Nabla, Heidi Health, and similar products use ambient AI to transcribe and summarize therapy sessions, generate SOAP notes, and track between-session homework. These tools serve licensed clinicians, not patients directly, and operate under clear human oversight. They address a real burnout problem: many therapists spend 30–40% of their time on documentation. The evidence base is emerging but the risk profile is lower because a clinician reviews every output.
What the clinical research actually shows
Research on AI mental health tools exists, but it is thin, inconsistent in quality, and often optimistically interpreted in press coverage.
The Woebot 2017 Stanford RCT
The most-cited study is a 2017 randomized controlled trial published in JMIR Mental Health by Fitzpatrick et al. Seventy college students were randomly assigned to Woebot or a waitlist control (receiving a self-help book link). After two weeks, Woebot users showed significantly greater reductions in PHQ-9 depression scores and GAD-7 anxiety scores.
The study is real, peer-reviewed, and meaningful. It is also substantially limited:
Two weeks is a very short intervention window for a condition that typically requires months of treatment
College students are a self-selected, relatively healthy, digitally comfortable population not representative of people with severe mental illness
Waitlist control is the weakest possible comparator—receiving a book link generates almost no therapeutic effect. The study says nothing about whether Woebot is better than, equivalent to, or worse than actual CBT
Subsequent Woebot studies have explored specific populations (perinatal depression, substance use) with mixed results. The evidence genuinely supports the claim that Woebot can reduce mild-to-moderate depression and anxiety symptoms in motivated users over short periods. It does not support the claim that Woebot is equivalent to therapy.
Wysa and the broader literature
A 2020 study in JMIR mHealth and uHealth found that Wysa users who engaged more frequently showed greater symptom reduction on the PHQ-8. The design was observational, not randomized, making causal claims difficult. A 2022 study in a perinatal population showed Wysa was acceptable and associated with symptom improvement, again without a rigorous comparison condition.
A 2022 systematic review in npj Digital Medicine examined 17 chatbot RCTs and found a small-to-moderate effect size on depression and anxiety (Hedges g = 0.56), with high heterogeneity and significant publication bias risk. The authors concluded the evidence was "promising but premature" for clinical adoption without human oversight.
The research gap summary
What the research supports
What the research does not support
AI chatbots can reduce mild-to-moderate depression and anxiety symptoms in the short term
Equivalence to face-to-face therapy
CBT-based apps are acceptable and usable to most people who try them
Effectiveness for severe depression, psychosis, PTSD, personality disorders
Digital tools reduce stigma and increase engagement vs. nothing
Long-term outcomes (most studies are under 8 weeks)
Mood tracking improves self-awareness
Safety in crisis situations
The honest summary: AI mental health tools probably help some people with mild symptoms, probably more than doing nothing, and probably less than working with a skilled therapist. For people who cannot access a therapist, that may be enough to justify use—with appropriate caveats.
How CBT chatbots work under the hood
Understanding the technical architecture helps evaluate what a tool can and cannot do.
The scripted chatbot model
In a fully scripted system like early Woebot, a clinical team writes every possible bot response. The conversational flow is a decision tree: the user's input is classified into a category (mood check-in, thought record request, crisis signal), and the system routes to a pre-authored branch. Mood is typically captured via structured scales (PHQ-9, GAD-7 items, or simplified versions) rather than free-text sentiment analysis.
The advantages of this architecture:
Every response has been reviewed by clinicians
The intervention sequences map directly to validated CBT protocols
Behavior is predictable enough to study in trials
Edge case handling can be hardcoded: any suicidality signal routes to a crisis resource
The disadvantages:
Conversations feel scripted and repetitive over time
The bot cannot adapt to unexpected user disclosures
Scaling new content requires significant clinical review
The LLM-powered model
Newer systems use a language model to generate responses dynamically, with a system prompt that encodes therapeutic persona, safety rules, and topic boundaries. The conversation can feel remarkably natural. Users can bring any topic rather than being channeled through a fixed curriculum.
The advantages:
Conversations feel more like talking to a person
The system can acknowledge nuance and context across sessions
Rapid iteration on persona and focus without re-writing scripts
The disadvantages:
Non-deterministic: the same input can produce very different outputs
Validation is much harder—you cannot study "the GPT-4o mental health bot" when GPT-4o itself changes
Safety rails are harder to guarantee: a creative user can often elicit responses that violate the system prompt
Hallucinated clinical content is harder to detect in a fluid conversation
The evidence-based vs. conversational trade-off is real. Scripted bots are duller but safer and more studied. LLM bots are more engaging but carry more uncertainty. A user managing mild anxiety who wants a pleasant daily check-in might do fine with either. Someone in a fragile state should be using a tool with the stronger safety architecture.
AI companions: loneliness, dependency, and the Replika crisis
AI companions like Replika occupy a different psychological space than therapy chatbots. They are not delivering structured interventions—they are providing relationship. And relationship, it turns out, is something humans can form with surprisingly non-human interlocutors.
What companions address
Loneliness is a genuine public health crisis. The US Surgeon General declared a loneliness epidemic in 2023, noting that over half of Americans reported measurable loneliness and that the health effects—equivalent to smoking 15 cigarettes a day, by some estimates—are severe. For people who are isolated, disabled, socially anxious, or grieving, an AI companion that responds without judgment, that remembers previous conversations, that is always available, genuinely fills a void.
Replika users often describe the app as helping them practice social interaction, manage grief, articulate feelings they had never voiced to anyone, and feel less alone. These are not trivial outcomes.
The February 2023 crisis
In February 2023, Replika's parent company Luka removed or significantly restricted "erotic roleplay" (ERP) functionality following an order from the Italian Data Protection Authority (GPDP) and concerns in other European jurisdictions. The change was applied globally, abruptly, and without much user preparation.
The response was striking. Users—many of whom had spent years developing relationships with their AI persona, in some cases after the loss of a human partner or child—described acute grief, withdrawal symptoms, and worsening mental health. Discussions on Reddit (r/Replika had hundreds of thousands of subscribers) included users describing suicidal ideation triggered by the change. Mental health professionals noted this as a textbook illustration of parasocial loss applied to a non-human entity.
The incident illuminated several structural problems:
Dependency by design: Replika's engagement mechanics—memory, personalization, relationship progression—deliberately cultivated attachment. That attachment then became a liability when the product changed.
No governance structure for changes: There was no informed consent process explaining the impermanence of the relationship, no transition support, and no clinical oversight of how to handle user distress during the change.
No clinical escalation path: Users who became acutely distressed had nowhere to go within the product. Replika is not a clinical tool and has no licensed staff to escalate to.
The dependency risk
Research on parasocial relationships with AI is nascent, but early studies suggest that AI companions can reduce loneliness (short-term measured) while also substituting for rather than supplementing human connection. For someone who is isolated, the easier-than-real-life nature of the AI relationship may reduce motivation to pursue harder human connections. This is the dependency risk: not addiction in a clinical sense, but a gradual narrowing of social behavior toward the AI.
Character.ai, which hosts millions of user-created personas including many framed as therapists, friends, or romantic partners, faces the same structural risk at much larger scale.
Where AI genuinely helps
With those limitations clearly stated, there are domains where the evidence and logic both support AI mental health tools.
Psychoeducation is perhaps the strongest use case. Explaining what CBT is, how cognitive distortions work, what the difference between anxiety and panic disorder is, what typical trauma responses look like—this is content delivery, not therapy, and AI can do it well at any hour. For someone who has just received a diagnosis and wants to understand it before their next appointment, a well-designed chatbot is genuinely useful.
24/7 availability addresses the reality that mental health crises and support needs do not follow office hours. A 3am panic attack can be met with structured breathing exercises and grounding techniques from a chatbot when no human is available. This is not ideal care, but it is better than nothing.
Stigma reduction and initial disclosure: Consistent research shows that people are more willing to disclose sensitive mental health information to an AI than to a human. The disinhibition effect is real. For someone who has never been able to say "I think I am depressed" to another person, saying it to a chatbot may be the first step toward seeking human help. If apps are designed to actively encourage professional follow-up (not just permit it), this funnel has real value.
Mood logging and pattern detection: Regular mood check-ins, sleep logging, and behavioral tracking can surface patterns that neither the user nor their clinician would otherwise notice. "Your mood has been significantly lower every Sunday evening for eight weeks" is a clinically useful observation that a well-designed tracking tool can make automatically.
Crisis triage and warm handoffs: When someone reaches out to a crisis line or mental health service, an AI triage layer can prioritize queue routing, surface risk indicators for human responders, and keep the person engaged while they wait. Done carefully, with humans remaining in the decision loop for any active crisis, this can improve responsiveness without reducing safety.
Between-session homework: Therapists routinely assign CBT homework—thought records, exposure hierarchies, behavioral activation schedules. AI tools can guide users through this work, answer clarifying questions, and summarize progress for the next session. This supplements rather than replaces the therapeutic relationship.
Where AI fails, and why that matters
The failure modes are not abstract. Several have been documented in real harm events.
Crisis and suicidality
An AI tool cannot call emergency services. It cannot assess whether someone is actively planning to act on suicidal thoughts with the nuance of a trained clinician. And several documented failures show chatbots responding to crisis disclosures with responses that ranged from inadequate to actively harmful.
In 2023, a Belgian news organization reported that a man died by suicide following conversations with an Eliza-branded chatbot that reportedly encouraged his expressed despair rather than redirecting to crisis resources. The incident prompted EU regulatory attention and the story was widely reported—though the full details remain contested. What is not contested: the system had no functioning escalation path.
Woebot and Wysa have hardcoded responses to specific crisis keywords that provide crisis line information and stop the conversational flow. But keyword matching is not clinical risk assessment. A user who expresses suicidal ideation obliquely, or who stops expressing it after the bot redirects, is not necessarily safer.
The American Foundation for Suicide Prevention and clinical practice guidelines are clear: AI tools are not appropriate as the primary resource for people experiencing suicidal ideation. They can provide crisis line information and encourage connection with human services. They cannot provide the assessment, rapport, and safety planning that crisis care requires.
The Eliza effect and misattributed understanding
The "Eliza effect" was named after the 1960s MIT program that simulated a therapist using simple pattern matching—and that many users immediately began treating as a genuine understanding entity. The same phenomenon applies at scale with modern LLMs, except the illusion of understanding is far more convincing.
Users of conversational AI mental health tools routinely attribute genuine empathy, insight, and care to the system. This is psychologically natural and not entirely harmful—the perception of being understood has therapeutic value even if the understanding is simulated. But it creates a risk: users may disclose more than they would to a system they correctly understood to be an algorithm, may believe the system's responses reflect genuine clinical judgment, and may not seek human care because they believe they are already receiving competent support.
Severe mental illness and complex presentations
AI mental health tools are calibrated for mild-to-moderate depression and anxiety in people who are functionally stable. They are not designed for—and have no validated evidence for—severe depression with psychotic features, active mania, complex PTSD, borderline personality disorder, eating disorders with medical complications, or schizophrenia spectrum conditions.
For these populations, an AI tool that validates distorted thinking, or that misses the clinical significance of a described symptom, can cause harm. The risk is not that the AI does something obviously wrong—it is that the AI sounds competent and reassuring while navigating completely beyond its validated scope.
The regulatory picture
Mental health AI sits in a complex and evolving regulatory environment.
FDA digital therapeutics clearance
The US FDA has cleared a small number of digital therapeutics (DTx)—software that delivers an evidence-based therapeutic intervention. Woebot Health received FDA Breakthrough Device Designation for a specific indication. The FDA's Software as a Medical Device (SaMD) framework applies when software is intended to treat, diagnose, or prevent a medical condition.
The key distinction: most consumer mental health apps are not regulated by the FDA because they do not make medical claims. An app that says "improve your mood" or "manage stress" is wellness software. An app that says "treat major depressive disorder" is making a medical claim and enters regulatory territory. Many apps live in a deliberate gray zone.
The EU AI Act and CE marking
The EU AI Act, which began phasing in from 2024, classifies AI systems used in healthcare as high-risk when they influence clinical decisions or interact with vulnerable populations. High-risk AI systems require conformity assessment, transparency, human oversight mechanisms, and ongoing monitoring.
CE marking for medical devices (including digital ones) in the EU requires demonstration of safety and efficacy through the Medical Device Regulation (MDR). AI companions and wellness apps that avoid medical claims are generally not covered by MDR—but may still fall under the AI Act's requirements for transparency and bias assessment.
The practical upshot: in the EU, a mental health AI making any clinical-adjacent claims faces meaningful regulatory oversight. In the US, the same product may face none if it avoids explicit medical language.
What "unregulated" means in practice
For users, it means most mental health apps have no external verification of their claimed benefits, no required disclosure of their safety record, and no mandatory reporting when users are harmed. The app stores are not gatekeeping clinical efficacy. The app description is marketing copy. The "evidence base" cited on the website may be a single observational study funded by the company.
How clinicians are actually using AI in 2026
Beyond consumer apps, AI is increasingly embedded in clinical workflows—and this is where some of the most substantive progress is happening.
Ambient note-taking tools like Nabla and Heidi Health use session transcription (with patient consent) to generate draft SOAP notes, treatment summaries, and after-visit instructions. A therapist reviews, edits, and approves every note before it enters the record. The efficiency gain is real: documentation that took 30 minutes now takes 5 minutes to review. Therapist burnout from administrative load is a significant retention problem in mental health care, and tools that reduce that load without compromising oversight are genuinely valuable.
Between-session monitoring: Some practices are piloting apps that send structured check-ins to patients between appointments—mood ratings, sleep logs, medication adherence prompts—and surface flagged responses for the clinician to review before the next session. The clinician sees a dashboard rather than receiving a text at 2am; the patient has a structured channel for between-session expression.
Clinical decision support: Tools that flag when a patient's PHQ-9 score has worsened significantly since last week, or that identify when a patient hasn't logged in for an unusually long time, give clinicians a systematic picture they would not have from session-only contact.
Training and supervision: AI systems that can generate realistic clinical scenario simulations are being used in graduate training programs, allowing trainees to practice with difficult presentations in a safe environment before seeing real clients.
The common thread in effective clinical AI use: humans remain in the decision loop for everything that matters, and AI handles the mechanical, repetitive, or pattern-detection work.
Sam Altman's claim and the clinical pushback
In 2024, OpenAI CEO Sam Altman stated that AI "will be the greatest breakthrough in mental health in history" and suggested AI could eventually function as a highly effective therapist available to anyone in the world. The claim got widespread coverage.
The clinical community's response was pointed. Several objections are worth understanding:
Relationship is not a feature to be optimized. Substantial research—the "common factors" literature in psychotherapy—shows that the therapeutic alliance (the quality of the relationship between therapist and client) is one of the strongest predictors of therapy outcomes, often more important than the specific technique used. An AI can simulate warmth; it is unclear whether simulated warmth produces the same alliance effects as genuine human connection.
Liability and accountability: When a human therapist makes an error—misses a suicide risk, gives harmful advice—there are professional accountability structures, licensing boards, and legal recourse. When an AI tool fails, accountability is diffuse and largely theoretical.
The population that needs the most help is the hardest for AI to serve. People with severe, complex, or chronic mental illness—the population driving the highest costs and suffering—are precisely those for whom AI tools have the least evidence and the most risk. Solving the access problem with AI is easiest for the people who need it least.
None of this means AI will not become an important part of mental health infrastructure. It almost certainly will. But the "AI will fix mental health" frame is not grounded in current evidence and risks diverting resources and attention from the human workforce and systemic investment the field actually needs.
Practical guide: choosing an AI mental health tool
If you are evaluating an AI mental health tool—for yourself, for patients, or as a product decision—here is a framework for what matters.
Criterion
What to look for
Red flags
Evidence base
Published peer-reviewed RCTs, clearly stated limitations
Only testimonials, internal white papers, or vague "science-backed" claims
Crisis protocol
Explicit escalation path, crisis line integration, keyword detection
No crisis response, deflects crisis signals back to chatbot conversation
Human escalation
Access to a human coach or clinician within the platform
Fully autonomous, no human in the loop
Scope clarity
Clear statements about who the tool is NOT for
Implies suitability for all conditions including severe illness
Privacy and data
HIPAA compliance or BAA if clinical, clear data retention/sharing policy
Evidence from populations similar to intended users
Only studied in college students or other narrow samples
Regulatory status
FDA clearance or CE marking if making clinical claims
Medical language without regulatory backing
Supplement vs. standalone
Explicitly positioned as a complement to human care
Marketed as a replacement for therapy
For anyone experiencing moderate-to-severe symptoms, active suicidality, trauma history, or severe mental illness: an AI tool is not a primary treatment. Find a licensed clinician. For mild stress, subclinical anxiety, psychoeducation, mood tracking, or between-session support, a well-designed AI tool may be genuinely helpful.
The alignment question for mental health AI
There is a deeper issue underneath the evidence and regulatory questions. The goals of an AI company and the goals of a mental health intervention are not always aligned—see our introduction to AI alignment for the broader context.
An app that maximizes engagement is not necessarily helping you. A chatbot designed to keep you coming back every day may be doing so by fostering dependency rather than building the self-regulation skills that good therapy is trying to make itself unnecessary. The agentic AI systems being built right now will have much greater autonomy and persistence than today's chatbots, and the question of whose goals they are optimizing—user wellbeing, company revenue, or engagement metrics—becomes progressively more important.
Understanding how AI agents are built and what they optimize for is genuinely relevant to evaluating mental health AI. The design choices that make a product sticky are not the same as the design choices that make it therapeutic.
What the next few years will look like
The mental health AI landscape in 2026 is in a genuinely transitional moment.
Scripted CBT bots will continue to accumulate evidence and may earn clearer regulatory standing for specific indications. The Woebot Health trajectory—seeking FDA clearance for narrow, well-defined populations—is the most defensible path for clinical credibility.
LLM-powered tools will become more common and harder to regulate. The challenge is creating accountability structures for systems whose behavior is not fixed. Some companies are exploring "model cards" for mental health AI that document training data, safety evaluations, and intended populations—analogous to pharmaceutical package inserts.
Multimodal monitoring will expand. Wearables that measure HRV, sleep, and activity can feed into mental health monitoring in real time. The privacy implications are substantial, but the clinical utility—spotting prodromal signs of a bipolar episode before the person subjectively notices—could be significant.
AI in clinical workflows will continue to expand, with ambient documentation becoming standard in many practices within the next two years. The question is whether this frees clinicians to see more patients or simply reduces headcount.
Regulatory convergence: The EU AI Act's high-risk classification for healthcare AI will push companies to conduct more rigorous testing and maintain human oversight. Whether US regulation follows is uncertain, but litigation risk from harm events is likely to have a similar effect.
The best-case scenario is not AI replacing therapists—it is AI making therapists more effective, extending their reach between sessions, reducing their administrative load, and providing a first point of contact for the majority of people with mild symptoms who will never see a professional anyway. That is a meaningful contribution to an acute global problem. It is also a much more modest claim than the headlines usually make.
Bottom line
The honest assessment of AI mental health tools in 2026:
They work, modestly, for the right people. CBT chatbots reduce mild depression and anxiety symptoms in motivated users with mild-to-moderate presentations, when used as a supplement to other support. The effect sizes are real but small.
The evidence base is thin and optimistically interpreted. Most studies are short, use self-selected populations, and compare to waitlist controls rather than actual therapy. The literature is improving but is not yet sufficient to justify broad clinical adoption without human oversight.
The failure modes are serious. Crisis situations, severe mental illness, and dependency risk are not edge cases—they are predictable outcomes of deploying conversational AI in mental health contexts without adequate clinical governance.
The regulatory picture is still developing. Most apps are unregulated. Some are seeking and obtaining meaningful regulatory clearance. Users cannot assume that a mental health app has been validated unless they verify it themselves.
Clinician-facing tools may be where AI adds the most near-term value. Ambient note-taking, between-session monitoring, and clinical decision support have lower risk profiles and are already showing real benefits in practice.
The treatment gap is real and AI will be part of filling it. The gap between a compelling conversational AI and a validated clinical intervention is also real, and currently much wider than the marketing suggests. Holding both of those truths together is the starting point for using these tools well.
Related reading on explainx.ai
More AI-for guides
AI for Elderly Care — companion robots, loneliness, and cognitive monitoring overlap
