explainx.ai0k
TrendingAI News TodayPathwaysSkills
Pricing
explainx.ai

Upskill in AI — 16 free pathways, live workshops & bootcamps, and 50+ courses from practitioners. Plus the skills, tools, and MCP servers to practice on.

follow us

follow on google

Add explainx.ai as a preferred source

corporate training

support@explainx.ai

get started

Find your pathTake Free Evaluation

community

Join the community

learn

mind: share how you thinkpathways — start freeworkshopsbootcampscoursescompare Explainxcertificationsmock testsexplainx universitycorporate traininglearn skills & mcp

discover

skillsmcp serversexplainx mcptoolsmdx readeragentsllmsdesignsdictionarypeopleagi trackerfelony benchranks

company

aboutvisionmissionteaminstructorsteach on explainxpartnershipscommunityhackathonscareers

content

daily AI newsstate of AI — live resultsblogreleasespromptsgeneratorsresource libraryfor LLMsexplainx.ai kids

solutions

all solutionsdeveloper upskillingmarketing upskillingproduct manager upskillingleadership upskilling

newsletter · weekly

Get AI news, tools, and insights in your inbox.

supportcontactprivacytermsdata rightshow we create contentsubmission guidelines

© 2026 AISOLO Technologies Pvt Ltd

explainx.ai

  1. Home
  2. /
  3. Dictionary
  4. /
  5. Adaptive Exploration Bias
Safety & Alignmentaka exploration-exploitation biasaka emergent stratification bias

Adaptive Exploration Bias

Adaptive exploration bias is when an AI agent invents a systematic bias toward or against a group or option purely from under-exploring during sequential decision-making, even when no real difference between the options exists.

Ask Melo about this← all terms

The term comes from the ICML 2026 spotlight paper "Large Language Models Develop Novel Social Biases Through Adaptive Exploration" (Wu, Liu, Bai, Griffiths; Princeton/Stanford), which had LLMs play a repeated hiring-decision game across four fictional demographic groups with identical success rates. Models still stratified applicants by group, overgeneralizing from early random outcomes and then exploiting that impression instead of continuing to sample — a failure mode borrowed from human decision-making research (the "hot stove effect"). Unlike training-data bias, this bias has no origin in the model's training corpus; it is generated live by insufficient exploration during a sequential task, and the paper found it gets worse, not better, with newer and larger models. Classical bandit algorithms like UCB and Thompson Sampling, which explore more systematically, show far less of it on the same task.

Related terms

Bias MitigationReward HackingSampling BiasExistential Risk from AIRed TeamAI Text Watermark

Where Adaptive Exploration Bias comes up

  • LLMs Invent New Social Biases in a Hiring Game — ICML 2026 Spotlight