南郭先生——下文会解释这个中国古代寓言中的模仿者 Mr. Nan Guo——通常并不是骗子。更多时候,我们现在想称为模仿者的人,是被训练其他人的同一套激励训练出来的——被一个奖励集体产出、从不要求个人交账的系统塑造出来,然后在规则改变时让系统感到惊讶。如果我们想理解为什么合奏能运转那么久,就要从建造合奏的人开始,而不是从坐在合奏里的人开始。
在那些 AI 大规模运作的职业中,AI 所做的,与其说是揭露欺诈,不如说是一场可读性事件——一个长期依赖集体产出的系统,第一次开始产生能够读出个人的信号。那 60% 因预期 AI 而裁员、不是因 AI 已经交付收益而裁员的组织,响应的并不是一项新技术,而是在抓住一个他们以前无法正当化的重组理由。合奏让个人归因在政治上困难。AI 时刻让它在政治上容易。病理是旧的;催化剂是新的。
Dell'Acqua 及其同事(2023/2026)对 758 名 BCG 咨询顾问做了田野实验。在专业能力前沿以内的任务上——标准咨询套件——低于平均水平的顾问使用 AI 后质量提升 43%;高于平均水平的顾问提升 17%。趋同。但当任务转向一个落在 AI 能力前沿之外的商业问题解决任务时,使用 AI 的顾问给出正确解决方案的概率比不使用 AI 的人低 19 个百分点(Dell'Acqua et al. 2023)。AI 给了错误的信心。论文说,工作者“在方向盘前睡着了”——停止质疑那些看起来权威的输出。论文命名的“锯齿状技术前沿”,正是 AI 可靠帮忙的任务与 AI 可靠误导的任务之间的边界——而关键技能,是知道自己站在哪一边。
Vendraminelli 及其同事 2025 年 HBS 工作论文中所谓的 GenAI Wall Effect,让这个机制更清楚。在一家大型英国公司的受控实验中,AI 在执行任务上为相邻外部人抹平了场地——但缺乏领域知识来评估 AI 输出的远距离外部人,即便有 AI 辅助,也无法缩小与内部人的差距(Vendraminelli et al. 2025)。墙不是努力问题。它是评估问题。远距离外部人无法判断 AI 输出是否合适;内部人可以。AI 放大了这个差异。
METR(2025)在编码中发现了相邻现象:经验丰富的开源开发者在复杂代码库上使用 AI 工具时反而慢了 19%,尽管他们预期会提速 24%——而且事后他们仍然相信 AI 让自己更快了(METR 2025)。这项研究规模小(N=16;发现具有提示性而非决定性),但感知差距很重要:即便专家也会误判评估问题。
三个职业显示出同样结构:
在法律工作中,生产任务是用 AI 辅助起草一份诉状;任何合格助理都能用旧时间的一小部分完成。评估任务是在签上自己名字之前识别哪些引文是幻觉。这两件事需要的能力不同。第一件需要熟悉格式。第二件需要足够懂法理,知道 Fabulozo Airlines v. Carillo 并不存在。
在管理咨询中,生产任务是生成一套关于行业动态的 40 页幻灯片;AI 可以在几分钟内生成一个貌似合理的版本。评估任务是识别 AI 的哪些框架假设不适用于这个客户的真实问题——那些嵌入数据选择、竞争框架、隐含市场定义中的假设。抓住这些,需要在足够多语境中做过足够多次这项工作,才能识别看似合理的答案何时是错的。
在产品管理中,生产任务是撰写需求文档和用户故事;AI 做得不错。评估任务是识别 AI 生成的综合是否漏掉了一个会在生产环境中出问题的边界情况——这需要把产品实际推过生产环境足够多次,脑中有一套边界情况如何呈现的模型。
这三个职业的共同点是:评估步骤需要无法从 AI 借来的领域特定判断,因为 AI 正是被评估的对象。
评估型 AI 正在到来。它不会消解这个机制,因为构建评估型 AI 需要领域量规,而只有已经拥有领域判断的人才能制定这些量规——这正是 GenAI Wall 显示的东西。护城河也许会缩小,但仍然需要有人告诉评估型 AI,目标领域里的“正确”长什么样。即便护城河缩小得比这个论证预测得更快,“建立评估能力”在 24 个月视野内仍然是可执行的——而读者眼下要做的大多数决定,恰恰都在这个视野内。
劳动力市场数据支持这个总体方向:Brynjolfsson、Chandar 和 Chen(2025)使用 ADP 工资记录和 AI 暴露指数发现,在最受 AI 暴露影响的职业中,22-25 岁劳动者的相对就业下降 16%,而同一职业中的有经验劳动者保持稳定或增长(Brynjolfsson et al. 2025)。如果 AI 正在自动化入门级生产任务,而资深评估任务大体仍然完整,这个模式正是你会预期看到的。
2023 年,律师 Steven Schwartz 使用 ChatGPT 为一宗航空人身伤害案件做研究。他提交的诉状包含多项案例引用:Varghese v. China Southern Airlines、Shaboon v. EgyptAir、Petersen v. Iran Air 等等。这些案例并不存在。当 P. Kevin Castel 法官要求提供副本时,Schwartz 提交了宣誓书证明它们真实存在,却没有核查。法院最终分别对 Schwartz、他的合伙人 LoDuca 以及律所处以 5,000 美元制裁——合计 15,000 美元——并认定存在“有意识回避以及向法院作出虚假和误导性陈述”(Mata v. Avianca 2023)。生成很容易。失败的是评估测试。
模式并不是 Schwartz 是个异类。斯坦福法学院 2025 年一项预注册研究,测量了专门为减少幻觉而设计的 AI 法律研究工具中的幻觉率:Lexis+ AI 在 17% 的查询中生成伪造引文;Westlaw AI-Assisted Research 为 33%;GPT-4 为 43%(Magesh et al. 2025)。这些不是通用聊天机器人。它们是专门构建、带检索增强生成、瞄准引文准确性这个具体问题的工具。它们仍然在大约六分之一到三分之一的查询中产生幻觉。评估测试不是思想实验。它是正在运行的基线专业要求。
加州上诉法院在 Noland v. Land of the Free(2025)中把这一点具体化。律师 Amir Mostafavi 提交的开篇诉状中,23 处引文有 21 处是伪造的;法院对他处以 10,000 美元制裁,并把他移交州律师协会。到了是否判给对方律师费的问题,法院拒绝了——因为对方律师也没有抓住伪造引文,显然是在法院自己提出问题后才意识到。这是一个新兴信号:识别对方诉状中的 AI 幻觉,正在成为基线专业能力的一部分——不是新的法律义务,而是一种正在悄悄形成的职业期待(Noland v. Land of the Free 2025)。
把文章放下一分钟。想想你最近依赖的一份 AI 生成工作——一份备忘录、一份草稿、一份市场摘要、一段代码、一份研究综合、一套幻灯片。具体说出你在依赖之前核查过的最后一个 AI 生成主张。不要说“我通常都会审阅一切”。不要说“我大体有感觉”。说出过去两周里,你从某个具体 AI 输出中拿出并对照一手来源验证过的一个具体主张。如果你说不出来,你是在把 AI 用于生产,而不是用于评估。这不是判决。它是诊断。
从下一份你依赖的 AI 输出开始。具体说出你所在领域里的“正确”长什么样。然后测试输出是否满足这个定义。不是它看起来是否合理——而是它是否满足定义。持续做。评估能力通过重复发展;最初几次会缓慢、不确定,而且很可能会暴露出你过去依赖的东西比你检查过的更多。
读到这里的职业中段人士,站在一个特定决策点。工作十二到十五年——发展性不透明本应已经解决。学徒窗口已经关闭,或正在关闭。真正的判断是否在其中形成,是接下来二十四个月会回答的问题,一次 AI 输出回答一次。这不是敌意观察。处在这个阶段的人——职业中段、有证书、有经验,身处本文一直讨论的合奏式不透明职业——拥有早期职业者没有的东西:多年的真实领域暴露,可用来扎根评估。
发展性与永久性的区别在这里很重要:如果合奏曾作为学徒托举你,并逐渐给你更多个人责任,那么 AI 正在测试的是你已经建立的判断。你会在使用它时认出它。如果合奏从未发问——如果十二年过去,你一直是那个为幻灯片做贡献、却从未必须为幻灯片是否正确辩护的人——那么 AI 正在安装的,是一场本来早该到来的测试,只是它来晚了。
南郭当夜逃走,因为他知道自己无法通过独奏。二阶独奏不同。不是齐湣王叫你演奏。它是晚上 11 点那个安静瞬间:你把又一份 AI 草稿粘进又一份你将签上自己名字的文件里,然后决定自己要如何阅读它——像一个能抓住错误的人那样读,还是像一个希望一切都没问题的人那样读。
Brynjolfsson, E., Chandar, B., & Chen, R. "Canaries in the Coal Mine? Six Facts about the Recent Employment Effects of Artificial Intelligence." Stanford Digital Economy Lab Working Paper, August 2025. https://digitaleconomy.stanford.edu/
Davenport, T.H., & Srinivasan, L. "Companies Are Laying Off Workers Because of AI's Potential — Not Its Performance." Harvard Business Review, January 2026.
Dell'Acqua, F. et al. "Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality." HBS Working Paper 24-013 (September 2023); published Organization Science, 2026. https://ssrn.com/abstract=4573321
Goldin, C., & Rouse, C. "Orchestrating Impartiality: The Impact of 'Blind' Auditions on Female Musicians." American Economic Review, 90(4):715–741, September 2000.
Magesh, V. et al. "Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools." Journal of Empirical Legal Studies, 2025. DOI: 10.1111/jels.12413. https://arxiv.org/abs/2405.20362
McKinsey & Company (Hancock, B. & Weddle, B.). "What Works — and Doesn't — in Performance Management." November 2024.
METR. "Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity." July 10, 2025. ArXiv: 2507.09089. https://arxiv.org/abs/2507.09089
Mata v. Avianca, Inc., No. 1:22-cv-01461, 678 F. Supp.3d 443 (S.D.N.Y. June 22, 2023).
Noland v. Land of the Free, L.P., California Court of Appeal, Case No. B331918, September 12, 2025.
Noy, S., & Zhang, W. "Experimental Evidence on the Productivity Effects of Generative Artificial Intelligence." Science, 381(6654):187–192, July 14, 2023. DOI: 10.1126/science.adh2586.
Peng, S., Kalliamvakou, E., Cihon, P., & Demirer, M. "The Impact of AI on Developer Productivity: Evidence from GitHub Copilot." ArXiv: 2302.06590, February 2023. https://arxiv.org/abs/2302.06590
Spence, M. "Job Market Signaling." Quarterly Journal of Economics, 87(3):355–374, August 1973.
Vendraminelli, L. et al. "The GenAI Wall Effect: Examining the Limits to Horizontal Expertise Transfer Between Occupational Insiders and Outsiders." HBS Working Paper 26-011, September 2025. https://ssrn.com/abstract=5462694
Dunning, D., & Kruger, J. "Unskilled and Unaware of It: How Difficulties in Recognizing One's Own Incompetence Lead to Inflated Self-Assessments." Journal of Personality and Social Psychology, 77(6):1121–1134, December 1999. PubMed PMID: 10626367.
Acemoglu, D., & Restrepo, P. "The Wrong Kind of AI? Artificial Intelligence and the Future of Labor Demand." Cambridge Journal of Regions, Economy and Society, 13(1):25–35, 2020. NBER Working Paper 25682. https://www.nber.org/papers/w25682
By the time you read a new article about AI and jobs, you have already read it. The numbers change; the structure does not. A projection appears — the World Economic Forum's 2025 Future of Jobs Report projects 92 million roles displaced by 2030, with 170 million new roles created, a net gain of 78 million that somehow never seems to land as reassuring (WEF 2025). A wave of layoffs follows, interpreted as confirmation. In 2025, US employers announced 1.2 million job cuts — a 58% increase over 2024 — and the coverage ran its familiar arc: AI has arrived, the sorting has begun, choose your side (Challenger Gray & Christmas 2026).
This piece is about ensemble-opaque knowledge work — consulting, legal, product, corporate strategy, research writing. Surgery, aviation, individual sports, and the other professions that already measure you solo are not in scope; AI does not change legibility structures that were already there.
Here is what most of that coverage did not note: only 54,836 of those 1.2 million announced cuts — 4.5% of the total — cited AI as a reason. The layoff wave was real. The AI attributions was mostly not. Most of those cuts had nothing to do with AI actually changing output: according to a December 2025 survey of over 1,000 executives by Davenport and Srinivasan in Harvard Business Review, 60% of the organizations that reduced headcount did so in anticipation of AI's future impact, not because AI had delivered gains — and only 2% reported large layoffs tied to actual AI implementation (Davenport & Srinivasan 2026). Davenport and Srinivasan read this as pretext: the layoffs were already coming; AI provided the cover.
That gap — between the story being told and what is actually driving it — is where this article begins. If AI is not causing most of the displacement, what is? And why is the AI story so useful to the people telling it?
The 南郭先生 — Mr. Nan Guo, the mimic of an old Chinese parable explained below — was not usually a fraud. Most often, the person we now want to call a mimic was trained by the same incentives that trained everyone else — was shaped by a system that rewarded collective output, never once asked for an individual accounting, and was then surprised when the rules changed. If we want to understand why the ensemble worked for so long, we start with the people who built it, not the people who sat inside it.
For decades, the dominant direction of organizational performance management was away from individual accountability. Cappelli and Tavis traced this arc in a well-known 2016 HBR piece: companies were moving from annual-rating systems toward continuous development conversations, from individual scoring toward team-based metrics, from accountability to cultivation (Cappelli & Tavis 2016). The shift was not irrational. Individual attribution is painful, politically costly, and organizationally disruptive. Over a third of managers, McKinsey found in 2024, are perceived as lacking the skills to have direct conversations about performance — a perception survey, not a behavioral audit, and likely conservative at that (McKinsey 2024).
For a long time, this arrangement was stable. Economists have a name for why. Signaling theory — developed by Michael Spence in a 1973 paper that eventually won a Nobel Prize — describes what happens in labor markets when employers cannot distinguish between high- and low-ability workers: both groups acquire the same credential, receive the same wage, and coexist in what is called a pooling equilibrium (Spence 1973). The equations are not necessary. For a long time, the credential was cheap enough that the bluffer and the expert could acquire the same signal and earn the same wage. That equilibrium held as long as the signal was cheap and the test never came.
There is an old Chinese story. King Xuan of Qi liked to hear the yu — an ancient reed instrument — played by an ensemble of 300. A man named Nan Guo could not play, but he stood in the ensemble, fingers moving, receiving the same rice as the real musicians. When King Xuan died and his son King Min took the throne, King Min wanted to hear the players one by one. Nan Guo fled that night. The story has been remembered as a parable about mimicry. 南郭先生 — "Mr. Nan Guo" — became Chinese shorthand for the miming ensemblist. But the story has always been told from the wrong end. The man who hired Nan Guo — the court master who organized a 300-player ensemble rather than auditioning any player alone — was not naive. He was building something in which the question of individual competence would never have to be asked. The interesting character is not the man who could not play. It is the court master who assembled an ensemble of 300 precisely so that no one would ever have to.
This is not an argument against Acemoglu's concern about macro productivity; that is a different level of the problem. This is an argument about which individuals become legible, not about how big the pie grows.
What AI is doing, in the professions where it operates at scale, is less an exposure of fraud than a legibility event — the moment when a system that long ran on collective output begins, for the first time, to produce individually readable signals. The 60% of organizations cutting staff in anticipation of AI, not because of AI-delivered gains, are not responding to a new technology so much as seizing a new justification for a restructuring they could not previously justify. The ensemble made individual attribution politically difficult. The AI moment makes it politically easy. The pathology is old; the catalyst is new.
Before going further: the ensemble earned a defense, and this article owes it one.
Opacity is not only cover for mediocrity — it is the substrate of apprenticeship. Juniors cannot solo on Day 1 and should not be asked to. Hospitals have rounds, law firms have partnerships, consulting teams carry analysts, orchestras have sections. In all of these, the new person is carried by the collective while their judgment develops. The opacity is protective, not evasive. The ensemble absorbs error while the apprentice builds the capacity to avoid it.
The ATM is a useful historical mirror here. When ATMs were deployed across the United States from the 1980s onward — eventually numbering around 400,000 machines — you might expect bank teller employment to have collapsed. It did not. Teller employment actually grew, from roughly 500,000 to 600,000, because lower branch operating costs allowed banks to open more branches, shifting the teller role toward relationship banking that required human judgment (Bessen 2015). The ATM didn't expose tellers; it transformed what tellers did. The ensemble changed shape, but it held.
The Goldin and Rouse (2000) blind audition study shows the same mechanism working in reverse: according to the study, placing a physical screen between musician and evaluator increased by about 50% the probability a woman would advance from a preliminary round — the magnitude is contested by a later statistical critique (Gelman 2019), but the direction survives. Deliberately removing opacity changed who got through. The ensemble had been carrying not just apprentices but permanent inhabitants.
Two kinds of opacity are at work in every ensemble. The first is developmental — the seed in the silo. The second is permanent — the silo that never lets the seed out. The critique is of the second.
Developmental opacity resolves. The apprenticeship has a timeline, and at the end of that timeline the apprentice is expected to know, and to be known. The ensemble teaches the solo; eventually it calls for one. The ensemble this argument is concerned with is the one that never called — the structure in which twelve, fifteen, twenty years passed and the question of individual judgment simply never arrived. Dunning and Kruger (1999) documented what this looks like from the inside: people in the bottom quartile of tested performance estimated themselves at around the 62nd percentile, not because they were dishonest but because the same knowledge needed to perform well is needed to recognize poor performance — the metacognitive gap and the performance gap are one and the same thing. The magnitude of that finding is debated; the direction is not.
None of this is hostile to apprenticeship. The question is what apprenticeship was supposed to resolve into — and what happens when the ensemble never asks.
The empirical picture is genuinely complicated, and it would be dishonest to pretend otherwise.
The strongest version of the case for AI as a great equalizer is real, and it deserves an honest hearing. Noy and Zhang (2023), in a preregistered randomized controlled trial published in Science, found that for mid-level professional writing tasks, ChatGPT substantially raised the floor — low-ability writers improved most, the distribution compressed, and inequality fell (Noy & Zhang 2023). If AI gives the weakest performers the biggest lift, then the ensemble's opacity dissolves not by exposing the 南郭先生 but by making them genuinely more capable — which would mean the second-order solo is simply wrong. Peng et al. (2023) found something similar in coding: GitHub Copilot gave developers an average 55.8% speedup on a well-defined task, with less experienced developers benefiting more (Peng et al. 2023). The distribution compressed in both domains.
The moderator is task type.
The convergence findings are robust for what we might call inside-frontier production tasks: writing a draft, generating code for a specified function, completing a defined deliverable where the quality criteria are clear and the AI's errors are checkable by anyone. These tasks converged. The divergence findings appear when the task shifts from producing to spec to judging what counts as correct — and especially when the task requires a domain-specific answer to the question: is this right?
Dell'Acqua and colleagues (2023/2026) ran a field experiment with 758 BCG consultants. On tasks inside the expertise frontier — the standard consulting suite — below-average consultants using AI improved quality by 43%; above-average consultants improved by 17%. Convergence. But when the task shifted to one business problem-solving task that fell outside the AI's competence frontier, consultants using AI were 19 percentage points less likely to produce correct solutions than those without (Dell'Acqua et al. 2023). The AI gave false confidence. The workers "fell asleep at the wheel," as the paper puts it — ceasing to question output that appeared authoritative. What the study named the "jagged technological frontier" is the boundary between the tasks where AI reliably helps and the tasks where AI reliably misleads — and the critical skill is knowing which side you are on.
The mechanism becomes even clearer in Vendraminelli and colleagues' 2025 HBS working paper on what they call the GenAI Wall Effect. In a controlled experiment at a large UK firm, AI leveled the playing field for adjacent outsiders on execution tasks — but distant outsiders, who lacked the domain knowledge to evaluate AI output, could not close the gap with insiders even with AI assistance (Vendraminelli et al. 2025). The wall is not an effort problem. It is an evaluation problem. Distant outsiders could not judge whether the AI output was appropriate; insiders could. AI amplified that difference.
METR (2025) found something adjacent in coding: experienced open-source developers working on complex codebases were 19% slower when using AI tools, despite expecting a 24% speedup — and even after the fact, they still believed AI had made them faster (METR 2025). The study was small (N=16; the findings are suggestive, not definitive) but the perception gap matters: even experts misjudged the evaluation problem.
Three professions show the same structure:
In legal work, the production task is drafting a brief with AI assistance; any competent associate can do it in a fraction of the old time. The evaluation task is identifying which citations are hallucinated before signing your name to them. These require different things. The first requires fluency with the format. The second requires knowing the doctrine well enough to know that Fabulozo Airlines v. Carillo does not exist.
In management consulting, the production task is generating a 40-slide deck on industry dynamics; AI can produce a plausible version in minutes. The evaluation task is identifying which of the AI's framing assumptions are wrong for this client's actual problem — the assumptions baked into the data selection, the competitive frame, the implicit market definition. Catching those requires having done this work enough times in enough contexts to recognize when the plausible-looking answer is wrong.
In product management, the production task is writing requirement documents and user stories; AI does this well. The evaluation task is recognizing when the AI-generated synthesis has missed an edge case that will break in production — which requires having run products through production enough times to carry a mental model of how edge cases present.
What these three professions share is that the evaluation step requires domain-specific judgment that cannot be borrowed from AI, because AI is what is being evaluated.
Evaluator-AI is arriving. It will not dissolve the mechanism, because building an evaluator-AI requires domain rubrics that only someone who already has domain judgment can formulate — which is precisely what the GenAI Wall shows. The moat may shrink, but a human still has to tell the evaluator-AI what "correct" looks like in the target domain. And even if the moat shrinks faster than that argument predicts, "build evaluation competence" remains actionable for a 24-month horizon — and most of what the reader is deciding right now is on that horizon.
The labor market data backs the general direction: Brynjolfsson, Chandar, and Chen (2025), using ADP payroll records and AI exposure indices, found a 16% relative employment decline for workers aged 22–25 in the most AI-exposed occupations, while experienced workers in the same occupations remained stable or grew (Brynjolfsson et al. 2025). The pattern fits what you would expect if AI were automating the entry-level production tasks while the senior evaluation tasks remained largely intact.
The most concrete evidence for what evaluation failure costs comes from law — where written records exist, and where courts have a structural incentive to name incompetence when they encounter it.
In 2023, attorney Steven Schwartz used ChatGPT to research an aviation personal-injury case. The brief he filed included multiple case citations: Varghese v. China Southern Airlines, Shaboon v. EgyptAir, Petersen v. Iran Air, among others. These cases do not exist. When Judge P. Kevin Castel asked for copies, Schwartz submitted affidavits attesting to their reality without checking. The court eventually issued sanctions of $5,000 each to Schwartz, his partner LoDuca, and the firm — $15,000 total — and found "conscious avoidance and false and misleading statements to the Court" (Mata v. Avianca 2023). Generation was easy. Evaluation was the test that failed.
The pattern is not that Schwartz was an outlier. A 2025 preregistered study from Stanford Law measured hallucination rates in dedicated AI legal research tools specifically designed to reduce hallucination: Lexis+ AI produced fabricated citations in 17% of queries; Westlaw AI-Assisted Research in 33%; GPT-4 in 43% (Magesh et al. 2025). These are not general-purpose chatbots. They are purpose-built tools with retrieval-augmented generation aimed at the specific problem of citation accuracy. They still hallucinate in roughly one in six to one in three queries. The evaluation test is not a thought experiment. It is the baseline professional requirement, running now.
A California appeals court made this concrete in Noland v. Land of the Free (2025). Attorney Amir Mostafavi filed an opening brief in which 21 of 23 quotations were fabricated; the court sanctioned him $10,000 and referred him to the state bar. When it came to the question of opposing counsel's fees, the court declined to award them — because opposing counsel had also failed to catch the fabricated citations, apparently becoming aware of the problem only when the court itself raised it. This is an emerging signal that spotting AI hallucinations in opposing briefs is becoming part of baseline professional competence — not a new legal duty, but a professional expectation that is quietly taking shape (Noland v. Land of the Free 2025).
Put the article down for a minute. Think about the last AI-generated piece of work you relied on — a memo, a draft, a market summary, a piece of code, a research synthesis, a deck. Name, specifically, the last AI-generated claim you fact-checked before relying on it. Not "I usually review everything." Not "I have a general sense." Name one specific claim, from one specific piece of AI output, that you verified against a primary source in the last two weeks. If you cannot name one, you are using AI for production, not for evaluation. That is not a verdict. It is a diagnostic.
If you can name one, notice what doing that felt like — how long it took, what you did, whether you would do it again for the next piece. That feeling is the feeling of evaluation competence being exercised. It is the feeling of the test, in session.
There is a genuine objection to everything above, and it deserves more than a footnote.
The specific tests that emerge will be political. Which hallucinations count? Which "correct" is correct? Each evaluative regime privileges some knowledge over others, and whoever sets the test shapes which workers pass. A legal citation check and a strategic-framing check and a product edge-case check are all versions of the same demand — but they are not neutral metrics. They are constructed categories, and they will be constructed by people with interests.
Recall Goldin and Rouse's (2000) blind audition study: the screen increased the probability of female advancement because it removed one source of bias — but the audition criteria themselves (the repertoire, the judging rubric, the standards for "correct" intonation) were set by people in positions of power, and those criteria carried their own assumptions. The auditions were fairer than what preceded them. They were not fair in any absolute sense.
But: refusing to build evaluation competence on the grounds that the tests are contestable is the position that would have rejected blind auditions in 1970 because the audition criteria were contestable. The criteria were contestable. The auditions mattered anyway.
The direction of the mechanism is not fabricated. Whatever specific tests emerge across consulting, law, product, and corporate strategy, they will demand evaluation competence rather than mere production competence. Building evaluation judgment in your own domain — what "correct" looks like, where the AI is most likely to miss it, what questions to press when the output seems plausible — is the investment that holds across the range of possible test designs. The specific implementation will be political. The underlying demand will not.
If you could not name a fact-checked claim in the preceding section, shame is the wrong response. The useful thing is to identify what genuine evaluation competence looks like in your own domain — not as a category, but as a habit — and start building it.
Start with the next piece of AI output you rely on. Name, specifically, what "correct" would look like in your domain. Then test whether the output meets that definition. Not whether it looks plausible — whether it meets the definition. Keep doing it. Evaluation competence develops through repetition, and the first few repetitions will be slow and uncertain and will probably reveal that you have been relying on more than you checked.
The mid-career professional reading this piece sits at a particular decision point. Twelve to fifteen years in — the developmental opacity should have resolved. The apprenticeship window has closed, or is closing. Whether genuine judgment developed inside it is a question that the next twenty-four months will answer, one AI output at a time. That is not a hostile observation. Someone at this stage — mid-career, credentialed, experienced, in the ensemble-opaque professions this article has been about — has something that earlier-career workers do not: years of actual domain exposure in which to ground evaluation.
The question is whether those years built a habit of checking or a habit of producing. The two are not the same, and AI makes the difference visible in a way that was not previously possible when output was always collective.
The developmental-vs-permanent distinction matters here: if the ensemble carried you as an apprentice and gradually extended you more individual responsibility, then what AI is testing is judgment you already built. You will recognize it when you use it. If the ensemble never asked — if twelve years passed and you were always the person who contributed to the deck but never the person who had to defend whether the deck was right — then what AI is installing is a test that was always supposed to come, arriving late.
Nan Guo fled that night because he knew he could not pass the solo. The second-order solo is different. It is not King Min calling you to play. It is the quiet moment, at 11 p.m., when you paste one more AI draft into one more document you will sign your name to, and you decide whether to read it the way a person reads who can catch what is wrong — or the way a person reads who is hoping nothing is.
Brynjolfsson, E., Chandar, B., & Chen, R. "Canaries in the Coal Mine? Six Facts about the Recent Employment Effects of Artificial Intelligence." Stanford Digital Economy Lab Working Paper, August 2025. https://digitaleconomy.stanford.edu/
Davenport, T.H., & Srinivasan, L. "Companies Are Laying Off Workers Because of AI's Potential — Not Its Performance." Harvard Business Review, January 2026.
Dell'Acqua, F. et al. "Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality." HBS Working Paper 24-013 (September 2023); published Organization Science, 2026. https://ssrn.com/abstract=4573321
Goldin, C., & Rouse, C. "Orchestrating Impartiality: The Impact of 'Blind' Auditions on Female Musicians." American Economic Review, 90(4):715–741, September 2000.
Magesh, V. et al. "Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools." Journal of Empirical Legal Studies, 2025. DOI: 10.1111/jels.12413. https://arxiv.org/abs/2405.20362
McKinsey & Company (Hancock, B. & Weddle, B.). "What Works — and Doesn't — in Performance Management." November 2024.
METR. "Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity." July 10, 2025. ArXiv: 2507.09089. https://arxiv.org/abs/2507.09089
Mata v. Avianca, Inc., No. 1:22-cv-01461, 678 F.Supp.3d 443 (S.D.N.Y. June 22, 2023).
Noland v. Land of the Free, L.P., California Court of Appeal, Case No. B331918, September 12, 2025.
Noy, S., & Zhang, W. "Experimental Evidence on the Productivity Effects of Generative Artificial Intelligence." Science, 381(6654):187–192, July 14, 2023. DOI: 10.1126/science.adh2586.
Peng, S., Kalliamvakou, E., Cihon, P., & Demirer, M. "The Impact of AI on Developer Productivity: Evidence from GitHub Copilot." ArXiv: 2302.06590, February 2023. https://arxiv.org/abs/2302.06590
Spence, M. "Job Market Signaling." Quarterly Journal of Economics, 87(3):355–374, August 1973.
Vendraminelli, L. et al. "The GenAI Wall Effect: Examining the Limits to Horizontal Expertise Transfer Between Occupational Insiders and Outsiders." HBS Working Paper 26-011, September 2025. https://ssrn.com/abstract=5462694
Dunning, D., & Kruger, J. "Unskilled and Unaware of It: How Difficulties in Recognizing One's Own Incompetence Lead to Inflated Self-Assessments." Journal of Personality and Social Psychology, 77(6):1121–1134, December 1999. PubMed PMID: 10626367.
Acemoglu, D., & Restrepo, P. "The Wrong Kind of AI? Artificial Intelligence and the Future of Labor Demand." Cambridge Journal of Regions, Economy and Society, 13(1):25–35, 2020. NBER Working Paper 25682. https://www.nber.org/papers/w25682