Generative AI is often presented as a great equalizer in knowledge work. Junior employees can suddenly produce documents, analyses, and draf
Generative AI is often presented as a great equalizer in knowledge work. Junior employees can suddenly produce documents, analyses, and drafts that once required years of supervised practice, while senior professionals use the same tools to accelerate their established workflows. A three-month field experiment with 133 patent attorneys, however, reveals a more complicated picture. AI assistance did improve immediate performance across the board, and the least experienced attorneys gained the most. But when the tool was removed, those junior gains largely disappeared, while senior attorneys retained much of what they had learned. The findings are a cautionary tale for any organization that expects AI to transform productivity without weakening professional development.
Why junior professionals gained the most
For a junior patent attorney, drafting claims, searching prior art, and anticipating examiner objections are demanding tasks that normally require repeated cycles of feedback and revision. AI assistance can act as a real-time scaffold: it suggests structures, flags missing elements, and helps produce competent first drafts far more quickly. In the experiment, junior attorneys experienced the largest immediate productivity gains because the tool compressed much of the trial-and-error learning curve. This effect is especially attractive in remote and hybrid teams. Managers may see new hires become productive sooner, and distributed colleagues can work from cleaner drafts without relying on constant synchronous guidance from busy seniors.
The retention problem after the tool is switched off
The more troubling finding is what happened when AI support was removed. Junior attorneys who had relied heavily on the tool struggled to maintain their earlier performance, while senior attorneys, who already possessed firm mental models of legal reasoning, continued to perform well. This suggests the juniors had not simply learned faster; in many cases, they had offloaded core reasoning to the software. Without the AI scaffold, they had fewer internal reference points to guide their judgment. The distinction matters because a tool that improves output today can quietly erode the very capabilities that make a professional valuable later. The study does not argue that AI is useless, but it does challenge the assumption that short-term productivity gains automatically translate into long-term skill acquisition.
A sharper risk for remote and hybrid teams
Remote work already places more weight on written communication and self-directed learning. Informal development moments, such as overhearing a senior colleague reason through a difficult case or asking a quick question after a meeting, are less frequent when teams are distributed. AI tools can fill some of that gap by offering instant guidance, but they can also mask the need for genuine mentorship. A junior employee working alone may produce polished work with AI assistance while never realizing that critical judgment calls are being made by the model rather than by them. Over time, organizations may find that their remote junior staff are highly productive on standard tasks but unprepared for novel, ambiguous, or high-stakes situations where AI is unavailable or unreliable.
How HR leaders can protect long-term growth
HR leaders and team managers should treat AI rollout as a skill-development challenge, not merely a productivity initiative. One practical step is to create deliberate no-AI exercises: core tasks that junior employees must complete from first principles before turning to a language model. Another is to require brief written explanations of how AI output was evaluated and changed, which encourages active review rather than passive copying. Mentor check-ins are also valuable, particularly when they ask early-career employees to explain their reasoning aloud and defend their edits. The goal is not to ban AI—such a policy would be unrealistic and counterproductive—but to ensure that junior professionals build the foundational judgment they will need when tools fail, change, or disappear. For remote-first organizations and talent platforms such as XMF, the study is a useful reminder to pair AI adoption with deliberate strategies for long-term skill preservation.
Originally published by XMF, inspired by publicly reported industry news.
Most conversations about generative AI in the workplace begin with productivity. A new three-month field experiment involving 133 patent att
Most conversations about generative AI in the workplace begin with productivity. A new three-month field experiment involving 133 patent attorneys offers a more uncomfortable lesson: the people who benefit most from AI on the job may also have the most to lose when the tool is no longer there. For HR leaders and managers, the findings challenge the assumption that short-term performance gains from AI automatically translate into a more skilled workforce.
The immediate boost is real, and juniors gain the most
The study put AI-assisted drafting and analysis tools in the hands of experienced and early-career patent attorneys. Junior practitioners, who typically spend years learning how to structure claims, search prior art, and anticipate objections, saw the largest immediate improvements in both speed and quality. The tool acted like a highly capable colleague, smoothing over gaps in experience and helping them produce work that looked closer to the output of a seasoned professional.
Senior attorneys also benefited, but their gains were more modest. Because they already possessed much of the reasoning the AI was supplying, the tool saved time but did not fundamentally change the quality of their judgment. For juniors, however, the AI often provided the missing logic, the standard phrasing, or the strategic framing they had not yet internalized. That is precisely why the short-term results looked so dramatic.
When the assistant disappears, a hidden gap emerges
The more striking part of the experiment came when the AI was removed. Senior attorneys largely retained the improvements they had shown while using the tool. Junior attorneys did not. Once the AI-driven scaffolding was gone, much of the apparent skill gain faded with it. Their performance reverted toward the level expected for their experience, suggesting that the AI had been masking capability gaps rather than closing them.
This pattern points to what learning specialists sometimes call shallow automation: a worker can produce an excellent result with the help of a system, but the underlying mental model remains underdeveloped. For junior employees in knowledge work, that is a serious concern. The early years of a career are meant to build the judgment that later allows independent, high-stakes work. If AI quietly substitutes for that struggle, organizations may discover too late that they have a cohort of professionals who are highly productive with the tool enabled but fragile without it.
Rethinking how organizations develop early-career talent
The implication is not to ban AI from junior roles. Doing so would ignore its power to accelerate learning when used deliberately. Instead, HR and learning teams should treat AI-assisted output and actual skill development as two separate metrics. One useful approach is to have juniors attempt a task independently before consulting AI, then compare their reasoning with the tool’s suggestions. Another is to require periodic no-AI assessments so managers can see where genuine progress is being made and where AI has been doing the heavy lifting.
This matters even more in remote and hybrid environments, where managers often observe finished work rather than the process behind it. In an office, a senior colleague can overhear how a junior thinks through a problem. In distributed teams, that visibility is easily lost. Workforce platforms that combine productivity tracking with structured skill assessments can help separate tool-assisted output from durable capability. At XMF, we see a similar need among distributed teams: the systems that measure performance must evolve as AI changes what performance means.
For organizations hiring and developing junior talent, the lesson is clear. AI can make early-career employees look more experienced than they are, but that appearance is not the same as competence. The companies that thrive will be those that use AI not as a crutch, but as a deliberate part of a learning path—one that still requires people to struggle, reflect, and eventually work without the scaffolding.
Originally published by XMF, inspired by publicly reported industry news.