The Digital Data Design Institute at Harvard is now the Harvard Business School AI Institute.

Out of the Loop?

The case for rethinking when humans should review AI output

We tend to treat human oversight in AI adoption as the responsible choice. But as organizations increase their reliance on AI, the feasibility of that plan falters: if AI is deployed at scale, there will simply be too many touchpoints to keep a human in the loop on them all. The new paper “Optimal Human AI Coordination in Decision Workflows: Collaboration Paradox and Automation Cliffs,” co-written by HBS AI Institute Associate Michael Lingzhi Li, tackles this challenge head on. For a given workflow, should decisions be made by AI alone, humans alone, or humans with AI assistance? According to this study, the surprising answer is not to collaborate by default.

Why This Matters

For business leaders and executives, adding more human-in-the-loop steps may feel like a safer AI strategy, but this research shows why that can be misleading. If you’re stretching your people across too many AI-assisted decisions and workflows, the expected gains and ROI may not materialize. The right strategy might be full automation, or even no AI at all. Collaboration doesn’t need to be the default answer: it’s a design choice, and one that will decide whether your organization will rise above the competition.


Link to the HBS AI Institute Insight Article
Link to the Research Paper
Sign up for our newsletter to stay up to date with HBS AI Institute news and research