What Broke When We Put AI Into Our Research Process

Date:

Share post:


  • Reliable AI research requires clear sources, approved rules, and traceable inputs.
  • Missing evidence and unfinished work must remain visible.
  • Corrections must become procedures to improve future research.

We built our AI-enabled research process for a fairly ordinary reason: consistency. Running it taught us that consistency was only the beginning.

The harder task was preserving all the small distinctions that make a piece of research trustworthy enough to inspect.

Read one company in March and another in September and it is surprisingly easy to end up with two impressions rather than two comparisons. The questions drift. The emphasis changes. What one company taught you affects what you notice in the next.

So, we formalized the research process. Evidence from filings would remain separate from calculations. Calculations would follow defined rules. Investment judgement would remain identifiable as judgement. Every company would pass through the same questions in the same order.

That was the design. Then we started running it.

The experience is still modest: one quarterly cycle across roughly twenty companies. But what surprised me was that consistency was not the hard part. Separating evidence, calculation and judgement was necessary, but not sufficient.

The process also had to preserve things we had barely thought about: which source governed, whether a statement was provisional, whether an action had actually happened, who owned a piece of metadata, and whether unfinished work still looked unfinished.

Most of the failures were mundane. That made them more useful.

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Related articles

Achieving Greater Digital Factory Outcomes with Connected Data for End-to-End Operational Transformation

For global manufacturing in the era of artificial intelligence (AI) transformation, the digital factory model pairs an...

Navy Federal Credit Union (NFCU) Launches New Flagship Premier Rewards Card [90K Bonus]

Update 11/3/26: Looks like it’s 90,000 points now. Was originally sent out via...

Democrats Have Retaken the House and Senate — but There’s an Even Bigger Winner Today

Yesterday, tens of millions of Americans made their voices heard by casting or mailing in their ballots....