Engineering Agency out of the Happy Path — Matthew Jewkes, Standard Cybernetics

A biopharma automation reached 99.95% accuracy on its business critical tasks after the team separated actual errors from ambiguous cases and exceptions. Matthew Jewkes describes building that system at Clarivate, where indexing drug development documents meant handling tens of thousands of new tasks a month. An early agent approach reached around 80% to 83%. Working through 1,000 evaluation examples with domain experts exposed three different problems: the model could be wrong, the organization could lack an agreed answer, or genuinely new science could require judgment. Each needed its own route. The routine path became a tightly specified automation, with uncertain and unusual cases escalated instead of pushed through. The larger payoff was recovering expert attention. Once routine decisions were handled, the remaining cases could be grouped for deliberate review: critical exceptions to clear, ambiguous low value work to freeze, and unusual demand that might justify a new product. One expert used that structured backlog to form an investment thesis before a major customer raised the same need. Jewkes lays out where the investment makes sense, how much evaluation work high reliability requires and why organizational ownership and trust matter alongside engineering. His bet is that companies will gain more from managing collective attention and judgment than from choosing a particular orchestration framework. Speaker info: - https://x.com/mjewkes - https://linkedin.com/in/mjewkes Timestamps: 0:00 - Expert attention and cheap execution 1:48 - Fully automate the happy path 4:18 - The biopharma indexing case study 6:39 - Errors, ambiguity and exceptions 8:52 - Routing uncertainty and the critical path 9:58 - From 95% to 99.95% accuracy 11:24 - Recovering expert judgment 12:51 - Exceptions as market signals 14:51 - Where full automation is worth the cost 17:17 - Evals and the value of human attention