Green Tests, Broken App: One Coordinator and Three AI Agents
A smoke detector with a green light is not proof that it works. The light only says the battery is in. To know, you press the button and listen. This post is about the week I stopped trusting the green light on my own app, pressed the button, and changed how the fixes get built. In my last post, Five Reviews in One Release , I ended with one question to ask about every fix: what else does this touch? I also said I would stop letting a green checkmark tell me I am done. This post is the bigger version of that lesson. It was not one fix that fooled me. It was the whole app. The Setup My personal assistant app is the one I wrote about in Building a Personal Assistant: What I Got Wrong . Every change to it comes with tests: small programs that check the app does what it should. By October 22, 905 issues were closed, 422 of them since August 1. Nearly all were closed because about 4,700 tests passed. That day I said it plainly: basic things did not work, and I had lost trust in the a...