AI Let Me Chase a Fake Bug for a Day
AI-assisted development is genuinely useful. It’s also very good at helping you waste a day on a wrong answer. While working on SP-MembershipManager, I kept running into inconsistent results when querying a user’s SharePoint site access. One run would return 19 sites. The next would return 8. Then 20. Then 12. No pattern, no obvious error — just noise. I asked Claude what was going on. It was confident: SharePoint replication lag. Data takes time to propagate across the service, results can be inconsistent during that window, etc. It sounded plausible. The whole point of this tool is to give non-technical users a reliable view of their permissions, so I really didn’t want it to be true, but it sounded true. ...