@tldr
What's your most important "chop wood carry water"?
Mine is looking into the logs for every single Bracky error report. (He is trained to @ mention me on any error that he is unable to resolve himself.)
With AI, there's an ineradicable element of "black box" to how it works, so the main way to surely get better is to let errors emerge in use and tweak the system to make these errors increasingly less likely.
These days, I often wince before opening my notifications, but this is basically our Pager Duty for Bracky.