Operations | Monitoring | ITSM | DevOps | Cloud

Managing IT assets smoothly is not an easy task. Organizations depend more on technology to execute their operations these days. Hence, the requirement for effective IT Asset Management (ITAM) has grown considerably. However, beyond merely managing these assets, ensuring compliance with relevant ITAM regulations and standards matters just as much. And, in this race to keep up with changing regulations, you are not alone. Many organizations face the same challenge.

AI teams have invested heavily in evaluation frameworks, yet getting those frameworks beyond local experimentation remains challenging. Teams using open source libraries like DeepEval and Pydantic Evals gain flexibility and research-grounded metrics, but operationalizing those evaluations still requires brittle custom integration code that doesn’t scale.

Builder in the loop is a Mezmo interview series focused on the engineers, product leaders, and operators shaping AURA, an open-source, MCP-native agent harness for production operations. This installment features Tony Rogers, whose work on AURA is less about building new features and more about trying to break them before users can.

Handling client calls when a third-party vendor has an outage - this will sound familiar if you are a managed service provider (MSP). Your first instinct would be to check if the vendor's status page or social media handle shows anything, or check crowdsourced websites like Downdetector. Or even ask your client to check themselves. These approaches do not scale when you have more than a few clients, many vendor status pages to check, and clients with different stacks.