Two-Tiered Evaluation Harness Architecture for AI Agents

Testing AI Agents with Evals

Testing AI Agents with Evals AI agents are probabilistic. The wording can change between runs, the agent may take different paths through its tools, and a slightly different response doesn’t necessarily mean the agent made a wrong decision. This mmakes it challenging for traditional software testing to produce reliable and actionable results and findings. Using an LLM to judge every test isn’t the answer either. It adds latency, cost, and another source of variability to the test suite. ...

September 16, 2026 · Tarek Mustafa
Image showing a cartoonish image about AI automated Freelance payments

AI Freelancer Payout Crew

AI-Powered Freelancer Payout Crew This project is a multi-agent payout workflow built with CrewAI. It simulates the lifecycle of freelancer payments, from validating payout data to checking compliance rules, selecting a payment route, preparing the payment instruction, and creating an audit trail. The goal was to explore how agent-based workflows can make a finance process more structured and easier to review. It is a prototype, not a production payment system. The Business Challenge Managing payments for a global freelance workforce is a complex, manual, and time-consuming operation. Finance teams are burdened with: ...

September 30, 2025 · Tarek Mustafa