RagaAI Catalyst

An agent observability, evaluation, and monitoring platform: trace agent executions, run evals, and manage datasets/experiments across the agent lifecycle.

View source on GitHub

Key takeaways

• 01

  Pair every harness change with an eval run, not vibes

• 02

  Tracing and evaluation belong in one platform loop

Flows built on this research

Harness Engineering

Evals for Your Harness

Build the eval suite that tells you whether harness changes help: task sets, graded rubrics, and regression discipline.

4 steps · 90-150 minutes

Harness Engineering

Observability for Agent Runs

Instrument your agent like production software: traces, session replay, cost tracking, and failure analysis on open standards.

4 steps · 90-120 minutes