evaluator▌

Calibrate an LLM judge against human judgment.

../../../engineering-team/tech-stack-evaluator/SKILL.md

Build evaluation pipelines for LangSmith with LLM-as-Judge and custom code evaluators. \n \n Three core components: creating evaluators (LLM-as-Judge or custom code), defining run functions to capture agent outputs and trajectories, and running evaluations locally or auto-running via uploaded evaluators \n Supports both offline evaluators (comparing run outputs to dataset examples) and online evaluators (real-time quality checks on production runs) \n Requires LangSmith API key and project confi

Every analysis MUST include ALL of these: