AIniverse Get the App

langsmith-evaluator

by langchain-ai · Github

INVOKE THIS SKILL when building evaluation pipelines for LangSmith. Covers three core components: (1) Creating Evaluators - LLM-as-Judge, custom code; (2) Defining Run Functions - how to capture outputs and trajectories from your agent; (3) Running Evaluations - locally with evaluate() or auto-run via LangSmith. Uses the langsmith CLI tool.

Add langsmith-evaluator to your agent in AIniverse

Discover more reusable skills, save them to your stack, get notified when new ones land.

Open in App · skills.sh

More agent skills

find-skills

Helps users discover and install agent skills when they ask questions like "how do I do X", "find a skill for X", "is...

gstack-autoplan

Fully reviewed plan running CEO → design → eng review automatically.

android-agp-9-upgrade

Upgrades, or migrates, an Android project to use Android Gradle Plugin (AGP) version 9. Do not use this skill for mig...

gstack-benchmark

Baseline page load times, Core Web Vitals, and resource sizes.