Waxell

skill

agent-observability-eval-bootstrap Review findings

datadog-labsdatadog-labs/agent-skillsupdated

Bootstrap evaluators from production traces: by default propose online LLM-judge evaluators and, after you confirm, create them in Datadog as disabled drafts (never auto-enabled); on request emit Python SDK code or a framework-agnostic JSON spec instead. Use when user says "bootstrap evaluators", "generate evaluators", "create evals from traces", "eval bootstrap", "write evaluators", "build eval suite", "publish evaluators", or wants to generate BaseEvaluator/LLMJudge code or online judge configs from production LLM trace data. Works with ml_app and optional RCA report or failure hypothesis.
datadog-labs's own description, from the skill's files.
Stars
185
Version
v1
Copies
0

Overview

holdReview findings

Waxell's checks found 2 findings to review, highest severity medium.

Highest severity
medium
Findings
2
What ran
Static analysis + deep scan

A clean result means nothing alarming in what is published, not a guarantee. How the checks work

We don't republish the skill's instructions. Read them on GitHub at the reviewed commit.

Security

Security scan

Checked yesterday

Result

Review findings Waxell's checks found 2 findings to review, highest severity medium.

Checked with static analysis + deep scan: servers it launches, packages it installs at runtime, scripts piped to a shell and bundled binaries. The deep scan also read the instructions for prompt injection and data exfiltration. Nothing was run. How the checks work

Findings (2)

medium · 2

  • medium

    Excessive Agency: Autonomous Decision Making

    SKILL.md:490 · skillspector:EA2

  • medium

    Excessive Agency: Autonomous Decision Making

    SKILL.md:1156 · skillspector:EA2

Versions

Version history

Each distinct content we have seen, newest first, with the verdict it got at the time.

One version so far: v1, seen 2026-11-16.

See and control which skills your people use

Inside your organization, Waxell scans each skill and plugin before anyone installs it, approves what passes and publishes it to a private marketplace, and puts every MCP tool call behind one governed URL.

30 minutes. No commitment.

SOC 2 Type II attested · ISO/IEC 27001:2022 certified · HIPAA with a BAA · aligned to the EU AI Act and NIST AI RMF

More engineering skills and plugins

See all