Waxell

skill

agent-observability-online-experiment Review findings

datadog-labsdatadog-labs/agent-skillsupdated

Load this skill when the user wants to run an online experiment (live-traffic A/B test) on an LLM application instrumented with Agent Observability: compare two versions of a prompt, model, or behavior using a Datadog feature flag, score metrics from evaluations, and cost and token metrics. Covers creating the flag, wiring the app, creating the experiment, attaching metrics, setting the traffic split, and starting it. Triggers: online experiment, A/B test an LLM app, test a prompt change on live traffic, experiment with feature flag and evaluation score.
datadog-labs's own description, from the skill's files.
Stars
185
Version
v1
Copies
0

Overview

holdReview findings

Waxell's checks found 2 findings to review, highest severity high.

Highest severity
high
Findings
2
What ran
Static analysis + deep scan

A clean result means nothing alarming in what is published, not a guarantee. How the checks work

We don't republish the skill's instructions. Read them on GitHub at the reviewed commit.

Security

Security scan

Checked yesterday

Result

Review findings Waxell's checks found 2 findings to review, highest severity high.

Checked with static analysis + deep scan: servers it launches, packages it installs at runtime, scripts piped to a shell and bundled binaries. The deep scan also read the instructions for prompt injection and data exfiltration. Nothing was run. How the checks work

Findings (2)

high · 1

  • high

    Agent Snooping: Agent Config Directory Access

    SKILL.md:58 · skillspector:AS1

medium · 1

  • medium

    Rogue Agent: Session Persistence

    SKILL.md:28 · skillspector:RA2

Versions

Version history

Each distinct content we have seen, newest first, with the verdict it got at the time.

One version so far: v1, seen 2026-11-16.

See and control which skills your people use

Inside your organization, Waxell scans each skill and plugin before anyone installs it, approves what passes and publishes it to a private marketplace, and puts every MCP tool call behind one governed URL.

30 minutes. No commitment.

SOC 2 Type II attested · ISO/IEC 27001:2022 certified · HIPAA with a BAA · aligned to the EU AI Act and NIST AI RMF

More data & analytics skills and plugins

See all