skill
agent-observability-online-experiment Review findings
Load this skill when the user wants to run an online experiment (live-traffic A/B test) on an LLM application instrumented with Agent Observability: compare two versions of a prompt, model, or behavior using a Datadog feature flag, score metrics from evaluations, and cost and token metrics. Covers creating the flag, wiring the app, creating the experiment, attaching metrics, setting the traffic split, and starting it. Triggers: online experiment, A/B test an LLM app, test a prompt change on live traffic, experiment with feature flag and evaluation score.
- Stars
- 185
- Version
- v1
- Copies
- 0
Overview
Waxell's checks found 2 findings to review, highest severity high.
- Highest severity
- high
- Findings
- 2
- What ran
- Static analysis + deep scan
A clean result means nothing alarming in what is published, not a guarantee. How the checks work
We don't republish the skill's instructions. Read them on GitHub at the reviewed commit.
Security
Security scan
Checked yesterday
Result
Review findings Waxell's checks found 2 findings to review, highest severity high.
Checked with static analysis + deep scan: servers it launches, packages it installs at runtime, scripts piped to a shell and bundled binaries. The deep scan also read the instructions for prompt injection and data exfiltration. Nothing was run. How the checks work
Findings (2)
high · 1
- high
Agent Snooping: Agent Config Directory Access
SKILL.md:58 · skillspector:AS1
medium · 1
- medium
Rogue Agent: Session Persistence
SKILL.md:28 · skillspector:RA2
Versions
Version history
Each distinct content we have seen, newest first, with the verdict it got at the time.
One version so far: v1, seen 2026-11-16.
See and control which skills your people use
Inside your organization, Waxell scans each skill and plugin before anyone installs it, approves what passes and publishes it to a private marketplace, and puts every MCP tool call behind one governed URL.
30 minutes. No commitment.
SOC 2 Type II attested · ISO/IEC 27001:2022 certified · HIPAA with a BAA · aligned to the EU AI Act and NIST AI RMF
More data & analytics skills and plugins
agent-observability-session-classifydatadog-labsClassify whether user intent was satisfied in a Datadog Agent Observability trace or session. Three modes: (1) session_id, classify a… Review findingsData & analyticsSales & marketing185
agent-observability-trace-rcadatadog-labsRoot cause analysis on production LLM traces. Diagnoses why an LLM application is failing, works from eval judge verdicts, runtime errors,… Review findingsData & analyticsAI & agents185
dd-apmdatadog-labsAPM - install, onboard, instrument, enable, set up, configure, traces, services, dependencies, performance analysis, Data Streams… High riskData & analyticsAI & agents185
enable-dsmdatadog-labsEnable Data Streams Monitoring (DSM) on services already instrumented with APM, for end-to-end latency, throughput, and consumer lag… High riskData & analyticsSales & marketing185