skill
agent-observability-build-eval-from-annotations High risk
Fit a Datadog LLM-Obs evaluator to human labels. Takes an annotation queue, works out where in the trace the labelled property actually lives, drafts an LLM-judge that predicts the human label, scores that judge against the already-labelled rows with a metric agreed with the user, then hill-climbs it, inspect the errors, make one focused change, re-score, keep it only if it beats the best, for a bounded number of iterations, and finally publishes the winner to Datadog as a DISABLED evaluator (not a Datadog draft, a real evaluator with `enabled: false`). Use when the user says "build an…
- Stars
- 185
- Version
- v1
- Copies
- 0
Overview
Waxell rates it high risk: 5 findings, highest severity high.
- Highest severity
- high
- Findings
- 5
- What ran
- Static analysis + deep scan
A clean result means nothing alarming in what is published, not a guarantee. How the checks work
We don't republish the skill's instructions. Read them on GitHub at the reviewed commit.
Security
Security scan
Checked yesterday
Result
High risk Waxell rates it high risk: 5 findings, highest severity high.
Checked with static analysis + deep scan: servers it launches, packages it installs at runtime, scripts piped to a shell and bundled binaries. The deep scan also read the instructions for prompt injection and data exfiltration. Nothing was run. How the checks work
Findings (5)
high · 1
- high
Excessive Agency: External Model or Provider Selection
references/judge_runner.py:8 · skillspector:EA5
medium · 4
- medium
Without declared permissions the skill's intent is opaque and cannot be validated.
SKILL.md:1 · skillspector:LP3
- medium
Dangerous Code Execution: subprocess module call
references/judge_runner.py:97 · skillspector:AST4
- medium
Data Exfiltration: External Transmission
references/judge_runner.py:129 · skillspector:E1
- medium
Dangerous Code Execution: subprocess module call
references/judge_runner.py:168 · skillspector:AST4
Versions
Version history
Each distinct content we have seen, newest first, with the verdict it got at the time.
One version so far: v1, seen 2026-11-16.
See and control which skills your people use
Inside your organization, Waxell scans each skill and plugin before anyone installs it, approves what passes and publishes it to a private marketplace, and puts every MCP tool call behind one governed URL.
30 minutes. No commitment.
SOC 2 Type II attested · ISO/IEC 27001:2022 certified · HIPAA with a BAA · aligned to the EU AI Act and NIST AI RMF
More ai & agents skills and plugins
agent-skillsdatadog-labsDatadog skills for AI agents. Essential monitoring, logging, tracing and observability. High riskAI & agents185
service-remappingdatadog-labsCreate and manage APM service remapping rules: rewrite service names at ingestion time to collapse noisy inferred entities, clean up… Review findingsAI & agents185
linkfox-aigc-textgenlinkfox-aiAI 生文与图片理解,支持商品标题、五点描述、营销文案、翻译和数据总结。支持 GEM_3_1_PRO、GEM_3_7_FLASH、GEM_4_A、GT_6_1_S、GT_6_1_T、GT_6_L、GT_6_A;兼容旧模型别名。创建后查询同一任务,展示文本并以 count 读取… High riskAI & agents121
linkfox-amazon-policy-feedlinkfox-ai查询亚马逊面向卖家的最新政策法规与资讯,支持按站点和时间范围分页浏览、查看 AI 中文摘要及读取资讯全文。适用于卖家合规公告、平台规则变动、政策预警、FBA 和费用更新、多站点政策动态及政策原文查询,无需明确提及政策法规。不适用于商品、关键词或销量分析、Listing… High riskAI & agents121