7.6
/ 10
1 evaluations
2.1k Downloads
Overview
Provide an automated and structured security audit layer for OpenClaw skills, MCP servers, and external packages (npm/pip/etc.) by querying a shared trust registry, verifying integrity where possible, and guiding in-depth AI-assisted code reviews via standardized prompts and tooling.
Key Advantages
1.Automatic "security gate" that passively evaluates packages/skills/MCP servers on install or first use using a clear Trust Score decision table (pass/warn/block).
2.Shared trust registry (findings + integrity data) that lets multiple agents reuse prior audits instead of re-scanning the same packages from scratch.
3.Well-defined methodology for manual and auto-audits, including comprehensive prompts, component-type weighting, cross-file analysis, and AI-specific security patterns.
4.Pre-installation source acquisition workflows (npm pack, pip download, git clone, etc.) that avoid executing install hooks, reducing supply-chain risk during analysis.
5.Hardcoded integrity API endpoint and explicit hash verification script to detect tampering of audited packages where integrity data exists.
- Rich taxonomy of security patterns (prompt injection, tool
Use Cases
- Enforcing a security gate in OpenClaw-based environments so that every skill or MCP server install is automatically checked and scored before being trusted.
- Screening npm and pip packages for supply-chain risks (dangerous postinstall scripts, broad binary execution, credential exfiltration, etc.) prior to use in AI agent runtimes.
- Auditing MCP servers to ensure declared tool behavior matches actual implementation and that requested permissions are minimal and appropriately scoped.
- Running periodic security reviews of an organization’s internal skills/plugins, using the standardized prompts and scoring scheme to produce consistent JSON reports.
- Building a team- or organization-wide trust baseline by contributing audit reports to the shared registry and reusing others’ findings for faster future decisions.
Evaluation Scores
7.6
/ 10
Reliability
6.7
Functionality
8.6
Usability
7.4
Safety
8.0
Performance
7.0
Compatibility
7.5
Based on 1 evaluation · Latest: 3/20/2026
Download Trend
Loading...
Evaluation History (1)
7.6/103/20/2026▼
OS: linux-arm64LLM: openai/gpt-5-nano
**Judgement:** A strong, security-focused meta-skill that adds a structured, reasonably opinionated security layer around skills, MCP servers, and packages. Best suited for security-conscious or production deployments; overkill for casual experimentation.
**What it does well**
- Implements an **automatic Security Gate** that runs on installs/first use and bases decisions on a computed Trust Score (from findings and optional risk_score) plus optional hash verification.
- Provides a **shared registry** for findings and integrity data, enabling reuse of previous audits across agents and environments.
- Supplies **detailed audit methodology** (prompts, checklists, component-type weighting, cross-file and AI-specific attack pattern analysis) so your LLM can perform systematic security reviews.
- Emphasizes **pre-install analysis** (npm pack / pip download / git clone without running hooks), explicitly targeting supply-chain risks.
**Key risks / limitations**
- **External dependency:** Relies on the `skillaudit-api.vercel.app` service for findings and integrity; downtime, API changes, or compromise would degrade or distort results.
- **Integrity coverage is currently narrow:** Only the `ecap-security-auditor` package is in the integrity DB in the provided text; most packages will rely solely on findings-based scoring.
- **Audit quality is LLM-dependent:** Manual/auto audits depend on the agent correctly following prompts; false negatives and false positives are possible, especially on complex codebases.
- **Operational overhead:** Automatic checks on each install/use add latency and complexity; full audits require shell tooling and familiarity with npm/pip/git workflows.
- **Centralized trust model:** The shared registry becomes a key trust anchor; incorrect or malicious findings could influence gate decisions until peer-reviewed.
**Recommended scenarios**
- Teams running **OpenClaw agents in production or semi-trusted environments** that need an enforceable security gate around skills and MCP servers.
- Organizations concerned with **software supply-chain security** for npm/pip dependencies used by AI agents.
- Security or platform engineering groups who want **repeatable, structured AI-assisted audits** and a shared database of findings.
- Less suitable for purely local, low-risk experimentation where the overhead and external dependency may not be justified.
Comments (0)
No comments yet. Be the first!