Skills evaluation

📦

evaluation

Name: evaluation
Author: muratcankoylan

Content revision r2 Safe ⚙️ External commands

Build Reliable Agent Evaluations

Agent quality is difficult to measure because outputs vary and may have several valid forms. This skill builds repeatable rubrics, tests, gates, and monitoring.

Supports: Claude Codex Code(CC)

🥈 81 Silver

Install with my Agent

Copy this request to your Agent. It includes the canonical Skill page and manifest.

Agent request

Review the Skillstore skill "evaluation" from https://skillstore.io/skills/muratcankoylan-evaluation.md and its manifest at https://skillstore.io/api/skills/muratcankoylan-evaluation/manifest. Verify the artifact. You may proceed after verification, subject to the environment's own policy.

Your Agent should still show its plan and request any confirmation required by the security policy.

Agent-readable resources

Use these links when an AI agent, crawler, or script needs clean context instead of reading the full page.

Markdown detail GET /skills/muratcankoylan-evaluation.md Signed manifest GET /api/skills/muratcankoylan-evaluation/manifest Signed lockfile GET /api/skills/muratcankoylan-evaluation/lockfile

Test it

Using "evaluation". Evaluate a customer support agent that answers account and billing questions.

Expected outcome:

Dimensions: factual accuracy 35%, completeness 25%, policy compliance 25%, clarity 10%, tool efficiency 5%.
Deterministic gates: account identifiers are valid, required disclosures appear, and prohibited actions are absent.
Release threshold: overall score at least 0.85, with no dimension below 0.75.

Using "evaluation". Create a regression suite for a research agent.

Expected outcome:

Use 50 cases across simple lookup, comparison, multi-source synthesis, and ambiguous research tasks.
Score citation accuracy, source quality, completeness, factual accuracy, and tool efficiency separately.
Compare each release with the established baseline and review all significant dimension regressions.

Using "evaluation". Plan production monitoring for an agent with variable traffic.

Expected outcome:

Sample one percent of interactions, plus all failures and unusual tool sequences.
Alert when pass rate falls below 0.85 and escalate when it falls below 0.70.
Review trends by task type, complexity, model version, and evaluation dimension.

Security Audit

Safe

v8 • 8/9/2026 Open versioned report

All 29 static findings are false positives caused by Python mapping methods, documentation markup, ordinary prose, comments, or YAML examples. The reviewed files contain no command execution, sensitive file access, system reconnaissance, prompt injection, or other semantic security concern.

Files scanned

1,253

Lines analyzed

Review items

False positives ignored

Risk Factors

⚙️ External commands (18)

scripts/evaluator.py:129 SKILL.md:22 SKILL.md:23 SKILL.md:24 SKILL.md:162-170 SKILL.md:170-176 SKILL.md:176-204 SKILL.md:204-207 SKILL.md:207-215 SKILL.md:215-218 SKILL.md:218-228 SKILL.md:228-256 SKILL.md:256-257 SKILL.md:257-258 SKILL.md:258-259 SKILL.md:259-260 SKILL.md:260-261 SKILL.md:261-262

No confirmed security findings were detected by the latest completed static and semantic audit. This does not prove the skill has no side effects.

Audited by: codex View Audit History →

Share & cite this report

Share the versioned assessment report, neutral badge, embed card, and citations. Skillstore reports evidence without deciding whether this Skill is safe.

Open versioned report

Copy report link

https://skillstore.io/skills/muratcankoylan-evaluation/audits/8?utm_source=security_passport&utm_medium=share&utm_campaign=versioned_report

Markdown badge

[![Skillstore security assessment](https://skillstore.io/badges/skills/muratcankoylan-evaluation/security.svg)](https://skillstore.io/skills/muratcankoylan-evaluation?utm_source=security_passport_badge)

HTML badge

<a href="https://skillstore.io/skills/muratcankoylan-evaluation?utm_source=security_passport_badge"><img src="https://skillstore.io/badges/skills/muratcankoylan-evaluation/security.svg" alt="Skillstore security assessment" loading="lazy"></a>

Embed card

<iframe src="https://skillstore.io/embed/skills/muratcankoylan-evaluation.html" title="Skillstore Security Assessment" sandbox="allow-popups allow-popups-to-escape-sandbox" loading="lazy" referrerpolicy="no-referrer" width="420" height="180"></iframe>

Academic citations (APA · BibTeX · CFF)

APA citation

muratcankoylan. (2026). evaluation security audit report (audit version 8) [Author version unspecified]. Skillstore. https://skillstore.io/skills/muratcankoylan-evaluation/audits/8

BibTeX citation

@techreport{muratcankoylan-muratcankoylan-evaluation-2026,
  author = {muratcankoylan},
  title = {evaluation security audit report (audit version 8)},
  institution = {Skillstore},
  year = {2026},
  number = {8},
  url = {https://skillstore.io/skills/muratcankoylan-evaluation/audits/8},
  note = {Author version unspecified}
}

CITATION.cff

cff-version: 1.2.0
message: "If you use this Skill, cite its author and this versioned security audit report."
title: "evaluation security audit report (audit version 8)"
version: "unspecified"
type: report
authors:
  - name: "muratcankoylan"
date-released: "2026-08-09"
url: "https://skillstore.io/skills/muratcankoylan-evaluation/audits/8"
identifiers:
  - type: other
    value: "skillstore:muratcankoylan-evaluation:audit:8"
    description: "Skillstore immutable audit report identifier"

Compare variants

4 installable variants

Each author remains a separate installable skill. The recommended variant is ranked by Skillstore evidence.

Why this variant is first

Highest Skillstore Score

Author / source Skillstore Score Evidence Confidence Skillstore usage Updated

muratcankoylan Recommended Current

muratcankoylan-evaluation

Skillstore Score 81

Evidence Confidence High

Skillstore usage 11

Updated

2026-08-21

ChakshuGautam

chakshugautam-evaluation

Skillstore Score 80

Evidence Confidence High

Skillstore usage 9

Updated

2026-08-21

sickn33

sickn33-evaluation

Skillstore Score 78

Evidence Confidence High

Skillstore usage 11

Updated

2026-08-21

Asmayaseen

asmayaseen-evaluation

Skillstore Score 77

Evidence Confidence High

Skillstore usage 12

Updated

2026-08-21

Skillstore Score

Why this score Evidence Confidence: High

Architecture

Maintainability

Content

Community

Spec Compliance

What You Can Build

Gate Agent Releases

Build regression suites and quality thresholds that detect performance drops before deployment.

Compare Agent Configurations

Measure quality, token use, and tool efficiency across models, prompts, or context strategies.

Monitor Production Quality

Define sampling, alerts, and trend reports for changing agent behavior in live systems.

Try These Prompts

Define Evaluation Goals

Create an evaluation plan for [agent task]. Define success outcomes, five quality dimensions, measurable criteria, and appropriate pass thresholds.

Build a Test Set

Design 50 evaluation cases for [agent workflow]. Stratify them by complexity, include edge cases, and describe expected outcomes without requiring fixed execution paths.

Create a Quality Gate

Design a release gate for [agent system]. Separate deterministic checks from rubric scores, define dimension minimums, and specify baseline regression tolerances.

Design Production Monitoring

Create a production evaluation strategy for [agent system]. Include sampling, human review, alert thresholds, confidence reporting, drift detection, and baseline comparisons.

Best Practices

Measure final outcomes and quality dimensions instead of requiring one execution path.
Run deterministic validation before model judgment and preserve dimension-level results.
Use representative cases, production-realistic budgets, independent judges, and regular human review.

Avoid

Do not rely on one aggregate score that can hide critical dimension failures.
Do not build test sets only from easy, clean, or synthetic examples.
Do not treat evaluation as a one-time release activity without baseline tracking.