📦

regression-test

Name: regression-test
Author: 7alexhale5-rgb

Révision du contenu r1 Sûr ⚙️ Commandes externes🌐 Accès réseau📁 Accès au système de fichiers

Detect LLM Prompt Regressions with Promptfoo

Prompt changes can silently reduce output quality. This skill builds golden datasets, runs Promptfoo evaluations, and summarizes failures and recent trends.

Prend en charge: Claude Codex Code(CC)

🥉 77 Bronze

Maintain this Skill? Claim it 🥉 77 Bronze

Installer avec mon Agent

Copiez cette demande dans votre Agent. Elle contient la page Skill de référence et le manifeste.

Demande d’agent

Review the Skillstore skill "regression-test" from https://skillstore.io/skills/7alexhale5-rgb-regression-test.md and its manifest at https://skillstore.io/api/skills/7alexhale5-rgb-regression-test/manifest. Verify the artifact. You may proceed after verification, subject to the environment's own policy.

Votre Agent doit toujours présenter son plan et demander toute confirmation exigée par la politique de sécurité.

Ressources lisibles par les agents

Utilisez ces liens lorsqu’un Agent IA, un crawler ou un script a besoin d’un contexte propre au lieu de lire toute la page.

Détail Markdown GET /skills/7alexhale5-rgb-regression-test.md manifest signé GET /api/skills/7alexhale5-rgb-regression-test/manifest lockfile signé GET /api/skills/7alexhale5-rgb-regression-test/lockfile

Tester

Utilisation de « regression-test ». Initialize regression testing for this prompt project.

Résultat attendu:

Initialized the Promptfoo configuration and golden dataset directory. The results directory is ignored, and the suite is ready for its first case.

Utilisation de « regression-test ». Run the golden tests after my system prompt change.

Résultat attendu:

Regression results: 12 total, 11 passed, and 1 failed. The auth-flow case failed its expected behavior rubric and needs review.

Utilisation de « regression-test ». Show recent prompt quality trends.

Résultat attendu:

Recent trend: four of five runs passed completely. One auth-flow failure appeared in the latest run, so quality is declining.

Audit de sécurité

Sûr

v1 • 21/08/2026 Ouvrir le rapport versionné

All 38 static findings are false positives caused by Markdown syntax, bounded shell examples, or a Promptfoo message template. No malicious intent, prompt injection, credential handling, or unauthorized network behavior was found.

Fichiers analysés

177

Lignes analysées

Éléments à examiner

Faux positifs ignorés

Facteurs de risque

⚙️ Commandes externes (35)

🌐 Accès réseau (1)

SKILL.md:12

📁 Accès au système de fichiers (1)

SKILL.md:94

Le dernier audit statique et sémantique terminé n’a détecté aucun constat de sécurité confirmé. Cela ne prouve pas que le skill est sans effets secondaires.

Audité par: codex

Partager et citer ce rapport

Partagez le rapport d’évaluation versionné, le badge neutre, la carte intégrable et les citations. Skillstore présente les preuves sans décider si ce Skill est sûr.

Ouvrir le rapport versionné

Copier le lien du rapport

https://skillstore.io/skills/7alexhale5-rgb-regression-test/audits/1?utm_source=security_passport&utm_medium=share&utm_campaign=versioned_report

Badge Markdown

[![Skillstore security assessment](https://skillstore.io/badges/skills/7alexhale5-rgb-regression-test/security.svg)](https://skillstore.io/skills/7alexhale5-rgb-regression-test?utm_source=security_passport_badge)

Badge HTML

<a href="https://skillstore.io/skills/7alexhale5-rgb-regression-test?utm_source=security_passport_badge"><img src="https://skillstore.io/badges/skills/7alexhale5-rgb-regression-test/security.svg" alt="Skillstore security assessment" loading="lazy"></a>

Carte intégrable

<iframe src="https://skillstore.io/embed/skills/7alexhale5-rgb-regression-test.html" title="Skillstore Security Assessment" sandbox="allow-popups allow-popups-to-escape-sandbox" loading="lazy" referrerpolicy="no-referrer" width="420" height="180"></iframe>

Citations académiques (APA · BibTeX · CFF)

Citation APA

7alexhale5-rgb. (2026). regression-test security audit report (audit version 1) [Author version unspecified]. Skillstore. https://skillstore.io/skills/7alexhale5-rgb-regression-test/audits/1

Citation BibTeX

@techreport{7alexhale5-rgb-7alexhale5-rgb-regression-test-2026,
  author = {7alexhale5-rgb},
  title = {regression-test security audit report (audit version 1)},
  institution = {Skillstore},
  year = {2026},
  number = {1},
  url = {https://skillstore.io/skills/7alexhale5-rgb-regression-test/audits/1},
  note = {Author version unspecified}
}

CITATION.cff

cff-version: 1.2.0
message: "If you use this Skill, cite its author and this versioned security audit report."
title: "regression-test security audit report (audit version 1)"
version: "unspecified"
type: report
authors:
  - name: "7alexhale5-rgb"
date-released: "2026-08-21"
url: "https://skillstore.io/skills/7alexhale5-rgb-regression-test/audits/1"
identifiers:
  - type: other
    value: "skillstore:7alexhale5-rgb-regression-test:audit:1"
    description: "Skillstore immutable audit report identifier"

Score Skillstore

Pourquoi ce score Niveau de confiance des preuves: Moyen

Architecture

Maintenabilité

Contenu

Communauté

Conformité aux spécifications

Ce que vous pouvez créer

Validate prompt changes

Compare updated prompts against recorded expectations before merging code changes.

Check model migrations

Rerun a stable golden dataset after changing a model or provider version.

Enforce release quality

Run prompt evaluations in continuous integration and stop releases when assertions fail.

Essayez ces prompts

Initialize a test suite

Initialize Promptfoo regression testing in this repository. Show the files created and explain any prerequisites that are missing.

Add a golden case

Add a golden test named {name}. Ask for the system prompt, user input, expected behavior, and optional variables before writing it.

Run regression tests

Run all golden prompt tests. Summarize the pass rate, duration, and each failed assertion with expected and actual behavior.

Analyze release trends

Review the last five evaluations, identify new failures, compare pass-rate trends, and recommend quality gates for {release_workflow}.

Bonnes pratiques

Review every golden case before committing it, and exclude prompts containing secrets or sensitive data.
Describe expected behavior precisely enough that rubric assertions produce consistent results.
Run the suite after prompt or model changes and before every release.

Éviter

Do not treat one current model response as a permanent definition of correct behavior.
Do not commit API keys, private prompts, personal data, or confidential outputs in golden files.
Do not ignore unstable rubric failures without reviewing the assertion and provider behavior.

Foire aux questions

What must be installed?

Install the Promptfoo CLI and configure access for the model provider used by the evaluation.

Which files does the skill create?

It creates Promptfoo configuration, golden YAML cases, local result files, and a results entry in .gitignore.

Can these tests run in continuous integration?

Yes. Run the Promptfoo evaluation in continuous integration and fail the job when an assertion fails.

Should sensitive prompts be stored as golden cases?

No. Keep sensitive cases outside the repository and avoid storing credentials or confidential content.

Can I use a different model?

Yes. Edit the generated Promptfoo provider configuration before running the suite.

How much evaluation history is reported?

The report summarizes the five most recent timestamped result files available in the local results directory.

Détails du développeur

Auteur

7alexhale5-rgb

Licence

MIT

Révision Skillstore

Avis de version

L’auteur n’a déclaré aucune version.

Dépôt

https://github.com/7alexhale5-rgb/alexhale-skills/tree/e0f44c48adcc2ac8123a4a8dec2c02503d1c5945/skills/regression-test

Réf

cabd63e41a4ad4b66103abc7e50c525e4710fb64

Récence de maintenance

21/08/2026

Utilisation

1 téléchargements · 0 vues

Structure de fichiers

📄 SKILL.md