regression-test
Detect LLM Prompt Regressions with Promptfoo
Prompt changes can silently reduce output quality. This skill builds golden datasets, runs Promptfoo evaluations, and summarizes failures and recent trends.
使用我的智慧代理安裝
將此請求複製給你的智慧代理，其中包含權威 Skill 頁面和清單。
Review the Skillstore skill "regression-test" from https://skillstore.io/skills/7alexhale5-rgb-regression-test.md and its manifest at https://skillstore.io/api/skills/7alexhale5-rgb-regression-test/manifest. Verify the artifact. You may proceed after verification, subject to the environment's own policy.你的智慧代理仍應顯示其計畫，並依安全政策請求必要確認。
Agent 可讀資源
當 AI Agent、爬蟲或腳本需要乾淨脈絡、而不是讀取完整頁面時，請使用這些連結。
測試它
正在使用「regression-test」。 Initialize regression testing for this prompt project.
預期結果:
Initialized the Promptfoo configuration and golden dataset directory. The results directory is ignored, and the suite is ready for its first case.
正在使用「regression-test」。 Run the golden tests after my system prompt change.
預期結果:
Regression results: 12 total, 11 passed, and 1 failed. The auth-flow case failed its expected behavior rubric and needs review.
正在使用「regression-test」。 Show recent prompt quality trends.
預期結果:
Recent trend: four of five runs passed completely. One auth-flow failure appeared in the latest run, so quality is declining.
安全審計
安全All 38 static findings are false positives caused by Markdown syntax, bounded shell examples, or a Promptfoo message template. No malicious intent, prompt injection, credential handling, or unauthorized network behavior was found.
風險因素
⚙️ 外部命令 (35)
🌐 網路存取 (1)
📁 檔案系統存取 (1)
分享與引用此報告
分享版本化評估報告、中性徽章、嵌入卡片與引用。Skillstore 只報告證據，不判斷該 Skill 是否安全。
複製報告連結
https://skillstore.io/skills/7alexhale5-rgb-regression-test/audits/1?utm_source=security_passport&utm_medium=share&utm_campaign=versioned_reportMarkdown 徽章
[](https://skillstore.io/skills/7alexhale5-rgb-regression-test?utm_source=security_passport_badge)HTML 徽章
<a href="https://skillstore.io/skills/7alexhale5-rgb-regression-test?utm_source=security_passport_badge"><img src="https://skillstore.io/badges/skills/7alexhale5-rgb-regression-test/security.svg" alt="Skillstore security assessment" loading="lazy"></a>嵌入卡片
<iframe src="https://skillstore.io/embed/skills/7alexhale5-rgb-regression-test.html" title="Skillstore Security Assessment" sandbox="allow-popups allow-popups-to-escape-sandbox" loading="lazy" referrerpolicy="no-referrer" width="420" height="180"></iframe>學術引用 (APA · BibTeX · CFF)
APA 引用
7alexhale5-rgb. (2026). regression-test security audit report (audit version 1) [Author version unspecified]. Skillstore. https://skillstore.io/skills/7alexhale5-rgb-regression-test/audits/1BibTeX 引用
@techreport{7alexhale5-rgb-7alexhale5-rgb-regression-test-2026,
author = {7alexhale5-rgb},
title = {regression-test security audit report (audit version 1)},
institution = {Skillstore},
year = {2026},
number = {1},
url = {https://skillstore.io/skills/7alexhale5-rgb-regression-test/audits/1},
note = {Author version unspecified}
}CITATION.cff
cff-version: 1.2.0
message: "If you use this Skill, cite its author and this versioned security audit report."
title: "regression-test security audit report (audit version 1)"
version: "unspecified"
type: report
authors:
- name: "7alexhale5-rgb"
date-released: "2026-08-21"
url: "https://skillstore.io/skills/7alexhale5-rgb-regression-test/audits/1"
identifiers:
- type: other
value: "skillstore:7alexhale5-rgb-regression-test:audit:1"
description: "Skillstore immutable audit report identifier"
Skillstore 評分
評分依據 證據置信度: 中你可以打造什麼
Validate prompt changes
Compare updated prompts against recorded expectations before merging code changes.
Check model migrations
Rerun a stable golden dataset after changing a model or provider version.
Enforce release quality
Run prompt evaluations in continuous integration and stop releases when assertions fail.
試試這些提示
Initialize Promptfoo regression testing in this repository. Show the files created and explain any prerequisites that are missing.
Add a golden test named {name}. Ask for the system prompt, user input, expected behavior, and optional variables before writing it.Run all golden prompt tests. Summarize the pass rate, duration, and each failed assertion with expected and actual behavior.
Review the last five evaluations, identify new failures, compare pass-rate trends, and recommend quality gates for {release_workflow}.最佳實務
- Review every golden case before committing it, and exclude prompts containing secrets or sensitive data.
- Describe expected behavior precisely enough that rubric assertions produce consistent results.
- Run the suite after prompt or model changes and before every release.
避免
- Do not treat one current model response as a permanent definition of correct behavior.
- Do not commit API keys, private prompts, personal data, or confidential outputs in golden files.
- Do not ignore unstable rubric failures without reviewing the assertion and provider behavior.
常見問題
What must be installed?
Which files does the skill create?
Can these tests run in continuous integration?
Should sensitive prompts be stored as golden cases?
Can I use a different model?
How much evaluation history is reported?
開發者詳細資訊
授權
MIT
Skillstore 修訂
r1
版本提示
作者未聲明版本。
引用
cabd63e41a4ad4b66103abc7e50c525e4710fb64
維護新鮮度
2026/8/21
使用量
1 次下載 · 0 次瀏覽
檔案結構
📄 SKILL.md