技能 rsi-skill
📦

rsi-skill

內容修訂 r1 中風險 📁 檔案系統存取⚙️ 外部命令🌐 網路存取🔑 環境變數

Evaluate and Improve Prompts With Test Cases

Prompt changes can look useful without improving real results. This skill scores examples, proposes revisions, and retains candidates that improve training scores without lowering validation scores.

支援: Claude Codex Code(CC)
Maintain this Skill? Claim it 📊 72 尚可

使用我的智慧代理安裝

將此請求複製給你的智慧代理,其中包含權威 Skill 頁面和清單。

智能體請求
Review the Skillstore skill "rsi-skill" from https://skillstore.io/skills/lambdasec-rsi-skill.md and its manifest at https://skillstore.io/api/skills/lambdasec-rsi-skill/manifest. Verify the artifact. You may proceed after verification, subject to the environment's own policy.

你的智慧代理仍應顯示其計畫,並依安全政策請求必要確認。

Agent 可讀資源

當 AI Agent、爬蟲或腳本需要乾淨脈絡、而不是讀取完整頁面時,請使用這些連結。

測試它

正在使用「rsi-skill」。 Summarize the documented GSM8K optimization example.

預期結果:

  • The bundled example reports a baseline of 5/28 training cases and 2/12 validation cases.
  • The retained final revision reached 27/28 training cases and 11/12 validation cases.
  • Two intermediate revisions were discarded. These are documented results from one run, not guaranteed outcomes.

正在使用「rsi-skill」。 Initialize a new sentiment classification task.

預期結果:

  • Created a starter prompt for positive, negative, and neutral sentiment.
  • Added three labeled examples for editing.
  • This starter set is too small for validation splitting. Add representative cases before optimization.

安全審計

中風險
v1 • 2026/10/28 開啟版本化報告

Most static alerts concern harmless formatting, arithmetic examples, documentation links, or intended backend configuration. Four HTTP request findings expose credentials through unrestricted redirects; a separate model-grading weakness can undermine evaluation integrity. No evidence found of malicious instructions, embedded credentials, or intentional data theft.

6
已掃描檔案
520
分析行數
4
複核項目
0
已忽略的誤報

已確認的安全問題 (1)

中
Untrusted content can influence model-based grading
Judge mode concatenates task input and generated answers into a grading message. Attacker-controlled content can request PASS verdicts and undermine prompt selection.
The grader receives untrusted answer text without explicit data-only instructions and accepts a PASS prefix. Exploit success depends on the selected model.
能力複核項目 (4)

這些是真實的本機能力,對此技能而言可能是預期行為,因此需要複核,但不會按已確認的惡意行為計分。

高
Python HTTP libraries
req = urllib.request.Request(url, headers={"Authorization": f"Bearer {key}"} if key else {})
Authorization is attached as an ordinary request header before default urllib redirect handling. Cross-origin redirects can forward this bearer credential to another host.
高
Python HTTP libraries
with urllib.request.urlopen(req, timeout=timeout) as r:
Default urlopen follows redirects without restricting the credential-bearing request to its original origin. A local redirect-handler check confirmed Authorization forwarding.
高
Python HTTP libraries
req = urllib.request.Request(be["base"] + "/chat/completions", data=body, headers=headers)
The completion request includes Authorization in ordinary headers. A redirect accepted by urllib can send that credential to a different origin.
高
Python HTTP libraries
with urllib.request.urlopen(req, timeout=300) as r:
The completion request uses default redirect handling without an origin check. Accepted redirects can carry the bearer credential to an unintended host.
審計單位: codex
分享與引用此報告

分享版本化評估報告、中性徽章、嵌入卡片與引用。Skillstore 只報告證據,不判斷該 Skill 是否安全。

開啟版本化報告
安全評估

複製報告連結

https://skillstore.io/skills/lambdasec-rsi-skill/audits/1?utm_source=security_passport&utm_medium=share&utm_campaign=versioned_report

Markdown 徽章

[![Skillstore security assessment](https://skillstore.io/badges/skills/lambdasec-rsi-skill/security.svg)](https://skillstore.io/skills/lambdasec-rsi-skill?utm_source=security_passport_badge)

HTML 徽章

<a href="https://skillstore.io/skills/lambdasec-rsi-skill?utm_source=security_passport_badge"><img src="https://skillstore.io/badges/skills/lambdasec-rsi-skill/security.svg" alt="Skillstore security assessment" loading="lazy"></a>

嵌入卡片

<iframe src="https://skillstore.io/embed/skills/lambdasec-rsi-skill.html" title="Skillstore Security Assessment" sandbox="allow-popups allow-popups-to-escape-sandbox" loading="lazy" referrerpolicy="no-referrer" width="420" height="180"></iframe>
學術引用 (APA · BibTeX · CFF)

APA 引用

lambdasec. (2026). rsi-skill security audit report (audit version 1) [Author version unspecified]. Skillstore. https://skillstore.io/skills/lambdasec-rsi-skill/audits/1

BibTeX 引用

@techreport{lambdasec-lambdasec-rsi-skill-2026, author = {lambdasec}, title = {rsi-skill security audit report (audit version 1)}, institution = {Skillstore}, year = {2026}, number = {1}, url = {https://skillstore.io/skills/lambdasec-rsi-skill/audits/1}, note = {Author version unspecified} }

CITATION.cff

cff-version: 1.2.0 message: "If you use this Skill, cite its author and this versioned security audit report." title: "rsi-skill security audit report (audit version 1)" version: "unspecified" type: report authors: - name: "lambdasec" date-released: "2026-10-28" url: "https://skillstore.io/skills/lambdasec-rsi-skill/audits/1" identifiers: - type: other value: "skillstore:lambdasec-rsi-skill:audit:1" description: "Skillstore immutable audit report identifier"

Skillstore 評分

評分依據 證據置信度: 中
64
架構
85
可維護性
87
內容
65
社群
91
規範符合度

你可以打造什麼

Refine classification instructions

Compare a classifier prompt against labeled examples and inspect failures before accepting a revision.

Compare reasoning prompts

Use the bundled math cases to compare prompt variants with numeric checks and a reproducible validation split.

Test agent instruction changes

Evaluate instruction text against representative cases and review the proposed changes before applying them.

試試這些提示

Create a first evaluation
Help me evaluate this prompt: [prompt]. Initialize a task directory and help me define expected answers. Confirm the backend before sending data.
Measure a baseline
Evaluate the prompt and cases in [directory] using [approved endpoint and model]. Report the baseline score, failed cases, and scoring methods without revising anything.
Run controlled optimization
Optimize [directory] for up to five rounds using [approved endpoint and model]. Keep the default validation split and copy rejection. Report scores and proposed changes.
Validate an instruction revision
Optimize [directory] using [evaluation model] and [proposal model] on [approved endpoint]. Reevaluate the best prompt on [independent test directory]. Review failures before requesting deployment approval.

最佳實務

  • Confirm the resolved endpoint and model before inference. Obtain approval for private remote data and avoid untrusted redirects.
  • Use representative cases and deterministic checks where possible. Reserve a separate final test set beyond the reused validation split.
  • Review failures and prompt changes, repeat evaluation, and obtain approval before replacing production instructions.

避免

  • Sending confidential prompts or cases to an unapproved remote endpoint.
  • Treating validation gains from a small, repeatedly reused split as proof of general improvement.
  • Using model-judge verdicts as the only acceptance gate for adversarial or security-sensitive tasks.

常見問題

Does this skill train model weights?
No. It revises instruction text and measures the resulting answers against test cases.
Which model services can it use?
It supports OpenAI-compatible chat endpoints, including OptiQ Cloud, local OptiQ servers, and explicitly configured services. API features vary by backend.
Can I keep evaluation data local?
Yes, with an approved local endpoint. Select it explicitly and verify backend resolution because cloud configuration takes priority over automatic local discovery.
How many cases should I provide?
The instructions recommend 10 to 40 representative cases. Fewer than six cases disable validation splitting.
How does it select a revision?
Training scores must improve, and validation scores must not decrease when a validation set exists. Complete copied test inputs are rejected by default.
Are improvements guaranteed and automatically deployed?
No. Results depend on the model, checks, and examples. The instructions require user approval before applying the saved best prompt.

開發者詳細資訊

作者

lambdasec

授權

Apache-2.0

Skillstore 修訂

r1

版本提示

作者未聲明版本。

引用

87c9669baf85385959f9b0a344dc9dfc8d978f9c

維護新鮮度

2026/10/28

使用量

0 次下載 · 0 次瀏覽

檔案結構

lambdasec 的更多技能

查看全部
查看全部