nice-try-gpt
Harden CTF Challenges Against LLM Shortcuts
Challenge authors need to reduce shallow LLM pattern matching without making fair challenges frustrating. This skill reproduces the intended solve, selects a small resistance change, and verifies the result end to end.
๋ด ์์ด์ ํธ๋ก ์ค์น
์ด ์์ฒญ์ ์์ด์ ํธ์ ๋ณต์ฌํ์ธ์. ๊ณต์ Skill ํ์ด์ง์ ๋งค๋ํ์คํธ๊ฐ ํฌํจ๋์ด ์์ต๋๋ค.
Review the Skillstore skill "nice-try-gpt" from https://skillstore.io/skills/aleff-github-nice-try-gpt.md and its manifest at https://skillstore.io/api/skills/aleff-github-nice-try-gpt/manifest. Verify the artifact. You may proceed after verification, subject to the environment's own policy.์์ด์ ํธ๋ ๊ณ์ํด์ ๊ณํ์ ํ์ํ๊ณ ๋ณด์ ์ ์ฑ ์์ ์๊ตฌํ๋ ํ์ธ์ ์์ฒญํด์ผ ํฉ๋๋ค.
์์ด์ ํธ๊ฐ ์ฝ๊ธฐ ์ฌ์ด ๋ฆฌ์์ค
AI ์์ด์ ํธ, ํฌ๋กค๋ฌ, ์คํฌ๋ฆฝํธ๊ฐ ์ ์ฒด ํ์ด์ง ๋์ ์ ๋ฆฌ๋ ์ปจํ ์คํธ๋ง ํ์ํ ๋ ์ด ๋งํฌ๋ฅผ ์ฌ์ฉํ์ธ์.
ํ ์คํธํด ๋ณด๊ธฐ
"nice-try-gpt" ์ฌ์ฉ ์ค์ ๋๋ค. An authorized web challenge exposes an object identifier in a static response, making the intended authorization weakness immediately obvious.
์์ ๊ฒฐ๊ณผ:
Shortcut identified: static object disclosure. Recommended move: reveal the identifier through ordinary runtime activity, adding one observation without changing the vulnerability.
"nice-try-gpt" ์ฌ์ฉ ์ค์ ๋๋ค. A proposed transformation adds a five-step state machine and requires an unrelated protocol.
์์ ๊ฒฐ๊ณผ:
Rejected by the Human Cost Gate. It adds a new exploit primitive and materially increases player effort, so the original challenge should remain unchanged.
"nice-try-gpt" ์ฌ์ฉ ์ค์ ๋๋ค. The transformed challenge starts normally, preserves the weakness, removes the static cue, and passes an end-to-end solve.
์์ ๊ฒฐ๊ณผ:
TRANSFORMED PASS. The report records the baseline, selected resistance, human-cost estimate, post-change difficulty, verification result, and changed files.
๋ณด์ ๊ฐ์ฌ
์์ All 17 static detections are false positives. The command detections match Markdown backticks and status labels, while the reconnaissance detections describe CTF review criteria rather than host discovery or system probing.
์ํ ์์ธ
โ๏ธ ์ธ๋ถ ๋ช ๋ น์ด (12)
์ด ๋ณด๊ณ ์ ๊ณต์ ๋ฐ ์ธ์ฉ
๋ฒ์ ์ด ์ง์ ๋ ํ๊ฐ ๋ณด๊ณ ์, ์ค๋ฆฝ ๋ฐฐ์ง, ์๋ฒ ๋ ์นด๋ ๋ฐ ์ธ์ฉ์ ๊ณต์ ํ์ธ์. Skillstore๋ ๊ทผ๊ฑฐ๋ฅผ ๋ณด๊ณ ํ์ง๋ง ์ด Skill์ ์์ ์ฌ๋ถ๋ฅผ ํ๋จํ์ง ์์ต๋๋ค.
๋ณด๊ณ ์ ๋งํฌ ๋ณต์ฌ
https://skillstore.io/skills/aleff-github-nice-try-gpt/audits/2?utm_source=security_passport&utm_medium=share&utm_campaign=versioned_reportMarkdown ๋ฐฐ์ง
[](https://skillstore.io/skills/aleff-github-nice-try-gpt?utm_source=security_passport_badge)HTML ๋ฐฐ์ง
<a href="https://skillstore.io/skills/aleff-github-nice-try-gpt?utm_source=security_passport_badge"><img src="https://skillstore.io/badges/skills/aleff-github-nice-try-gpt/security.svg" alt="Skillstore security assessment" loading="lazy"></a>์๋ฒ ๋ ์นด๋
<iframe src="https://skillstore.io/embed/skills/aleff-github-nice-try-gpt.html" title="Skillstore Security Assessment" sandbox="allow-popups allow-popups-to-escape-sandbox" loading="lazy" referrerpolicy="no-referrer" width="420" height="180"></iframe>ํ์ ์ธ์ฉ (APA ยท BibTeX ยท CFF)
APA ์ธ์ฉ
aleff-github. (2026). nice-try-gpt security audit report (audit version 2) [Author version 0.2.0]. Skillstore. https://skillstore.io/skills/aleff-github-nice-try-gpt/audits/2BibTeX ์ธ์ฉ
@techreport{aleff-github-aleff-github-nice-try-gpt-2026,
author = {aleff-github},
title = {nice-try-gpt security audit report (audit version 2)},
institution = {Skillstore},
year = {2026},
number = {2},
url = {https://skillstore.io/skills/aleff-github-nice-try-gpt/audits/2},
note = {Author version 0.2.0}
}CITATION.cff
cff-version: 1.2.0
message: "If you use this Skill, cite its author and this versioned security audit report."
title: "nice-try-gpt security audit report (audit version 2)"
version: "0.2.0"
type: report
authors:
- name: "aleff-github"
date-released: "2026-09-20"
url: "https://skillstore.io/skills/aleff-github-nice-try-gpt/audits/2"
identifiers:
- type: other
value: "skillstore:aleff-github-nice-try-gpt:audit:2"
description: "Skillstore immutable audit report identifier"
Skillstore ์ ์
์ด ์ ์์ ์ด์ ์ฆ๊ฑฐ ์ ๋ขฐ๋: ์ค๊ฐ๋ง๋ค ์ ์๋ ๊ฒ
Review a Training Challenge
Reproduce a lab solve, identify the fastest shallow shortcut, and propose a small change that preserves the lesson.
Validate a Challenge Update
Check that a transformed challenge still starts, exposes the intended weakness, and produces the expected result.
Improve LLM-Assisted Practice
Reduce obvious model shortcuts while keeping the expected human knowledge, actions, and difficulty band stable.
์ด ํ๋กฌํํธ๋ฅผ ์ฌ์ฉํด ๋ณด์ธ์
Review this authorized CTF challenge. Record its vulnerability class, intended solve path, required knowledge, difficulty band, and clean-start procedure. Do not modify files.
Using the verified baseline evidence, identify the single cheapest LLM shortcut. Explain which player-facing clue enables it and why the shortcut does not represent the intended learning objective.
Choose the smallest resistance move that reduces the identified shortcut. Check the same vulnerability class, learning objective, prerequisite knowledge, and human-cost gate before proposing the change.
Verify the transformed challenge from a clean state. Check startup, legitimate behavior, intended vulnerability, shortcut reduction, runtime success, flag isolation, and independent-solver status. Produce the required final report.
๋ชจ๋ฒ ์ฌ๋ก
- Start with a clean, reproducible baseline before proposing any change.
- Prefer one evidence-based resistance move with one to three additional meaningful actions.
- Verify the intended solve, flag isolation, and normal application behavior after every change.
ํผํ๊ธฐ
- Do not hide flags behind randomness, unstable behavior, or undiscoverable values.
- Do not stack decoys, brute force, CAPTCHA, token flooding, or unrelated trivia.
- Do not claim LLM resistance without an isolated fresh-solver check or an explicit NOT TESTED result.
์์ฃผ ๋ฌป๋ ์ง๋ฌธ
Who should use this skill?
Does it create new vulnerabilities?
Can it test production systems?
How many changes should it make?
How does it verify success?
Does self-review prove model resistance?
๊ฐ๋ฐ์ ์ธ๋ถ ์ ๋ณด
์์ฑ์
aleff-github๋ผ์ด์ ์ค
GPL-3.0-only
์์ฑ์ ๋ฒ์
v0.2.0
Skillstore ๋ฆฌ๋น์
r2
๋ฒ์ ์๋ด
์ค์น ๊ฐ๋ฅํ ์ฝํ ์ธ ๊ฐ ๋ณ๊ฒฝ๋์์ง๋ง ์์ฑ์๊ฐ ์ ์ธ๋ ๋ฒ์ ์ ์ ๋ฐ์ดํธํ์ง ์์์ต๋๋ค.
๋ฆฌํฌ์งํ ๋ฆฌ
https://github.com/aleff-github/nicetrygpt/tree/f162c0e168b48a99f71224683eabbc8e63f38dcc/skills/nice-try-gpt์ฐธ์กฐ
9f1a7e8b681745b04f88358f3cf08da94782cac9
์ ์ง๋ณด์ ์ต์ ์ฑ
2026. 9. 20.
์ฌ์ฉ๋
0 ๋ค์ด๋ก๋ ยท 0 ์กฐํ
ํ์ผ ๊ตฌ์กฐ