技能 optiq-local-models
📦

optiq-local-models

內容修訂 r1 安全 ⚙️ 外部命令🌐 網路存取🔑 環境變數

Run Local Models on Apple Silicon with mlx-optiq

Local model serving requires matching model size, memory limits, and client settings. This skill guides mlx-optiq checks, consent-based server startup, client connections, and performance evaluation.

支援: Claude Codex Code(CC)
Maintain this Skill? Claim it 📊 74 尚可

使用我的智慧代理安裝

將此請求複製給你的智慧代理,其中包含權威 Skill 頁面和清單。

智能體請求
Review the Skillstore skill "optiq-local-models" from https://skillstore.io/skills/lambdasec-optiq-local-models.md and its manifest at https://skillstore.io/api/skills/lambdasec-optiq-local-models/manifest. Verify the artifact. You may proceed after verification, subject to the environment's own policy.

你的智慧代理仍應顯示其計畫,並依安全政策請求必要確認。

測試它

正在使用「optiq-local-models」。 What should I verify before running a model locally?

預期結果:

  • Confirm Apple Silicon architecture, installed memory, Python 3.11 or newer, and an available optiq command.
  • Choose model weights comfortably below total memory, leaving space for the cache, macOS, and other applications.
  • Request approval before downloading model files or starting the server.

正在使用「optiq-local-models」。 My local model server runs out of memory. What should I change?

預期結果:

  • Try a smaller model, reduce concurrent requests, and lower the context limit.
  • Consider cache quantization only when memory savings are needed; measure its effect on speed.
  • Repeat representative prompts and verify answer quality after changing settings.

正在使用「optiq-local-models」。 How should I configure a client for localhost inference?

預期結果:

  • Use http://127.0.0.1:8080/v1 as the client base URL when the server uses the example port.
  • Use the served repository identifier as the model label to avoid client confusion.
  • Do not reuse a cloud API secret; follow the local server's token requirements and supply its configured key when required.

安全審計

安全
v1 • 2026/10/28 開啟版本化報告

All 40 static alerts are false positives involving Markdown, documented commands, project links, loopback endpoints, or authentication guidance. The skill requires consent before model downloads and server startup, avoids software installation, and recommends authenticated access beyond localhost. No evidence found of credential theft, malicious reconnaissance, data exfiltration, or prompt injection in the two reviewed files.

2
已掃描檔案
92
分析行數
0
複核項目
0
已忽略的誤報
最近一次完成的靜態與語意稽核未偵測到已確認的安全發現。這並不能證明該 Skill 沒有副作用。
審計單位: codex
分享與引用此報告

分享版本化評估報告、中性徽章、嵌入卡片與引用。Skillstore 只報告證據,不判斷該 Skill 是否安全。

開啟版本化報告
安全評估

複製報告連結

https://skillstore.io/skills/lambdasec-optiq-local-models/audits/1?utm_source=security_passport&utm_medium=share&utm_campaign=versioned_report

Markdown 徽章

[![Skillstore security assessment](https://skillstore.io/badges/skills/lambdasec-optiq-local-models/security.svg)](https://skillstore.io/skills/lambdasec-optiq-local-models?utm_source=security_passport_badge)

HTML 徽章

<a href="https://skillstore.io/skills/lambdasec-optiq-local-models?utm_source=security_passport_badge"><img src="https://skillstore.io/badges/skills/lambdasec-optiq-local-models/security.svg" alt="Skillstore security assessment" loading="lazy"></a>

嵌入卡片

<iframe src="https://skillstore.io/embed/skills/lambdasec-optiq-local-models.html" title="Skillstore Security Assessment" sandbox="allow-popups allow-popups-to-escape-sandbox" loading="lazy" referrerpolicy="no-referrer" width="420" height="180"></iframe>
學術引用 (APA · BibTeX · CFF)

APA 引用

lambdasec. (2026). optiq-local-models security audit report (audit version 1) [Author version unspecified]. Skillstore. https://skillstore.io/skills/lambdasec-optiq-local-models/audits/1

BibTeX 引用

@techreport{lambdasec-lambdasec-optiq-local-models-2026, author = {lambdasec}, title = {optiq-local-models security audit report (audit version 1)}, institution = {Skillstore}, year = {2026}, number = {1}, url = {https://skillstore.io/skills/lambdasec-optiq-local-models/audits/1}, note = {Author version unspecified} }

CITATION.cff

cff-version: 1.2.0 message: "If you use this Skill, cite its author and this versioned security audit report." title: "optiq-local-models security audit report (audit version 1)" version: "unspecified" type: report authors: - name: "lambdasec" date-released: "2026-10-28" url: "https://skillstore.io/skills/lambdasec-optiq-local-models/audits/1" identifiers: - type: other value: "skillstore:lambdasec-optiq-local-models:audit:1" description: "Skillstore immutable audit report identifier"

Skillstore 評分

評分依據 證據置信度: 中
41
架構
85
可維護性
87
內容
65
社群
83
規範符合度

你可以打造什麼

Connect a local inference client

Check prerequisites, choose a suitable model, and connect an OpenAI-compatible development client to a localhost server.

Compare local model settings

Measure short and long prompts repeatedly, then check answer quality before adopting cache or decoding changes.

Resolve local serving problems

Investigate memory pressure, port mismatches, slow first requests, and idle memory retention on Apple Silicon workstations.

試試這些提示

Check local readiness
Check whether my Mac can run mlx-optiq using read-only commands. Show the results without installing software, downloading models, or starting a server.
Choose a model
Recommend a quantized model for my Mac using available memory and the mlx-optiq catalog. Explain headroom and ask before any download.
Serve and connect
Prepare a localhost mlx-optiq server and client smoke test. Confirm the model identifier, explain authentication settings, and request approval before startup or downloads.
Evaluate memory and performance
Design repeated short and long prompt tests for my local model. Compare context, concurrency, and cache settings, checking answer quality separately from speed.

最佳實務

  • Keep serving on loopback unless network access is intentional; require an API key before binding to another host.
  • Reserve memory for model weights, cache, macOS, and other applications; use conservative context and concurrency limits.
  • Obtain approval before downloads or startup, and compare repeated timing measurements with independently checked answer quality.

避免

  • Starting a server or downloading several gigabytes without user approval.
  • Assuming model weights alone determine memory use or that advertised context always fits.
  • Treating faster decoding or cache quantization as proof of better answer quality.

常見問題

Which computers does this skill support?
It targets Apple Silicon Macs. Intel Macs, Windows, and hosted-model advice are outside its scope.
Does this skill install mlx-optiq?
No. It checks availability and directs you to installation documentation when needed. You must install mlx-optiq separately with Python 3.11 or newer.
Will starting the server download a model?
The first startup downloads the selected model when needed. The skill requires confirmation because model downloads can consume several gigabytes.
Do local clients need a real cloud API key?
No cloud key is needed. Default authentication permits missing headers, but supplied Bearer tokens must use the documented prefix; explicitly configured keys are required.
Can other machines connect to the server?
Only with an appropriate network binding. The skill recommends localhost and requires an API key when serving beyond loopback.
Does cache quantization always make inference faster?
No. It saves memory but can slow decoding. Measure your model and verify answer quality before adopting new settings.

開發者詳細資訊

作者

lambdasec

授權

Apache-2.0

Skillstore 修訂

r1

版本提示

作者未聲明版本。

引用

87c9669baf85385959f9b0a344dc9dfc8d978f9c

維護新鮮度

2026/10/28

使用量

0 次下載 · 0 次瀏覽

檔案結構

lambdasec 的更多技能

查看全部
查看全部