スキル vaex
📊
處理超過 RAM 容量的大型資料集會導致記憶體錯誤和效能緩慢。Vaex 使用延遲評估和記憶體映射技術,無需將資料載入記憶體即可即時處理數十億行資料。
対応: Claude Codex Code(CC)
1
スキルZIPをダウンロード
2
Claudeでアップロード
設定 → 機能 → スキル → スキルをアップロードへ移動
3
オンにして利用開始
テストする
「vaex」を使用しています。 載入我的 10GB 銷售資料檔案並顯示各地區的收入分佈
期待される結果:
- 資料集形狀:150,000,000 行 × 25 欄
- 記憶體使用量:0 位元組(記憶體映射 HDF5)
- 各地區收入:
- • 北部:$12.5B(平均:$245)
- • 南部:$8.3B(平均:$198)
「vaex」を使用しています。 從身高和體重欄位建立 BMI 虛擬欄位
期待される結果:
- 已建立虛擬欄位:df['bmi']
- 記憶體開銷:0 位元組
- 公式:df.weight_kg / (df.height_m ^ 2)
- 已準備好進行聚合和篩選。
「vaex」を使用しています。 顯示總購買金額前 10 名的客戶
期待される結果:
- 客戶分析:
- • 最高消費客戶:總計 $1.2M
- • 前 10 名客戶:合計 $8.5M
- • 處理時間:0.3 秒(延遲評估)
セキュリティ監査
安全v5 • 1/17/2026
This is a pure documentation skill containing only reference guides and Python code examples for the Vaex library. All 501 static findings are false positives triggered by documentation patterns. The analyzer misinterprets markdown code examples, placeholder credential documentation, and legitimate feature descriptions as security issues. No executable code, network operations, or credential exposure exists.
8
スキャンされたファイル
3,938
解析された行数
4
検出結果
5
総監査数
リスク要因
⚙️ 外部コマンド (444)
references/core_dataframes.md:15 references/core_dataframes.md:19-31 references/core_dataframes.md:31-40 references/core_dataframes.md:40-54 references/core_dataframes.md:54-60 references/core_dataframes.md:60-70 references/core_dataframes.md:70-74 references/core_dataframes.md:74-86 references/core_dataframes.md:86-90 references/core_dataframes.md:90-100 references/core_dataframes.md:100-104 references/core_dataframes.md:104-114 references/core_dataframes.md:114-120 references/core_dataframes.md:120-129 references/core_dataframes.md:129-135 references/core_dataframes.md:135-152 references/core_dataframes.md:152-156 references/core_dataframes.md:156-171 references/core_dataframes.md:171-175 references/core_dataframes.md:175-188 references/core_dataframes.md:188-194 references/core_dataframes.md:194-211 references/core_dataframes.md:211-215 references/core_dataframes.md:215-226 references/core_dataframes.md:226-232 references/core_dataframes.md:232-243 references/core_dataframes.md:243-249 references/core_dataframes.md:249-255 references/core_dataframes.md:255-259 references/core_dataframes.md:259-266 references/core_dataframes.md:266-270 references/core_dataframes.md:270-277 references/core_dataframes.md:277-283 references/core_dataframes.md:283-284 references/core_dataframes.md:284-292 references/core_dataframes.md:292-298 references/core_dataframes.md:298-302 references/core_dataframes.md:302-315 references/core_dataframes.md:315-319 references/core_dataframes.md:319-327 references/core_dataframes.md:327-333 references/core_dataframes.md:333-337 references/core_dataframes.md:337-341 references/core_dataframes.md:341-347 references/core_dataframes.md:347-351 references/core_dataframes.md:351-361 references/core_dataframes.md:361-365 references/core_dataframes.md:365-366 references/core_dataframes.md:366-367 references/data_processing.md:11-21 references/data_processing.md:21-27 references/data_processing.md:27-44 references/data_processing.md:44-48 references/data_processing.md:48-63 references/data_processing.md:63-71 references/data_processing.md:71-84 references/data_processing.md:84-88 references/data_processing.md:88-111 references/data_processing.md:111-115 references/data_processing.md:115-128 references/data_processing.md:128-132 references/data_processing.md:132-136 references/data_processing.md:136-158 references/data_processing.md:158-162 references/data_processing.md:162-174 references/data_processing.md:174-178 references/data_processing.md:178-182 references/data_processing.md:182-201 references/data_processing.md:201-209 references/data_processing.md:209-225 references/data_processing.md:225-229 references/data_processing.md:229-264 references/data_processing.md:264-272 references/data_processing.md:272-285 references/data_processing.md:285-289 references/data_processing.md:289-303 references/data_processing.md:303-307 references/data_processing.md:307-317 references/data_processing.md:317-325 references/data_processing.md:325-334 references/data_processing.md:334-338 references/data_processing.md:338-347 references/data_processing.md:347-353 references/data_processing.md:353-364 references/data_processing.md:364-372 references/data_processing.md:372-380 references/data_processing.md:380-384 references/data_processing.md:384-395 references/data_processing.md:395-404 references/data_processing.md:404-410 references/data_processing.md:410-414 references/data_processing.md:414-424 references/data_processing.md:424-430 references/data_processing.md:430-447 references/data_processing.md:447-453 references/data_processing.md:453-464 references/data_processing.md:464-468 references/data_processing.md:468-477 references/data_processing.md:477-481 references/data_processing.md:481-490 references/data_processing.md:490-496 references/data_processing.md:496-503 references/data_processing.md:503-507 references/data_processing.md:507-512 references/data_processing.md:512-516 references/data_processing.md:516-523 references/data_processing.md:523-527 references/data_processing.md:527-539 references/data_processing.md:539-545 references/data_processing.md:545 references/data_processing.md:545-552 references/data_processing.md:552-553 references/data_processing.md:553-554 references/data_processing.md:554-555 references/io_operations.md:19-28 references/io_operations.md:28-38 references/io_operations.md:38-45 references/io_operations.md:45-55 references/io_operations.md:55-65 references/io_operations.md:65-79 references/io_operations.md:79-100 references/io_operations.md:100-104 references/io_operations.md:104-109 references/io_operations.md:109-115 references/io_operations.md:115-121 references/io_operations.md:121-133 references/io_operations.md:133-137 references/io_operations.md:137-143 references/io_operations.md:143-147 references/io_operations.md:147-154 references/io_operations.md:154-158 references/io_operations.md:158-173 references/io_operations.md:173-179 references/io_operations.md:179-192 references/io_operations.md:192-196 references/io_operations.md:196-202 references/io_operations.md:202-206 references/io_operations.md:206-212 references/io_operations.md:212-216 references/io_operations.md:216-229 references/io_operations.md:229-235 references/io_operations.md:235-254 references/io_operations.md:254-258 references/io_operations.md:258-266 references/io_operations.md:266-272 references/io_operations.md:272-284 references/io_operations.md:284-288 references/io_operations.md:288-299 references/io_operations.md:299-305 references/io_operations.md:305-319 references/io_operations.md:319-323 references/io_operations.md:323-334 references/io_operations.md:334-340 references/io_operations.md:340-351 references/io_operations.md:351-355 references/io_operations.md:355-363 references/io_operations.md:363-367 references/io_operations.md:367-370 references/io_operations.md:370-374 references/io_operations.md:374-381 references/io_operations.md:381-387 references/io_operations.md:387-404 references/io_operations.md:404-408 references/io_operations.md:408-420 references/io_operations.md:420-426 references/io_operations.md:426-435 references/io_operations.md:435-439 references/io_operations.md:439-444 references/io_operations.md:444-450 references/io_operations.md:450-457 references/io_operations.md:457-461 references/io_operations.md:461-466 references/io_operations.md:466-472 references/io_operations.md:472-475 references/io_operations.md:475-479 references/io_operations.md:479-487 references/io_operations.md:487-493 references/io_operations.md:493-502 references/io_operations.md:502-506 references/io_operations.md:506-514 references/io_operations.md:514-520 references/io_operations.md:520-531 references/io_operations.md:531-535 references/io_operations.md:535-541 references/io_operations.md:541-545 references/io_operations.md:545-551 references/io_operations.md:551-555 references/io_operations.md:555-561 references/io_operations.md:561-565 references/io_operations.md:565-575 references/io_operations.md:575-581 references/io_operations.md:581-603 references/io_operations.md:603-609 references/io_operations.md:609-626 references/io_operations.md:626-630 references/io_operations.md:630-638 references/io_operations.md:638-642 references/io_operations.md:642-655 references/io_operations.md:655-661 references/io_operations.md:661-665 references/io_operations.md:665-669 references/io_operations.md:669-673 references/io_operations.md:673-677 references/io_operations.md:677-685 references/io_operations.md:685-701 references/io_operations.md:701-702 references/io_operations.md:702-703 references/machine_learning.md:7 references/machine_learning.md:21-36 references/machine_learning.md:36-40 references/machine_learning.md:40-51 references/machine_learning.md:51-55 references/machine_learning.md:55-60 references/machine_learning.md:60-64 references/machine_learning.md:64-69 references/machine_learning.md:69-75 references/machine_learning.md:75-82 references/machine_learning.md:82-86 references/machine_learning.md:86-99 references/machine_learning.md:99-103 references/machine_learning.md:103-110 references/machine_learning.md:110-114 references/machine_learning.md:114-124 references/machine_learning.md:124-128 references/machine_learning.md:128-136 references/machine_learning.md:136-142 references/machine_learning.md:142-151 references/machine_learning.md:151-155 references/machine_learning.md:155-165 references/machine_learning.md:165-169 references/machine_learning.md:169-182 references/machine_learning.md:182-186 references/machine_learning.md:186-194 references/machine_learning.md:194-200 references/machine_learning.md:200-214 references/machine_learning.md:214-220 references/machine_learning.md:220-249 references/machine_learning.md:249-253 references/machine_learning.md:253-281 references/machine_learning.md:281-285 references/machine_learning.md:285-313 references/machine_learning.md:313-317 references/machine_learning.md:317-341 references/machine_learning.md:341-345 references/machine_learning.md:345-376 references/machine_learning.md:376-382 references/machine_learning.md:382-408 references/machine_learning.md:408-412 references/machine_learning.md:412-454 references/machine_learning.md:454-460 references/machine_learning.md:460-471 references/machine_learning.md:471-475 references/machine_learning.md:475-489 references/machine_learning.md:489-493 references/machine_learning.md:493-498 references/machine_learning.md:498-504 references/machine_learning.md:504-521 references/machine_learning.md:521-525 references/machine_learning.md:525-539 references/machine_learning.md:539-543 references/machine_learning.md:543-569 references/machine_learning.md:569-575 references/machine_learning.md:575-587 references/machine_learning.md:587-591 references/machine_learning.md:591-601 references/machine_learning.md:601-607 references/machine_learning.md:607-618 references/machine_learning.md:618-622 references/machine_learning.md:622-632 references/machine_learning.md:632-636 references/machine_learning.md:636-646 references/machine_learning.md:646-652 references/machine_learning.md:652-690 references/machine_learning.md:690-694 references/machine_learning.md:694-711 references/machine_learning.md:711-717 references/machine_learning.md:717-721 references/machine_learning.md:721-726 references/machine_learning.md:726-727 references/machine_learning.md:727-728 references/performance.md:11-23 references/performance.md:23-32 references/performance.md:32-43 references/performance.md:43-51 references/performance.md:51-66 references/performance.md:66-70 references/performance.md:70-89 references/performance.md:89-93 references/performance.md:93-99 references/performance.md:99-113 references/performance.md:113-121 references/performance.md:121-142 references/performance.md:142-146 references/performance.md:146-154 references/performance.md:154-162 references/performance.md:162-175 references/performance.md:175-179 references/performance.md:179-193 references/performance.md:193-197 references/performance.md:197-210 references/performance.md:210-218 references/performance.md:218-228 references/performance.md:228-232 references/performance.md:232-239 references/performance.md:239-243 references/performance.md:243-253 references/performance.md:253-261 references/performance.md:261-267 references/performance.md:267-271 references/performance.md:271-281 references/performance.md:281-285 references/performance.md:285-298 references/performance.md:298-306 references/performance.md:306-316 references/performance.md:316-320 references/performance.md:320-333 references/performance.md:333-341 references/performance.md:341-354 references/performance.md:354-358 references/performance.md:358-368 references/performance.md:368-374 references/performance.md:374-386 references/performance.md:386-390 references/performance.md:390-402 references/performance.md:402-406 references/performance.md:406-424 references/performance.md:424-428 references/performance.md:428-439 references/performance.md:439-443 references/performance.md:443-453 references/performance.md:453-459 references/performance.md:459-470 references/performance.md:470-474 references/performance.md:474-479 references/performance.md:479-483 references/performance.md:483-496 references/performance.md:496-502 references/performance.md:502-512 references/performance.md:512-516 references/performance.md:516-523 references/performance.md:523-527 references/performance.md:527-538 references/performance.md:538-542 references/performance.md:542-552 references/performance.md:552-562 references/performance.md:562 references/performance.md:562-569 references/performance.md:569-570 references/performance.md:570-571 references/visualization.md:20-38 references/visualization.md:38-42 references/visualization.md:42-57 references/visualization.md:57-61 references/visualization.md:61-70 references/visualization.md:70-76 references/visualization.md:76-91 references/visualization.md:91-95 references/visualization.md:95-106 references/visualization.md:106-110 references/visualization.md:110-119 references/visualization.md:119-125 references/visualization.md:125-140 references/visualization.md:140-144 references/visualization.md:144-170 references/visualization.md:170-176 references/visualization.md:176-194 references/visualization.md:194-198 references/visualization.md:198-210 references/visualization.md:210-216 references/visualization.md:216-232 references/visualization.md:232-236 references/visualization.md:236-250 references/visualization.md:250-258 references/visualization.md:258-261 references/visualization.md:261-265 references/visualization.md:265-268 references/visualization.md:268-272 references/visualization.md:272-275 references/visualization.md:275-281 references/visualization.md:281-305 references/visualization.md:305-309 references/visualization.md:309-314 references/visualization.md:314-320 references/visualization.md:320-329 references/visualization.md:329-333 references/visualization.md:333-350 references/visualization.md:350-354 references/visualization.md:354-378 references/visualization.md:378-384 references/visualization.md:384-393 references/visualization.md:393-397 references/visualization.md:397-413 references/visualization.md:413-419 references/visualization.md:419-429 references/visualization.md:429-433 references/visualization.md:433-443 references/visualization.md:443-449 references/visualization.md:449-489 references/visualization.md:489-493 references/visualization.md:493-515 references/visualization.md:515-519 references/visualization.md:519-534 references/visualization.md:534-540 references/visualization.md:540-550 references/visualization.md:550-554 references/visualization.md:554-564 references/visualization.md:564-580 references/visualization.md:580-587 references/visualization.md:587-591 references/visualization.md:591-597 references/visualization.md:597-601 references/visualization.md:601-607 references/visualization.md:607-611 references/visualization.md:611-612 references/visualization.md:612-613 SKILL.md:29 SKILL.md:37 SKILL.md:46 SKILL.md:48 SKILL.md:55 SKILL.md:63 SKILL.md:72 SKILL.md:83-111 SKILL.md:111-117 SKILL.md:117 SKILL.md:117-118 SKILL.md:118-119 SKILL.md:119-120 SKILL.md:120-121 SKILL.md:121-127 SKILL.md:127-130 SKILL.md:130-135 SKILL.md:135-146 SKILL.md:146-149 SKILL.md:149-157 SKILL.md:157-160 SKILL.md:160-165 SKILL.md:165-169 SKILL.md:169-171 SKILL.md:171-172 SKILL.md:172-173 SKILL.md:173-174 SKILL.md:174-175 SKILL.md:175-176
🌐 ネットワークアクセス (2)
📁 ファイルシステムへのアクセス (16)
references/io_operations.md:10 references/io_operations.md:13 references/io_operations.md:22 references/io_operations.md:31 references/io_operations.md:39 references/io_operations.md:48 references/io_operations.md:422 references/io_operations.md:427 references/io_operations.md:433 references/io_operations.md:434 references/io_operations.md:692 references/io_operations.md:637 references/io_operations.md:221 references/performance.md:259 references/performance.md:262 skill-report.json:125
🔑 環境変数 (1)
監査者: claude 監査履歴を表示 →
品質スコア
45
アーキテクチャ
100
保守性
85
コンテンツ
21
コミュニティ
100
セキュリティ
91
仕様準拠
作れるもの
分析海量資料集
探索和分析數十億行資料集,無需擔心記憶體錯誤或抽樣問題。
在大數據上訓練模型
在傳統工具無法處理的大型資料集上建立和部署機器學習管線。
處理時間序列資料
處理大型金融時間序列資料以進行風險分析和預測。
これらのプロンプトを試す
載入大型資料集
使用 Vaex 載入大型 HDF5/Parquet 檔案,並顯示基本統計資訊和欄位資訊。
篩選和聚合
根據條件篩選資料集,並高效執行分組聚合運算。
建立視覺化
為大型資料集建立熱圖或直方圖視覺化。
建立機器學習管線
使用 Vaex ML 轉換器預處理特徵並訓練 XGBoost 模型。
ベストプラクティス
- 將 CSV 檔案轉換為 HDF5 或 Arrow 格式以實現即時載入
- 使用虛擬欄位而非實體化資料以節省記憶體
- 使用 delay=True 批次處理多個操作以實現單次運算
- 使用選擇功能而非建立新的 DataFrame 來進行篩選
回避
- 在大型資料集上使用 .to_pandas_df() 會失去 Vaex 的優勢
- 在不需要時使用 .values 將資料轉換為 NumPy 陣列
- 重複匯出為 CSV 而非使用 HDF5/Arrow
- 無充分理由地實體化虛擬欄位
よくある質問
Vaex 如何處理大於 RAM 的資料集?
Vaex 使用記憶體映射檔案,將資料保留在磁碟上,僅將存取的部分讀入記憶體。
哪些檔案格式最適合 Vaex?
HDF5 和 Apache Arrow 提供即時載入。CSV 對大型檔案來說速度較慢。
我可以在 pandas 程式碼中使用 Vaex 嗎?
Vaex 的 API 與 pandas 相似,但某些操作有所不同。不保證完全相容 pandas。
使用 Vaex 時我的資料安全嗎?
Vaex 絕不會修改來源檔案。所有轉換都會建立虛擬欄位或新的匯出檔案。
為什麼我的操作執行緩慢?
請確認您使用的是 HDF5/Arrow 格式而非 CSV。對多個聚合操作使用 delay=True。
Vaex 與 Dask 或 Polars 相比如何?
Vaex 擅長以最少記憶體處理數十億行資料集。Dask 處理分散式運算,Polars 在記憶體內資料處理上更快。