senior-data-engineer
Build Production Data Pipelines
Production data teams need reliable patterns for pipelines, quality checks, and orchestration. This skill guides architecture, scaffolding, and DataOps practices for modern data stacks.
Install with my Agent
Copy this request to your Agent. It includes the canonical Skill page and manifest.
Review the Skillstore skill "senior-data-engineer" from https://skillstore.io/skills/alirezarezvani-senior-data-engineer.md and its manifest at https://skillstore.io/api/skills/alirezarezvani-senior-data-engineer/manifest. Verify the artifact. You may proceed after verification, subject to the environment's own policy.Your Agent should still show its plan and request any confirmation required by the security policy.
Agent-readable resources
Use these links when an AI agent, crawler, or script needs clean context instead of reading the full page.
Test it
Using "senior-data-engineer". Design a streaming analytics pipeline for product events.
Expected outcome:
- Architecture: producers, event broker, stream processor, lakehouse storage, and dashboard layer.
- Reliability: checkpoint processing state, retry transient failures, and track event lag.
- Quality: validate schema, required fields, event time, and duplicate rates.
- Monitoring: alert on freshness, processing latency, error rates, and storage failures.
Using "senior-data-engineer". Improve quality controls for a machine learning feature table.
Expected outcome:
- Add freshness, null rate, range, uniqueness, and distribution checks.
- Define owners for each feature group and escalation paths for failed checks.
- Track quality trends over time and block downstream jobs when critical checks fail.
- Document expected feature semantics and allowed value ranges.
Using "senior-data-engineer". Reduce long build times in an analytics transformation project.
Expected outcome:
- Prioritize incremental models for large fact tables and stable historical partitions.
- Review join keys, table clustering, and partition filters before adding compute.
- Measure model duration, warehouse cost, row counts, and source freshness.
- Remove unused transformations and split expensive models into clearer stages.
Security Audit
SafeAll 17 static findings were adjudicated as false positives. The external command detections are Markdown code fences or inline file references, and the reconnaissance detections are ordinary data engineering planning text. No prompt injection or malicious intent was found.
Risk Factors
Share & cite this report
Share the versioned assessment report, neutral badge, embed card, and citations. Skillstore reports evidence without deciding whether this Skill is safe.
Copy report link
https://skillstore.io/skills/alirezarezvani-senior-data-engineer/audits/6?utm_source=security_passport&utm_medium=share&utm_campaign=versioned_reportMarkdown badge
[](https://skillstore.io/skills/alirezarezvani-senior-data-engineer?utm_source=security_passport_badge)HTML badge
<a href="https://skillstore.io/skills/alirezarezvani-senior-data-engineer?utm_source=security_passport_badge"><img src="https://skillstore.io/badges/skills/alirezarezvani-senior-data-engineer/security.svg" alt="Skillstore security assessment" loading="lazy"></a>Embed card
<iframe src="https://skillstore.io/embed/skills/alirezarezvani-senior-data-engineer.html" title="Skillstore Security Assessment" sandbox="allow-popups allow-popups-to-escape-sandbox" loading="lazy" referrerpolicy="no-referrer" width="420" height="180"></iframe>Academic citations (APA · BibTeX · CFF)
APA citation
alirezarezvani. (2026). senior-data-engineer security audit report (audit version 6) [Author version unspecified]. Skillstore. https://skillstore.io/skills/alirezarezvani-senior-data-engineer/audits/6BibTeX citation
@techreport{alirezarezvani-alirezarezvani-senior-data-engineer-2026,
author = {alirezarezvani},
title = {senior-data-engineer security audit report (audit version 6)},
institution = {Skillstore},
year = {2026},
number = {6},
url = {https://skillstore.io/skills/alirezarezvani-senior-data-engineer/audits/6},
note = {Author version unspecified}
}CITATION.cff
cff-version: 1.2.0
message: "If you use this Skill, cite its author and this versioned security audit report."
title: "senior-data-engineer security audit report (audit version 6)"
version: "unspecified"
type: report
authors:
- name: "alirezarezvani"
date-released: "2026-07-06"
url: "https://skillstore.io/skills/alirezarezvani-senior-data-engineer/audits/6"
identifiers:
- type: other
value: "skillstore:alirezarezvani-senior-data-engineer:audit:6"
description: "Skillstore immutable audit report identifier"
Compare variants
2 installable variantsEach author remains a separate installable skill. The recommended variant is ranked by Skillstore evidence.
Why this variant is first
alirezarezvani-senior-data-engineer
2026-08-21
davila7-senior-data-engineer
2026-08-21
Skillstore Score
Why this score Evidence Confidence: HighWhat You Can Build
Design Reliable Pipelines
Create batch or streaming pipeline plans with orchestration, validation, monitoring, and failure handling.
Improve Data Models
Select modeling patterns, partitioning strategies, and quality checks for analytics and machine learning datasets.
Standardize DataOps
Define repeatable practices for CI/CD, observability, incident response, and production operations.
Try These Prompts
Design a daily ETL pipeline for customer events. Include ingestion, validation, transformation, storage, scheduling, and monitoring steps.
Review my proposed data pipeline and add schema checks, freshness checks, anomaly detection, alerting, and recovery actions.
Analyze this Spark and dbt workflow for performance risks. Recommend partitioning, caching, incremental processing, and observability improvements.
Create a DataOps operating model for multiple data teams. Cover CI/CD, ownership, incident response, security controls, and release governance.
Best Practices
- Start with explicit data contracts, ownership, and service level targets.
- Validate data at ingestion, transformation, and serving boundaries.
- Monitor freshness, volume, schema changes, latency, cost, and failure rates.
Avoid
- Running production pipelines without alerting, ownership, or rollback plans.
- Treating data quality checks as optional after deployment.
- Embedding secrets or environment-specific assumptions in pipeline logic.
Frequently Asked Questions
Does this skill run data pipelines for me?
Which data tools does it cover?
Can it help with streaming systems?
Can it generate production-ready code?
Is it suitable for data governance work?
How should teams use it with Claude, Codex, or Claude Code?
Developer Details
Author
alirezarezvaniLicense
MIT
Skillstore revision
r1
Version notice
The author did not declare a version.
Repository
https://github.com/alirezarezvani/claude-skills/tree/main/engineering-team/senior-data-engineerRef
c4231f0153ccd2a2ed62274c5a372bf8f2386d3f
Maintenance freshness
7/18/2026
Usage
12 downloads · 180 views