SS
Sigma Software
Data Engineer
Senior Data Engineer (Cybersecurity)
HybridSeniorData Engineerposted 5d ago
Role summaryAI-generated
The Senior Data Engineer will design, optimize, and maintain large-scale data pipelines for cybersecurity data, ensuring reliability and performance. They will collaborate with product and cross-functional teams to modernize the data platform and resolve bottlenecks in existing workflows.
Skills required
PythonSQLSparkAirflowData pipelinesData modelingPerformance optimizationCloud computingBig dataData engineeringdbtData transformationSnowflake
About this role
- Maintain and enhance existing data processes with a focus on reliability, scalability, and performance optimization
- Analyze and deeply understand existing data models, workflows, tables, and processing jobs
- Identify technical gaps, bottlenecks, inefficiencies, and opportunities for architectural improvements
- Design, optimize, and support large-scale data pipelines and transformation processes
- Drive modernization initiatives across the data platform and contribute to long-term architectural evolution
- Optimize complex SQL queries and improve data processing latency and efficiency
- Collaborate with product engineering and cross-functional teams on technical solutions and implementation strategies
- Contribute to both short-term delivery goals and long-term platform development initiatives
- Ensure adherence to best practices in data engineering, system reliability, and performance optimization
- Participate in technical discussions, solution design, and continuous improvement initiatives
Qualifications
- 5+ years of commercial experience in Data Engineering
- Expert-level Python skills
- Expert-level SQL skills with practical experience optimizing complex queries for performance and scalability
- Strong hands-on experience with DBT for data transformation and modeling
- Solid understanding of database concepts, including DDL, DML, indexing, normalization, and advanced SQL techniques
- Hands-on experience working with Snowflake
- Experience with Elastic Stack technologies
- Proven experience designing, building, and maintaining large-scale data pipelines
- Strong analytical thinking and problem-solving skills
- Ability to work independently in a high-autonomy engineering environment
- Experience driving technical initiatives from idea through implementation
- Strong communication and collaboration skills
- Upper-Intermediate English level or higher
WILL BE A PLUS
- Experience with Airflow for workflow orchestration
Apply on Sigma Software →Opens in new tab
score your resume against this role
Similar open roles
A
NEWData Platform Principal Architect, Seattle/San Francisco
On-siteStaffData Engineer
$220k – $300k USD
today
BG
NEWBlackstone Multi-Asset Investing - Lead Data Engineer-Product Management
On-siteSeniorData Engineer
$174k – $180k USD
today
R
NEWSenior Data Engineer - (GCP & Lakehouse Architecture) - On Site - Octopus by RTG
On-siteSeniorData Engineer
yesterday