Senior Data Engineer

Early Applicant

8-10 Years

Job Description

Architect, implement, and optimize ETL/ELT workflows using tools such as Databricks and Informatica to ingest and process large datasets.
Deploy and manage data infrastructure on Azure and AWS, including containerized services and serverless components.
Partner with data scientists, software engineers, and business stakeholders to translate requirements into scalable data solutions.
Monitor and tune pipeline performance, implement robust monitoring/alerting (e.g., Prometheus, DataDog), and troubleshoot production issues.
Define and enforce data validation rules, lineage tracking, and governance standards to ensure accurate and compliant data usage.
Build CI/CD pipelines for data code, automate deployments, and support model operationalization workflows.
Share knowledge of data engineering best practices, conduct code reviews, and mentor junior engineers.

Qualification

Bachelors or Masters degree in Computer Science, Engineering, Data Science, or related field.
8+ years of hands-on experience designing and building data pipelines and infrastructure.
Strong proficiency in data engineering tools and technologies, such as Apache Spark, Hadoop, Kafka, and cloud-based platforms (AWS, Azure, or GCP).
Hands-on experience with data modeling, ETL processes, and distributed data processing frameworks.