We are looking for an experienced Data Engineer (Cloud) to join our growing team. The ideal candidate should have hands-on expertise in designing and developing cloud-based data solutions using AWS, Databricks, Python, SQL, and ETL/ELT technologies. You will be responsible for building scalable data pipelines, modernizing cloud data platforms, and delivering secure, high-performance analytics solutions whilecollaborating with cross-functional teams.
Roles & Responsibilities
- Design and develop cloud-based data analytics solutions using AWS and Databricks.
- Build and maintain scalable ETL/ELT data pipelines using Python, SQL, and Spark SQL.
- Design and implement Data Lakes, Data Warehouses, and Data Marts.
- Develop cloud-native data integration solutions using Informatica IDMC.
- Automate infrastructure using Terraform and CloudFormation.
- Collaborate with business stakeholders to gather and translate technical requirements.
- Optimize SQL queries, Spark workloads, and cloud data processing performance.
- Implement CI/CD pipelines and support DevOps best practices.
- Ensure cloud security, IAM compliance, and data governance standards.
- Support AI/ML data engineering initiatives and reporting solutions.
- Prepare technical documentation and support production deployments.
Technical Requirements
- Experience: 5 -10 years in Cloud Data Engineering.
- Strong hands-on experience with AWS (Glue, Redshift, S3, Lambda, Athena, EMR, Kinesis).
- Expertise in Databricks, Delta Lake, Spark, Python, SQL, and Spark SQL.
- Experience with Informatica IDMC, ETL/ELT, and Data Warehousing.
- Knowledge of Terraform, CloudFormation, CI/CD, and DevOps.
- Experience with Oracle, SQL Server, MySQL, or Teradata.
- Understanding of Cloud Security, IAM, Data Modeling, and Agile methodologies.
Skills & Qualifications
- AWS Cloud Services
- Databricks & Apache Spark
- Python, SQL & Spark SQL
- ETL/ELT & Data Integration
- Informatica IDMC
- Data Warehousing & Data Lakes
- Terraform & CloudFormation
- CI/CD & DevOps
- Oracle / SQL Server / MySQL / Teradata
- Power BI / Tableau
- Cloud Security & IAM
- Strong analytical, problem-solving, and communication skills