Data Engineer

Job Description: Senior / Lead Azure Data Engineer (6+ Years)

Job Description

**mandatory

SN

Required Information

Details

Role**

Azure Data Engineer

Required Technical Skill Set**

Azure DataBricks, Pyspark. ADLS, Synapse

Desired Experience Range**

6+ Yrs Exp

Location of Requirement

Bangalore , Chennai

Desired Competencies (Technical/Behavioral Competency)

Must-Have**

(Ideally should not be more than 3-5)

• 3+ years of relevant experience in Pyspark and Azure Databricks.
• 1+ year of exp in Synapse Analytics
• Proficiency in integrating, transforming and consolidating data from various structured and unstructured data sources.
• Good experience in SQL or native SQL query languages.
• Strong experience in implementing Databricks notebooks using Python.
• Good experience in Azure Data Factory, ADLS, Storage Services, Synapse, Serverless architecture, Azure functions.

Good-to-Have

• Strong knowledge of Data management principles.
• Good experience in SSIS/ETL transformation processes.
• Experience in Azure DevOps and CI/CD deployments
• Strong problem solving and analytical skills.
• Experience with Agile development methodologies.

Microsoft Azure certifications (such as DP203) are preferred.

SN

Responsibility of / Expectations from the Role

1

This role will provide an opportunity for the candidate to work with a team of developers and designers that are responsible for developing applications on Azure Data tech stack

2

Ideal candidates need to be creative problem solvers, self-motivated and tenacious when tackling tough issues and will have to contribute to process improvements by bringing in new ideas and techniques to enhance the design and development process.

3

Collaboratively working with the project data team members on projects and tasks. Self-driven learning of technologies