Data Pipeline Development: Design, develop, and maintain efficient data pipelines using tools like Azure Data Factory and Databricks to process large volumes of data.
Database Management: Utilize strong experience with Relational Database Management Systems (RDBMS) and solid SQL (MSSQL) programming skills, including performance tuning and query optimization.
Data Integration: Collaborate with cross-functional teams to integrate data from multiple sources, ensuring seamless data flow and accessibility.
Data Quality Assurance: Implement data validation processes to ensure the accuracy and reliability of data across all platforms.
Collaboration: Work closely with data analysts and business stakeholders to understand data requirements and deliver solutions that meet business objectives.
Qualifications
Experience: Minimum of 2 years in data engineering development.
Technical Skills:
Proficient in SQL development with expertise in MSSQL.
Hands-on experience with data platforms such as Azure Data Explorer, Azure Synapse Analytics, and Databricks.
Familiarity with ETL/ELT processes and tools like Azure Data Factory.
Soft Skills:
Fast learner with the ability to adapt to new technologies quickly.
Collaborative team player who thrives in a cross-functional environment.
Open-minded and proactive in identifying opportunities for improvement.
