

Search by job, company or skills
Key Skills:
▪ Lead a team of data engineers in managing day-to-day BAU operations, production support, incident management, and platform stability.
▪ Strong AWS knowledge in terms of designing new architecture and providing optimized solutions for existing ones. (S3, Glue, DMS, MWAA, AMS, IAM).
▪ In-depth knowledge with respect to Snowflake and its architecture.
▪ Prefer prior Experience in BAU environment.
▪ Good knowledge on Airflow and MWAA.
▪ Hands-on experience in SQL/Python/Pyspark.
▪ Expertise in optimizing techniques in cloud environments.
▪ Should have the vision on data strategy and able to deliver the same.
▪ Should be able to lead the design and implementation of data management processes, including data sourcing, integration, and transformation.
▪ Able to manage and lead a team of data professionals, providing guidance, mentoring and foster a collaborative and innovative team culture focused on continuous improvement.
▪ To evaluate and recommend data-related technologies, tools, and platforms.
▪ Collaborate with IT teams to ensure seamless integration of data solutions.
▪ Should have experience in Implementing and enforcing data security protocols and ensure compliance with relevant regulations.
Required Qualifications:
▪ At least 8+ years of Data Engineer Experience
▪ Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field.
▪ At least 5+ years of recent hands-on professional experience (actively coding) working as a Lead handling support & production issue.
▪ 2+ experience with large scale datasets, data lake and data warehouse technologies such as AWS Redshift, Google BigQuery, Snowflake. Snowflake is highly preferred.
Job ID: 151766449
Skills:
MDM - Reference data management, Java, Bteq, Ranger, Hadoop Ecosystem, Apache Spark, Kafka, Impala, Hive, Performance Optimization, GCFR shell scripts, ATLAS, Flink, Teradata, Iceberg, Data Pipeline Orchestration, ETL Framework Automation Development, Data Integration CDC, QueryGrid, Trino, ETL ELT Development using Informatica Power Center, Nifi
Skills:
Unix, Hadoop, Pyspark, Apache Spark, Sql, ELT, Big Data Technologies, Git, Linux, Data Lake, Python, Etl, Enterprise Data Warehouse, Lakehouse architecture
Skills:
data engineering , Data Modelling, Pyspark, Sql, Devops, Git, Gcp, Data Governance, Azure, Python, AWS, Data Quality Frameworks, Streaming Data Processing, Databricks Platform, Workspace AI Agent, Delta Lake
Skills:
Performance Tuning, Kafka, TigerGraph, Tensorflow, Pytorch, Kinesis, Neo4j, Terraform, Data Modelling, Python, AWS, Cloudformation, Gcp, Azure, JanusGraph, scikit-learn, Query optimisation, Graph database concepts, Amazon Neptune, Neo4j Bloom, Link Prediction, Node Embeddings, Community Detection, Path finding algorithms, Indexing, Cypher query language
Skills:
Aws Cloud, Cicd, Databricks, Informatica, Etl, Ml, Ms Sql, Mysql, Oracle, Terradata, Ai, iac