Search Jobs

Search by job, company or skills

7-10 Years
SGD 9,000 - 12,000 per month
  • Posted 52 minutes ago
  • Be among the first 10 applicants

Job Description

Data Engineer -

. Hands-on production experience with Apache Doris (or a comparable MPP OLAP engine -

StarRocks, ClickHouse, Greenplum).

. Strong, deep SQL expertise - complex analytical queries, window functions, CTEs, query

optimization.

. Solid understanding of Doris architecture (FE/BE), the three data models

(Duplicate/Aggregate/Unique), partitioning, bucketing, and tablet/replica management.

. Experience with Apache Iceberg (or comparable open table formats - Delta Lake, Hudi) and

lakehouse / external-catalog federation.

. Practical experience with Snowflake and/or Apache Spark- enough to read, understand, and

migrate existing workloads.

. Understanding of distributed / MPP query execution: join distribution, runtime filters, memory

management, and data skew.

. Hands-on production experience with Trino (or PrestoSQL/Presto)

. Understanding of distributed query execution: MPP architecture, join distribution, memory/spill behaviour,

partition pruning, and predicate pushdown

. Experience with cloud object storage and columnar file formats (Parquet, ORC)

. Proficiency in at least one programming language (Python, Java, or Scala) for tooling, UDFs, and

Automation

. Version control (Git) and CI/CD for data pipelines.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Apache Iceberg

Parquet

ClickHouse

StarRocks

Hudi

Apache Doris

PrestoSQL

Trino

Delta Lake

Similar Jobs

12-14 yrs
Bengaluru, India, Remote
Skills:
, Spark, Databricks, Sql, Emr, Kafka, Hive, Redshift, Athena, Scalable data pipelines, Airflow, Micro-services architecture, Streaming pipelines, Flink, Column stores, AWS data services, Apache projects, Relational Databases
7-10 yrs
India, Remote
Skills:
Databricks, Python, Devops, Apache Spark, Pyspark, Azure DevOps, Microsoft Azure Cloud
3-13 yrs
Remote
Skills:
Data Engineer, Python, Sql, Pandas, BigQuery, Etl, Docker, Polar
8-10 yrs
INR 116,667 - 137,500 per month
Remote
Skills:
Python, Sql, Spark, Data Warehousing, Apache Kafka, AWS, Data Modeling, Docker, Big Data, ETL Processes
10-14 yrs
Remote
Skills:
data engineering , Gcp, BigQuery, DataFlow, Dataproc, Pyspark, Python, Sql, Pub/Sub, dbt