Lead Data Engineer

Apply now »

Date: 8 Jan 2025

Location: India, India

Company: Singtel Group

Category

Essential for this role

Good to have

 

  
  •  

Work Experience
  • Minimum 10 years of experience in data analytics field
  • Minimum 6 years of experience in running operation and support in Cloud Data Lakehouse environment
  • Experience with Azure Databricks
  • Experience in building and optimizing data pipelines, architectures and data sets
  • Excellent experience in Scala or Python
  • Ability to troubleshoot and optimize complex queries on the Spark platform
  • Knowledgeable on structured and unstructured data design / modeling, data access and data storage techniques
  • Experience with DevOps tools and environment
  • Data Engineering expertise in Big Data Management using Cloudera, Python, Hive, Scala, Data Warehouse, Data Lake

 

 

Technical / Professional Skills

Please provide at least 3
  • Azure Databricks
  • Python / Scala / Java
  • HIVE / HBase / Impala / Parquet
  • Sqoop, Kafka, Flume
  • SQL and RDBMS
  • Airflow
  • Jenkins / Bamboo
  • Github / Bitbucket
  • Nexus