Overview

We are looking for a Senior Databricks / Azure Data Engineer with strong, recent hands-on experience in Databricks implementation projects. The candidate should have expertise in modern Databricks features and end-to-end data engineering.

Key Responsibilities

• 10+ years of overall Data Engineering experience.
• Strong recent hands-on experience with Azure Databricks.
• Experience with Lakeflow Declarative Pipelines.
• Hands-on experience with Unity Catalog and migration from legacy workspaces.
• Strong experience in Data Vault modelling and data modelling concepts.
• Excellent hands-on skills in Python, PySpark, and SQL.
• Experience with Azure Data Factory, ADLS, Azure Synapse, and Azure Blob Storage.
• Strong knowledge of ETL/ELT, Apache Spark, Kafka, and Hadoop.
• Experience with data governance and data quality.
• Understanding of cloud security including Entra ID/Azure AD, Key Vault, RBAC, and secure connectivity.
• Experience with on-premises infrastructure / clusters such as Cloudera or Hortonworks is an advantage.
• Recent end-to-end Databricks implementation experience.

Preferred Skills

• Databricks performance optimization and Delta Lake.
• Experience with Airflow, Informatica, Talend, or NiFi.
• Azure DevOps / CI-CD / Terraform.

Qualifications

Important: Prioritize candidates whose most recent project is on Databricks. Candidates with only recent Fabric, Azure, or Snowflake experience should not be prioritized unless they have strong, current hands-on Databricks implementation experience.

Other Details

• Experience: 10+ Years
• Location: Remote
• Contract: 3 Months+ Extendable
• Shift timings: 1:30 PM to 10:30 PM (IST)
• Joining: Immediate

Key Skills

Azure Databricks | Lakeflow | Unity Catalog | Data Vault | PySpark | Python | SQL | Spark | ADF | ADLS | Synapse | Delta Lake | ETL/ELT | Kafka | Data Engineering