Overview

We are looking for an experienced Data Engineer (Microsoft Fabric) to design, develop, and maintain scalable data pipelines and modern data solutions using Microsoft Fabric.

Key Responsibilities

• Perform data analysis to understand source systems and business requirements.
• Translate requirements into scalable data models and pipeline designs.
• Build and maintain batch and incremental data ingestion pipelines into Microsoft Fabric.
• Develop scripts to ingest data from databases, flat files, and APIs.
• Design and implement Bronze, Silver, and Gold data layers.
• Build end-to-end ETL/ELT pipelines and reporting-ready datasets.
• Implement data quality checks, validation, logging, alerting, and error handling.
• Design self-healing pipelines with retry mechanisms and failure recovery.
• Optimize pipeline performance and troubleshoot production issues.
• Work with CI/CD and DevOps practices across Dev, Test, and Production environments.
• Develop and debug solutions using PySpark and SQL.
• Collaborate with Business, BI, and Architecture teams to deliver end-to-end data solutions.

Required Skills

• Microsoft Fabric
• ETL/ELT Pipeline Development
• PySpark
• SQL
• Data Modeling
• API & Database Integration
• CI/CD & DevOps
• Data Quality & Performance Optimization

Qualifications

• Experience: 8+ Years
• Openings: 1
• Work Timings: 1:30 PM – 10:30 PM IST
• Duration: 3 Months (Extendable)
• Location: Remote