Azure Data Engineer

Prodapt is the largest specialized player in the Connectedness industry. As an AI-first strategic technology partner, Prodapt provides consulting, business reengineering, and managed services for the largest telecom and tech enterprises building networks and digital experiences of tomorrow. A ServiceNow-invested company, Prodapt has been recognized by Gartner as a Large, Telecom-Native, Regional IT Service Provider. A “Great Place To Work® Certified™” company, Prodapt employs over 5,000 technology and domain experts across the Americas, Europe, India, Africa, & Japan. Prodapt is part of the 130-year-old business conglomerate The Jhaver Group, which employs over 32,000 people across 80+ locations globally.

We are seeking a highly skilled Azure Data Engineer with deep expertise in Microsoft Fabric to design, implement, and optimize our next-generation data analytics platform. In this role, you will lead the transition and development of end-to-end data pipelines within a unified SaaS analytics environment. You will leverage the full power of OneLake, Lakehouses, and PySpark notebooks to build scalable, high-performance architectures that transform raw data into actionable enterprise insights.

Responsibilities:

• Fabric Architecture Design: Architect and deploy end-to-end data engineering solutions leveraging the Microsoft Fabric ecosystem including OneLake, Lakehouses, Warehouses, and Streamhouses.
• Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines using Fabric Datafactory, Pipelines, and Dataflows Gen2.
• Data Processing & Transformation: Write complex, optimized data transformation scripts using PySpark, Spark SQL, and Python within Fabric Notebooks.
• Modern Data Warehousing: Implement a Medallion Architecture (Bronze/Silver/Gold layers) inside OneLake utilizing Delta Lake formats for Delta Live Tables.
• Performance Tuning: Optimize query speeds and pipeline performance through strategic file partitioning, indexing, and workspace capacity management.
• Data Modeling & Analytics Integration: Construct and optimize Fabric Semantic Models to ensure seamless, high-performance integration with Power BI reporting.
• Governance & Security: Enforce enterprise data security using Fabric RBAC, Azure Key Vault, Managed Identities, and Microsoft Purview for metadata lineage.
• DevOps Integration: Implement CI/CD workflows using Git integration and Azure DevOps to automate code deployment across development, testing, and production environments.

Required Skills & Qualifications

• Education: Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related technical field.
• Core Experience: Minimum 3+ years of professional experience in Azure Data Engineering, with at least 1 year of dedicated hands-on experience working directly inside Microsoft Fabric.
• Tech Stack Mastery:
• Languages: Advanced proficiency in SQL, Python, and PySpark.
• Fabric Components: Deep knowledge of Fabric Lakehouse, Dataflows Gen2, Shortcuts, and Fabric Notebooks.
• Legacy Azure Services: Solid background in traditional Azure data stack tools like Azure Data Factory (ADF), Azure Synapse Analytics, and ADLS Gen2.
• Methodologies: Strong comprehension of Kimball data warehousing methodologies, dimensional modeling, and Delta Lake frameworks.