Data Engineer – Azure Databricks (Corporate Data Platform)

We are hiring a Data Engineer with strong Azure Databricks and Azure Data Engineering experience to build and scale enterprise data pipelines across corporate functions including Finance, Compliance, Facilities, RESO, and HCG.

This role focuses on modern cloud data engineering, ETL/ELT pipelines, and enterprise system integration within a large-scale Azure data ecosystem.

NYC area (Hybrid – 3 days onsite per week)

Responsibilities

Design, build, and maintain Azure Databricks + Azure Data Factory pipelines
Develop ETL/ELT workflows for structured and unstructured data
Build scalable data models and lakehouse architectures
Integrate enterprise systems (ServiceNow, Workday, Dataverse, APIs)
Optimize SQL queries, Spark jobs, and data processing performance
Ensure data governance, security, and data quality standards
Support monitoring, troubleshooting, and pipeline reliability
Collaborate across business and technical teams

Required Skills

5+ years in Data Engineering / Cloud Data Engineering
Strong hands-on experience with Azure, Databricks, Spark
Advanced SQL and large-scale data processing
Experience with Azure Data Factory
Strong programming in Python or Scala
Experience with Azure SQL Database
Familiarity with APIs, event-driven architecture, and system integration
Experience with Azure Functions
Working knowledge of C# and/or PowerShell
Strong communication and stakeholder management skills

Nice to Have

Delta Lake / Lakehouse architecture
Azure DevOps / CI-CD pipelines
Data governance / catalog tools (e.g., Purview)
Agile/Scrum environment experience
Microsoft or Databricks certifications

Why This Role

High-impact enterprise data platform work
Exposure across multiple business domains
Opportunity to shape modern Azure Databricks architecture
Strong focus on scalability, engineering excellence, and innovation

Learn more about this Employer on their Career Site