Responsibilities
- Lead the architecture, design, and implementation ofadvanced analytics solutions using Azure Databricks and Microsoft Fabric.
- Apply deep expertise in big data technologies, dataengineering, cloud computing, Azure Databricks, and strong SQL skills todeliver scalable solutions.
- Work closely with business stakeholders and IT teams tounderstand requirements and deliver effective, business-aligned solutions.
- Oversee end-to-end implementation of data solutions,ensuring alignment with business requirements and industry best practices.
- Lead the development of data pipelines and ETL processesusing Azure Databricks, PySpark, and other relevant tools.
- Integrate Azure Databricks with Azure services such as AzureData Lake, Azure Synapse, Azure Data Factory, and on-premises systems.
- Provide expertise in Spark; Scala experience is an addedadvantage.
- Demonstrate strong Microsoft Fabric expertise, includingpipeline development, notebook development, semantic modelling, real-timeintelligence, and related scenarios.
- Provide technical leadership and mentorship to the dataengineering team, fostering a culture of continuous learning and improvement.
- Ensure proper documentation of architecture, processes, anddata flows while maintaining compliance with security and governance standards.
- Promote best practices for code quality, data security,scalability, and maintainability.
- Stay current with the latest developments in Databricks andassociated technologies to support continuous innovation.
Essential Skills
- Mandatory French-speaking capability.
- Strong experience with Azure Databricks, including clustermanagement, notebook development, and Delta Lake.
- Proficiency in big data technologies such as Hadoop andSpark, along with data processing frameworks such as PySpark.
- Deep understanding of Azure services, including Azure DataLake, Azure Synapse, and Azure Data Factory.
- Experience with Power BI, SSRS, SSAS, and SKU migration fromP-SKU to F-SKU.
- Experience with ETL/ELT processes, data warehousing, anddata lake development.
- Strong SQL skills and familiarity with NoSQL databases.
- Experience with CI/CD pipelines and version control systemssuch as Git.
- Knowledge of cloud security best practices.
Requirements
Soft Skills
- Mandatory French-speaking capability.
- Excellent communication skills, with the ability to explaincomplex technical concepts to non-technical stakeholders.
- Strong problem-solving skills and a proactive approach toidentifying and resolving issues.
- Leadership skills, with the ability to manage and mentor ateam of data engineers.
Nice-to-Have Skills
- Power BI experience for dashboarding and reporting.
- Microsoft Fabric experience for analytics and integrationtasks.
- Spark Streaming experience for processing real-time datastreams.
- Familiarity with Azure Resource Manager templates forinfrastructure as code practices.
Experience
- Demonstrated expertise of 12 years in developing dataingestion and transformation pipelines using Databricks/Synapse notebooks andAzure Data Factory.
- Solid understanding and hands-on experience with Deltatables, Delta Lake, and Azure Data Lake Storage Gen2.
- Experience using Auto Loader and Delta Live Tables forseamless data ingestion and transformation.
- Proficiency in building and optimizing query layers usingDatabricks SQL.
- Demonstrated experience integrating Databricks with AzureSynapse, ADLS Gen2, and Power BI for end-to-end analytics solutions.
- Prior experience developing, optimizing, and deploying PowerBI reports.
- Familiarity with modern CI/CD practices, especially in thecontext of Databricks and cloud-native solutions.
Â
Learn more about this Employer on their Career Site
