SonicJobs Logo
Left arrow iconBack to search

Specialist - Architecture

Maarut
Posted 4 days ago, valid for 12 days
Location

Toronto, Ontario

Salary

Competitive

Contract type

Full Time

By applying, a Sonicjobs account will be created for you. Sonicjobs's Privacy Policy and Terms & Conditions will apply.

SonicJobs' Terms & Conditions and Privacy Policy also apply.

Sonic Summary

info
  • The position requires a seasoned professional with 12 years of experience in developing data ingestion and transformation pipelines using Azure Databricks and related technologies.
  • Key responsibilities include leading the architecture and implementation of advanced analytics solutions, overseeing data pipeline development, and providing technical leadership to the data engineering team.
  • The candidate must possess strong expertise in big data technologies, cloud computing, and SQL, with a mandatory requirement for French-speaking capability.
  • The role offers a competitive salary, reflecting the expertise and experience required to deliver scalable and effective data solutions aligned with business needs.
  • Familiarity with Azure services, ETL processes, and modern CI/CD practices is essential for success in this position.

Responsibilities

  • Lead the architecture, design, and implementation ofadvanced analytics solutions using Azure Databricks and Microsoft Fabric.
  • Apply deep expertise in big data technologies, dataengineering, cloud computing, Azure Databricks, and strong SQL skills todeliver scalable solutions.
  • Work closely with business stakeholders and IT teams tounderstand requirements and deliver effective, business-aligned solutions.
  • Oversee end-to-end implementation of data solutions,ensuring alignment with business requirements and industry best practices.
  • Lead the development of data pipelines and ETL processesusing Azure Databricks, PySpark, and other relevant tools.
  • Integrate Azure Databricks with Azure services such as AzureData Lake, Azure Synapse, Azure Data Factory, and on-premises systems.
  • Provide expertise in Spark; Scala experience is an addedadvantage.
  • Demonstrate strong Microsoft Fabric expertise, includingpipeline development, notebook development, semantic modelling, real-timeintelligence, and related scenarios.
  • Provide technical leadership and mentorship to the dataengineering team, fostering a culture of continuous learning and improvement.
  • Ensure proper documentation of architecture, processes, anddata flows while maintaining compliance with security and governance standards.
  • Promote best practices for code quality, data security,scalability, and maintainability.
  • Stay current with the latest developments in Databricks andassociated technologies to support continuous innovation.

Essential Skills

  • Mandatory French-speaking capability.
  • Strong experience with Azure Databricks, including clustermanagement, notebook development, and Delta Lake.
  • Proficiency in big data technologies such as Hadoop andSpark, along with data processing frameworks such as PySpark.
  • Deep understanding of Azure services, including Azure DataLake, Azure Synapse, and Azure Data Factory.
  • Experience with Power BI, SSRS, SSAS, and SKU migration fromP-SKU to F-SKU.
  • Experience with ETL/ELT processes, data warehousing, anddata lake development.
  • Strong SQL skills and familiarity with NoSQL databases.
  • Experience with CI/CD pipelines and version control systemssuch as Git.
  • Knowledge of cloud security best practices.


Requirements


Soft Skills

  • Mandatory French-speaking capability.
  • Excellent communication skills, with the ability to explaincomplex technical concepts to non-technical stakeholders.
  • Strong problem-solving skills and a proactive approach toidentifying and resolving issues.
  • Leadership skills, with the ability to manage and mentor ateam of data engineers.

Nice-to-Have Skills

  • Power BI experience for dashboarding and reporting.
  • Microsoft Fabric experience for analytics and integrationtasks.
  • Spark Streaming experience for processing real-time datastreams.
  • Familiarity with Azure Resource Manager templates forinfrastructure as code practices.

Experience

  • Demonstrated expertise of 12 years in developing dataingestion and transformation pipelines using Databricks/Synapse notebooks andAzure Data Factory.
  • Solid understanding and hands-on experience with Deltatables, Delta Lake, and Azure Data Lake Storage Gen2.
  • Experience using Auto Loader and Delta Live Tables forseamless data ingestion and transformation.
  • Proficiency in building and optimizing query layers usingDatabricks SQL.
  • Demonstrated experience integrating Databricks with AzureSynapse, ADLS Gen2, and Power BI for end-to-end analytics solutions.
  • Prior experience developing, optimizing, and deploying PowerBI reports.
  • Familiarity with modern CI/CD practices, especially in thecontext of Databricks and cloud-native solutions.

 






Learn more about this Employer on their Career Site

Apply now in a few quick clicks

By applying, a Sonicjobs account will be created for you. Sonicjobs's Privacy Policy and Terms & Conditions will apply.

SonicJobs' Terms & Conditions and Privacy Policy also apply.