Back to search
Title: Principle Data Engineer
Location: Hybrid - Once per Month Travel to office in North West.
Salary: 75,000 + Package
Role Overview:
The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management.
The Principal Data Engineer will:
lIdentify opportunities for automation and process improvement.
lMentor and guide data engineers.
lEstablish coding standards and best practices.
lImplement and document data integrity and quality checks.
lOptimize queries.
lFacilitate collaboration within the data engineering team.
lThis role involves close collaboration with the Principal Cloud Engineer and the Data Architect to ensure data pipeline designs are optimized and reliable within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are essential.
Candidate Profile:
lExtensive ETL/ELT background with experience in developing data pipelines, optimizing queries, and enhancing database performance.
lProficient in data modeling and data warehousing.
lMultiple years of experience with GCP, especially with core processing and orchestration products like BigQuery, DataFlow, DataFusion, DataStream, Cloud Functions, DataProc, and Airflow/Composer.
lStrong problem-solving skills and a meticulous approach to code reviews.
lProven leadership qualities with the ability to uphold high standards within the team.
lExperience in managing and participating in the full development lifecycle of data products.
lDemonstrated experience in a leading role within a Data Engineering function, including directing other data engineers through the design, build, and deployment of complex data solutions and driving CI/CD implementation and adoption.
lSelf-motivated with the ability to drive innovation and mentor team members.
Experience & Skills:
l7+ years in Data Engineering.
l1+ years in a Lead/Principal Engineer role.
l3+ years of experience with GCP.
lExtensive experience with SQL and Data Lake/Warehouse solutions.
lProficiency in languages such as SQL, Python, Java, or Scala.
lIn-depth knowledge of query optimization techniques and experience in fine-tuning complex SQL queries.
lStrong understanding of Data Governance, including Data Dictionaries, MDM, Lineage, Data Legislation, and handling PII.
lExcellent communication skills and the ability to work collaboratively with cross-functional teams.
lExperience with Agile/Scrum/SDLC methodologies.
