Lead Data Engineer - Snowflake, ELT with SQL, Python.
Hybrid working - 1 day per week in central London.
£90-110k DoE
This small, world-class, healthcare scale-up is seeking a topflight Lead Data Engineer to take ownership of its data engineering team, data pipelines and warehouses.
This is a key role within the company, mixing technical - developing ELT pipelines and warehouses based around Snowflake - and team leadership.
The company’s mobile, web and data products are live in 12 countries and 8 languages, spanning 3 AWS regions. Their business is growing very strongly.
The role will suit a high-energy, pro-active, Data Engineer with expertise gained in fast moving, agile, start-up/scale-up environments.
Requirements:
- 8+ years' experience in architecting, developing, scaling and monitoring complex data pipelines
- Expert in cloud data platforms e.g. Snowflake, Databricks, BigQuery, Redshift
- Expert in SQL and Python
- Strong understanding of data development best practices
- Strong understanding of design patterns and architectural best practices
- Experience of mentoring other data engineers and analysts
Responsibilities:
- Owner and lead developer of the company data pipelines and warehouses, based around Snowflake
- Completing the process to move legacy ETL pipelines from Python, SQL, PostgreSQL, Airflow to Snowflake ELT
- Owning data quality, availability and security
- Proactively analysing and improving the quality of data products - including performance, scalability, maintainability, test coverage and documentation
- Striving to implement best practices for data development, establishing and documenting standards across UK and US data teams
- Working with internal and external teams around raw data ingestion (e.g. from EMRs)
- Leading on all hiring into the data team
- Mentoring other Data Engineers
Benefits include:
- Pension contributions
- Private healthcare
- Annual training budget
- Flexible hybrid working and home-working set-up allowance