Data Engineer

Your new companyYou will be working for a welcoming and engaging organisation which is currently going through a comprehensive data transformation programme, designed to establish a robust approach to modernising the use and management of all data, to inform decision-making and support regulatory activity. Your new roleAs a data engineer, you will help build and maintain the data infrastructure and systems that collect, manage and transform raw data for onward use by data analysts and data scientists. You will implement efficient data systems that are aligned appropriately to business goals, and will make all the organisation's data accessible to be used in support of relevant aspects of the organisation. Key responsibilities:

• Working to Extract, Transform and Load (ETL) data sets from a variety of data sources across the enterprise technology stack.
• Monitoring the execution of data workflows, including identifying and mitigating risks, setting service level indicators and configuring alerts.
• Adopting data governance best practice when processing raw data to develop, test and maintain datasets, including the use and maintenance of relevant resources (such as, but not limited to, a data catalogue, data dictionary, logical data models).
• Supporting continuous data quality improvements across the organisation by exploring enhancements to: automated quality assurance processes; the reliability of data workflows; and the effectiveness of data transformations.
• Applying dimensional data modelling concepts and practices across the'organisation's data to develop conceptual, logical and physical data models that support efficiency and effectiveness of business operations
• Advocating and supporting an evidence-led culture across the organisation, assisting with driving enhancements to the organisation's data capability

What you'll need to succeedTo be successful in this role, you will be:

• Adaptable, with a willingness to work flexibly as the needs of the organisation evolve.
• Able to work well within a team, and able to work closely with internal and external stakeholders.
• Able to take a logical and analytical approach, and to take a pragmatic, collaborative approach to solving problems.
• Experienced in organising, manipulating, understanding and optimising data structures through data management tools and analytical programming, and of designing and running complex processes from beginning to end.
• Adept at communicating technical concepts to a non-technical audience.

You will need the following technical skills:

• Knowledge of modern tools and methodologies that help shape the organisation's ability to provide business insight.
• Good knowledge of the Microsoft Azure data ecosystem
• Strong contemporary Microsoft data solution and development skills
• A comprehensive knowledge of database design and development, data management and systems integration
• Knowledge of automation testing as part of a data engineering pipeline
• Knowledge of software development approaches, disciplines and best practice
• Awareness of how data is used by Analysts, Data Scientists and in Business Intelligence tools (Power BI, Tableau)
• Experience using Cloud services (primarily Azure)
• Experience using ETL tools (SSIS, Data Factory)
• Experience using APIs to send and receive data.
• Good knowledge of code management principles and experience using source Control Management tools, such as Azure DevOps, Git
• Experience connecting datasets together from a variety of sources (XML, JSON, SQL, CSV).
• Experience of developing and supporting data warehouse modelling.
• Experience scripting data pipelines in Python & T-SQL
• Experience of developing and delivering data services through Continuous Integration, Continuous Delivery practices
• Experience of effective delivery, working to Agile methodologies.

What you'll get in returnIn return you will receive a competitive annual salary and a flexible hybrid working set up, requiring you to be in the office 1-2 times per month. You will also have the opportunity to gain valuable experience developing a cloud data ecosystem, utilising the full Microsoft data solution and getting hands on experience across various technologies.What you need to do nowIf you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion on your career.

Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at hays.co.uk