Senior Data & Analytics Lead

As a Data Engineer II, you will be leading the effort to develop, enhance, and support existing and new data pipelines, data ingestions, data storage, and traditional Data-warehouse/BI systems across medium and large sized projects concurrently. 

You will support our software developers, database architects, data analysts and data scientists on vital initiatives and ensure optimal data delivery architecture consistent throughout ongoing projects. You will have the opportunity to influence our data and analytics roadmap by constant interactions with various business and technology teams. 

You will lead the design of vital components and suggest/implement new frameworks and tools based on industry and technological trends and advances. You will also consult with process owners in reviewing, interpreting & developing systems in accordance with user requirements and ensuring code quality through proper documentation, best practices, and code reviews. Working in our collaborative environment, you will further develop your skills while also acting as a mentor and technical guide to other associate data engineers.

Responsibilities:

•  Be the primary contact and lead support associate for multiple critical projects/data pipelines and integrations and resolve customer issues in a timely manner

•  Collaborate with technical/business leaders, product owners, software engineers, data architects and data analysts to acquire and understand requirements / acceptance criteria

•  Participate in defining Data Engineering Process and Technology strategies. 

•  Provide day-to-day task leadership and project reviews.

•  Assemble large, complex data sets that meet functional / non-functional business requirements

•  Produce deliverables for medium to large sized projects with clean, well-documented and easily maintainable code that adheres to defined coding standards

•  Design and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

•  Build and leverage the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources both on premise and cloud

•  Partner with cross functional teams to build analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics

•  Participate in building data security and data governance guidelines

•  Ensure solution is sustainable across implementation and use, troubleshooting and analyzing open issues and bug-fixes and ensuring on-time delivery and hand-offs

•  Communicate status and issues to team members and stakeholders

•  Participate in Design and Deploy Tollgate reviews and gain buy in from cross-functional teams including QA, Architect, Security, Webmaster and Operations

•  Contribute and Influence the discovery and decision-making process when changes to standards and technology are required (tools, conventions and design patterns)

•  Assign projects and review deliverables from onshore and offshore software engineers      

•  Provide constructive input to department management regarding team members assigned to project                    

•  Independently conduct new hire interviews

•  Design and manage models to handle large datasets of existing structured and unstructured data

•  Research and discover new methods to acquire data, and new applications for existing data

•  Stay current with rapidly developing Data Engineering landscape and share knowledge internally and with customers

•  Create recommendations for increasing data utilization based on understanding of data delivery environment

•  Other duties as assigned