Home
Pune, Maharashtra
Data Engineer

Data Engineer

Agivant Technologies India Private Limited

Posted 3 days ago, valid for 13 days

Pune, Pune Division, Maharashtra

Competitive

Full Time

By applying, a Sonicjobs account will be created for you. Sonicjobs's Privacy Policy and Terms & Conditions will apply.

SonicJobs' Terms & Conditions and Privacy Policy also apply.

Sonic Summary

The position involves executing large-scale asset rationalization, pipeline migrations, and programmatic metadata implementations using various enterprise tools.
Key responsibilities include migrating and consolidating legacy dashboards and data pipelines based on usage telemetry, while also writing code for metric definitions into central catalogs via APIs.
The role requires monitoring real-time dashboards for data health and resolving issues related to pipeline freshness and volume drops within strict SLAs.
Candidates should have extensive experience with Hive, Advanced SQL, Python, and data visualization tools, as well as hands-on querying of distributed datasets.
A minimum of 5 years of experience is required, with a salary range of $100,000 to $130,000.

Mission: Execute massive-scale asset rationalization,pipeline migrations, and programmatic metadata implementations using enterprisequery, visualization, and telemetry tools.

Core Responsibilities:

• Asset Rationalization: Execute the migration,consolidation, or retirement of hundreds of legacy enterprise dashboards(Tableau, PowerBI) and data pipelines based on strict usage telemetry.

• Programmatic Definitions: Write code that pushes metricdefinitions, dimensions, and owner mapping programmatically into centralsemantic catalogs via APIs.

• Data Health Enforcement: Monitor real-time observabilitydashboards and resolve automated escalations regarding pipeline freshness lagsor volume drops within strict SLAs.

Requirements

Tech Stack & Depth:

• Core: Hive, Advanced SQL, Python for data manipulation,Airflow (or similar orchestration), Tableau / Enterprise Visualization tools.

• Depth: Hands-on querying of massive distributed datasets(Hive/Presto/Trino) and telemetry logging. Must know how to trace complex datalineage manually through code.

Good to Have / Bonus Tech Stack:

• Experience with Databricks workflows and PySpark optimization.

• Integrating automated testing in dbt.

• Utilizing AI coding assistants for rapid SQL script generation and optimization.

Learn more about this Employer on their Career Site

Apply now in a few quick clicks

By applying, a Sonicjobs account will be created for you. Sonicjobs's Privacy Policy and Terms & Conditions will apply.

SonicJobs' Terms & Conditions and Privacy Policy also apply.