SonicJobs Logo
Left arrow iconBack to search

ML / Fine-Tuning Engineer

DATAECONOMY
Posted 13 days ago, valid for 10 days
Salary

Competitive

Contract type

Full Time

Health Insurance
Life Insurance

By applying, a Sonicjobs account will be created for you. Sonicjobs's Privacy Policy and Terms & Conditions will apply.

SonicJobs' Terms & Conditions and Privacy Policy also apply.

Sonic Summary

info
  • The job title is ML / Fine-Tuning Engineer, located in Hyderabad or Pune, requiring a notice period of 0-30 days and offering a hybrid work mode.
  • Candidates should have a minimum of 5 years of experience in ML engineering, with at least 2 years specifically in LLM fine-tuning.
  • The role involves fine-tuning open-source LLMs, running SFT and RL alignment to improve accuracy, and executing training on AWS GPU instances.
  • A salary of INR 5.0 Lakhs for health insurance coverage is provided, along with benefits such as retirement plans, flexible work options, and a generous leave policy.
  • Preferred qualifications include experience with specific frameworks and distributed training methods, as well as familiarity with tool-calling tasks.
Job Title:ML / Fine-Tuning Engineer
Location: Hyderabad OR Pune
Notice Period : 0-30 Days
Mode of Work:Hybrid
Experience :5+ Years


We are looking for ML / Fine-Tuning Engineer who can deliver (under supervision of ProServe Tech Lead) the end-to-endfine-tuning of open-source LLMs for a narrow, high-volume production task onAWS — SFT and alignment experiments (GRPO, DPO), debugging training onmulti-GPU clusters, and iterating to strict accuracy targets. Models from 8B to70B parameters.

What We Expect:

  • Fine-tune open-source LLMs (Qwen, Llama) from experiment to production-ready checkpoint
  • Run SFT and RL alignment (GRPO, DPO) to improve output accuracy
  • Execute training on AWS GPU instances (p4d, p5, g5) using distributed training
  • Diagnose/fix training issues: loss imbalances, OOM errors, gradient instabilities
  • Collaborate with evaluation and data engineering to iterate on quality gaps
  • Make data-driven model scaling decisions (8B → 14B → 70B) based on offline metrics


Requirements

  • Experience: 5+ years ML engineering, with 2+ years in LLM fine-tuning
  • LLM Models: Hands-on with open-source LLMs — Qwen and Llama required
  • Training Methods: SFT, LoRA/QLoRA, GRPO, DPO/RLHF
  • Frameworks: NVIDIA NeMo/NeMoRL, VeRL, HuggingFace TRL — must have used at least two
  • Distributed Training: DeepSpeed ZeRO, FSDP2, multi-node GPU orchestration
  • AWS Infrastructure: p4d/p5/g5 GPU instances, SageMaker Training Jobs
  • Languages: Python, PyTorch; CUDA debugging a plus

Preferred (Not Required): Fine-tuning fortool-calling/agent tasks; multi-node GRPO/RLHF with NeMoRL or VeRL; tokenizerinternals and chat-template rendering for tool-use formats.



Benefits

  • Comprehensive Medical Coverage:
    Health insurance of INR 5.0 Lakhs for you and your family (up to 6 members), ensuring complete peace of mind.
  • Robust Protection Plans:
    Group Personal Accident Insurance and Group Term Life Insurance to safeguard you and your loved ones.
  • Retirement Benefits:
    PF and Gratuity provided as per standard government regulations.
  • Flexible Work Options:
    Enjoy hybrid work arrangements & flexible working hours.
  • Generous Leave Policy:
    21 days of annual leave, in addition to 10 company-declared holidays.
  • Employee Well-being Spaces:
    Access to a dedicated break-out area with round-the-clock refreshments for relaxation and rejuvenation.





Learn more about this Employer on their Career Site

Apply now in a few quick clicks

By applying, a Sonicjobs account will be created for you. Sonicjobs's Privacy Policy and Terms & Conditions will apply.

SonicJobs' Terms & Conditions and Privacy Policy also apply.