Back to search
As a Software Dev Engineer on the Evaluations & Optimization team, you will build state-of-the-art systems that help customers assess the quality, performance, and reliability of Agents and build state of the art solutions for agents optimization. You will define and deliver foundational infrastructure and developer tooling that powers evaluation workflows for some of the world’s most advanced GenAI and Agentic systems.
Our work spans deep learning, large-scale distributed systems, and evaluation science workflows. We work closely with applied scientists, product managers, and UX designers to deliver services that are robust, extensible, and easy to use for developers and enterprise customers alike.
Key job responsibilities
• Design and implement core runtime infrastructure components including control plane APIs, data plane execution environments, and deployment orchestration systems
• Develop monitoring, observability, and operational tooling to ensure production reliability and enable rapid incident response
• Collaborate with AWS Lambda, Bedrock, and open-source framework teams (LangChain, LangGraph, Strands) to integrate and optimize agent capabilities
• Contribute to technical strategy and architecture decisions for session management, identity/permissions, cross-account access, and security integrations
About the team
Agentic AI drives innovation at the forefront of artificial intelligence, enabling customers to transform their businesses through cutting-edge AI solutions. We build and deliver the foundational AI services that power the future of cloud computing, helping organizations harness the potential of AI to solve their most complex challenges. Join our dynamic team of AI/ML practitioners, applied scientists, software engineers, and solution architects who work backwards from customer needs to create agentic technologies. If you're passionate about shaping the future of AI while making a meaningful impact for customers worldwide, we want to hear from you.
Basic Qualifications: - 1+ years of non-internship professional software development experience
- Experience programming with at least one software programming language Preferred Qualifications: - Bachelor's degree in computer science or equivalent
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, Seattle - 143,700.00 - 194,400.00 USD annually
Learn more about this Employer on their Career Site
