Data Infrastructure

Genesis

Posted 3 months ago, valid for 9 days

San Carlos, CA 94070, US

Competitive

Full Time

By applying, a Sonicjobs account will be created for you. Sonicjobs's Privacy Policy and Terms & Conditions will apply.

Sonic Summary

The job involves designing, building, and maintaining large-scale data pipelines for robotics foundation model training and evaluation at a petabyte scale.
Candidates should have a minimum of 8 years of extensive experience in creating and managing large-scale data pipelines.
The role requires strong software engineering skills in languages such as Python or Go, and a deep understanding of distributed systems like Spark or Kafka.
Experience with data storage technologies, including data lakes and object stores like S3, is also essential, along with familiarity with production-grade infrastructure like Kubernetes and Terraform.
The salary for this position is competitive, and a bonus is available for candidates with experience in supporting AI systems, particularly embodied AI like self-driving.

What You’ll Do

Design, build, and maintain large-scale data pipelines (batch and streaming) for robotics foundation model training and evaluation at petabyte scale
Own core data infrastructure: data model, storage systems, ingestion pipelines, transformation frameworks, and orchestration layers
Standardize data models and unify processing pipelines across real-world teleoperation and synthetic simulation datasets
Collaborate with a team of driven individuals committed to building general-purpose Physical AI

What You’ll Bring

Excellent software engineering skills (Python, Go, or similar)
Extensive experience designing, building, and maintaining large-scale data pipelines (8+ years)
Deep understanding of distributed systems (Spark, Kafka, or similar)
Extensive experience with data storage technologies (data lakes, warehouses, object stores like S3)
Experience running and maintaining production-grade infrastructure (Kubernetes, Terraform)
Bonus: Experience supporting AI systems, in particular embodied AI like self-driving

Learn more about this Employer on their Career Site

Apply now in a few quick clicks

By applying, a Sonicjobs account will be created for you. Sonicjobs's Privacy Policy and Terms & Conditions will apply.