Role Summary

The Senior Kafka Administrator / Developerwill design, build, operate and improve enterprise Kafka and event-streamingplatforms across AWS and Kubernetes, including Amazon EKS. The role requiresstrong hands-on Kafka administration, integration development, cloud-nativeoperations and production support experience.

The role works closely with application,integration, cloud, security and operations teams to deliver reliableevent-driven solutions, resolve complex issues, automate repeatable tasks andsupport platform lifecycle, governance and service improvement activities.

Key Responsibilities

· Administer and support Kafkaplatforms, including brokers, topics, partitions, replication, consumer groups,Kafka Connect, Schema Registry and related services.

· Design and develop Kafkaproducers, consumers, stream-processing components and reusable integrationpatterns using Java, Spring Boot, Python or similar technologies.

· Deploy, operate and improveKafka and supporting components on Kubernetes and Amazon EKS using Helm, CI/CD,GitOps and approved cloud-native patterns.

· Manage platform reliability,resilience, capacity, performance, patching, upgrades, backup, recovery andlifecycle activities across production and non-production environments.

· Troubleshoot complex issuesacross applications, brokers, connectors, schemas, networking, storage,certificates and cloud infrastructure.

· Implement monitoring, alertingand dashboards for broker health, throughput, latency, replication, disk usage,consumer lag and connector health.

· Apply security and governancecontrols, including TLS, authentication, authorisation, ACLs, secrets,certificates, least-privilege access and vulnerability remediation.

· Support incidents, problems,changes and releases, including root-cause analysis, runbook improvement andautomation of recurring operational tasks.

· Guide application teams ontopic design, partitioning, message contracts, schema evolution, retries,dead-letter handling, idempotency and supportability.

· Maintain architecture,configuration, operational, recovery and support documentation.

Technical Leadership

· Act as the senior technicalpoint of contact for Kafka platform design, engineering and operationalmatters.

· Mentor engineers, reviewtechnical work and promote consistent engineering and operational standards.

· Lead planning for upgrades,migrations, resilience improvements and platform modernisation.

· Communicate risks,dependencies, options and recommendations clearly to technical and businessstakeholders.

Key Skills & Experience

Technical Experience

· Strong hands-on experienceadministering Apache Kafka or Confluent Platform in complex enterpriseenvironments.

· Solid understanding of Kafkabrokers, topics, partitions, replication, consumer groups, Kafka Connect,Schema Registry and MirrorMaker.

· Experience developing Kafkaproducers, consumers and integration services using Java, Spring Boot, Pythonor equivalent technologies.

· Hands-on experience withKubernetes and Amazon EKS, including Docker, Helm, storage, networking,ingress, secrets and identity integration.

· Working knowledge of AWSservices such as EKS, EC2, S3, IAM, CloudWatch, Route 53 and core networkingservices.

· Experience with CI/CD, GitOpsand Infrastructure as Code tools such as Jenkins, Argo CD, Terraform orCloudFormation.

· Strong Linux, networking, TLS,DNS, certificate and distributed-systems troubleshooting capability.

· Experience with observabilitytools such as Prometheus, Grafana, CloudWatch, Dynatrace, Splunk or equivalent.

Preferred Qualifications

Degree in Information Technology, Engineering, Computer Science, or related discipline.
AWS, Azure, ITIL, Kubernetes, Database, or relevant technology certifications.
Experience managing large-scale enterprise or government technology environments.
Experience with hybrid cloud, platformmodernization, and operational transformation programs.

Learn more about this Employer on their Career Site

Kafka Developer