Leave us your email address and we'll send you all the new jobs according to your preferences.
DevOps Engineer - Kafka Services
Posted 2 hours 53 minutes ago by Consol Partners
Contract
Not Specified
Other
Luxembourg, Luxembourg
Job Description
Job Title: DevOps Engineer - Kafka
Duration: 12months + Contract (Possible Extensions)
Location: Luxembourg (Onsite)
Role Overview:
- We are looking for a highly skilled DevOps Engineer to take ownership of the Kafka service within our IT ecosystem.
- The ideal candidate will be responsible for implementing and maintaining Kafka infrastructure to ensure high availability, scalability, and performance.
- This role requires deep expertise in Apache Kafka, strong automation skills, and experience managing distributed data streaming platforms in a complex enterprise environment
Key Accountabilities:
- Kafka Administration & Operations: Deploy, configure, monitor, and maintain Kafka clusters in a high-availability production environment.
- Performance Optimization: Tune Kafka configurations, partitions, replication, and producers/consumers to ensure efficient message streaming.
- Infrastructure as Code (IaC): Automate Kafka infrastructure deployment and management using Terraform, Ansible, or similar tools.
- Monitoring & Incident Management: Implement robust monitoring solutions (eg, Dynatrace) and troubleshoot performance bottlenecks, latency issues, and failures.
- Security & Compliance: Ensure secure data transmission, access control, and compliance with security best practices (SSL/TLS, RBAC, Kerberos).
- CI/CD & Automation: Integrate Kafka with CI/CD pipelines and automate deployment processes to improve efficiency and reliability.
- Capacity Planning & Scalability: Analyze workloads and plan for horizontal scaling, resource optimization, and failover strategies.
- Collaboration: Work closely with development teams to support Kafka-based applications and ensure seamless data flow.
- Training and technical support to end users and other stakeholders.
- Writing/Updating procedure.
- To contribute to the knowledge base.
- Work together as a team.
Essential Skills:
- 5+ years of experience in DevOps, Site Reliability Engineering (SRE), or Kafka administration.
- Strong hands-on experience with Apache Kafka (setup, tuning, and troubleshooting).
- Proficiency in Scripting (Python, Bash) and automation tools (Terraform, Ansible).
- Experience with cloud environments (AWS, Azure, or GCP) and Kubernetes-based Kafka deployments.
- Familiarity with Kafka Connect, KSQL, Schema Registry, and Zookeeper.
- Knowledge of logging and monitoring tools (Dynatrace, ELK, Splunk).
- Understanding of networking, security, and access control for Kafka clusters.
- Experience with CI/CD tools (Jenkins, GitLab, Argo CD).
- Ability to analyze logs, debug issues, and propose proactive improvements.
- Excellent problem-solving and communication skills.
- An ITIL qualification is an asset.
- Strong communication skills (oral/written) to interact effectively and professionally with both internal and external customers.
- Ability to work in an international/multicultural environment.
- Ability to work both independently and with other team members.
- EU citizenship.
- You can work in shifts (7 AM - 8 PM) and provide 24/7 support.
Preferred Skills:
- Experience with Confluent Kafka or other managed Kafka solutions.
- Knowledge of event-driven architectures and stream processing (Flink, Spark, Kafka Streams).
- Experience with service mesh technologies (Istio, Linkerd) for Kafka networking.
- Certifications in Kafka, Kubernetes, or cloud platforms.
Consol Partners
Related Jobs
Fitness Instructor - Colliers Wood
- London, United Kingdom
Delivery Driver
- Ayrshire, Ayr, United Kingdom, KA6 5
Fitness Professional
- West Midlands, Sutton Coldfield, United Kingdom, B72 1
Wellbeing and Activities Assistant
- £12.50 Hourly
- Berkshire, Reading, United Kingdom, RG317
Support Worker
- £24,829 Annual
- Surrey, Horley, United Kingdom, RH6 0