CrawlJobs Logo

DevOps Engineer – Kafka Service

https://www.soprasteria.com Logo

Sopra Steria

Location Icon

Location:
Luxembourg , Leudelange

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

We are looking for a highly skilled DevOps Engineer to take ownership of the Kafka service within our IT ecosystem. The ideal candidate will be responsible for implementing, and maintaining Kafka infrastructure to ensure high availability, scalability, and performance. This role requires deep expertise in Apache Kafka, strong automation skills, and experience managing distributed data streaming platforms in a complex enterprise environment.

Job Responsibility:

  • Kafka Administration & Operations: Deploy, configure, monitor, and maintain Kafka clusters in a high-availability production environment
  • Performance Optimization: Tune Kafka configurations, partitions, replication, and producers/consumers to ensure efficient message streaming
  • Infrastructure as Code (IaC): Automate Kafka infrastructure deployment and management using Terraform, Ansible, or similar tools
  • Monitoring & Incident Management: Implement robust monitoring solutions (e.g., Dynatrace) and troubleshoot performance bottlenecks, latency issues, and failures
  • Security & Compliance: Ensure secure data transmission, access control, and compliance with security best practices (SSL/TLS, RBAC, Kerberos)
  • CI/CD & Automation: Integrate Kafka with CI/CD pipelines and automate deployment processes to improve efficiency and reliability
  • Capacity Planning & Scalability: Analyze workloads and plan for horizontal scaling, resource optimization, and failover strategies

Requirements:

  • 5+ years of experience in DevOps, Site Reliability Engineering (SRE), or Kafka administration
  • Strong hands-on experience with Apache Kafka (setup, tuning, and troubleshooting)
  • Proficiency in scripting (Python, Bash) and automation tools (Terraform, Ansible)
  • Experience with cloud environments (AWS, Azure, or GCP) and Kubernetes-based Kafka deployments
  • Familiarity with Kafka Connect, KSQL, Schema Registry, Zookeeper
  • Knowledge of logging and monitoring tools (Dynatrace, ELK, Splunk)
  • Understanding of networking, security, and access control for Kafka clusters
  • Experience with CI/CD tools (Jenkins, GitLab, ArgoCD)
  • Ability to analyze logs, debug issues, and propose proactive improvements
  • Excellent problem-solving and communication skills
  • An ITIL qualification is an asset

Nice to have:

An ITIL qualification

What we offer:

Work among high-level professionals at the forefront of corporate software solutions and innovation at Europe’s Leading Digital Service Provider

Additional Information:

Job Posted:
June 18, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for DevOps Engineer – Kafka Service

DevOps Engineer

We are looking for a skilled and proactive Middle DevOps Engineer to join our te...
Location
Location
Latvia , Riga
Salary
Salary:
Not provided
omnic.net Logo
OMNIC
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2–3+ years in a DevOps Engineer role
  • Strong hands-on experience with Docker
  • At least 1–2 years of production-level Kubernetes experience (including Helm)
  • AWS Required (EC2, Lambda, ECS, EKS, VPC, Subnets, Security Groups, NACLs, Route 53, ALB/NLB, S3, EBS, EFS, RDS (PostgreSQL), ElastiCache (Redis), MSK (Kafka), CloudWatch, CloudTrail, IAM, Organizations, SQS, SNS)
  • GCP a Plus
  • Proven experience with GitLab CI or similar tools
  • Experience with AWS CodePipeline/CodeBuild is a plus
  • Familiarity with Prometheus, Grafana, ELK Stack, Loki, Promtail
  • Strong proficiency in Terraform (CloudFormation is a plus)
  • Solid understanding of networking protocols (TCP/IP, HTTP/S, DNS) and security
Job Responsibility
Job Responsibility
  • Monitor system performance and ensure high availability
  • Deploy and support new services in production
  • Automate development and infrastructure processes (CI/CD, deployment, rollback)
  • Troubleshoot and resolve infrastructure and application incidents
  • Maintain and improve Kubernetes clusters and AWS resources
  • Handle infrastructure tasks like setting up VPNs with partner environments and provisioning new project environments
  • Collaborate with Dev, QA, and PM teams
  • Maintain and update infrastructure documentation
What we offer
What we offer
  • Competitive salary and monthly bonuses based on performance
  • Collaborative team environment focused on innovation
  • Professional growth opportunities through cross-functional training and mentorship programs
  • Participation in meaningful projects that promote sustainable business transformation
  • Flexible working conditions with a hybrid/onsite model
  • Fulltime
Read More
Arrow Right

Sr Staff/Principal Devops Engineer

Balbix is looking for a DevOps Sr Staff/Principal Engineer to join our growing t...
Location
Location
India , Delhi
Salary
Salary:
Not provided
balbix.com Logo
Balbix
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or a related field
  • 10+ years of experience in DevOps for Sr Staff or 12-15 years for Principal
  • 4+ years of experience setting up and managing infrastructure in AWS for a product development organization
  • Ability to independently architect, design, document, and implement complex platforms and complex DevOps systems
  • Solid understanding of AWS infrastructure and services such as load balancers (ALB/ELB), IAM, KMS, Networking, EC2, CloudWatch, CloudTrail, CloudFormation, Lambda, etc.
  • 4+ years of experience building infrastructure using Terraform
  • 3+ years of solid experience with Kubernetes and Helm
  • Expert-level programming experience with Python for scripting and automation
  • Excellent knowledge of working on configuration management systems such as Ansible
  • Hands-on experience with CI/CD code management and deployment technologies like GitLab, Jenkins, or similar
Job Responsibility
Job Responsibility
  • Lead the development of critical DevOps projects, set technical direction, and influence the organization's technical strategy
  • Solve complex problems, mentor senior engineers, and collaborate with cross-functional teams to deliver high-impact DevOps solutions
  • Design and develop IaC components for Balbix solutions and internal engineering tools running in AWS
  • Build and deploy a state-of-the-art security SaaS platform using the latest CI/CD techniques, ensuring it is fully automated, repeatable, and secure
  • Secure infrastructure using best practices (e.g., TLS, bastion hosts, certificate management, authentication and authorization, network segmentation)
  • Design and develop a scalable, cost-efficient deployment infrastructure on Kubernetes
  • Design and implement consistent observability systems for Balbix solutions
  • Participate in on-call rotation
  • Fulltime
Read More
Arrow Right

Senior DevOps Engineer - ElasticSearch Admin

You will be part of a high-performing team, leading and executing to enable grow...
Location
Location
Germany , Berlin
Salary
Salary:
Not provided
auto1.com Logo
AUTO1 Group
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience administrating Elasticsearch clusters (5+ Data nodes)
  • Knowledge of planning and executing data retention and life cycle management, Index and Datastream mappings, as well as ML and transform jobs
  • Hands-on experience in operations of sizing, monitoring, and management, for Kafka, Logstash, Beats, Kibana, and Elastic Agent
  • Experience with queuing systems and data streams in production (SQS, ActiveMQ, Kinesis, Kafka or similar)
  • Familiarity with programming languages such as: PHP and/or Python and/or Java
  • 4+ years of experience in administering/developing/DevOps in a Linux/Unix environment
  • AWS Expert
  • Experience in creating CI/CD pipelines preferably using Jenkins
  • Experience with docker orchestration engines (ECS, Kubernetes, swarm, UCP, etc)
  • Significant experience with Docker, Terraform, or CloudFormation
Job Responsibility
Job Responsibility
  • Maintenance, support, and ongoing performance enhancements on multiple Elastic instances
  • Performing system upgrades, troubleshooting, and resolving infrastructure and system issues, as well as log ingestion and communication issues
  • Design and develop scalable, robust, and high-performance data pipelines and data storage solutions
  • Develop and maintain observability frameworks using tools like Kibana, Grafana, or similar
  • Work with cross-functional teams to define observability and search requirements
  • Scale, script and maintain our development and production platform foundation with AWS and GCP
  • Stay updated on the newest tools and (cloud) services
  • Perform database backups, migrations, and upgrades as needed
  • Discuss and evangelize for new technologies and best practices amongst and outside of your team
What we offer
What we offer
  • Relocation support to Germany which includes visa assistance, apartment search and help with costs
  • Educational budget for your personal growth
  • Above-average corporate pension plan
  • Work from home up to 5 days a week
  • Truly international and diverse working environment with more than 90 different nationalities
  • Fulltime
Read More
Arrow Right

Senior DevOps Cloud Engineer

A Senior DevOps Cloud Engineer in the HPE Networking Business designs, develops ...
Location
Location
United States , Roseville
Salary
Salary:
133500.00 - 307000.00 USD / Year
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in computer science, engineering, information systems, or closely related quantitative discipline
  • typically, 10+ years’ experience
  • proven track record of designing, implementing, and supporting multi-tier architectures in an enterprise scale organization
  • experience leading teams of engineers, providing technical direction and oversight
  • strong programming skills in Python
  • experience with Tcl, C/C++, and JavaScript a plus
  • good understanding of distributed systems, event-driven programming paradigms, and designing for scale and performance
  • experience with cloud-native applications, developer tools, managed services, and next-generation databases
  • knowledge of DevOps practices like CI/CD, infrastructure as code, containerization, and orchestration using Kubernetes, Redis, Kafka
  • good written and verbal communication skills and agile in a changing environment.
Job Responsibility
Job Responsibility
  • Analyses new or enhancement feature requests and determines the required coding, testing, and integration activities
  • designs and develops moderate to complex software modules per feature specifications adhering to quality and security policies
  • identifies debugs and creates solutions for issues with code and integration into application architecture
  • develops and executes comprehensive test plans for features adhering to performance, scale, usability, and security requirements
  • deploys cloud-based systems and application code using continuous integration/deployment (CI/CD) pipelines to automate cloud applications' management, scaling, and deployment
  • contributes towards innovation and integration of new technologies into projects
  • analyzes science, engineering, business, and other data processing problems to develop and implement solutions to complex application problems, system administration issues, or network concerns.
What we offer
What we offer
  • Comprehensive suite of benefits that supports physical, financial and emotional wellbeing
  • programs catered to helping you reach career goals
  • unconditional inclusion in the workplace.
  • Fulltime
Read More
Arrow Right

Director, Service Reliability Engineering

As Director of SRE, you will lead the team responsible for accelerating and auto...
Location
Location
United States , Bethesda
Salary
Salary:
125600.00 - 203700.00 USD / Year
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Undergraduate degree in computer science, software engineering, or a related field (or equivalent experience)
  • 10+ years of experience in SRE, devsecops or IT operations
  • At least 5 years’ experience in a previous leadership role within SRE, devsecops or IT Operations
  • At least five years of experience in the following technologies - Presentation Management: HTML, CSS, JS, Backbone, Node JS, Android, iOS, Application Platforms: NGINX, Java, Akana, Play Framework, Tomcat, Docker, Openshift, Application Data: PostgreSQL, Couchbase, Cassandra, Integration Services: Apache Kafka, Apache Spark, Akana, Analytics Platforms: Hadoop, dashDB, Cognos, Tableau, Security: Forgerock, OpenID, OAUTH, Ping Identity, Public Cloud: Azure, Google Cloud, AliCloud, Amazon Web Services, CI/CD: Harness
  • Experience with test automation
  • Working knowledge and proven track record of implementing disaster indifferent architecture
  • Experience with CDN and Akamai tools
  • Linux/Unix system administration experience
  • Proficient in scripting and programming languages (like Python, Go, Bash, Shell)
  • Hands on experience with infrastructure as code (like Terraform), container orchestration (like Kubernetes), and reliability automation
Job Responsibility
Job Responsibility
  • Define and execute Marriott’s SRE vision, aligning with business objectives and technology roadmaps
  • Build, mentor and lead a high-performing SRE team, fostering a culture of collaboration and innovation
  • Establish reliability, observability and automation goals to improve system uptime, performance and scalability
  • Partner with engineering, operations and security teams to drive best practices and continuous improvement
  • Implement reliability-focused engineering practices, including SLAs, SLOs/SLIs and error budgets
  • Design and maintain resilient, scalable and fault-tolerant architectures across cloud and hybrid environments
  • Develop strategies to proactively identify and mitigate risks to system performance and availability
  • Drive root cause analysis (RCA) and post-mortem processes to prevent recurring incidents
  • Champion automation in monitoring, deployment and incident resolution to reduce toil and enhance efficiency
  • Lead and optimize incident response processes, ensuring rapid detection, diagnosis, and resolution of system failures
What we offer
What we offer
  • Bonus program
  • comprehensive health care benefits
  • 401(k) plan with up to 5% company match
  • employee stock purchase plan at 15% discount
  • accrued paid time off (including sick leave where applicable)
  • life insurance
  • group disability insurance
  • travel discounts
  • adoption assistance
  • paid parental leave
  • Fulltime
Read More
Arrow Right

Principal Software Engineer

Principal Software Engineer (Golang | Distributed Systems) to join a high-growth...
Location
Location
United Kingdom , London
Salary
Salary:
170000.00 GBP / Year
weareorbis.com Logo
Orbis Consultants
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years’ backend engineering experience, ideally at Staff / Principal / Tech Lead level
  • Expert-level proficiency with Golang in production
  • Proven track record designing distributed systems and event-driven architectures (Kafka, RabbitMQ, WebSockets)
  • Deep understanding of PostgreSQL, Redis, and high-performance data systems
  • Strong DevOps mindset – CI/CD, infrastructure as code, observability (Grafana, Prometheus, OpenTelemetry)
  • Exceptional communicator, able to influence architecture and direction across teams
Job Responsibility
Job Responsibility
  • Architect and scale high-throughput, event-driven systems built in Go
  • Lead the evolution of real-time APIs and data platforms handling billions of requests
  • Stay deeply hands-on with Golang while influencing design and long-term technical strategy
  • Drive improvements in observability, testing, and performance across all services
  • Mentor senior engineers and play a key role in shaping engineering culture
What we offer
What we offer
  • 25% bonus
  • excellent benefits
  • Fulltime
Read More
Arrow Right

Software Engineer

TapHere! is looking for a self-starting, team-oriented Software Engineer to join...
Location
Location
United States , Chantilly
Salary
Salary:
Not provided
taphere.com Logo
TapHere! Technology
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • TS/SCI clearance
  • Bachelor’s degree in computer science, Computer Engineering, Software Engineering, Information Systems, or a related discipline and minimum 2 years of prior relevant experience
  • Active Security+ or other IAT level 2/3 certificate
  • Experience with Agile Software Development Process and Methodologies
  • Experience Java software development life cycle
  • Experience with cloud technologies such as Amazon Web Services (AWS) or GovCloud
  • Experience with PostgreSQL or similar Relational Database Management System (RDBMS)
  • Mid/Senior Linux administration experience
  • DevOps Automation experience
  • Development experience with Microservices, Kafka (or any other Java based message broker) and Kubernetes
Job Responsibility
Job Responsibility
  • Work well under pressure and have the ability to work within timelines on capabilities and technologies with a wide range of maturity levels
Read More
Arrow Right

Software Engineer

We have an immediate opening for a Software Developer to join our engineering gr...
Location
Location
Canada , Longueuil
Salary
Salary:
Not provided
aviyatech.com Logo
aviya
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s/Master’s degree in Software Engineering, or Computer Science
  • Minimum of 2-3 years’ experience in design, development and support of production-tier software application services and micro-services
  • Scrum/Agile software development and project life cycle experience
  • Experience with Azure Dev Ops, GitHub tools for software configuration management systems and version control processes
  • Strong programming skills in Java, Python
  • Strong knowledge of software development process and Object-Oriented Programming skills (Java, Python)
  • Knowledge of Message Queue Systems, especially Apache Kafka and Kafka Streams
  • AWS serverless knowledge to participate in the migration to Cloud based infrastructure
  • Proficient in MS Office, especially in Excel
  • Good oral and written communication skills in English is mandatory
Job Responsibility
Job Responsibility
  • Design and update software applications to accommodate new design proposals
  • Continuously monitor production system performance KPIs and investigate in-service open issues
  • Design and update software to implement issues/enhancements into the applications for continuous improvements
  • Create and update class diagrams and design specification documents for new developments
  • Responsible for verification procedures and unit testing in support of CI/CD
  • Collaborate with the IT department for DevOps activities, applications troubleshooting
Read More
Arrow Right