Junior Data Infrastructure Engineer

As part of the Data Infrastructure team you will be supporting mission critical big data platforms, to ensure they are fully performant, reliable, available and secure. We call it data infrastructure engineering, also known as DataOps or Database Administration or SRE. The role is a mixture of development of tooling and operational support for our platforms, two aspects that go hand-in-hand. It requires attention to detail and curiousity about how the systems work under the hood, and gives you a wide base of skills from low level system tuning to general coding. We manage four main storage platforms, namely: Apache Solr (~2.2 PB), Apache HBase (~450 TB), PostgreSQL (~15 TB), Kafka (~60 TB). These platforms are all open source, written in Java, Scala or C, and we maintain in-house builds and patching of them. We use a variety of open-source and in-house developed tooling to manage these services, mostly written in Rust and Python, which run primarily on hundreds of servers in multiple data centres and in the cloud. We maintain a balance between project work and operational/ad-hoc work for all members in the team, whether they are senior or recent graduates, and your day-to-day work will be a mix of these.