CrawlJobs Logo

Senior Backend Engineer - Data Ingestion

clickhouse.com Logo

ClickHouse

Location Icon

Location:
Spain

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

The ClickPipes Platform plays a critical role in driving the growth of our company and ensuring the success of our clients by seamlessly onboarding and integrating data from diverse data sources into ClickHouse. Working at a petabyte scale and in high-velocity environments, this role offers an exceptional opportunity to solve challenging technical problems, operate with significant autonomy, and make a measurable impact.

Job Responsibility:

  • Develop and enhance integrations with various data sources including streaming platforms, databases, data lakes, and object stores
  • Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements
  • Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience
  • Participate in on-call rotations to ensure system reliability and respond to production incidents

Requirements:

  • 5+ years of relevant software development industry experience building data-intensive software solutions
  • Strong knowledge of Golang and experience with its ecosystem
  • Experience with distributed systems and microservices architecture
  • The ability to design and build robust ETL data pipelines that can handle large volumes of data reliably and efficiently
  • Understanding data replication methodologies like CDC
  • Good knowledge of cloud-native architecture and practical experience with at least one major CSP
  • Excellent communication skills and the ability to work well within a team and across engineering teams
  • Strong problem solver and have solid production debugging skills

Nice to have:

Experience with Java is a plus

What we offer:
  • Flexible work environment
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company - Every new team member who joins our company receives stock options
  • Time off - Flexible time off in the US, generous entitlement in other countries
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings – opportunities to engage with colleagues at company-wide offsites

Additional Information:

Job Posted:
December 07, 2025

Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Backend Engineer - Data Ingestion

New

Senior Data Engineer

SoundCloud is looking for a Senior Data Engineer to join our growing Content Pla...
Location
Location
Germany; United Kingdom , Berlin; London
Salary
Salary:
Not provided
soundcloud.com Logo
SoundCloud
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven experience in backend engineering (Scala/Go/Python) with strong design and data modeling skills
  • Hands-on experience building ETL/ELT pipelines and streaming solutions on cloud platforms (GCP preferred)
  • Proficient in SQL and experienced with relational and NoSQL databases
  • Familiarity with event-driven architectures and messaging systems (Pub/Sub, Kafka, etc.)
  • Knowledge of data governance, schema management, and versioning best practices
  • Understanding observability practices: logging, metrics, tracing, and incident response
  • Experience with containerization and orchestration (Docker, Kubernetes)
  • Experience deploying and managing services in cloud environments, preferably GCP, AWS
  • Strong collaboration skills and ability to work across backend, data, and product teams
Job Responsibility
Job Responsibility
  • Design, build, and maintain high-performance services for content modeling, serving, and integration
  • Develop data pipelines (batch & streaming) with cloud native tools
  • Collaborate on rearchitecting the content model to support rich metadata
  • Implement APIs and data services that power internal products, external integrations, and real-time features
  • Ensure data quality, governance, and validation across ingestion, storage, and serving layers
  • Optimize system performance, scalability, and cost efficiency for both backend services and data workflows
  • Work with infrastructure-as-code (Terraform) and CI/CD pipelines for deployment and automation
  • Monitor, debug, and improve reliability using various observability tools (logging, tracing, metrics)
  • Collaborate with product leadership, music industry experts, and engineering teams across SoundCloud
What we offer
What we offer
  • Extensive relocation support including allowances, one way flights, temporary accommodation and on the ground support on arrival
  • Creativity and Wellness benefit
  • Employee Equity Plan
  • Generous professional development allowance
  • Flexible vacation and public holiday policy where you can take up to 35 days of PTO annually
  • 16 paid weeks for all parents (birthing and non-birthing), regardless of gender, to welcome newborns, adopted and foster children
  • Free German courses at beginning, intermediate and advanced
  • Various snacks, goodies, and 2 free lunches weekly when at the office
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Radix is building the most trusted data and analytics platform in multifamily. J...
Location
Location
United States , Scottsdale
Salary
Salary:
Not provided
radix.com Logo
Radix (AZ)
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering or backend systems, with 2+ years collaborating closely with analytical or scientific practitioners
  • Experience designing at least one end-to-end data application (visualization, model pipeline, etc.) for production use
  • Strong understanding of data modeling, batch processing, and streaming systems
  • Hands-on experience with SQL/NoSQL databases, cloud storage, file-based datasets, and Infrastructure-as-code
  • Experience building or operating data pipelines on AWS cloud services (Lambda, S3, RDS, ECS)
  • Understanding of AI/LLM integration and prompt engineering fundamentals
  • Proficiency with Git/GitHub, and familiarity with Spark and Kubernetes
  • Strong problem-solving skills, ownership, and ability to identify root causes of technical debt and recurring problems
  • Demonstrated ability to translate Product/Science requirements into technical plans and hold teams accountable to delivery timelines
  • Undergraduate degree in computer science, computer engineering, software engineering, or equivalent
Job Responsibility
Job Responsibility
  • Build scalable ETL/ELT pipelines for ingesting structured and unstructured data (Excel, JSON, PDFs, APIs)
  • Design and maintain data pipelines using SQL, Python, Node.js, or TypeScript
  • Work with distributed compute systems (Spark, Kubernetes), message queues, and streaming data
  • Manage and optimize data storage in MongoDB, PostgreSQL, Redis, Snowflake, and S3
  • Develop clean, standardized data schemas and event-driven transformations
  • Integrate AI-assisted parsers, mappers, and LLM-supported transformations
  • Collaborate with backend, analytics, product, and AI teams to break down requirements into well-defined engineering problems
  • Implement monitoring, data validation, and reliability checks (DQ rules, freshness, duplication)
  • Own production readiness, including on-call responsibilities and incident follow-ups
  • Mentor engineers, conduct thorough code reviews, and introduce patterns that raise the team's technical bar
What we offer
What we offer
  • Medical, dental and vision coverage designed to support your wellbeing
  • Pre-IPO Equity
  • Performance Bonus
  • Learn From the Best
  • Build Category-Defining Products
Read More
Arrow Right
New

Senior Backend Engineer- Data Ingestion - (ClickPipes Platform)

The ClickPipes Platform plays a critical role in driving the growth of our compa...
Location
Location
United States
Salary
Salary:
133450.00 - 197200.00 USD / Year
clickhouse.com Logo
ClickHouse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant software development industry experience building data-intensive software solutions
  • Strong knowledge of Golang and experience with its ecosystem
  • Experience with distributed systems and microservices architecture
  • The ability to design and build robust ETL data pipelines that can handle large volumes of data reliably and efficiently
  • Understanding data replication methodologies like CDC
  • Good knowledge of cloud-native architecture and practical experience with at least one major CSP
  • You have excellent communication skills and the ability to work well within a team and across engineering teams
  • You are a strong problem solver and have solid production debugging skills
Job Responsibility
Job Responsibility
  • Develop and enhance integrations with various data sources including streaming platforms, databases, data lakes, and object stores
  • Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements
  • Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience
  • Participate in on-call rotations to ensure system reliability and respond to production incidents
What we offer
What we offer
  • Flexible work environment - ClickHouse is a globally distributed company and remote-friendly
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company - Every new team member who joins our company receives stock options
  • Time off - Flexible time off in the US, generous entitlement in other countries
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings – We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites
  • Fulltime
Read More
Arrow Right
New

Senior Backend Engineer - Data Ingestion

The ClickPipes Platform plays a critical role in driving the growth of our compa...
Location
Location
Canada
Salary
Salary:
Not provided
clickhouse.com Logo
ClickHouse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant software development industry experience building data-intensive software solutions
  • Strong knowledge of Golang and experience with its ecosystem
  • Experience with distributed systems and microservices architecture
  • The ability to design and build robust ETL data pipelines that can handle large volumes of data reliably and efficiently
  • Understanding data replication methodologies like CDC
  • Good knowledge of cloud-native architecture and practical experience with at least one major CSP
  • You have excellent communication skills and the ability to work well within a team and across engineering teams
  • You are a strong problem solver and have solid production debugging skills
Job Responsibility
Job Responsibility
  • Develop and enhance integrations with various data sources including streaming platforms, databases, data lakes, and object stores
  • Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements
  • Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience
  • Participate in on-call rotations to ensure system reliability and respond to production incidents
What we offer
What we offer
  • Flexible work environment
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company - Every new team member who joins our company receives stock options
  • Time off - Flexible time off in the US, generous entitlement in other countries
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings – We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites
Read More
Arrow Right
New

Senior Backend Engineer - Data Ingestion (ClickPipes)

About ClickHouse: Recognized on the 2025 Forbes Cloud 100 list, ClickHouse is on...
Location
Location
Netherlands
Salary
Salary:
Not provided
clickhouse.com Logo
ClickHouse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of industry experience building as a backend engineer
  • Golang
  • Kubernetes
  • Terraform (or comparable IaC tool)
  • cloud-native architecture
  • solid knowledge of at least one major cloud service provider
  • Customer Focus
  • Attention to Detail
  • Collaboration
  • Problem Solver
Job Responsibility
Job Responsibility
  • Enhance and scale our high-performance data onboarding platform to handle increasing volumes of data in real-time
  • Own and evolve our infrastructure across multiple cloud providers (AWS, with expansion to GCP and Azure)
  • Drive improvements to our deployment pipelines, infrastructure automation, and operational processes
  • Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience
  • Participate in on-call rotations to ensure system reliability and respond to production incidents
  • Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements
What we offer
What we offer
  • Flexible work environment
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company
  • Time off
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings
Read More
Arrow Right
New

Senior Backend Engineer - Data Ingestion

The ClickPipes Platform plays a critical role in driving the growth of our compa...
Location
Location
United Kingdom
Salary
Salary:
Not provided
clickhouse.com Logo
ClickHouse
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of industry experience building as a backend engineer
  • Golang
  • Kubernetes
  • Terraform (or comparable IaC tool)
  • cloud-native architecture
  • solid knowledge of at least one major cloud service provider
  • Customer Focus
  • Attention to Detail
  • Collaboration
  • Problem Solver
Job Responsibility
Job Responsibility
  • Enhance and scale our high-performance data onboarding platform to handle increasing volumes of data in real-time
  • Own and evolve our infrastructure across multiple cloud providers (AWS, with expansion to GCP and Azure)
  • Drive improvements to our deployment pipelines, infrastructure automation, and operational processes
  • Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience
  • Participate in on-call rotations to ensure system reliability and respond to production incidents
  • Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements
What we offer
What we offer
  • Flexible work environment
  • Healthcare - Employer contributions towards your healthcare
  • Equity in the company
  • Time off
  • A $500 Home office setup if you’re a remote employee
  • Global Gatherings
Read More
Arrow Right
New

Senior Backend Engineer (Analytics)

At hyperexponential, we're building the AI-powered platform that enables the wor...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
hyperexponential.com Logo
hyperexponential
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Built production backend systems with proven experience as a polyglot engineer, ideally with strong Kotlin skills and the ability to work effectively across multiple languages and tech stacks
  • Delivered scalable cloud infrastructure using AWS and infrastructure-as-code tools like Terraform, with hands-on experience building distributed systems that handle real-world data volumes
  • Developed data warehousing solutions with hands-on experience building ETL pipelines, data modelling, and orchestration workflows using modern tools (e.g., dbt, Airflow, Spark), demonstrating the ability to transform raw data into reliable, performant analytics infrastructure that supports business decision-making at scale
  • Collaborated effectively across teams to deliver features that customers actually use, with evidence of translating business requirements into technical solutions that drive measurable impact
  • Maintained high code quality standards with a commitment to clean, well-documented, maintainable systems and the discipline to build infrastructure that scales with business growth
  • Demonstrated curiosity about emerging technologies, particularly around data processing, analytics platforms, and AI/ML tools that can enhance developer productivity and unlock new customer value.
Job Responsibility
Job Responsibility
  • Build scalable data systems in Kotlin that enable insurers to ingest, process, and explore complex datasets, turning months of manual analysis into real-time insights that drive billion-dollar risk decisions
  • Design distributed analytics infrastructure on AWS using Terraform, creating robust, cloud-native systems that handle enterprise-scale data volumes while maintaining reliability and performance
  • Deliver customer-facing analytics features that transform how users understand and optimise risk modelling, building intuitive interfaces for complex portfolio analytics that were previously impossible
  • Drive technical innovation in data architecture, piloting emerging technologies and AI/ML approaches that continuously improve the analytics experience and unlock new capabilities for customers
  • Collaborate across disciplines with Product, UX, and Engineering teams to translate complex business requirements into elegant technical solutions that balance powerful functionality with usability
  • Elevate system quality through robust architecture decisions, comprehensive testing, and clear documentation that makes complex data systems maintainable and scalable as the team grows.
What we offer
What we offer
  • £5,000 training and conference budget for individual and group development
  • 25 days of holiday plus 8 bank holidays (33 days total)
  • Company pension scheme via Penfold
  • Mental health support and therapy via Spectrum.life
  • Individual wellbeing allowance via Juno
  • Private healthcare insurance through AXA
  • Income protection and Life Insurance
  • Cycle to Work Scheme
  • Top-spec equipment (laptop, screens, adjustable desks, etc.)
  • Regular remote and in-person hackathons, lunch and learns, socials, and game nights
  • Fulltime
Read More
Arrow Right
New

Senior Software Engineer, Wikidata Platform

The Wikimedia Foundation is seeking a Senior Software Engineer to join the team ...
Location
Location
Salary
Salary:
141352.00 - 175725.00 USD / Year
wikimediafoundation.org Logo
Wikimedia Foundation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience as a backend or platform engineer working on distributed systems or data platforms
  • Deep understanding of database and knowledge graph representation technologies and standards
  • Proficiency in Java, C++, or other systems languages. Ability to set up, scale, and investigate systems is more important than expertise in a particular language.
  • Experience building and operating production-grade services with SLOs
  • Familiarity with modern observability tools (metrics, logging, tracing)
  • Understanding of graph databases, search indexes, or data processing pipelines
  • Ability to work collaboratively across disciplines and communicate clearly across technical and non-technical audiences
  • A commitment to learning, resilience, and contributing to a mission-driven engineering culture
Job Responsibility
Job Responsibility
  • Design, build, and maintain backend systems and APIs that power Wikidata’s query infrastructure
  • Improve reliability, observability, and automation of the Wikidata Query Service and data pipelines
  • Collaborate with SRE, data engineers, and product teams to ensure stability and scalability under growing usage
  • Monitor production systems, respond to operational incidents, and proactively identify and resolve bottlenecks
  • Support platform migrations and system upgrades (e.g., triple stores, streaming ingestion)
  • Contribute to deployment automation, CI/CD workflows, and service instrumentation
  • Participate in code reviews, design discussions, and technical planning
  • Document systems and share knowledge with team members and Wikimedia’s broader technical community
  • Fulltime
Read More
Arrow Right
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.