CrawlJobs Logo

Staff Software Engineer, Spark (Java)

cloudera.com Logo

Cloudera

Location Icon

Location:
Hungary , Budapest

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises. The Data Platform Pillar is the bedrock of Cloudera’s technology, where we design and build the core components that let our customers store, manage, and process data with unmatched scalability, security, and performance. Cloudera is seeking a Staff Software Engineer, Spark (Java) with strong distributed systems expertise to work on the Cloudera distribution of Apache Spark and Livy. The role involves building enterprise-grade systems for customers running Spark on thousands of nodes and processing petabytes of data. We are looking for a passionate engineer eager to enhance a product already supporting major production systems and to drive the next-generation Data Engineering experience. You will collaborate with a distributed team across the United States and Hungary, including multiple Apache Spark committers.

Job Responsibility:

  • Design new features for Cloudera’s data engineering experience, and take them from prototypes to leading a team to deliver the feature in production at scale
  • Contribute to Apache Spark, Livy
  • Develop new features in Scala/Java/Python on a modern platforms
  • Gain expertise in distributed data processing, from SQL planners and optimizers, to data layout and table formats like Apache Parquet and Iceberg, to fault tolerance in distributed systems
  • Gain a solid understanding and deep technical knowledge of components across the Cloudera Data Engineering Experience stack, but focusing on Iceberg and Spark
  • Get to work on large scale distributed systems, from 100s to 1000s of nodes, in production clusters
  • Debug system level deployment issues, root cause analysis, perform system test analysis and resolve failures
  • Work on improving internal infrastructure
  • Collaborate with other team members and stakeholders

Requirements:

  • 6+ years professional software development
  • Experience leading and delivering complex product enhancements
  • Strong understanding of at least one of the following languages: Java, Scala, Python
  • Experience with systems design, development
  • Passionate about programming, clean coding habits, attention to detail, and focus on quality
  • Strong oral and written communication skills
  • Strong ability to research and solve problems independently without constant supervision
  • Open-minded, desire to learn new things and build great products
  • Experience with distributed systems

Nice to have:

  • Experience with SQL planners
  • Experience with using/developing Apache Spark, Livy or other related technologies
  • Experience with large-scale, distributed systems design and development with an understanding of scaling, performance, and scheduling
  • Solid experience with at least one cloud
What we offer:
  • Generous PTO Policy
  • Support work life balance with Unplugged Days
  • Flexible WFH Policy
  • Mental & Physical Wellness programs
  • Phone and Internet Reimbursement program
  • Access to Continued Career Development
  • Comprehensive Benefits and Competitive Packages
  • Paid Volunteer Time
  • Employee Resource Groups

Additional Information:

Job Posted:
January 26, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Staff Software Engineer, Spark (Java)

Senior Staff Software Engineer

As a Senior Staff Software Engineer, you will join a highly performing team of e...
Location
Location
United States , New York
Salary
Salary:
156400.00 - 225000.00 USD / Year
siriusxm.com Logo
SiriusXM
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree in Computer Science/Mathematics or a similar field
  • 12+ years of software engineering experience in Java programming language (preferably JDK17 or higher)
  • 5+ years of experience developing and designing data applications and data pipelines
  • 7+ years of experience crafting microservices and scalable products, utilizing diverse cloud platforms (ideally AWS)
  • Strong understanding of engineering software processes, lifecycle methodology, configuration management, release management, and system verification and testing
  • Ability to work independently and oversee entire projects or significant parts, focusing on completing the tasks on time
  • Proven ability to research and become proficient in new technologies
  • Strong analytical and problem-solving skills, with meticulous attention to detail and a dedication to continuous improvement
  • Proficiency in constructing detailed software architecture diagrams
  • Interpersonal skills and ability to interact and work with staff at all levels
Job Responsibility
Job Responsibility
  • Design and build high-performance, reliable, and scalable reporting APIs and data pipelines
  • Lead high-level architecture discussions and planning sessions work with ad measurement, revenue and addressability data
  • Work with various teams of engineers building software in a collaborative development process
  • Execute tasks with utmost clarity and precision, demonstrating a strong sense of ownership and providing clear direction to drive projects forward effectively
  • Collaborate with the Product team to clarify the scope of the projects by giving thoughtful feedback which challenges and clarifies requirements intent
  • Collaborate with the Global Operations and Cloud Infrastructure teams to ensure flawless production deployments and support the Incident Management team
  • Responsible for conducting technical interviews as needed, ensuring a consistently high bar for engineering excellence and performance standards
  • Responsible for mentoring and guiding junior engineers.
What we offer
What we offer
  • discretionary short-term and long-term incentives
  • Fulltime
Read More
Arrow Right

Staff /Sr Staff/ Principal Engineer - Lakehouse

Balbix is the world's leading platform for cybersecurity posture automation. Usi...
Location
Location
India , Bangalore; Gurgaon
Salary
Salary:
Not provided
balbix.com Logo
Balbix
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in backend software development dealing with large scale applications involving large scale data
  • Proven experience in defining and improving application design and architecture
  • Drive to discover and learn the required new technologies
  • Exposure to state of the art technologies for large scale data systems
  • Proficiency in programming languages such as Python, Scala or Java
  • Hands-on experience with large scale technologies such as Apache Spark, Apache Flink, Cassandra
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform
  • Bachelor's or Master's degree in Computer Science, Engineering, or related field
  • Excellent problem-solving and analytical skills
  • Strong communication and collaboration skills
Job Responsibility
Job Responsibility
  • Collaborate with product managers, data scientists, and other stakeholders to understand requirements and translate them into technical solutions
  • Design, develop, and deploy high scale systems using state of the art technologies
  • Build reliable, consistent and high throughput data services and interfaces
  • Mentor junior developers and contribute to knowledge sharing within the team
  • Help define and ensure the best practices and guidelines across the systems
  • Optimize and tune applications for performance and scalability
  • Troubleshoot and resolve issues in production environments
  • Fulltime
Read More
Arrow Right

Staff Data Engineer

As a Staff Data Engineer, you will be leading the architecture, design and devel...
Location
Location
United States; Canada , Remote
Salary
Salary:
Not provided
https://www.1password.com Logo
1Password
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 8+ years of professional software engineering experience
  • Minimum of 7 years technical engineering experience building data processing applications (batch and streaming) with coding in languages
  • In-depth, hands-on experience on extensible data modeling, query optimizations and work in Java, Scala, Python, and related technologies
  • Experience in data modeling across external facing product insights and business processes, such as revenue/sales operations, finance, and marketing
  • Experience with Big Data query engines such as Hive, Presto, Trino, Spark
  • Experience with data stores such as Redshift, MySQL, Postgres, Snowflake, etc.
  • Experience using Realtime technologies like Apache Kafka, Kinesis, Flink, etc.
  • Experience building scalable services on top of public cloud infrastructure like Azure, AWS, or GCP with extensive use of datastores like RDBMS, key-value stores, etc.
  • Experience leveraging distributed systems at scale and systems knowledge on infrastructure hardware, resources bare-metal hosts to containers to networking.
Job Responsibility
Job Responsibility
  • Design, develop, and automate large-scale, high-performance batch and streaming data processing systems to drive business growth and enhance product experience
  • Build data engineering strategy that supports a rapidly growing tech company and aligns with the priorities across our product strategy and internal business organizations’ desire to leverage data for more competitive advantages
  • Build scalable data pipelines using best-in-class software engineering practices
  • Develop optimal data models for storage and retrieval, meeting critical product and business requirements
  • Establish and execute short and long-term architectural roadmaps in collaboration with Analytics, Data Platform, Business Systems, Engineering, Privacy and Security
  • Lead efforts on continuous improvement to the efficiency and flexibility of the data, platform, and services
  • Mentor Analytics & Data Engineers on best practices, standards and forward-looking approaches on building robust, extensible and reusable data solutions
  • Influence and evangelize high standard of code quality, system reliability, and performance.
What we offer
What we offer
  • Maternity and parental leave top-up programs
  • Generous PTO policy
  • Four company-wide wellness days
  • Company equity for all full-time employees
  • Retirement matching program
  • Free 1Password account
  • Paid volunteer days
  • Employee-led inclusion and belonging programs and ERGs
  • Peer-to-peer recognition through Bonusly
  • Fulltime
Read More
Arrow Right

Senior Staff Software Engineer

As a Senior Staff Software Engineer, you will join a highly performing team of e...
Location
Location
United States , Oakland; Washington; Atlanta; New York; Irving
Salary
Salary:
156400.00 - 225000.00 USD / Year
siriusxm.com Logo
SiriusXM
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s Degree in Computer Science/Mathematics or a similar field
  • 8+ years of software engineering experience in Java programming language (preferably JDK17 or higher)
  • 5+ years of experience developing and designing data applications and data pipelines
  • 8+ years of experience crafting microservices and scalable products, utilizing diverse cloud platforms (ideally AWS)
  • Strong understanding of engineering software processes, lifecycle methodology, configuration management, release management, and system verification and testing
  • Ability to work independently and oversee entire projects or significant parts, focusing on completing the tasks on time
  • Proven ability to research and become proficient in new technologies
  • Strong analytical and problem-solving skills, with meticulous attention to detail and a dedication to continuous improvement
  • Proficiency in constructing detailed software architecture diagrams
  • Interpersonal skills and ability to interact and work with staff at all levels
Job Responsibility
Job Responsibility
  • Design and build high-performance, reliable, and scalable reporting APIs and data pipelines
  • Lead high-level architecture discussions and planning sessions work with ad measurement, revenue and addressability data
  • Work with various teams of engineers building software in a collaborative development process
  • Execute tasks with utmost clarity and precision, demonstrating a strong sense of ownership and providing clear direction to drive projects forward effectively
  • Collaborate with the Product team to clarify the scope of the projects by giving thoughtful feedback which challenges and clarifies requirements intent
  • Collaborate with the Global Operations and Cloud Infrastructure teams to ensure flawless production deployments and support the Incident Management team
  • Responsible for conducting technical interviews as needed, ensuring a consistently high bar for engineering excellence and performance standards
  • Responsible for mentoring and guiding junior engineers.
What we offer
What we offer
  • Discretionary short-term and long-term incentives
  • Fulltime
Read More
Arrow Right

Applications Development Senior Group Manager

This role will be part of the Risk Data team and is a senior management level po...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong academic record, ideally with a Bachelor’s or Master’s degree in Computer Science or engineering or related technical discipline
  • Proven experience in enterprise application development with full stack technologies
  • Strong Architect and hands on technical experience in implementing large volume real time complex solutions in Big Data Platforms & Public Cloud platforms
  • Experience in Data architecture, strong Software development fundamentals, data structures, design patterns, object-oriented principles
  • Experience in design and delivery of multi-tiered applications and high performance server side components
  • Skills on system performance tuning, high performance, low latency, multithreading and experience with Java server side programming
  • Preferred experience in Handling high volumes of data and working with In-memory databases and Caching solutions
  • Experience of building and leading teams, ideally with a global resource profile and demonstrated ability to deliver large projects efficiently and on time
  • Significant experience in large Financial Services Technology services companies is expected for this position
  • Hands-on development, architecture and leadership experience in real-time data engineering platforms implementation
Job Responsibility
Job Responsibility
  • Lead the efforts in Institutional Data Platform (ICG) that span multiple businesses, products and functions
  • Delivery of Price Risk related Data initiatives and Capital reporting (GSIB) related deliverables
  • Establish strong relationships with the global business stakeholders and ensure transparency of project deliveries
  • Actively identify and manage risks and issues, working with disparate teams to create mitigation plans and follow-through to resolution
  • Adhere to all key Project Management (PMQC) & Engineering Excellence standards
  • Ensure timely communications to Senior Technology Management and Business Partners in Front Office, Middle Office & other Operations functions
  • Drive the design and development of system architecture, work with end-users of the systems, and enhance the quality of deliverables
  • Ensure staff follows Citi documented policy and procedures as well as maintain desktop procedures and supporting documentation for filings on a current basis and in comprehensive manner
  • Ensure change is managed with appropriate controls, documentation, and approvals including implementation of new and revised regulatory reporting requirements
  • Manage and maintain all disaster recovery plans, oversee appropriate testing, and provide permit-to-operate for new applications
What we offer
What we offer
  • 27 days annual leave (plus bank holidays)
  • A discretional annual performance related bonus
  • Private Medical Care & Life Insurance
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right

Cloud Developer

HPE Aruba Networking Central offers enhanced network visibility, streamlined net...
Location
Location
United States , San Jose
Salary
Salary:
117500.00 - 270000.00 USD / Year
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in computer science, Information Systems, or equivalent
  • 2-4 years of work experience in Cloud Development
  • Strong analytical and problem-solving skills
  • Software applications testing methodology, including writing and execution of test plans, debugging, and testing scripts and tools
  • Excellent written and verbal communication skills
  • mastery in English and local language
  • 6+ months of hands-on experience with Cloud, Containers, Kubernetes, Distributed Systems
  • Programming experience in Java
  • Experience in Python is a plus
  • Experience in ArangoDB and ClickHouse is a plus
Job Responsibility
Job Responsibility
  • Designs enhancements, updates, and programming changes for portions and subsystems of end-user applications software running on local, networked, and Internet- based platforms
  • Analyzes design and determines coding, programming, and integration activities required based on general objectives and knowledge of overall architecture of product or solution
  • Writes and executes complete testing plans, protocols, and documentation for assigned portion of application
  • identifies and debugs and creates solutions for issues with code and integration into application architecture
  • Leads a project team of other software applications engineers and internal and outsourced development partners to develop reliable, cost effective and high-quality solutions for assigned applications portion or subsystem
  • Collaborates and communicates with management, internal, and outsourced development partners regarding software applications design status, project progress, and issue resolution
  • Represents the software applications engineering team for all phases of larger and more-complex development projects
  • Provides guidance and mentoring to less- experienced staff members
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right
New

Staff Software Engineer

The Model Development Lifecycle Team is building a cutting-edge platform to simp...
Location
Location
United States
Salary
Salary:
200000.00 - 250000.00 USD / Year
Domino Data Lab
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience developing and managing high-performance back-end systems in distributed computing environments
  • Working closely with cross-functional teams to integrate systems with front-end interfaces and third-party services
  • Designing and implementing secure, scalable APIs (e.g., RESTful APIs, gRPC)
  • Profiling and optimizing back-end performance, especially in cloud environments or with container technologies like Docker and Kubernetes.
  • Using robust testing frameworks (unit, integration, end-to-end) and setting up CI/CD pipelines
  • Familiarity with model registries, versioning, and lifecycle management tools like MLflow or KubeFlow is a big plus
  • Experience with frameworks like Apache Spark, Azure ML, or SageMaker is a plus
  • Proficiency with cloud providers (AWS, Azure, GCP) and deploying services in these environments
  • Expertise in languages such as Python, Java, Scala, or Go
Job Responsibility
Job Responsibility
  • Integrate model monitoring to provide a holistic view of deployment health and performance
  • Enhance tagging capabilities across Domino entities to improve discoverability and tracking
  • Expand LLM hosting capabilities to address customer needs for scale, performance, and logging
  • Innovate within our Domino Apps offering by incorporating feature requests from major customers
What we offer
What we offer
  • equity
  • company bonus or sales commissions/bonuses
  • 401(k) plan
  • medical, dental, and vision benefits
  • wellness stipends
  • Fulltime
Read More
Arrow Right
New

Shuttle driver

This Class A CDL Shuttle Driver position will support the KDP Essex, VT Distribu...
Location
Location
United States , Essex
Salary
Salary:
30.41 - 31.93 USD / Hour
keurigdrpepper.com Logo
Keurig Dr Pepper
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High school diploma or general equivalency diploma (GED)
  • Lift, push, and pull up to 50lbs
  • 1 Year of CDL Class A Experience
  • Clean Driving Record
Job Responsibility
Job Responsibility
  • Moving Trailers between the yard and the loading dock
  • Moving and Placing Trailer Stands
  • Securing and Inspecting loads
  • Vehicle Pre and Post Use Inspections
  • Maintain cleanliness in assigned area
  • Responsibility to report food safety, quality and regulatory compliance to plant or division personnel with authority to initiate action
  • Performs other duties as requested by management
  • Follow all Keurig Dr Pepper policies and procedures
What we offer
What we offer
  • Benefits eligible day one
  • Medical
  • Dental
  • Vision
  • Disability
  • Paid Time Off (including vacation and sick time)
  • 401k with company match
  • Tuition Reimbursement
  • Mileage Reimbursement
  • Fulltime
Read More
Arrow Right