Principal Software Engineer - Data Platform Job at Arcesium (New York)

Principal Software Engineer, Trusted Data Platform

As a Principal Software Engineer, you will be a technical leader and hands-on co...

Location

India , Bangalore

Salary:

Not provided

Atlassian

Expiration Date

Until further notice

Requirements

Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related technical field
10+ years of experience in backend software development, focusing on distributed systems and storage solutions
5+ years of experience working with AWS storage services (S3, DynamoDB, EBS, EFS, FSx, Glacier)
Strong expertise in system design, architecture, and scalability for large-scale storage solutions
Proficiency in at least one major backend programming language (Kotlin, Java, Go, Rust, or Python)
Experience designing and implementing highly available, fault-tolerant, and cost-efficient storage architectures
Deep understanding of distributed systems, replication strategies, sharding, and caching
Knowledge of data security, encryption best practices, and compliance requirements (SOC2, GDPR, HIPAA)
Experience leading engineering teams, mentoring senior engineers, and driving technical roadmaps
Proficiency with observability tools, performance monitoring, and troubleshooting at scale

Job Responsibility

Designing and optimizing high-scale, distributed storage systems built on AWS storage technologies
Shaping the architecture, performance, and reliability of backend storage solutions that power critical applications at scale
Designing, implementing, and optimizing backend storage services that support high throughput, low latency, and fault tolerance
Working closely with senior engineers, architects, and cross-functional teams to drive scalability, availability, and efficiency improvements in large-scale storage solutions
Leading technical deep dives, architecture reviews, and root cause analyses to resolve complex production issues related to storage performance, consistency, and durability
Driving best practices in distributed system design, security, and cloud cost optimization
Mentoring senior engineers, contributing to technical roadmaps, and helping shape the long-term storage strategy
Collaborating with Site Reliability Engineers (SREs) to implement observability, monitoring, and disaster recovery strategies, ensuring high availability and compliance with industry standards
Advocating for automation, Infrastructure-as-Code (IaC), and DevOps best practices, leveraging tools like Terraform, AWS CloudFormation, Kubernetes (EKS), and CI/CD pipelines to enable scalable deployments and operational excellence

What we offer

Atlassians can choose where they work – whether in an office, from home, or a combination of the two
Atlassians have more control over supporting their family, personal goals, and other priorities
We can hire people in any country where we have a legal entity
Interviews and onboarding are conducted virtually
Whatever your preference - working from home, an office, or in between - you can choose the place that's best for your work and your lifestyle

Senior Principal Data Platform Software Engineer

We’re looking for a Sr Principal Data Platform Software Engineer (P70) to be a k...

Location

Salary:

239400.00 - 312550.00 USD / Year

Atlassian

Expiration Date

Until further notice

Requirements

15+ years in Data Engineering, Software Engineering, or related roles, with substantial exposure to big data ecosystems
Demonstrated experience building and operating data platforms or large‑scale data services in production
Proven track record of building services from the ground up (requirements → design → implementation → deployment → ongoing ownership)
Hands‑on experience with AWS, GCP (e.g., compute, storage, data, and streaming services) and cloud‑native architectures
Practical experience with big data technologies, such as Databricks, Apache Spark, AWS EMR, Apache Flink, or StarRocks
Strong programming skills in one or more of: Kotlin, Scala, Java, Python
Experience leading cross‑team technical initiatives and influencing senior stakeholders
Experience mentoring Staff/Principal engineers and lifting the technical bar for a team or org
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience

Job Responsibility

Design, develop and own delivery of high quality big data and analytical platform solutions aiming to solve Atlassian’s needs to support millions of users with optimal cost, minimal latency and maximum reliability
Improve and operate large‑scale distributed data systems in the cloud (primarily AWS, with increasing integration with GCP and Kubernetes‑based microservices)
Drive the evolution of our high-performance analytical databases and its integrations with products, cloud infrastructures (AWS and GCP) and isolated cloud environments
Help define and uplift engineering and operational standards for petabyte scale data platforms, with sub‑second analytic queries and multi‑region availability (coding guidelines, code review practices, observability, incident response, SLIs/SLOs)
Partner across multiple product and platform teams (including Analytics, Marketplace/Ecosystem, Core Data Platform, ML Platform, Search, and Oasis/FedRAMP) to deliver company‑wide initiatives that depend on reliable, high‑quality data
Act as a technical mentor and multiplier, raising the bar on design quality, code quality, and operational excellence across the broader team
Design and implement self‑healing, resilient data platforms with strong observability, fault tolerance, and recovery characteristics
Own the long‑term architecture and technical direction of Atlassian’s product data platform with projects that are directly tied to Atlassian’s company-level OKRs
Be accountable for the reliability, cost efficiency, and strategic direction of Atlassian’s product analytical data platform
Partner with executives and influence senior leaders to align engineering efforts with Atlassian’s long-term business objectives

What we offer

health and wellbeing resources
paid volunteer days

Fulltime

Principal Software Engineer – AI Platform

At Snorkel, we believe meaningful AI doesn’t start with the model, it starts wit...

Location

United States , Redwood City; San Francisco

Salary:

275000.00 - 300000.00 USD / Year

Snorkel AI

Expiration Date

Until further notice

Requirements

Bachelor’s degree in Computer Science or related field
12+ years of experience in designing and building customer-facing software systems for cloud-native applications
Deep experience with AI/ML frameworks and pipelines
Experience at high-growth technology startups
Experience building software products for large enterprise customers
Experience with architecting and developing production web-scale systems (including monitoring, telemetry, performance, reliability, triage, and debuggability)
Deep experience with Python, distributed computing, and cloud platforms
Passion for promoting technical communication, mentorship, and improving engineering culture

Job Responsibility

Work across teams and across the stack to deliver major new features and infrastructure
Improve our practices and culture
Align Engineering on a shared technical vision
Be a key technical advisor to company leadership
Act as a mentor and role model for every engineer
Think years ahead about how Snorkel AI can deliver on its technical mission to democratize AI through data
Take on the biggest, most ambiguous, and most rewarding challenges that arise

Fulltime

Principal Data Engineer

PointClickCare is searching for a Principal Data Engineer who will contribute to...

Location

United States

Salary:

183200.00 - 203500.00 USD / Year

PointClickCare

Expiration Date

Until further notice

Requirements

Principal Data Engineer with at least 10 years of professional experience in software or data engineering, including a minimum of 4 years focused on streaming and real-time data systems
Proven experience driving technical direction and mentoring engineers while delivering complex, high-scale solutions as a hands-on contributor
Deep expertise in streaming and real-time data technologies, including frameworks such as Apache Kafka, Flink, and Spark Streaming
Strong understanding of event-driven architectures and distributed systems, with hands-on experience implementing resilient, low-latency pipelines
Practical experience with cloud platforms (AWS, Azure, or GCP) and containerized deployments for data workloads
Fluency in data quality practices and CI/CD integration, including schema management, automated testing, and validation frameworks (e.g., dbt, Great Expectations)
Operational excellence in observability, with experience implementing metrics, logging, tracing, and alerting for data pipelines using modern tools
Solid foundation in data governance and performance optimization, ensuring reliability and scalability across batch and streaming environments
Experience with Lakehouse architectures and related technologies, including Databricks, Azure ADLS Gen2, and Apache Hudi
Strong collaboration and communication skills, with the ability to influence stakeholders and evangelize modern data practices within your team and across the organization

Job Responsibility

Lead and guide the design and implementation of scalable streaming data pipelines
Engineer and optimize real-time data solutions using frameworks like Apache Kafka, Flink, Spark Streaming
Collaborate cross-functionally with product, analytics, and AI teams to ensure data is a strategic asset
Advance ongoing modernization efforts, deepening adoption of event-driven architectures and cloud-native technologies
Drive adoption of best practices in data governance, observability, and performance tuning for streaming workloads
Embed data quality in processing pipelines by defining schema contracts, implementing transformation tests and data assertions, enforcing backward-compatible schema evolution, and automating checks for freshness, completeness, and accuracy across batch and streaming paths before production deployment
Establish robust observability for data pipelines by implementing metrics, logging, and distributed tracing for streaming jobs, defining SLAs and SLOs for latency and throughput, and integrating alerting and dashboards to enable proactive monitoring and rapid incident response
Foster a culture of quality through peer reviews, providing constructive feedback and seeking input on your own work

What we offer

Benefits starting from Day 1!
Retirement Plan Matching
Flexible Paid Time Off
Wellness Support Programs and Resources
Parental & Caregiver Leaves
Fertility & Adoption Support
Continuous Development Support Program
Employee Assistance Program
Allyship and Inclusion Communities
Employee Recognition … and more!

Fulltime

Principal Data Engineer

A VC-backed conversational AI scale-up is expanding its engineering team and is ...

Location

United States

Salary:

Not provided

Orbis Consultants

Expiration Date

Until further notice

Requirements

5+ years in software development and data engineering with ownership of production-grade systems
Proven expertise in Spark/PySpark
Strong knowledge of distributed computing and modern data modeling approaches
Solid programming skills in Python, with an emphasis on clean, maintainable code
Hands-on experience with SQL and NoSQL databases (e.g., PostgreSQL, DynamoDB, Cassandra)
Excellent communicator who can influence and partner across teams

Job Responsibility

Design and evolve distributed, cloud-based data infrastructure that supports both real-time and batch processing at scale
Build high-performance data pipelines that power analytics, AI/ML workloads, and integrations with third-party platforms
Champion data reliability, quality, and observability, introducing automation and monitoring across pipelines
Collaborate closely with engineering, product, and AI teams to deliver data solutions for business-critical initiatives

What we offer

Fully remote
great equity
the chance to join a rocketship

Fulltime

Principal Software Engineer in Test

We are seeking a highly experienced Principal Engineer – Testing to join our dyn...

Location

Brazil , São Paulo

Salary:

Not provided

Invisible Technologies

Expiration Date

Until further notice

Requirements

10+ years of experience in software quality engineering, test automation, or systems testing roles
Expertise in test automation frameworks (e.g., Pytest, Playwright, etc.) and infrastructure-as-code pipelines
Strong programming skills in Python, JavaScript/TypeScript
Experience designing and validating tests in distributed, event-driven, and microservices architectures
Familiarity with testing in AI/ML systems, including model output validation and behavior-driven testing
Experience with containerized environments (Docker), and cloud platforms (AWS/GCP/Azure)
Strong understanding of CI/CD systems (particularly Git,) and modern observability tooling (e.g., Grafana, Prometheus)
Excellent problem-solving, debugging, and documentation skills
A track record of technical leadership and mentoring in cross-functional environments

Job Responsibility

Design, implement, and own the testing architecture across the AI platform, spanning backend, APIs, data pipelines, and AI models
Build and scale automation frameworks to support unit, integration, regression, performance, and AI-specific testing
Develop test strategies that balance reliability, speed, and coverage for complex, dynamic, and data-heavy systems
Create simulation and sandbox environments to test AI workflows and orchestration logic
Integrate automated testing into CI/CD pipelines, enabling confident, rapid deployments with safety guarantees
Lead root cause analysis and implement practices that prevent regressions across systems and features
Champion a quality-balanced culture and mentor engineers in best practices for building robust, testable systems

Principal Data Engineer

We are on the lookout for a Principal Data Engineer to help define and lead the ...

Location

United Kingdom

Salary:

Not provided

Dotdigital

Expiration Date

Until further notice

Requirements

Extensive experience delivering python-based projects in the data engineering space
Extensive experience working with SQL and NoSQL database technologies (e.g. SQL Server, MongoDB & Cassandra)
Proven experience with modern data warehousing and large-scale data processing tools (e.g. Snowflake, DBT, BiqQuery, Clickhouse)
Hands on experience with data orchestration tools like Airflow, Dagster or Prefect
Experience using cloud environments (e.g. Azure, AWS, GCP) to process, store and surface large scale data
Experience using Kafka or similar event-based architectures e.g. (Pub/Sub via AWS SQS, Azure EventHubs, AWS Kinesis)
Strong grasp of data architecture and data modelling principles for both OLAP and OLTP workloads
Capable in the wider software development lifecycle in terms of agile ways of working and continuous integration/deployment of data solutions
Experience as a lead or Principal Engineer on large-scale data initiative or product builds
Demonstrated ability to architect data systems and data structures for high volume, high throughput systems

Job Responsibility

Lead the design and implementation of scalable, secure and resilient data systems across streaming, batch and real-time use cases
Architect data pipelines, model and storage solutions that power analytical and product use cases
using primarily Python and SQL via orchestration tooling that run workloads in the cloud
Leverage AI to automate both data processing and engineering processes
Assure and drive best practices relating to data infrastructure, governance, security and observability
Work with technologists across multiple teams to deliver coherent features and data outcomes
Support the data team to help adopt data engineering principles
Identify, validate and promote new tools and technologies that improve the performance and stability of data services

What we offer

Parental leave
Medical benefits
Paid sick leave
Dotdigital day
Share reward
Wellbeing reward
Wellbeing Days
Loyalty reward

Fulltime

Senior Software Engineer - Transactional Data Platform

As a Senior Software Engineer, you will play a critical role in designing, build...

Location

Australia , Sydney

Salary:

Not provided

Atlassian

Expiration Date

Until further notice

Requirements

Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related technical field
5+ years of experience in backend software development
3+ years of hands-on experience working with AWS cloud services, particularly AWS storage technologies (S3, DynamoDB, EBS, EFS, FSx, or Glacier)
3+ years of experience in designing and developing distributed systems or high-scale backend services
Strong programming skills in Kotlin
Experience working in agile environments following DevOps and CI/CD best practices
Strong Backend Development Skills
Proficiency in Kotlin, Java for backend development
Experience building high-performance, scalable microservices and APIs
Strong understanding of RESTful APIs, gRPC, and event-driven architectures

Job Responsibility

Designing, building, and optimizing high-performance, scalable, and resilient backend storage solutions on AWS cloud infrastructure
Developing distributed storage systems, APIs, and backend services that power mission-critical applications, ensuring low-latency, high-throughput, and fault-tolerant data storage
Collaborating closely with principal engineers, architects, SREs, and product teams to define technical roadmaps, improve storage efficiency, and optimize access patterns
Driving performance tuning, data modeling, caching strategies, and cost optimization across AWS storage services like S3, DynamoDB, EBS, EFS, FSx, and Glacier
Contributing to infrastructure automation, security best practices, and monitoring strategies using tools like Terraform, CloudWatch, Prometheus, and OpenTelemetry
Troubleshooting and resolving production incidents related to data integrity, latency spikes, and storage failures, ensuring high availability and disaster recovery preparedness
Mentoring junior engineers, participating in design reviews and architectural discussions, and advocating for engineering best practices such as CI/CD automation, infrastructure as code, and observability-driven development

What we offer

Atlassians can choose where they work – whether in an office, from home, or a combination of the two
Flexibility for eligible candidates to work remotely across the West US

Fulltime

Principal Software Engineer - Data Platform

Arcesium

Location:
United States , New York

Category:
IT - Software Development

Contract Type:
Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Additional Information:

Job Posted:
January 06, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Principal Software Engineer - Data Platform

Principal Software Engineer, Trusted Data Platform

Senior Principal Data Platform Software Engineer

Principal Software Engineer – AI Platform

Principal Data Engineer

Principal Data Engineer

Principal Software Engineer in Test

Principal Data Engineer

Senior Software Engineer - Transactional Data Platform

Principal Software Engineer - Data Platform

Arcesium

Location:United States , New York

Category:IT - Software Development

Contract Type:Not provided

Salary:

Job Description:

Job Responsibility:

Requirements:

Additional Information:

Job Posted:January 06, 2026

Looking for more opportunities? Search for other job offers that match your skills and interests.

Similar Jobs for Principal Software Engineer - Data Platform

Principal Software Engineer, Trusted Data Platform

Senior Principal Data Platform Software Engineer

Principal Software Engineer – AI Platform

Principal Data Engineer

Principal Data Engineer

Principal Software Engineer in Test

Principal Data Engineer

Senior Software Engineer - Transactional Data Platform

Location:
United States , New York

Category:
IT - Software Development

Contract Type:
Not provided

Job Posted:
January 06, 2026