CrawlJobs Logo

Senior AWS Data Engineer / Data Platform Engineer

northbaysolutions.com Logo

NorthBay

Location Icon

Location:
United Arab Emirates , Dubai

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

We are seeking a highly experienced Senior AWS Data Engineer to design, build, and optimize large-scale data platforms on AWS. The ideal candidate will have deep hands-on experience with AWS data services, batch and streaming data processing, and orchestration frameworks, playing a key role in architecting and maintaining enterprise-grade data solutions.

Job Responsibility:

  • Design, develop, and optimize scalable data pipelines using AWS native services
  • Lead the implementation of batch and near-real-time data processing solutions
  • Architect and manage data ingestion, transformation, and storage layers
  • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
  • Orchestrate complex data workflows using Apache Airflow (MWAA)
  • Develop and manage serverless data processing using AWS Lambda
  • Design and optimize data warehouses using Amazon Redshift
  • Implement and manage NoSQL data models using Amazon DynamoDB
  • Utilize AWS DataZone for data governance, cataloging, and access management
  • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
  • Ensure data security, quality, performance, and cost optimization
  • Collaborate with architects, analytics teams, and business stakeholders
  • Provide technical guidance and mentorship to junior team members

Requirements:

  • 8+ years of experience in data engineering and data platform development
  • Strong hands-on experience with: AWS Glue
  • Amazon EMR (Spark)
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
  • Strong experience with batch data processing architectures
  • Proficiency in SQL, Python, and Spark
  • Experience working with large-scale datasets and distributed systems
  • Strong understanding of data modeling, data warehousing, and ETL patterns
  • Experience with CI/CD pipelines and Infrastructure as Code is a plus

Nice to have:

  • AWS Certification (Data Analytics / Solutions Architect)
  • Experience with data governance and metadata management
  • Exposure to data lake and lakehouse architectures

Additional Information:

Job Posted:
December 26, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior AWS Data Engineer / Data Platform Engineer

New

Senior Principal Data Platform Software Engineer

We’re looking for a Sr Principal Data Platform Software Engineer (P70) to be a k...
Location
Location
Salary
Salary:
239400.00 - 312550.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 15+ years in Data Engineering, Software Engineering, or related roles, with substantial exposure to big data ecosystems
  • Demonstrated experience building and operating data platforms or large‑scale data services in production
  • Proven track record of building services from the ground up (requirements → design → implementation → deployment → ongoing ownership)
  • Hands‑on experience with AWS, GCP (e.g., compute, storage, data, and streaming services) and cloud‑native architectures
  • Practical experience with big data technologies, such as Databricks, Apache Spark, AWS EMR, Apache Flink, or StarRocks
  • Strong programming skills in one or more of: Kotlin, Scala, Java, Python
  • Experience leading cross‑team technical initiatives and influencing senior stakeholders
  • Experience mentoring Staff/Principal engineers and lifting the technical bar for a team or org
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience
Job Responsibility
Job Responsibility
  • Design, develop and own delivery of high quality big data and analytical platform solutions aiming to solve Atlassian’s needs to support millions of users with optimal cost, minimal latency and maximum reliability
  • Improve and operate large‑scale distributed data systems in the cloud (primarily AWS, with increasing integration with GCP and Kubernetes‑based microservices)
  • Drive the evolution of our high-performance analytical databases and its integrations with products, cloud infrastructures (AWS and GCP) and isolated cloud environments
  • Help define and uplift engineering and operational standards for petabyte scale data platforms, with sub‑second analytic queries and multi‑region availability (coding guidelines, code review practices, observability, incident response, SLIs/SLOs)
  • Partner across multiple product and platform teams (including Analytics, Marketplace/Ecosystem, Core Data Platform, ML Platform, Search, and Oasis/FedRAMP) to deliver company‑wide initiatives that depend on reliable, high‑quality data
  • Act as a technical mentor and multiplier, raising the bar on design quality, code quality, and operational excellence across the broader team
  • Design and implement self‑healing, resilient data platforms with strong observability, fault tolerance, and recovery characteristics
  • Own the long‑term architecture and technical direction of Atlassian’s product data platform with projects that are directly tied to Atlassian’s company-level OKRs
  • Be accountable for the reliability, cost efficiency, and strategic direction of Atlassian’s product analytical data platform
  • Partner with executives and influence senior leaders to align engineering efforts with Atlassian’s long-term business objectives
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
  • Fulltime
Read More
Arrow Right
New

Senior Engineering Manager - Infra Platform

Lead the team that powers every product at Intercom, building the platform that ...
Location
Location
Ireland , Dublin
Salary
Salary:
Not provided
intercom.com Logo
Intercom
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience leading an infrastructure or platform team in a cloud environment, ideally AWS, with accountability for availability and costs
  • A track record of independently leading and delivering on complex initiatives, often spanning multiple projects, teams, and quarters
  • Expert grasp of modern web and distributed systems
  • Clear, timely communication
  • Comfort with data
  • Ability to learn quickly, iterate, unblock yourself and your team, and persist until the right problem is solved
Job Responsibility
Job Responsibility
  • Lead and inspire a high-performing, autonomous team of engineers working on scaling and optimizing Intercom’s core infrastructure and supporting systems
  • Navigate complex scaling and infrastructure challenges, guiding the team through strategic decisions on how we build and scale Intercom’s core components
  • Collaborate closely with domain experts and other parts of R&D
  • Drive strategic initiatives and execute high-impact projects, ensuring they are delivered reliably and efficiently
  • Use the best tools in the industry
  • Foster a culture of agility and simplicity, prioritising scalability and uptime while supporting continuous deployment and incremental improvements
  • Mentor and coach engineers and future leaders, playing an active role in their hiring, onboarding, and career development
  • Adapt and thrive across various functions to ensure objectives are met
What we offer
What we offer
  • Competitive salary and equity in a fast-growing start-up
  • We serve lunch every weekday, plus a variety of snack foods and a fully stocked kitchen
  • Regular compensation reviews
  • Pension scheme & match up to 4%
  • Life assurance
  • Comprehensive health and dental insurance for you and your dependents
  • Flexible paid time off policy
  • Paid maternity leave
  • 6 weeks paternity leave for fathers
  • Cycle-to-Work Scheme
  • Fulltime
Read More
Arrow Right
New

Senior Data Architect

We are seeking a highly experienced Senior Data Architect with 12+ years of expe...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of experience in Data Engineering and Data Architecture
  • Proven experience working as a Data Architect on large-scale AWS platforms
  • Strong experience designing enterprise data lakes and data warehouses
  • Hands-on experience with batch data processing and orchestration frameworks
  • Excellent communication and stakeholder management skills
  • Ability to work onsite in Dubai, UAE
  • AWS Glue (ETL, Data Catalog)
  • Amazon EMR (Batch Processing)
  • AWS Lambda (Serverless Data Processing)
  • Amazon MWAA (Apache Airflow)
Job Responsibility
Job Responsibility
  • Design and own end-to-end AWS data architecture for enterprise platforms
  • Define data architecture standards, best practices, and reference models
  • Architect batch and event-driven data pipelines using AWS native services
  • Lead data ingestion, transformation, and orchestration workflows
  • Design and implement solutions using AWS Glue, EMR, Lambda, and MWAA (Airflow)
  • Architect data lakes and data warehouses using Amazon S3 and Amazon Redshift
  • Design NoSQL data solutions using Amazon DynamoDB
  • Implement data governance, metadata management, and access control using AWS DataZone
  • Ensure monitoring, logging, and observability using Amazon CloudWatch
  • Partner with engineering, analytics, and business teams to translate requirements into scalable data solutions
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

NorthBay is looking for a Senior Data Engineer with a strong passion for databas...
Location
Location
Pakistan , Lahore; Islamabad; Karachi
Salary
Salary:
250000.00 - 350000.00 PKR / Month
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Up to 3 years of relevant experience in database deployment, management, or migration
  • Hands-on experience with PostgreSQL, MongoDB, DocumentDB, MySQL, or Oracle
  • Experience using AWS Database Migration Services (AWS DMS) for data migration projects
  • Knowledge of NoSQL databases and DocumentDB is a plus
  • Understanding of ETL/ELT pipelines, data engineering, and data flow orchestration
  • Familiarity with backup/recovery, replication, and clustering concepts
  • Strong analytical, problem-solving, and communication skills
Job Responsibility
Job Responsibility
  • Support and execute database migration initiatives across multiple database platforms and AWS environments
  • Collaborate with technical leads to ensure successful, secure, and validated database migrations
  • Develop and maintain data validation plans, migration scripts, and testing frameworks
  • Work closely with application teams to ensure business continuity, performance, and SLAs are maintained during migration
  • Perform database performance tuning, monitoring, and troubleshooting to ensure reliability and scalability
  • Contribute to database design, replication, clustering, backup/recovery, and CDC (Change Data Capture) strategies
  • Demonstrate strong understanding of OLTP and OLAP workloads and migration best practices
What we offer
What we offer
  • Fuel expense reimbursement
  • Paid holidays and vacation
  • Medical outpatient reimbursement & health insurance
  • Opportunity to work in a highly collaborative, AWS-focused environment on impactful migration projects
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

NorthBay is looking for a Senior Data Engineer with a strong passion for databas...
Location
Location
Pakistan , Lahore; Islamabad; Karachi
Salary
Salary:
250000.00 - 350000.00 PKR / Month
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Up to 3 years of relevant experience in database deployment, management, or migration
  • Hands-on experience with PostgreSQL, MongoDB, DocumentDB, MySQL, or Oracle
  • Experience using AWS Database Migration Services (AWS DMS) for data migration projects
  • Knowledge of NoSQL databases and DocumentDB is a plus
  • Understanding of ETL/ELT pipelines, data engineering, and data flow orchestration
  • Familiarity with backup/recovery, replication, and clustering concepts
  • Strong analytical, problem-solving, and communication skills
Job Responsibility
Job Responsibility
  • Support and execute database migration initiatives across multiple database platforms and AWS environments
  • Collaborate with technical leads to ensure successful, secure, and validated database migrations
  • Develop and maintain data validation plans, migration scripts, and testing frameworks
  • Work closely with application teams to ensure business continuity, performance, and SLAs are maintained during migration
  • Perform database performance tuning, monitoring, and troubleshooting to ensure reliability and scalability
  • Contribute to database design, replication, clustering, backup/recovery, and CDC (Change Data Capture) strategies
  • Demonstrate strong understanding of OLTP and OLAP workloads and migration best practices
What we offer
What we offer
  • Fuel expense reimbursement
  • Paid holidays and vacation
  • Medical outpatient reimbursement & health insurance
  • Opportunity to work in a highly collaborative, AWS-focused environment on impactful migration projects
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

NorthBay is looking for a Senior Data Engineer with a strong passion for databas...
Location
Location
Pakistan , Lahore; Islamabad; Karachi
Salary
Salary:
250000.00 - 350000.00 PKR / Month
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Up to 3 years of relevant experience in database deployment, management, or migration
  • Hands-on experience with PostgreSQL, MongoDB, DocumentDB, MySQL, or Oracle
  • Experience using AWS Database Migration Services (AWS DMS) for data migration projects
  • Knowledge of NoSQL databases and DocumentDB is a plus
  • Understanding of ETL/ELT pipelines, data engineering, and data flow orchestration
  • Familiarity with backup/recovery, replication, and clustering concepts
  • Strong analytical, problem-solving, and communication skills
Job Responsibility
Job Responsibility
  • Support and execute database migration initiatives across multiple database platforms and AWS environments
  • Collaborate with technical leads to ensure successful, secure, and validated database migrations
  • Develop and maintain data validation plans, migration scripts, and testing frameworks
  • Work closely with application teams to ensure business continuity, performance, and SLAs are maintained during migration
  • Perform database performance tuning, monitoring, and troubleshooting to ensure reliability and scalability
  • Contribute to database design, replication, clustering, backup/recovery, and CDC (Change Data Capture) strategies
  • Demonstrate strong understanding of OLTP and OLAP workloads and migration best practices
What we offer
What we offer
  • Fuel expense reimbursement
  • Paid holidays and vacation
  • Medical outpatient reimbursement & health insurance
  • Opportunity to work in a highly collaborative, AWS-focused environment on impactful migration projects
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

As a Senior Data Engineer on our Core Engineering Data Team, you will design and...
Location
Location
United States , Boston
Salary
Salary:
111800.00 - 164000.00 USD / Year
simplisafe.com Logo
SimpliSafe
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field or equivalent practical experience
  • 4+ years of experience in software engineering, data engineering, or a related field, with at least 2 years focused on data operations or data infrastructure
  • Strong knowledge of AWS or other public cloud platforms (e.g., Azure, GCP)
  • Strong SQL knowledge and experience optimizing for data warehousing technologies like AWS Athena
  • Strong knowledge of Python for use in data transformation
  • Hands-on experience with ETL/ELT, schema design, and datalake technologies
  • Hands-on experience with data orchestration tools like Dagster, Airflow, or Prefect
  • Experience with CI/CD pipelines, Docker, Kubernetes, and infrastructure-as-code tools (e.g., Terraform, CloudFormation)
  • Familiarity with various data and table formats (JSON, Avro, Parquet, Iceberg)
  • Love of data and a passion for building reliable data products
Job Responsibility
Job Responsibility
  • Collaborate with analysts, engineers, product managers, and stakeholders to design and implement solutions for Product and Engineering data workflows
  • Identify areas for improvement and contribute to centralized data platform
  • Manage data pipeline, orchestration, storage, and analytics infrastructure for Product and Engineering
  • Monitor performance and reliability of data pipelines, implementing solutions for scalability and efficiency
  • Optimize table structures to support query and usage patterns
  • Partner with producers of data across SimpliSafe to develop an understanding of data creation and meaning
  • Support data discovery, catalog, and analytics tooling
  • Implement and maintain data security measures and ensure compliance with data governance policies
  • Design and implement testing strategies and data quality validation to ensure the accuracy, reliability, and integrity of data pipelines
  • Contribute to the formation of our new team, assisting with the development of team norms, practices, and charter
What we offer
What we offer
  • A mission- and values-driven culture and a safe, inclusive environment where you can build, grow and thrive
  • A comprehensive total rewards package that supports your wellness and provides security for SimpliSafers and their families
  • Free SimpliSafe system and professional monitoring for your home
  • Employee Resource Groups (ERGs) that bring people together, give opportunities to network, mentor and develop, and advocate for change
  • Participation in our annual bonus program, equity, and other forms of compensation, in addition to a full range of medical, retirement, and lifestyle benefits
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

We are looking for a Data Engineer to join our team and support with designing, ...
Location
Location
Salary
Salary:
Not provided
foundever.com Logo
Foundever
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 7 years plus experience in data engineering
  • Track record of deploying and maintaining complex data systems at an enterprise level within regulated environments
  • Expertise in implementing robust data security measures, access controls, and monitoring systems
  • Proficiency in data modeling and database management
  • Strong programming skills in Python and SQL
  • Knowledge of big data technologies like Hadoop, Spark, and NoSQL databases
  • Deep experience with ETL processes and data pipeline development
  • Strong understanding of data warehousing concepts and best practices
  • Experience with cloud platforms such as AWS and Azure
  • Excellent problem-solving skills and attention to detail
Job Responsibility
Job Responsibility
  • Design and optimize complex data storage solutions, including data warehouses and data lakes
  • Develop, automate, and maintain data pipelines for efficient and scalable ETL processes
  • Ensure data quality and integrity through data validation, cleansing, and error handling
  • Collaborate with data analysts, machine learning engineers, and software engineers to deliver relevant datasets or data APIs for downstream applications
  • Implement data security measures and access controls to protect sensitive information
  • Monitor data infrastructure for performance and reliability, addressing issues promptly
  • Stay abreast of industry trends and emerging technologies in data engineering
  • Document data pipelines, processes, and best practices for knowledge sharing
  • Lead data governance and compliance efforts to meet regulatory requirements
  • Collaborate with cross-functional teams to drive data-driven decision-making within the organization
What we offer
What we offer
  • Impactful work
  • Professional growth
  • Competitive compensation
  • Collaborative environment
  • Attractive salary and benefits package
  • Continuous learning and development opportunities
  • A supportive team culture with opportunities for occasional travel for training and industry events
Read More
Arrow Right
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.