CrawlJobs Logo

Senior Data Engineer

capitalone.com Logo

Capital One

Location Icon

Location:
United States , McLean

Category Icon

Job Type Icon

Contract Type:
Employment contract

Salary Icon

Salary:

144200.00 - 181000.00 USD / Year

Job Description:

Senior Data Engineer. Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One.

Job Responsibility:

  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Requirements:

  • Bachelor’s Degree
  • At least 3 years of experience in application development (Internship experience does not apply)
  • At least 1 year of experience in big data technologies

Nice to have:

  • 5+ years of experience in application development including Python, SQL, Scala, or Java
  • 2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
  • 3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
  • 2+ year experience working on real-time data and streaming applications
  • 2+ years of experience with NoSQL implementation (Mongo, Cassandra)
  • 2+ years of data warehousing experience (Redshift or Snowflake)
  • 3+ years of experience with UNIX/Linux including basic commands and shell scripting
  • 2+ years of experience with Agile engineering practices
What we offer:
  • performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
  • comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being

Additional Information:

Job Posted:
December 30, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Data Engineer

New

Senior Data Engineer

Our Data Engineering Team is comprised of data experts. We build world-class dat...
Location
Location
Salary
Salary:
Not provided
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A BS in Computer Science or equivalent experience with 5+ years of professional experience as a Sr. Data Engineer or in a similar role
  • Strong programming skills using Python
  • Working knowledge of relational databases and query authoring (SQL)
  • Experience designing data models for optimal storage and retrieval to meet product and business requirements
  • Experience building scalable data pipelines using Spark (SparkSQL) with Airflow scheduler/executor framework or similar scheduling tools
  • Experience working with AWS data services or similar Apache projects (Spark, Flink, Hive, and Kafka)
  • Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team
  • Well versed in modern software development practices (Agile, TDD, CICD)
Job Responsibility
Job Responsibility
  • You'll partner with the product analytics and data scientist team to build the data solutions that allow them to obtain more insights from our data and use that to support important business decisions
  • You'll work with different stakeholders to understand their needs and architect/build the data models, data acquisition/ingestion processes and data applications to address those requirements
  • You'll add new sources, code business rules, and produce new metrics that support the product analysts and data scientists
  • You'll be the data domain expert who understand all the nitty-gritty of our products
  • You'll own a problem end-to-end
  • You'll improve data quality by using & improving internal tools/frameworks to automatically detect DQ issues
What we offer
What we offer
  • health and wellbeing resources
  • paid volunteer days
Read More
Arrow Right
New

Senior Data Engineer

Binariks is looking for a highly motivated and skilled Senior Data Engineer to j...
Location
Location
Salary
Salary:
Not provided
binariks.com Logo
Binariks
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years as a Data Engineer with experience in working with AWS
  • Experience with Terraform
  • Experience with Datalakes, Medallion Architecture
  • Experience with SQL
  • Professional experience with Python
  • Experience with Athena, Glue, Glue Streaming, Kinesis, dbt
  • Able to work as a team to deliver against requirements in a collaborative and agile way
  • Excellent communication skills in English
Job Responsibility
Job Responsibility
  • Managing and improving our cloud data lakehouse for analytic and aggregate data
  • Building data pipelines
  • Developing foundations for handling larger volumes of streaming data
  • Manage our cloud data infrastructure using IaC tooling
  • Assist teams on integrating with the data lake and consuming from it
  • Developing customer-facing data products, such as APIs and data timelines
  • Help develop our machine learning data capabilities
What we offer
What we offer
  • 18 days of paid annual leave
  • 10 sick leaves
  • Additional days off for special occasions
  • Medical Care
  • Health check-up
  • English Class
  • Play Room
  • IT Cluster membership
  • Business Trip
  • Tech Talks
Read More
Arrow Right
New

Senior AWS Data Engineer / Data Platform Engineer

We are seeking a highly experienced Senior AWS Data Engineer to design, build, a...
Location
Location
United Arab Emirates , Dubai
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in data engineering and data platform development
  • Strong hands-on experience with: AWS Glue
  • Amazon EMR (Spark)
  • AWS Lambda
  • Apache Airflow (MWAA)
  • Amazon EC2
  • Amazon CloudWatch
  • Amazon Redshift
  • Amazon DynamoDB
  • AWS DataZone
Job Responsibility
Job Responsibility
  • Design, develop, and optimize scalable data pipelines using AWS native services
  • Lead the implementation of batch and near-real-time data processing solutions
  • Architect and manage data ingestion, transformation, and storage layers
  • Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
  • Orchestrate complex data workflows using Apache Airflow (MWAA)
  • Develop and manage serverless data processing using AWS Lambda
  • Design and optimize data warehouses using Amazon Redshift
  • Implement and manage NoSQL data models using Amazon DynamoDB
  • Utilize AWS DataZone for data governance, cataloging, and access management
  • Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

NorthBay is looking for a Senior Data Engineer with a strong passion for databas...
Location
Location
Pakistan , Lahore; Islamabad; Karachi
Salary
Salary:
250000.00 - 350000.00 PKR / Month
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Up to 3 years of relevant experience in database deployment, management, or migration
  • Hands-on experience with PostgreSQL, MongoDB, DocumentDB, MySQL, or Oracle
  • Experience using AWS Database Migration Services (AWS DMS) for data migration projects
  • Knowledge of NoSQL databases and DocumentDB is a plus
  • Understanding of ETL/ELT pipelines, data engineering, and data flow orchestration
  • Familiarity with backup/recovery, replication, and clustering concepts
  • Strong analytical, problem-solving, and communication skills
Job Responsibility
Job Responsibility
  • Support and execute database migration initiatives across multiple database platforms and AWS environments
  • Collaborate with technical leads to ensure successful, secure, and validated database migrations
  • Develop and maintain data validation plans, migration scripts, and testing frameworks
  • Work closely with application teams to ensure business continuity, performance, and SLAs are maintained during migration
  • Perform database performance tuning, monitoring, and troubleshooting to ensure reliability and scalability
  • Contribute to database design, replication, clustering, backup/recovery, and CDC (Change Data Capture) strategies
  • Demonstrate strong understanding of OLTP and OLAP workloads and migration best practices
What we offer
What we offer
  • Fuel expense reimbursement
  • Paid holidays and vacation
  • Medical outpatient reimbursement & health insurance
  • Opportunity to work in a highly collaborative, AWS-focused environment on impactful migration projects
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

NorthBay is looking for a Senior Data Engineer with a strong passion for databas...
Location
Location
Pakistan , Lahore; Islamabad; Karachi
Salary
Salary:
250000.00 - 350000.00 PKR / Month
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Up to 3 years of relevant experience in database deployment, management, or migration
  • Hands-on experience with PostgreSQL, MongoDB, DocumentDB, MySQL, or Oracle
  • Experience using AWS Database Migration Services (AWS DMS) for data migration projects
  • Knowledge of NoSQL databases and DocumentDB is a plus
  • Understanding of ETL/ELT pipelines, data engineering, and data flow orchestration
  • Familiarity with backup/recovery, replication, and clustering concepts
  • Strong analytical, problem-solving, and communication skills
Job Responsibility
Job Responsibility
  • Support and execute database migration initiatives across multiple database platforms and AWS environments
  • Collaborate with technical leads to ensure successful, secure, and validated database migrations
  • Develop and maintain data validation plans, migration scripts, and testing frameworks
  • Work closely with application teams to ensure business continuity, performance, and SLAs are maintained during migration
  • Perform database performance tuning, monitoring, and troubleshooting to ensure reliability and scalability
  • Contribute to database design, replication, clustering, backup/recovery, and CDC (Change Data Capture) strategies
  • Demonstrate strong understanding of OLTP and OLAP workloads and migration best practices
What we offer
What we offer
  • Fuel expense reimbursement
  • Paid holidays and vacation
  • Medical outpatient reimbursement & health insurance
  • Opportunity to work in a highly collaborative, AWS-focused environment on impactful migration projects
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

NorthBay is looking for a Senior Data Engineer with a strong passion for databas...
Location
Location
Pakistan , Lahore; Islamabad; Karachi
Salary
Salary:
250000.00 - 350000.00 PKR / Month
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Up to 3 years of relevant experience in database deployment, management, or migration
  • Hands-on experience with PostgreSQL, MongoDB, DocumentDB, MySQL, or Oracle
  • Experience using AWS Database Migration Services (AWS DMS) for data migration projects
  • Knowledge of NoSQL databases and DocumentDB is a plus
  • Understanding of ETL/ELT pipelines, data engineering, and data flow orchestration
  • Familiarity with backup/recovery, replication, and clustering concepts
  • Strong analytical, problem-solving, and communication skills
Job Responsibility
Job Responsibility
  • Support and execute database migration initiatives across multiple database platforms and AWS environments
  • Collaborate with technical leads to ensure successful, secure, and validated database migrations
  • Develop and maintain data validation plans, migration scripts, and testing frameworks
  • Work closely with application teams to ensure business continuity, performance, and SLAs are maintained during migration
  • Perform database performance tuning, monitoring, and troubleshooting to ensure reliability and scalability
  • Contribute to database design, replication, clustering, backup/recovery, and CDC (Change Data Capture) strategies
  • Demonstrate strong understanding of OLTP and OLAP workloads and migration best practices
What we offer
What we offer
  • Fuel expense reimbursement
  • Paid holidays and vacation
  • Medical outpatient reimbursement & health insurance
  • Opportunity to work in a highly collaborative, AWS-focused environment on impactful migration projects
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

The mission of the business intelligence team is to create a data-driven culture...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.randstad.com Logo
Randstad
Expiration Date
February 28, 2026
Flip Icon
Requirements
Requirements
  • Master’s degree in Computer Science / Information Technology or related field, highly preferred
  • Extensive knowledge of BI concepts and related technologies that help drive sustainable technical solutions
  • Extensive Experience with data lakes, ETL and data warehouses
  • Advanced experience of building data pipelines
  • Passion for building quality BI software
  • Project Management and/or process improvement experience highly preferred
  • Polyglot coder and expert level in multiple languages including, Python, R, Java, SQL, relational databases, ERP, DOMO or other data visualization tools i.e. Tableau
  • Advanced and proven experience with Google cloud platform (GCP) is preferred. But experience with Microsoft Azure / Amazon will be considered
  • Any exposure to Kafka, Spark, and Scala will be an added advantage
  • Should demonstrate a strong understanding of OOPS concepts and methodologies
Job Responsibility
Job Responsibility
  • Architect and build complex data pipelines using advanced cloud data technologies
  • Lead efforts to optimize data pipelines for performance, scalability, and cost-efficiency
  • Define industry best practices for building data pipelines
  • Ensure data security, compliance, and governance standards are met
  • Partner with leadership team to define and implement agile and DevOps methodologies
  • Serve as subject matter expert and define data architecture and infrastructure requirements
  • Partner with business analysts to plan project execution including appropriate product and technical specifications, direction, resources, and establishing realistic completion times
  • Understand data technology trends and identify opportunities to implement new technologies and provide forward-thinking recommendations
  • Proactively partner with internal stakeholders to bridge gaps, provide historical references, and design the appropriate processes
  • Design and implement a robust data observability process
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineer

Beacon Technologies is seeking a Senior Data Engineer for our client partner. Th...
Location
Location
Salary
Salary:
Not provided
beacontechinc.com Logo
Beacon Technologies
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Data engineering (SQL)
  • Scripting (Python, PowerShell, Bash)
  • Custom development (API integration, file-based integration)
  • Strategic thinker
  • Mentor juniors
  • Governance aware
Job Responsibility
Job Responsibility
  • Design integrations
  • Optimize rule structures
  • Lead analytics initiatives
  • Manage workforce identity (system access) for all corporate and field employees
What we offer
What we offer
  • Career advancement opportunities
  • Extensive training
  • Excellent benefits including paying for health and dental premiums for salaried employees
  • Fulltime
Read More
Arrow Right
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.