CrawlJobs Logo

Data Test Engineer

optisolbusiness.com Logo

OptiSol Business Solutions

Location Icon

Location:
India, Chennai

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

We are looking for a skilled Data Test Engineer who can design, build, and validate end-to-end data pipelines. In this role, you will work closely with data engineers and business teams to ensure that data is accurate, complete, and reliable. You will be responsible for testing data workflows, writing complex SQL queries, automating data quality checks, and integrating validations into CI/CD pipelines. If you have a strong background in data engineering and a keen eye for quality, we’d love to have you on our team.

Job Responsibility:

  • Design, develop, and maintain robust ETL/ELT pipelines to process large volumes of structured and unstructured data using Azure Data Factory, PySpark, and SQL-based tools
  • Collaborate with data architects and analysts to understand transformation requirements and implement business rules correctly
  • Develop and execute complex SQL queries to validate, transform, and performance-tune data workflows
  • Perform rigorous data validation including source-to-target mapping (S2T), data profiling, reconciliation, and transformation rule testing
  • Conduct unit, integration, regression, and performance testing for data pipelines and storage layers
  • Automate data quality checks using Python and frameworks like Great Expectations, DBT, or custom-built tools
  • Monitor data pipeline health and implement observability through logging, alerting, and dashboards
  • Integrate testing into CI/CD workflows using tools like Azure DevOps, Jenkins, or GitHub Actions
  • Troubleshoot and resolve data quality issues, schema changes, and pipeline failures
  • Ensure compliance with data privacy, security, and governance policies
  • Maintain thorough documentation for data flows, test logic, and validation processes

Requirements:

  • 4+ years of experience in Data Engineering and Data/ETL Testing
  • Strong expertise in writing and optimizing SQL queries (joins, subqueries, window functions, performance tuning)
  • Proficiency in Python or PySpark for data transformation and automation
  • Hands-on experience with ETL tools such as Azure Data Factory, Talend, SSIS, or Informatica
  • Familiarity with cloud platforms, preferably Azure
  • AWS or GCP is a plus
  • Experience working with data lakes, data warehouses (Snowflake, BigQuery, Redshift), and modern data platforms
  • Knowledge of version control systems (Git), issue tracking tools (JIRA), and Agile methodologies
  • Exposure to data testing frameworks like Great Expectations, DBT tests, or custom validation tools
  • Experience integrating data testing into CI/CD pipelines

Nice to have:

Familiarity with Airflow, Databricks, BI tools (Power BI, Tableau), and metadata management practices

What we offer:
  • Competitive salary aligned with industry standards
  • Hands-on experience with enterprise-scale data platforms and cloud-native tools
  • Opportunities to work on data-centric initiatives across AI, analytics, and enterprise transformation
  • Access to internal learning accelerators, mentorship, and career growth programs
  • Flexible work culture, wellness initiatives, and comprehensive health benefits

Additional Information:

Job Posted:
December 11, 2025

Employment Type:
Fulltime
Icon
View All Jobs In This Company
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data Test Engineer

Software Engineer - Data Engineering

Akuna Capital is a leading proprietary trading firm specializing in options mark...
Location
Location
United States , Chicago
Salary
Salary:
130000.00 USD / Year
akunacapital.com Logo
AKUNA CAPITAL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS/MS/PhD in Computer Science, Engineering, Physics, Math, or equivalent technical field
  • 5+ years of professional experience developing software applications
  • Java/Scala experience required
  • Highly motivated and willing to take ownership of high-impact projects upon arrival
  • Prior hands-on experience with data platforms and technologies such as Delta Lake, Spark, Kubernetes, Kafka, ClickHouse, and/or Presto/Trino
  • Experience building large-scale batch and streaming pipelines with strict SLA and data quality requirements
  • Must possess excellent communication, analytical, and problem-solving skills
  • Recent hands-on experience with AWS Cloud development, deployment and monitoring necessary
  • Demonstrated experience working on an Agile team employing software engineering best practices, such as GitOps and CI/CD, to deliver complex software projects
  • The ability to react quickly and accurately to rapidly changing market conditions, including the ability to quickly and accurately respond and/or solve math and coding problems are essential functions of the role
Job Responsibility
Job Responsibility
  • Work within a growing Data Engineering division supporting the strategic role of data at Akuna
  • Drive the ongoing design and expansion of our data platform across a wide variety of data sources, supporting an array of streaming, operational and research workflows
  • Work closely with Trading, Quant, Technology & Business Operations teams throughout the firm to identify how data is produced and consumed, helping to define and deliver high impact projects
  • Build and deploy batch and streaming pipelines to collect and transform our rapidly growing Big Data set within our hybrid cloud architecture utilizing Kubernetes/EKS, Kafka/MSK and Databricks/Spark
  • Mentor junior engineers in software and data engineering best practices
  • Produce clean, well-tested, and documented code with a clear design to support mission critical applications
  • Build automated data validation test suites that ensure that data is processed and published in accordance with well-defined Service Level Agreements (SLA’s) pertaining to data quality, data availability and data correctness
  • Challenge the status quo and help push our organization forward, as we grow beyond the limits of our current tech stack
What we offer
What we offer
  • Discretionary performance bonus
  • Comprehensive benefits package that may encompass employer-paid medical, dental, vision, retirement contributions, paid time off, and other benefits
  • Fulltime
Read More
Arrow Right
New

Sr. Data Engineer I, Data Infrastructure

Khan Academy is partnering with SafeInsights to provide researchers access to st...
Location
Location
United States , Mountain View
Salary
Salary:
137871.00 - 172339.00 USD / Year
khanacademy.org Logo
Khan Academy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience in data engineering within a production environment
  • Experience with Google infrastructure services and data services particularly GCS & Big Query
  • Advanced knowledge of Python
  • Strong SQL skills
  • Demonstrated proficiency with Docker and Kubernetes
  • Experience with Airflow
  • Background in applied math, statistics, economics, or a related technical field
  • Motivated by the Khan Academy mission “to provide a free world-class education for anyone, anywhere"
  • Proven cross-cultural competency skills demonstrating self-awareness, awareness of other, and the ability to adopt inclusive perspectives, attitudes, and behaviors to drive inclusion and belonging throughout the organization.
Job Responsibility
Job Responsibility
  • Collaborate with our Data Insights Group to understand the desired end data product and the overall projects goals
  • Collaborate with our data architect and Data Infrastructure team to understand available data source and tooling
  • Propose tooling and processes that will work with extant Khan Academy systems to meet the projects goals
  • Build test and refine these tools and processes
  • Deliver the SafeInsights container and associated project deliverables
  • Provide documentation and training required to maintain and enhance the above
What we offer
What we offer
  • Competitive salaries
  • Ample paid time off as needed
  • Remote-first culture
  • Generous parental leave
  • An exceptional team
  • The chance to put your talents towards a deeply meaningful mission
  • Opportunities to connect through affinity, ally, and social groups
  • 401(k) + 4% matching
  • Comprehensive insurance, including medical, dental, vision, and life
  • Fulltime
Read More
Arrow Right
New

Principal Data Engineer

PointClickCare is searching for a Principal Data Engineer who will contribute to...
Location
Location
United States
Salary
Salary:
183200.00 - 203500.00 USD / Year
pointclickcare.com Logo
PointClickCare
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Principal Data Engineer with at least 10 years of professional experience in software or data engineering, including a minimum of 4 years focused on streaming and real-time data systems
  • Proven experience driving technical direction and mentoring engineers while delivering complex, high-scale solutions as a hands-on contributor
  • Deep expertise in streaming and real-time data technologies, including frameworks such as Apache Kafka, Flink, and Spark Streaming
  • Strong understanding of event-driven architectures and distributed systems, with hands-on experience implementing resilient, low-latency pipelines
  • Practical experience with cloud platforms (AWS, Azure, or GCP) and containerized deployments for data workloads
  • Fluency in data quality practices and CI/CD integration, including schema management, automated testing, and validation frameworks (e.g., dbt, Great Expectations)
  • Operational excellence in observability, with experience implementing metrics, logging, tracing, and alerting for data pipelines using modern tools
  • Solid foundation in data governance and performance optimization, ensuring reliability and scalability across batch and streaming environments
  • Experience with Lakehouse architectures and related technologies, including Databricks, Azure ADLS Gen2, and Apache Hudi
  • Strong collaboration and communication skills, with the ability to influence stakeholders and evangelize modern data practices within your team and across the organization
Job Responsibility
Job Responsibility
  • Lead and guide the design and implementation of scalable streaming data pipelines
  • Engineer and optimize real-time data solutions using frameworks like Apache Kafka, Flink, Spark Streaming
  • Collaborate cross-functionally with product, analytics, and AI teams to ensure data is a strategic asset
  • Advance ongoing modernization efforts, deepening adoption of event-driven architectures and cloud-native technologies
  • Drive adoption of best practices in data governance, observability, and performance tuning for streaming workloads
  • Embed data quality in processing pipelines by defining schema contracts, implementing transformation tests and data assertions, enforcing backward-compatible schema evolution, and automating checks for freshness, completeness, and accuracy across batch and streaming paths before production deployment
  • Establish robust observability for data pipelines by implementing metrics, logging, and distributed tracing for streaming jobs, defining SLAs and SLOs for latency and throughput, and integrating alerting and dashboards to enable proactive monitoring and rapid incident response
  • Foster a culture of quality through peer reviews, providing constructive feedback and seeking input on your own work
What we offer
What we offer
  • Benefits starting from Day 1!
  • Retirement Plan Matching
  • Flexible Paid Time Off
  • Wellness Support Programs and Resources
  • Parental & Caregiver Leaves
  • Fertility & Adoption Support
  • Continuous Development Support Program
  • Employee Assistance Program
  • Allyship and Inclusion Communities
  • Employee Recognition … and more!
  • Fulltime
Read More
Arrow Right
New

Powertrain Manufacturing Test Engineer

We are seeking a highly motivated Manufacturing Test Engineer to join our Powert...
Location
Location
United States , Garden Grove
Salary
Salary:
120000.00 - 150000.00 USD / Year
harbingermotors.com Logo
Harbinger Motors
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Electrical Engineering, Mechanical Engineering, Mechatronics, or related field
  • 5-10+ years of experience in test engineering, preferably in electric powertrain or automotive manufacturing
  • Proven experience with specifying, sourcing, and launching automated test equipment in a high-volume environment
  • Experience with test automation, data acquisition systems, and industrial instrumentation
  • Knowledge of statistical process control (SPC) and design of experiments (DOE) methodologies
  • Strong analytical and problem-solving skills
  • Ability to work in a fast-paced, collaborative environment
Job Responsibility
Job Responsibility
  • Define and manage test specifications, parameters, and acceptance criteria to ensure functional and quality compliance
  • Analyze test data, diagnose failures, and implement root cause analysis and corrective actions
  • Drive continuous improvement of testing processes through data-driven analysis, process optimization, and feedback loops with manufacturing engineering and quality teams
  • Train maintenance and production teams on test equipment operation and troubleshooting procedures
  • Lead the end-to-end sourcing and implementation of a high-volume electric drive unit EOL test rig, including scope definition, RFQ generation, vendor evaluation and selection, and technical/commercial alignment with internal stakeholders
  • Oversee vendor management through design, build, FAT/SAT, and on-site commissioning, ensuring successful integration and production launch at the manufacturing facility with full adherence to safety, quality, and throughput requirements
What we offer
What we offer
  • Comprehensive Health, Dental & Vision (HDV) – 100% employee covered
  • Early-stage Stock Options
  • Robust Retirement Savings (401k, HSA, FSA)
  • Generous Paid Time Off (PTO) & Parental Leave
  • Annual Vacation Bonus
  • Wellness & Fertility Benefits
  • Cell Phone Stipend
  • Complimentary Meals & Stocked Kitchens
  • Fulltime
Read More
Arrow Right
New

Senior Mechanical Engineer: Test Development Engineering

As a Senior Mechanical Engineer in Test Development Engineering, you will play a...
Location
Location
United States , South Jordan, Utah
Salary
Salary:
Not provided
cricut.com Logo
Cricut
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Mechanical Engineering, Mechatronics, or a related field
  • 10+ years of experience in mechanical design, test and calibration equipment development, or precision metrology systems
  • Proficiency in CAD software (Creo, SolidWorks) and related engineering analysis tools (FEA, tolerance analysis)
  • Strong understanding of mechanical systems, pneumatic and electromechanical integration, and manufacturing processes
  • Deep knowledge of measurement science, tolerance analysis, and statistical methods for calibration and product qualification
  • Experience in test system design, metrology instrumentation, and mechanical calibration processes
  • Hands-on experience with mechanical test setups, data acquisition, and troubleshooting of measurement systems
  • Excellent analytical, problem-solving, and documentation skills
  • Strong communication skills and ability to lead cross-functional technical efforts
Job Responsibility
Job Responsibility
  • Conceptualize, design, and document assembly jigs, test fixtures, and precision metrology systems to support both production and validation testing
  • Develop custom calibration and test instruments, including mechanical, pneumatic, and electro-mechanical assemblies for high-accuracy measurements
  • Integrate sensors, load cells, displacement transducers, pressure gauges, and other instrumentation into test systems to support product calibration and verification
  • Collaborate with cross-functional teams (Design, Manufacturing, Quality, Calibration Labs, and Contract Manufacturers) to define test requirements and system capabilities
  • Utilize CAD software (Creo, SolidWorks) to create detailed 3D models and drawings of mechanical systems, with GD&T applied for precision alignment and repeatability
  • Generate and maintain Requirement Documents, Calibration Procedures, and Test System Specifications to ensure alignment between product and test design intent
  • Participate in supplier design reviews and qualification of external test and calibration equipment
  • Develop and validate test procedures, calibration methods, and verification plans for measurement systems and mechanical fixtures
  • Ensure measurement system analysis (MSA), gage R&R, and traceability to NIST or equivalent standards in all calibration processes
  • Conduct statistical evaluations of test data to assess system reliability, repeatability, and reproducibility
What we offer
What we offer
  • competitive Medical, Dental, and Vision coverage
  • 401(k) match
  • generous PTO
  • tuition reimbursement
  • yearly lifestyle stipend
  • exclusive employee discounts
  • Fulltime
Read More
Arrow Right

Data Engineer

The Data Engineer is accountable for developing high quality data products to su...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • First Class Degree in Engineering/Technology/MCA
  • 3 to 4 years’ experience implementing data-intensive solutions using agile methodologies
  • Experience of relational databases and using SQL for data querying, transformation and manipulation
  • Experience of modelling data for analytical consumers
  • Ability to automate and streamline the build, test and deployment of data pipelines
  • Experience in cloud native technologies and patterns
  • A passion for learning new technologies, and a desire for personal growth, through self-study, formal classes, or on-the-job training
  • Excellent communication and problem-solving skills
  • ETL: Hands on experience of building data pipelines. Proficiency in at least one of the data integration platforms such as Ab Initio, Apache Spark, Talend and Informatica
  • Big Data: Exposure to ‘big data’ platforms such as Hadoop, Hive or Snowflake for data storage and processing
Job Responsibility
Job Responsibility
  • Developing and supporting scalable, extensible, and highly available data solutions
  • Deliver on critical business priorities while ensuring alignment with the wider architectural vision
  • Identify and help address potential risks in the data supply chain
  • Follow and contribute to technical standards
  • Design and develop analytical data models
  • Fulltime
Read More
Arrow Right

Data Engineer

The Data Engineer is accountable for developing high quality data products to su...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • First Class Degree in Engineering/Technology/MCA
  • 5 to 8 years’ experience implementing data-intensive solutions using agile methodologies
  • Experience of relational databases and using SQL for data querying, transformation and manipulation
  • Experience of modelling data for analytical consumers
  • Ability to automate and streamline the build, test and deployment of data pipelines
  • Experience in cloud native technologies and patterns
  • A passion for learning new technologies, and a desire for personal growth, through self-study, formal classes, or on-the-job training
  • Excellent communication and problem-solving skills
  • ETL: Hands on experience of building data pipelines. Proficiency in two or more data integration platforms such as Ab Initio, Apache Spark, Talend and Informatica
  • Big Data: Experience of ‘big data’ platforms such as Hadoop, Hive or Snowflake for data storage and processing
Job Responsibility
Job Responsibility
  • Developing and supporting scalable, extensible, and highly available data solutions
  • Deliver on critical business priorities while ensuring alignment with the wider architectural vision
  • Identify and help address potential risks in the data supply chain
  • Follow and contribute to technical standards
  • Design and develop analytical data models
  • Fulltime
Read More
Arrow Right
New

Senior Crypto Data Engineer

Token Metrics is seeking a multi-talented Senior Big Data Engineer to facilitate...
Location
Location
Vietnam , Hanoi
Salary
Salary:
Not provided
Token Metrics
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Data Engineering, Big Data Analytics, Computer Engineering, or related field
  • A Master's degree in a relevant field is an added advantage
  • 3+ years of Python, Java or any programming language development experience
  • 3+ years of SQL & No-SQL experience (Snowflake Cloud DW & MongoDB experience is a plus)
  • 3+ years of experience with schema design and dimensional data modeling
  • Expert proficiency in SQL, NoSQL, Python, C++, Java, R
  • Expert with building Data Lake, Data Warehouse or suitable equivalent
  • Expert in AWS Cloud
  • Excellent analytical and problem-solving skills
  • A knack for independence and group work
Job Responsibility
Job Responsibility
  • Liaising with coworkers and clients to elucidate the requirements for each task
  • Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed
  • Reformulating existing frameworks to optimize their functioning
  • Testing such structures to ensure that they are fit for use
  • Building a data pipeline from different data sources using different data types like API, CSV, JSON, etc
  • Preparing raw data for manipulation by Data Scientists
  • Implementing proper data validation and data reconciliation methodologies
  • Ensuring that your work remains backed up and readily accessible to relevant coworkers
  • Remaining up-to-date with industry standards and technological advancements that will improve the quality of your outputs
  • Fulltime
Read More
Arrow Right
Welcome to CrawlJobs.com –
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Australia Jobs Canada Jobs Poland Jobs Ireland Jobs Spain Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
© 2025 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy