CrawlJobs Logo

DataOps Engineer (AWS)

northbaysolutions.com Logo

NorthBay

Location Icon

Location:
India

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

3800000.00 - 4100000.00 INR / Year
Save Job
Save Icon
Apply Position

Job Description:

We are looking for a skilled DevOps + Data Engineer (AWS) to design, build, and manage scalable cloud infrastructure and data platforms. The ideal candidate will have strong experience in AWS, Terraform, CI/CD, and ETL/data pipelines, and will work closely with data engineers, analytics teams, and application developers to ensure reliable, secure, and high-performing systems.

Job Responsibility:

  • Design, deploy, and manage AWS cloud infrastructure using Infrastructure as Code (Terraform)
  • Build, maintain, and optimize ETL/data pipelines for large-scale data processing
  • Automate infrastructure provisioning, deployment, and monitoring
  • Develop and manage CI/CD pipelines for data and application workloads
  • Ensure high availability, scalability, security, and cost optimization of AWS environments
  • Support data ingestion, transformation, and orchestration workflows
  • Monitor systems, troubleshoot issues, and improve system reliability
  • Implement logging, monitoring, and alerting for infrastructure and data pipelines
  • Collaborate with Data Engineers, Analytics teams, and DevOps teams
  • Enforce security best practices, IAM policies, and compliance standards

Requirements:

  • 5–7 years of experience in DevOps, Data Engineering, or Cloud Engineering
  • Strong hands-on experience with AWS services (EC2, S3, RDS, Lambda, EMR, Glue, Redshift, etc.)
  • Solid experience with Terraform for infrastructure automation
  • Experience building and maintaining ETL/data pipelines
  • Proficiency in Python and/or Shell scripting
  • Experience with CI/CD tools (GitHub Actions, Jenkins, GitLab CI, etc.)
  • Strong understanding of Linux systems and networking fundamentals
  • Experience with monitoring tools (CloudWatch, Prometheus, Grafana, ELK, etc.)

Nice to have:

  • Experience with Airflow, AWS Glue, or similar orchestration tools
  • Knowledge of Docker and Kubernetes
  • Experience with data warehouses and analytics platforms
  • Understanding of security best practices and data governance
  • Exposure to cost optimization and performance tuning on AWS

Additional Information:

Job Posted:
January 12, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Icon
NorthBay - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for DataOps Engineer (AWS)

DataOps Engineer

Looking for DataOps Engineer to lead database performance management for SaaS he...
Location
Location
Salary
Salary:
Not provided
hivex.tech Logo
Hivex
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3.5+ years of professional database management, development, and/or DataOps experience in a SaaS product environment
  • Experience database performance engineering large scale systems through high growth
  • Experience leading data quality management activities
  • Ability to collaborate with Java and Python developers on best practices for database performance and data quality
  • Deep knowledge of database internals and best practices for transactional and analytical processing
  • Ability to problem-solve collaboratively and independently
Job Responsibility
Job Responsibility
  • Define and build automated a database performance engineering process and framework
  • Collect and manage deterministic, well-known, and representative test sets
  • Optimize database performance using configuration, best-practices, and effective models
  • Engage with developers to collaborate on requirements and performance engineering
  • Create and manage ETL processes
  • Detect and respond to operational and customer problems
Read More
Arrow Right

Senior Sales Engineer

The Senior Sales Engineer role at Infinite Lambda is designed for a technical le...
Location
Location
Salary
Salary:
Not provided
infinitelambda.com Logo
Infinite Lambda
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Engineering, Computer Science, or a related field is required
  • an advanced degree is preferred
  • A proven track record in sales engineering or technical sales, preferably within the data, cloud, or technology sectors, with significant leadership experience
  • experience in data engineering, analytics engineering and data scientist roles and related technologies, such as AWS, Azure, Snowflake, Redshift, Databricks, dbt and machine learning frameworks is essential
  • Stream processing and batch data warehouse processing, event-driven architecture, micro-services, DataOps and MLOps practices
  • Experience in international markets or expanding into new regions is a plus, particularly knowledge of South American markets and business practices, which is desirable for this role
  • Exceptional verbal and written communication skills, with the ability to translate complex technical concepts into business benefits for clients and stakeholders
  • Experience in leading sales engineering teams or functions, with a strategic mindset to influence company direction and market expansion
  • Strong ability to work effectively across different departments and levels, fostering collaboration with Product & Services, Customer Success, and Sales & Partnerships.
Job Responsibility
Job Responsibility
  • Initiate and manage engagements with prospective clients from the early stages of the sales process, ensuring a strong start to the sales cycle
  • Understand and document client needs, articulating how Infinite Lambda’s products and services can address these needs effectively
  • Collaborate with the sales team to drive a collaborative approach, creating compelling proposals that align with client expectations
  • Conduct and facilitate technical deep-dive workshops with prospective clients to showcase capabilities and gather insights, using workshop outputs to strengthen proposals
  • Identify relevant Infinite Lambda products and services, working with the sales team to position them strategically for each opportunity
  • Assist both the sales and delivery teams in estimating project scope, effort, and resources, producing realistic and commercially viable account strategies. This includes defining initial team composition, tools to utilise, and a high-level roadmap
  • Work with departments such as Product & Services, Customer Success, and Sales & Partnerships to clearly define roles and responsibilities, ensuring seamless collaboration across functions
  • Collaborate with Product & Services to stay informed about existing offerings and influence product roadmaps, helping design new products and services based on client feedback and market trends
  • Enhance the positioning of Infinite Lambda’s products and services during the sales process and beyond, improving how value is communicated to clients
  • Liaise with senior leadership (CEO, CTO, CPO, COO, CSO) at Infinite Lambda to formulate a clear strategy for combining data and cloud expertise into a holistic value proposition, strengthening the company’s market positioning
What we offer
What we offer
  • private health insurance
  • work-from-home budget
  • unlimited paid holiday
  • wellness benefits
  • dedicated learning and development time
  • access to top-notch learning portals
  • coaching opportunities.
Read More
Arrow Right

Senior Sales Engineer

The Senior Sales Engineer role at Infinite Lambda is designed for a technical le...
Location
Location
United States
Salary
Salary:
Not provided
infinitelambda.com Logo
Infinite Lambda
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • A Bachelor’s degree in Engineering, Computer Science, or a related field is required
  • an advanced degree is preferred
  • A proven track record in sales engineering or technical sales, preferably within the data, cloud, or technology sectors, with significant leadership experience
  • experience in data engineering, analytics engineering and data scientist roles and related technologies, such as AWS, Azure, Snowflake, Redshift, Databricks, dbt and machine learning frameworks is essential
  • Stream processing and batch data warehouse processing, event-driven architecture, microservices, DataOps and MLOps practices
  • Experience in international markets or expanding into new regions is a plus, particularly knowledge of South American markets and business practices, which is desirable for this role
  • Exceptional verbal and written communication skills, with the ability to translate complex technical concepts into business benefits for clients and stakeholders
  • Experience in leading sales engineering teams or functions, with a strategic mindset to influence company direction and market expansion
  • Strong ability to work effectively across different departments and levels, fostering collaboration with Product & Services, Customer Success, and Sales & Partnerships.
Job Responsibility
Job Responsibility
  • Initiate and manage engagements with prospective clients from the early stages of the sales process, ensuring a strong start to the sales cycle
  • Understand and document client needs, articulating how Infinite Lambda’s products and services can address these needs effectively
  • Collaborate with the sales team to drive a collaborative approach, creating compelling proposals that align with client expectations
  • Conduct and facilitate technical deep-dive workshops with prospective clients to showcase capabilities and gather insights, using workshop outputs to strengthen proposals
  • Identify relevant Infinite Lambda products and services, working with the sales team to position them strategically for each opportunity
  • Assist both the sales and delivery teams in estimating project scope, effort, and resources, producing realistic and commercially viable account strategies. This includes defining initial team composition, tools to utilise, and a high-level roadmap
  • Work with departments such as Product & Services, Customer Success, and Sales & Partnerships to clearly define roles and responsibilities, ensuring seamless collaboration across functions
  • Collaborate with Product & Services to stay informed about existing offerings and influence product roadmaps, helping design new products and services based on client feedback and market trends
  • Enhance the positioning of Infinite Lambda’s products and services during the sales process and beyond, improving how value is communicated to clients
  • Liaise with senior leadership (CEO, CTO, CPO, COO, CSO) at Infinite Lambda to formulate a clear strategy for combining data and cloud expertise into a holistic value proposition, strengthening the company’s market positioning
What we offer
What we offer
  • private health insurance
  • work-from-home budget
  • unlimited paid holiday
  • wellness benefits
  • dedicated learning and development time
  • access to top-notch learning portals
  • coaching opportunities
Read More
Arrow Right

Lead Database Engineer

We are looking for a skilled and proactive DataOps Engineer with strong Database...
Location
Location
India , Chennai; Coimbatore; Madurai
Salary
Salary:
Not provided
optisolbusiness.com Logo
OptiSol Business Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong knowledge of SQL Server architecture and internals
  • Hands-on experience in performance tuning, query optimization, and indexing strategies
  • Proficiency in T-SQL scripting and database automation
  • Proven ability in troubleshooting live database issues and bottlenecks
  • Hands-on with cloud database services (Azure SQL, AWS RDS)
  • Excellent communication and cross-functional collaboration skills
  • Strong analytical and problem-solving abilities
  • A Bachelor’s degree in Computer Science, Information Technology, or related field
Job Responsibility
Job Responsibility
  • Administer and manage SQL Server databases, including AlwaysOn Availability Groups (AAGs) and Failover Cluster Instances (FCIs)
  • Optimize database performance through advanced query tuning, indexing, and execution plans
  • Troubleshoot and resolve issues such as blocking, deadlocks, and slow queries
  • Automate DBA tasks using PowerShell, T-SQL, and modern DataOps practices
  • Monitor and manage cloud databases (Azure SQL, AWS RDS, etc.)
  • Collaborate with engineering teams to ensure high availability, scalability, and disaster recovery readiness
  • Implement database backup, restore, and DR strategies aligned with enterprise needs
What we offer
What we offer
  • Opportunity to work on cutting-edge database and DataOps practices
  • Collaborate with experts across data engineering, AI, and cloud technologies
  • Access to learning platforms, certifications, and mentoring
  • Leadership visibility and opportunities to grow within a fast-scaling team
  • Attractive performance-linked rewards
  • Fulltime
Read More
Arrow Right

Lead Data Engineer

As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in...
Location
Location
United Kingdom , Any UK Office Hub (Bristol / London / Manchester / Swansea)
Salary
Salary:
80000.00 - 96000.00 GBP / Year
madetech.com Logo
Made Tech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies
  • Strong experience in IaC and able to guide how one could deploy infrastructure into different environments
  • Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop
  • Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes)
  • Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines
  • You understand how to create reusable libraries to encourage uniformity or approach across multiple data pipelines
  • Able to document and present end-to-end diagrams to explain a data processing system on a cloud environment
  • Some knowledge of how you would present diagrams (C4, UML, etc.)
  • Enthusiasm for learning and self-development
  • You have experience of working on agile delivery-lead projects and can apply agile practices such as Scrum, XP, Kanban
Job Responsibility
Job Responsibility
  • Define, shape and perfect data strategies in central and local government
  • Help public sector teams understand the value of their data, and make the most of it
  • Establish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCP
  • Contribute to our recruitment efforts and take on line management responsibilities
  • Help implement efficient data pipelines & storage
What we offer
What we offer
  • 30 days of paid annual leave
  • Flexible parental leave options
  • Part time remote working for all our staff
  • Paid counselling as well as financial and legal advice
  • 7% employer matched pension
  • Flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan
  • Optional social and wellbeing calendar of events
  • Fulltime
Read More
Arrow Right

Principal Data Engineer

Our Principal Data Engineers are responsible for leading and delivering strategi...
Location
Location
United Kingdom , Bristol; London; Manchester; Swansea
Salary
Salary:
100000.00 - 115000.00 GBP / Year
madetech.com Logo
Made Tech
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Understanding of the issues and challenges that the public sector faces in delivering services that make the best use of data and digital capabilities, transforming legacy infrastructure, and taking an innovative and user-centric approach
  • Ability to innovate and take learnings from the commercial sector, other countries and advances in technology and apply them to UK Public Sector challenges to create tangible solutions for our clients
  • Experience building trusted advisor relationships with senior client stakeholders within the public sector.
  • Experience of building and leading high performing, consulting teams and creating the leveraged engagements to provide a cost-effective, profitable, successful client-facing delivery
  • Leadership of bids and solution shaping to produce compelling proposals that help Made Tech win new business and grow the industry
  • Experience of managing third-party partnerships and suppliers (in conjunction with Made Tech colleagues) to provide a consolidated and seamless delivery team to clients.
  • Experience in delivering complex and difficult engagements that span multiple capabilities for user-facing digital and data services in the public sector
  • Experience in identifying opportunities based on client needs and developing targeted solutions to progress the development of the opportunity
  • Experience of working with sales professionals and commercial responsibility for strategic organisational goals.
  • Experience working directly with customers and users within a technology consultancy
Job Responsibility
Job Responsibility
  • Collaborate with clients to understand their needs, provide solution advice in your role as a trusted advisor and shape solutions that leverage Made Tech's wider capabilities and credentials
  • Assess project performance as a part of the billable delivery team, Quality Assure (QA) the deliverables and outcomes, and ensure client satisfaction. Coach and mentor team members as well as providing direction to enable them to achieve their engagement outcomes and to develop their careers
  • Act as a Technical Authority of the Data & AI capability to provide oversight and ensure alignment with internal and industry best practices. Ensure engagement experience is captured and used to improve standards and contribute to Made Tech knowledge
  • Participate in business development activities, including bids and pre-sales within the account, industry and practice. Coach team members on their contributions and oversee the relevant technical aspects of the proposal submission
  • Undertake people management responsibilities, including performance reviews and professional development of your engagement and practice colleagues
  • Serve as a thought leader within Made Tech, our account engagements and the wider public sector and represent the company at industry events
What we offer
What we offer
  • 30 days of paid annual leave + bank holidays
  • Flexible Parental Leave
  • Remote Working
  • Paid counselling as well as financial and legal advice
  • Flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan
  • Optional social and wellbeing calendar of events
  • Fulltime
Read More
Arrow Right

Graduate Data Engineer

As a Graduate Data Engineer, you will build and maintain scalable data pipelines...
Location
Location
United Kingdom , Marlow
Salary
Salary:
Not provided
srgtalent.com Logo
SRG
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Degree in Computer Science, Engineering, Mathematics, or similar, or similar work experience
  • Up to 2 years of experience building data pipelines at work or through internships
  • Can write clear and reliable Python/PySpark code
  • Familiar with popular analytics tools (like pandas, numpy, matplotlib), big data frameworks (like Spark), and cloud services (like Palantir, AWS, Azure, or Google Cloud)
  • Deep understanding of data models, relational and non-relational databases, and how they are used to organize, store, and retrieve data efficiently for analytics and machine learning
  • Knowledge about software engineering methods, including DevOps, DataOps, or MLOps is a plus
  • Master's degree in engineering (such as AI/ML, Data Systems, Computer Science, Mathematics, Biotechnology, Physics), or minimum 2 years of relevant technology experience
  • Experience with Generative AI (GenAI) and agentic systems will be considered a strong plus
  • Have a proactive and adaptable mindset: willing to take initiative, learn new skills, and contribute to different aspects of a project as needed to drive solutions from start to finish, even beyond the formal job description
  • Show a strong ability to thrive in situations of ambiguity, taking initiative to create clarity for yourself and the team, and proactively driving progress even when details are uncertain or evolving
Job Responsibility
Job Responsibility
  • Build and maintain data pipelines, leveraging PySpark and/or Typescript within Foundry, to transform raw data into reliable, usable datasets
  • Assist in preparing and optimizing data pipelines to support machine learning and AI model development, ensuring datasets are clean, well-structured, and readily usable by Data Science teams
  • Support the integration and management of feature engineering processes and model outputs into Foundry's data ecosystem, helping enable scalable deployment and monitoring of AI/ML solutions
  • Engaged in gathering and translating stakeholder requirements for key data models and reporting, with a focus on Palantir Foundry workflows and tools
  • Participate in developing and refining dashboards and reports in Foundry to visualize key metrics and insights
  • Collaborate with Product, Engineering, and GTM teams to align data architecture and solutions, learning to support scalable, self-serve analytics across the organization
  • Have some prompt engineering experience with large language models, including writing and evaluating complex multi-step prompts
  • Continuously develop your understanding of the company's data landscape, including Palantir Foundry's ontology-driven approach and best practices for data management
Read More
Arrow Right

Data Scientist

At LeverX, we have had the privilege of delivering over 950 projects. With 20+ y...
Location
Location
Salary
Salary:
Not provided
leverx.com Logo
LeverX
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ years of experience as a Data Scientist
  • Hands-on experience with data analysis (probability theory and statistics, table data analysis experience) and statistical libraries such as SciPy or statsmodels
  • Knowledge and hands-on experience with machine learning, including both supervised and unsupervised learning, classical models, neural networks, and popular frameworks (scikit-learn, LightGBM, XGBoost, Keras, PyTorch, and TensorFlow)
  • Proficiency in Python and the ability to create APIs for developed solutions using tools such as FastAPI, Flask, Django REST framework, TensorFlow Serving, PyTorch Serving, Docker, and others
  • Experience with reporting and visualization tools and libraries (e.g., Matplotlib, Seaborn, Plotly, Altair, Jupyter Notebooks, Streamlit, TensorBoard) as well as with machine learning services offered by at least one major cloud provider (AWS, Azure, or GCP)
  • Understanding of DataOps and MLOps
  • Experience working according to Agile practices
  • English B2+
Job Responsibility
Job Responsibility
  • Collaborate closely with a distributed team of Data Scientists, Engineers, and stakeholders across various time zones
  • Own the full lifecycle of AI/ML solutions, from initial research and prototyping to model deployment and monitoring in production
  • Engage with business stakeholders to gather requirements, clarify goals, and translate them into data-driven solutions
  • Leverage cloud ML services and containerized APIs to build scalable machine learning pipelines
  • Apply classical ML models and neural networks using cutting-edge frameworks for a wide range of predictive and analytical tasks
  • Utilize AI tools extensively in the SDLC process
What we offer
What we offer
  • Projects in different domains: Healthcare, manufacturing, e-commerce, fintech, etc.
  • Projects for every taste: Startup products, enterprise solutions, research & development projects, and projects at the crossroads of SAP and the latest web technologies
  • Global clients based in Europe and the US, including Fortune 500 companies
  • Employment security: We hire for our team, not just a specific project. If your project ends, we will find you a new one
  • Healthy work atmosphere: On average, our employees stay in the company for 4+ years
  • Market-based compensation and regular performance reviews
  • Internal expert communities and courses
  • Perks to support your growth and well-being
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy