CrawlJobs Logo

Senior Big Data Infra Engineer

rackspace.com Logo

Rackspace

Location Icon

Location:
Vietnam

Category Icon

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided

Job Description:

We are seeking a highly skilled and experienced Senior Big Data Infra Engineer to join our dynamic team. The ideal candidate will have a strong background in developing and scaling both stream and batch processing systems, and a solid understanding of public cloud technologies. This role involves working in a remote environment, requiring excellent communication skills and the ability to solve complex problems independently and creatively.

Job Responsibility:

  • Implementing automation/DevOps best practices for CI/CD, IaC, Containerization, etc to Build a reusable infra structure for stream and batch processing systems at scale
  • Create automation, whether that is building DevOps pipelines, scripting or creating Infrastructure as Code in Terraform
  • Participating in work sessions with clients
  • Completing technical documentation

Requirements:

  • Experience in Developing and Scaling data Processing Systems This includes working with technologies like Pub/Sub, Kafka, Kinesis, DataFlow, Flink, Hadoop, Pig, Hive, and Spark
  • Expertise in public cloud services, Azure/AWS or GCP
  • Experience with Cloud managed services and understanding of cloud-based messaging/stream processing systems are critical
  • Experienced in Infrastructure and Applied DevOps principles in daily work. Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform to automate and improve development and release processes
  • Has knowledge in containerization technologies such as Docker and Kubernetes to enhance the scalability and efficiency of applications
  • Worked effectively in a remote setting, maintaining strong written and verbal communication skills. Collaborate with team members and stakeholders, ensuring clear understanding of technical requirements and project goals
  • Proven experience in engineering stream/batch processing systems at scale
  • Strong programming abilities in Java and Python
  • Hands-on experience in public cloud platforms. Additional experience with other cloud technologies is advantageous
  • Cloud Engineer Certification or other Cloud Professional level certification
  • 4+ years of experience in customer-facing software/technology or consulting
  • 4+ years of experience with “on-premises to cloud” migrations or IT transformations
  • 4+ years of experience building, and operating solutions built on GCP or AWS/Azure
  • Technical degree: Computer Science, software engineering or related

Additional Information:

Job Posted:
January 05, 2026

Employment Type:
Fulltime
Work Type:
Remote work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Senior Big Data Infra Engineer

Applications Development Senior Group Manager

This role will be part of the Risk Data team and is a senior management level po...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong academic record, ideally with a Bachelor’s or Master’s degree in Computer Science or engineering or related technical discipline
  • Proven experience in enterprise application development with full stack technologies
  • Strong Architect and hands on technical experience in implementing large volume real time complex solutions in Big Data Platforms & Public Cloud platforms
  • Experience in Data architecture, strong Software development fundamentals, data structures, design patterns, object-oriented principles
  • Experience in design and delivery of multi-tiered applications and high performance server side components
  • Skills on system performance tuning, high performance, low latency, multithreading and experience with Java server side programming
  • Preferred experience in Handling high volumes of data and working with In-memory databases and Caching solutions
  • Experience of building and leading teams, ideally with a global resource profile and demonstrated ability to deliver large projects efficiently and on time
  • Significant experience in large Financial Services Technology services companies is expected for this position
  • Hands-on development, architecture and leadership experience in real-time data engineering platforms implementation
Job Responsibility
Job Responsibility
  • Lead the efforts in Institutional Data Platform (ICG) that span multiple businesses, products and functions
  • Delivery of Price Risk related Data initiatives and Capital reporting (GSIB) related deliverables
  • Establish strong relationships with the global business stakeholders and ensure transparency of project deliveries
  • Actively identify and manage risks and issues, working with disparate teams to create mitigation plans and follow-through to resolution
  • Adhere to all key Project Management (PMQC) & Engineering Excellence standards
  • Ensure timely communications to Senior Technology Management and Business Partners in Front Office, Middle Office & other Operations functions
  • Drive the design and development of system architecture, work with end-users of the systems, and enhance the quality of deliverables
  • Ensure staff follows Citi documented policy and procedures as well as maintain desktop procedures and supporting documentation for filings on a current basis and in comprehensive manner
  • Ensure change is managed with appropriate controls, documentation, and approvals including implementation of new and revised regulatory reporting requirements
  • Manage and maintain all disaster recovery plans, oversee appropriate testing, and provide permit-to-operate for new applications
What we offer
What we offer
  • 27 days annual leave (plus bank holidays)
  • A discretional annual performance related bonus
  • Private Medical Care & Life Insurance
  • Employee Assistance Program
  • Pension Plan
  • Paid Parental Leave
  • Special discounts for employees, family, and friends
  • Access to an array of learning and development resources
  • Fulltime
Read More
Arrow Right

Senior Data Designer

This job posting is for an existing, active vacancy looking for experience in Da...
Location
Location
Canada , Markham
Salary
Salary:
120000.00 - 140000.00 CAD / Year
techmahindra.com Logo
Tech Mahindra
Expiration Date
February 19, 2026
Flip Icon
Requirements
Requirements
  • A bachelor's degree in Management Information Systems, Computer Science, Computer Information Systems, or a related Information Technology area
  • Minimum 8 years’ of experience successfully leading Data modeling & design with expertise in building large-scale enterprise data models
  • Solid grasp/experience with data technologies & tools (Snowflake, Hadoop, PostgreSQL, Informatica, DBT cloud, Airflow, AWS Glue etc.,)
  • Proficient in industry-standard data modelling methodologies
  • Excellent teamwork and communication abilities
  • Excellent consultative, facilitative, and consensus-building abilities
  • Proven expertise in developing relational databases in a corporate context
  • Demonstrated expertise in developing models for Business Intelligence solutions
  • Excellent analytical, data profiling, and problem-solving abilities
  • Excellent oral and written communication abilities
Job Responsibility
Job Responsibility
  • Work with the ETL data engineering team & business intelligence team to understand requirements for the database design and model the data as per the needs of business
  • Work with the ML engineering team and understand the needs for ML models and appropriately build the data models for their feature stores
  • Be in charge of developing conceptual, logical, and physical data models and implementing RDBMS, operational data stores (ODS), data marts, JSON/XML schemas and data lakes schemas on target platforms (SQL/NoSQL)
  • Manage the extension of existing data architecture and optimize data query performance through best practices
  • Collaborate with the development team to design and build the database model
  • Work in collaboration with data engineering teams in documenting the source to target mappings
  • Understand the company’s data migration needs
  • Work with the development team to implement the migration rules related to data
  • Work with data scientists to understand feature engineering needs and design the required logical & physical data models in the underlying ecosystem
  • Help determine data security needs and work with security or infra teams to implement security solutions
What we offer
What we offer
  • medical, vision, dental, life, disability insurance
  • paid time off (including holidays, parental leave, and sick leave, as required by law)
  • Fulltime
!
Read More
Arrow Right

Senior Software Engineer

Are you interested in building the next state-of-the-art AI infrastructure to fu...
Location
Location
India , Hyderabad
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • Experience working on large‑scale big data systems such as Cosmos, Hadoop, Magnetar, or equivalent platforms
  • Experience building or operating streaming data pipelines (e.g., real‑time or near‑real‑time processing systems)
  • Experience with Apache Spark and Scala technologies
  • Bachelor's Degree in Computer Science OR related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, OR Python OR Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Job Responsibility
Job Responsibility
  • Design, implement, and ship infrastructure related features related to enable ads metrics alerting, diagnostics and monitoring
  • Optimize data processing pipelines and evolve architectures to maximize performance and minimize cost
  • Enhance flight analysis infra to optimize CTS and add new business metrics
  • Deep dive into data to find key insights that drive technical design and feature roadmaps
  • Work with partner ads and Bing teams to light-up different ads scenarios, and leverage their work
  • Operational support for the product to fix bugs and mitigate/resolve livesites
  • Fulltime
Read More
Arrow Right

Intermediate / Senior Machine Learning Engineer

We are seeking passionate Senior Machine Learning Engineers to design, develop, ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
nttdata.com Logo
NTT DATA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, or related field (PhD is a plus)
  • 5+ years of experience in machine learning engineering, MLOps, or large-scale AI/DS systems
  • Strong foundations in data structures, algorithms, and distributed systems
  • Proficient in Python (scikit-learn, PyTorch, TensorFlow, XGBoost, etc.) and SQL
  • Hands-on experience building and deploying ML models at scale in cloud environments (GCP Vertex AI, AWS SageMaker, Azure ML)
  • Experience with containerization (Docker, Kubernetes) and orchestration (Airflow, TFX, Kubeflow)
  • Familiarity with CI/CD pipelines, infrastructure-as-code (Terraform/Helm), and configuration management
  • Experience with big data and streaming technologies (Spark, Flink, Kafka, Hive, Hadoop)
  • Practical exposure to model observability tools (Prometheus, Grafana, EvidentlyAI) and governance (WatsonX)
  • Strong understanding of statistical methods, ML algorithms, and deep learning architectures
Job Responsibility
Job Responsibility
  • Design, deploy, and maintain production-ready ML models and pipelines for real-world applications
  • Build and scale ML pipelines using Vertex AI Pipelines, Kubeflow, Airflow, and manage infra-as-code with Terraform/Helm
  • Implement automated retraining, drift detection, and re-deployment of ML models
  • Develop CI/CD workflows (GitHub Actions, GitLab CI, Jenkins) tailored for ML
  • Implement model monitoring, observability, and alerting across accuracy, latency, and cost
  • Integrate and manage feature stores, knowledge graphs, and vector databases for advanced ML/RAG use cases
  • Ensure pipelines are secure, compliant, and cost-optimized
  • Drive adoption of MLOps best practices: develop and maintain workflows to ensure reproducibility, versioning, lineage tracking, governance
  • Mentor junior engineers and contribute to long-term ML platform architecture design and technical roadmap
  • Stay current with the latest ML research and apply new tools pragmatically to production systems
Read More
Arrow Right

Senior Product Manager

Microsoft AI (MAI) team builds innovative and responsible AI-powered personalize...
Location
Location
United States , Redmond
Salary
Salary:
119800.00 - 234700.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree AND 5+ years experience in product/service/program management or software development OR equivalent experience
  • Experience in driving big cross organization initiatives in deep technical area such as search
  • Understand scaling challenges with open-source technologies like HDFS, Spark & Kafka
  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience
  • 4+ years experience improving product metrics for a product, feature, or experience in a market (e.g., growing customer base, expanding customer usage, avoiding customer churn)
  • Experience in LLM evals, metrics, quality is a big plus
  • Has successfully built and ran large scale cloud/distributed compute, storage and inferencing systems and products
  • Experience with inventory and capacity management understanding the demand, supply and engineering dependencies, compliance and security related activities
Job Responsibility
Job Responsibility
  • Define product vision and strategy by understanding of customer needs, leadership vision and competitive market
  • Identifies short-and long-term investment opportunities, evaluates tradeoffs, and drives the product roadmap
  • Drive innovation in search and grounding for Bing, Copilot and Office users by working closely with engineering, product and leadership
  • Make personalized News, Web, image, and video recommendations to millions of users, globally
  • Empower hundreds of scientists to quickly and safely experiment and continually improve the product
  • Evolve multi-tenant platforms for infra for Storage & Inferencing such as ObjectStore, HDFS, Spark and Kafka for Big Data and NRT processing
  • Do inventory and capacity management of the complex fleet of CPU and GPU running these large systems
  • Fulltime
Read More
Arrow Right
New

Senior Manager Events and Catering

Assists the Assistant Director of Catering by providing support to the operation...
Location
Location
United States
Salary
Salary:
85000.00 - 113000.00 USD / Year
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • High school diploma or GED
  • 4 years’ experience in the event management, food and beverage, or related professional area
  • OR Bachelor’s degree from an accredited university in Hotel and Restaurant Management, Hospitality, Business Administration, or related major
  • 2 years’ experience in the event management, food and beverage, or related professional area
Job Responsibility
Job Responsibility
  • Projects supply needs for the department
  • Applies knowledge of all laws as they relate to an event
  • Understands the impact of banquet operations on the overall success of a conference event and manages activities to maximize customer satisfaction
  • Adheres to and reinforces all standards, policies, and procedures
  • Maintains established sanitation levels
  • Manages departmental inventories and maintains equipment
  • Schedules banquet service staff to forecast and service standards, while maximizing profits
  • Assists team in developing lasting relationships with groups to retain business and increase growth
  • Manages department controllable expenses to achieve or exceed budgeted goals
  • Verifies that all banquet event orders (BEO’s) are developed and distributed according to established guidelines
What we offer
What we offer
  • Relocation Assistance Available
  • Fulltime
Read More
Arrow Right
New

Software Engineer

We are looking for a skilled Software Engineer to join our dynamic team in New Y...
Location
Location
United States , New York
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science or a related field from a reputable institution
  • At least 3 years of experience as a software engineer, with a proven track record in full-stack development
  • Proficiency in TypeScript, React.js, and Node.js
  • Hands-on experience with mobile development, particularly using React Native
  • Ability to design and develop performance-sensitive and low-latency systems
  • Strong problem-solving skills and attention to detail
  • Familiarity with startup environments and an entrepreneurial mindset
Job Responsibility
Job Responsibility
  • Develop and maintain full-stack applications using TypeScript, React, and React Native
  • Design, implement, and optimize low-latency systems and performance-sensitive software
  • Collaborate with cross-functional teams to deliver high-quality solutions that meet user needs
  • Contribute to the development of mobile applications with expertise in React Native
  • Write clean, efficient, and scalable code to ensure optimal application functionality
  • Debug and troubleshoot technical issues to maintain system reliability
  • Participate in code reviews and provide constructive feedback to team members
  • Stay up-to-date with emerging technologies and incorporate best practices into development processes
  • Work in an entrepreneurial environment, taking ownership of projects and driving them to completion
  • Engage with product teams to understand user requirements and deliver impactful solutions
What we offer
What we offer
  • medical, vision, dental, and life and disability insurance
  • eligible to enroll in our company 401(k) plan
Read More
Arrow Right
New

Ct technologist

PRN CT Technologist position at Atrium Health Navicent Peach. Need PRN CT techno...
Location
Location
United States , Byron
Salary
Salary:
33.05 - 49.60 USD / Hour
advocatehealth.com Logo
Advocate Health Care
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Graduate of an accredited two-year AMA program in Radiologic or Nuclear Medicine Technology required
  • ARRT certification in Radiology or NMTCB for Nuclear Medicine and advanced registry from the ARRT in CT scanning within one year of hire required
  • BLS required
Job Responsibility
Job Responsibility
  • Examines requests and verifies orders on each assigned patient
  • Properly identify and assist patients while offering a brief explanation of the procedures
  • Interviews patients for a complete medical history
  • Assumes responsibility for the exam from beginning of exam until completion of dictated results
  • Prepares and administers IV contrast according to departmental protocols
  • Evaluates technical quality of images and consults with a Radiologist if needed
  • Performs basic patient care functions
  • Performs CT scanning and assists Radiologist/PA during invasive procedures
  • Is authorized to obtain medication or contrast material as directed for administration by a licensed practitioner
  • Practices principle of radiation safety for self, employees, patients and family members
What we offer
What we offer
  • Paid Time Off programs
  • Health and welfare benefits such as medical, dental, vision, life, and Short- and Long-Term Disability
  • Flexible Spending Accounts for eligible health care and dependent care expenses
  • Family benefits such as adoption assistance and paid parental leave
  • Defined contribution retirement plans with employer match and other financial wellness programs
  • Educational Assistance Program
  • Parttime
Read More
Arrow Right