CrawlJobs Logo

Hadoop Administrator

logic-loops.com Logo

Logic Loops

Location Icon

Location:
United States, Atlanta

Category Icon
Category:
IT - Administration

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Responsibility:

  • Deploy new Hadoop infrastructure, Hadoop cluster upgrades, cluster maintenance, troubleshooting, capacity planning and resource optimization
  • Review, develop, and implement strategies that preserve the availability, stability, security and scalability of large Hadoop clusters
  • Interact with developers, architects and other operation team members to resolve job performance issues
  • Preparation of architecture, design and operational documentation
  • Participation in weekly on call rotation to provide operational support

Requirements:

  • Hands-on experience with the Hadoop stack (HDFS, MapReduce, Hbase, Pig, Hive, Oozie)
  • Extensive experience with Oracle 10g/11g databases and PL/SQL
  • Monitor and review Oracle database instances to identify potential maintenance and tuning issues
  • Expertise in systems administration, Linux tools, configuration management in a large-scale environment
  • Troubleshoot and debug Hadoop ecosystem runtime issues
  • Recover from node failures and troubleshoot common Hadoop cluster issues
  • Document all production scenarios, issues, and resolutions
  • Teamwork in providing hardware architectural guidance, planning, estimating cluster capacity, and creating roadmaps for Hadoop cluster deployment
  • Evaluation of Hadoop infrastructure requirements and design/deploy solutions (i.e., high availability big data clusters, etc.)
  • Expertise in performance tuning, system dump analysis, and storage capacity management
  • Experience with versioning, change control, problem management
  • Strong communication and technical writing skills
  • Result-oriented engineer with a laser-sharp delivery focus
  • Must-Have Primary Skill: Technical Lead-BIG Data ( BD)-Apache Hadoop (HDFS)-Hbase/Hive/Pig/Mahoot/Flume/Scoop/MapReduce/Yarn

Additional Information:

Job Posted:
December 10, 2025

Icon
View All Jobs In This Company
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Hadoop Administrator

New

Database Administrator II

We are seeking a highly skilled Cloudera Hadoop Administrator (DBA) with hands-o...
Location
Location
Salary
Salary:
100900.00 - 126100.00 USD / Year
acehardware.com Logo
ACE Hardware
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 4+ years of hands-on experience administering Cloudera Hadoop clusters
  • 2–3+ years of Databricks experience in production environments
  • 2+ years of Databricks administration experience on Azure (preferred)
  • Strong knowledge of Spark and Delta Lake architecture
  • Experience with IAM, Active Directory, and SSO integration
  • Familiarity with DevOps and CI/CD for data platforms
  • Deep understanding of Hadoop ecosystem: Hive, Impala, Spark, HDFS, YARN
  • Experience integrating data from DB2 to Hadoop/Databricks using tools like Sqoop or custom connectors
  • Scripting skills in Shell and/or Python for automation and system administration
  • Solid foundation in Linux/Unix system administration
Job Responsibility
Job Responsibility
  • Manage and support Cloudera Hadoop clusters and services (HDFS, YARN, Hive, Impala, Spark, Oozie, etc.)
  • Perform cluster upgrades, patching, performance tuning, capacity planning, and health monitoring
  • Secure the Hadoop platform using Kerberos, Ranger, or Sentry
  • Develop and maintain automation and monitoring scripts
  • Ingest data using tools such as Sqoop, NiFi, DEI Informatica, Qlik
  • Support release and deployment activities, including deployment of new across Dev/Test and Production environments
  • Integration of CI/CD pipelines (Git, or custom tooling) for automated code deployment
  • Ensuring minimal downtime, rollback capability, and alignment with change management policies
  • Maintain detailed release documentation, track changes in version control systems, and collaborate with development and operations teams to streamline deployment workflows
  • Administer and maintain Databricks workspaces in cloud environments (Azure, or GCP)
What we offer
What we offer
  • Incentive opportunities
  • Generous 401(k) retirement savings plan with matching and discretionary contributions
  • Comprehensive health coverage (medical, dental, vision and disability) & life insurance benefits
  • 21 days of vacation
  • Up to 6 paid holidays
  • Annual Ace Cares Week
  • 20 hours off work per year to volunteer
  • Opportunities to help Children’s Miracle Network Hospitals and the Ace Helpful Fund
  • On-site classes, facilitator-led courses, and a generous tuition assistance program
  • Frequent campus events (Employee Appreciation Week, vendor demos, cookouts, merchandise sales)
  • Fulltime
Read More
Arrow Right

Splunk Consultant

DeployPartners deliver high-quality Service Assurance Solutions expertise throug...
Location
Location
Australia , North Sydney
Salary
Salary:
Not provided
deploypartners.com Logo
DeployPartners
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 3+ Years experience in installing and configuring Splunk
  • An understanding of the components of a larger-scale Splunk implementation
  • Extensive knowledge of Operating systems, server administration, routers, switches, firewalls, load balancers, fault management, email servers, VM Platforms, Cloud Services, Hadoop, IPS, IDS and TCP/IP
  • Experience with both Linux and Windows operating systems: comfortable with the command line interface
  • Working knowledge or recent experience with scripting languages (bash, pearl), regular expressions, application development (java, python, .NET) SQL
  • Experience in successful startups in the area of system management
  • Ability to quickly explore, examine and understand complex problems and how these relate to the customer's business
  • Able to quickly understand and interpret customer problems and navigate complex organisations
  • Effective at communicating clearly to technical and business audiences
  • Well-organised with a healthy sense of urgency and ability to set, communicate and meet aggressive goals
Job Responsibility
Job Responsibility
  • Responsible for system installations, configuration, testing and design
  • Estimating required project effort and durations
  • Prepare and submit project weekly reports on work executed
  • Prepare and create clear concise and professional project documentation
  • Assisting in pre-sales activities, including responding to RFP, RFQ and SOW's
  • Provide customer support on Splunk projects and assist with tickets logged and live and development systems when not on customer site
  • Fulltime
Read More
Arrow Right

Business Intelligence Developer

The CTI Enterprise Analytical Services (EAS) organization is actively recruiting...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of experience with Business Intelligence tool or data federation tools such as Starburst developer or administrator
  • 3+ years of Linux, Shell scripting, Ansible experience
  • 8+ years overall IT experience
  • Knowledge of the Hadoop ecosystem with experience in Hive, Spark, etc. is a plus
  • Knowledge of Java or any programming language is a plus
  • Good interpersonal skills with excellent communication skills - written and spoken English
  • Able to interact with client projects in cross-functional teams
  • Good team player interested in sharing knowledge and cross-training other team members and shows interest in learning new technologies and products
  • 5+ years of hands-on experience in setting up security (authentication and authorization) for Business Intelligence or data federation products
  • Experience with container technologies, Kubernetes, and cloud architectures, including some exposure to public cloud platforms such as AWS, GCP
Job Responsibility
Job Responsibility
  • Deliver the tooling and capabilities needed to enable data & analytics services such as Starburst, Tableau on massive, distributed data sets
  • Understand Engineering needs including those required to build, maintain, and operate the system through all phases of its life
  • Create and maintain continuous integration and deployment processes including testing and monitoring to ensure the solution is reliable and measurable
  • Take full ownership of designing solutions, and building blueprints, prototypes, and frameworks to drive enablement of new capabilities
  • Collaborate with cross-functional teams to build a portfolio of capabilities for recommendation and use in new product developments
  • Publish best practices, configuration recommendations, design patterns, tool/technology selection methodologies, and playbooks for Engineering and user communities
  • Collaborate with cross-functional Engineering teams to build a portfolio of capabilities to recommend and use in analytical product development across Citi lines of Businesses
  • Enable Hybrid cloud implementation along with security for Business Intelligence products
  • Enable Business Intelligence products on external Cloud platforms as SaaS or PaaS solutions and integrate with various Cloud and on-prem data sources
  • Build reusable security and deployment framework for Business Intelligence services enabled on Cloud and on-prem
  • Fulltime
Read More
Arrow Right

Bigdata Support Lead Engineer

The Lead Data Analytics analyst is responsible for managing, maintaining, and op...
Location
Location
India , Bengaluru; Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of total IT experience
  • 5+ years of experience in supporting Hadoop (Cloudera)/big data technologies
  • 5+ years of experience in public cloud infrastructure (AWS or GCP)
  • Experience with Kubernetes and cloud-native technologies
  • Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.)
  • Advanced knowledge of the Hadoop ecosystem and Big Data technologies
  • Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)
  • Knowledge of troubleshooting techniques for Hive, Spark, YARN, Kafka, and HDFS
  • Advanced Linux system administration and scripting skills (Shell, Python)
  • Experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Spark with Java or Scala or Python
Job Responsibility
Job Responsibility
  • Lead day to day operation and support for Cloudera Hadoop ecosystem components (HDFS, YARN, Hive, Impala, Spark, HBase, etc)
  • Troubleshoot issues related to data ingestion, job failures, performance degradation and service unavailability
  • Monitor cluster health using Cloudera Manager and respond to alerts, logs, and metrics
  • Collaborate with engineering teams to analyze root causes and implement preventive measures
  • Collaborate patching, service restarts, failovers and rolling restarts for cluster maintenance
  • Assist in user onboarding, access control and issues in accessing the cluster services
  • Contribute to documentation for knowledge base
  • Work on data recovery, replication, and backup support tasks
  • Responsible for moving all legacy workloads to cloud platform
  • Ability to research and assess open-source technologies, public cloud tech stack (AWS/GCP) components to recommend and integrate into the design and implementation
  • Fulltime
Read More
Arrow Right

Principal Site Reliability Engineer

Location
Location
United States , Ft. Meade
Salary
Salary:
Not provided
cipherlogix.com Logo
CipherLogix
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Fourteen (14) years experience in software development/engineering, including requirements analysis, software development, installation, integration, evaluation, enhancement, maintenance, testing, and problem diagnosis/resolution
  • Ten (10) years experience in system engineering/architecture
  • Ten (10) years experience working with products that support highly distributed, massively parallel computation needs such as Hbase, Hadoop, CloudBase/Acumulo, Big Table, Cassandra, Scality etc
  • At least ten (10) years experience writing software scripts using scripting languages such as Perl, Python, or Ruby for software automation
  • At least four (4) years experience managing and monitoring large Cloud System (>200 nodes). Cloud Systems Administrator or Developer Certification
  • Experience in performing and providing technical direction for the development, engineering, interfacing, integration, and testing of complete hardware/software systems to include monitoring technical health of a system, improving organizational processes, implementation of postmortem (failure) analysis and incident management
  • Ten (10) years experience in the cleared environment
  • Ten (10) years demonstrated experience developing software for one of the following: Windows, UNIX, or Linux OS
  • Knowledge and experience with developing distributed storage routing and querying algorithms
  • Experience in developing documentation required to support a program’s technical issues and training situations
  • Fulltime
Read More
Arrow Right

Director, Service Reliability Engineering

As Director of SRE, you will lead the team responsible for accelerating and auto...
Location
Location
United States , Bethesda
Salary
Salary:
125600.00 - 203700.00 USD / Year
https://www.marriott.com Logo
Marriott Bonvoy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Undergraduate degree in computer science, software engineering, or a related field (or equivalent experience)
  • 10+ years of experience in SRE, devsecops or IT operations
  • At least 5 years’ experience in a previous leadership role within SRE, devsecops or IT Operations
  • At least five years of experience in the following technologies - Presentation Management: HTML, CSS, JS, Backbone, Node JS, Android, iOS, Application Platforms: NGINX, Java, Akana, Play Framework, Tomcat, Docker, Openshift, Application Data: PostgreSQL, Couchbase, Cassandra, Integration Services: Apache Kafka, Apache Spark, Akana, Analytics Platforms: Hadoop, dashDB, Cognos, Tableau, Security: Forgerock, OpenID, OAUTH, Ping Identity, Public Cloud: Azure, Google Cloud, AliCloud, Amazon Web Services, CI/CD: Harness
  • Experience with test automation
  • Working knowledge and proven track record of implementing disaster indifferent architecture
  • Experience with CDN and Akamai tools
  • Linux/Unix system administration experience
  • Proficient in scripting and programming languages (like Python, Go, Bash, Shell)
  • Hands on experience with infrastructure as code (like Terraform), container orchestration (like Kubernetes), and reliability automation
Job Responsibility
Job Responsibility
  • Define and execute Marriott’s SRE vision, aligning with business objectives and technology roadmaps
  • Build, mentor and lead a high-performing SRE team, fostering a culture of collaboration and innovation
  • Establish reliability, observability and automation goals to improve system uptime, performance and scalability
  • Partner with engineering, operations and security teams to drive best practices and continuous improvement
  • Implement reliability-focused engineering practices, including SLAs, SLOs/SLIs and error budgets
  • Design and maintain resilient, scalable and fault-tolerant architectures across cloud and hybrid environments
  • Develop strategies to proactively identify and mitigate risks to system performance and availability
  • Drive root cause analysis (RCA) and post-mortem processes to prevent recurring incidents
  • Champion automation in monitoring, deployment and incident resolution to reduce toil and enhance efficiency
  • Lead and optimize incident response processes, ensuring rapid detection, diagnosis, and resolution of system failures
What we offer
What we offer
  • Bonus program
  • comprehensive health care benefits
  • 401(k) plan with up to 5% company match
  • employee stock purchase plan at 15% discount
  • accrued paid time off (including sick leave where applicable)
  • life insurance
  • group disability insurance
  • travel discounts
  • adoption assistance
  • paid parental leave
  • Fulltime
Read More
Arrow Right

Cloud Technical Architect / Data DevOps Engineer

The role involves designing, implementing, and optimizing scalable Big Data and ...
Location
Location
United Kingdom , Bristol
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • An organised and methodical approach
  • Excellent time keeping and task prioritisation skills
  • An ability to provide clear and concise updates
  • An ability to convey technical concepts to all levels of audience
  • Data engineering skills – ETL/ELT
  • Technical implementation skills – application of industry best practices & designs patterns
  • Technical advisory skills – experience in researching technological products / services with the intent to provide advice on system improvements
  • Experience of working in hybrid environments with both classical and DevOps
  • Excellent written & spoken English skills
  • Excellent knowledge of Linux operating system administration and implementation
Job Responsibility
Job Responsibility
  • Detailed development and implementation of scalable clustered Big Data solutions, with a specific focus on automated dynamic scaling, self-healing systems
  • Participating in the full lifecycle of data solution development, from requirements engineering through to continuous optimisation engineering and all the typical activities in between
  • Providing technical thought-leadership and advisory on technologies and processes at the core of the data domain, as well as data domain adjacent technologies
  • Engaging and collaborating with both internal and external teams and be a confident participant as well as a leader
  • Assisting with solution improvement activities driven either by the project or service
  • Support the design and development of new capabilities, preparing solution options, investigating technology, designing and running proof of concepts, providing assessments, advice and solution options, providing high level and low level design documentation
  • Cloud Engineering capability to leverage Public Cloud platform using automated build processes deployed using Infrastructure as Code
  • Provide technical challenge and assurance throughout development and delivery of work
  • Develop re-useable common solutions and patterns to reduce development lead times, improve commonality and lowering Total Cost of Ownership
  • Work independently and/or within a team using a DevOps way of working
What we offer
What we offer
  • Extensive social benefits
  • Flexible working hours
  • Competitive salary
  • Shared values
  • Equal opportunities
  • Work-life balance
  • Evolving career opportunities
  • Comprehensive suite of benefits that supports physical, financial and emotional wellbeing
  • Fulltime
Read More
Arrow Right
New

Senior Payments Operations Manager

As Senior Payments Operations Manager for Procedures, Standards & GTM Readiness,...
Location
Location
United States
Salary
Salary:
188000.00 - 235000.00 USD / Year
airbnb.com Logo
Airbnb
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 12+ years of experience in payments, fintech, or financial services, with a focus on operations, enablement, or process management
  • Proven success in building and scaling operational payment processes across complex, cross-functional organizations
  • Deep understanding of pay-ins, payouts, operational workflows, forecasting, and exception management, including regulatory, compliance, and policy requirements
  • Demonstrated ability to translate strategy and policy into actionable, scalable operations
  • Strong collaboration and stakeholder management skills across Product, Risk, Compliance, Finance, and Operations teams
  • Analytical and structured thinker with a bias for execution and continuous improvement
  • Excellent communicator, able to simplify complex concepts and influence effectively across all levels of the organization
Job Responsibility
Job Responsibility
  • Operational Enablement & Execution: Partner cross-functionally to operationalize core workflows for Airbnb’s payments platform—including third-party payments, unpaid payouts, blocked third-party payments, dormant accounts, liens, garnishments, and escheatment—ensuring each has clear ownership, documented processes, appropriate tooling, and reliable execution with defined performance metrics and SLAs
  • Collaborate cross-functionally with Product, Risk, Compliance, Partnerships, Treasury, Customer Support, FP&A, and regional teams to align on workflow design, tooling needs, volume projections, resource planning, and budgeting
  • Balance control and experience, ensuring operational processes meet policy, risk, and compliance requirements while minimizing friction for guests and hosts
  • Identify and implement optimization opportunities across money-movement operations, leveraging automation, AI, and data insights to improve accuracy, speed, and scalability
  • Close ownership gaps by establishing clear accountability, measurable SLAs, and consistent global execution standards
  • Develop playbooks, procedures, and escalation paths that define how payments operations are executed and governed across markets and teams
  • May eventually lead directly or indirectly a team of people to enable and execute operations
  • Policies, Procedures & Standards: Define and maintain clear policies and procedures that guide payment operations, ensuring ownership, consistency, and compliance globally
  • Embed controls into everyday work so processes meet legal and regulatory requirements without adding unnecessary friction
  • Keep policies and procedures current and simple, updating them as products, markets, or regulations evolve, and ensuring teams know how to apply them in daily operations
What we offer
What we offer
  • bonus
  • equity
  • benefits
  • Employee Travel Credits
  • Fulltime
Read More
Arrow Right
Welcome to CrawlJobs.com –
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Australia Jobs Canada Jobs Poland Jobs Ireland Jobs Spain Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
© 2025 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy