This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
This position is under ICG TTS Operations Technology (OpsTech) Group, to help the implementation of next-generation Digital Automation Platform and Imaging Workflow Technologies. The role involves development and optimization of Spark applications in Scala, guiding a team of engineers, and ensuring scalability and efficiency of data pipelines using cutting-edge technologies.
Job Responsibility:
Develop, test, and deploy production-grade Spark applications in Scala, ensuring optimal performance, scalability, and resource utilization
Provide technical leadership and guidance to a team of data engineers, fostering a culture of technical excellence, collaboration, and continuous improvement
Conduct rigorous code reviews, establish coding standards, and enforce best practices for Spark Scala development, data governance, and data quality
Identify and resolve performance bottlenecks in Spark applications through advanced tuning techniques
Design and build complex data pipelines
Articulate technical concepts to diverse audiences
Requirements:
Hands on knowledge of SPARK, Py-Spark, scala, Java
Hands on knowledge of RDBMS like MS-SQL/Oracle
Knowledge of CI/CD tools like LightSpeed, uDeploy
Profound understanding of Spark's architecture (RDDs, DataFrames, Datasets), execution model, and optimization techniques
Extensive experience with Spark SQL, Spark Streaming, and Spark Core
Proven ability to design and build complex data pipelines (ETL/ELT)
Expert-level proficiency in Scala programming, including functional programming paradigms and object-oriented design
Strong hands-on experience with the broader Hadoop ecosystem (HDFS, YARN, Hive, Kafka, etc.) and related big data technologies
Solid understanding of relational databases (SQL, schema design) and NoSQL databases
Excellent communication, interpersonal, and leadership skills
Exceptional analytical and problem-solving abilities
What we offer:
Global benefits designed to support your well-being, growth, and work-life balance
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.