CrawlJobs Logo

Apache Spark Technical Lead

https://www.soprasteria.com Logo

Sopra Steria

Location Icon

Location:
India , Noida ▼

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

Define and implement the data requirements and database structure for the application. This includes viable solution building for large amount of data with state of the art technologies such as Spark for Big Data, NoSQL for databases and Python. Work with French customers directly and must have good proficiency in French Language, atleast A2 level certified in French Language. They will be integrated in Agile Squad including French Customer resources and will have constant and regular interactions in French inside the team.

Job Responsibility:

  • Define and implement the data requirements and database structure for the application
  • Viable solution building for large amount of data with state of the art technologies such as Spark for Big Data, NoSQL for databases and Python
  • Work with French customers directly
  • Will be integrated in Agile Squad including French Customer resources and will have constant and regular interactions in French inside the team

Requirements:

  • 5 to 10 years experience
  • Define and implement data requirements and database structures for applications
  • Design logical and physical data models and ensure efficient data storage
  • Develop scalable solutions using Big Data technologies (e.g., Spark, Hadoop, NoSQL)
  • Must have good proficiency in French Language, atleast A2 level certified in French Language
  • Ensure smooth data collection, storage, and processing for high-volume datasets
  • Establish and manage database operations, change control, and disaster recovery processes
  • Optimize performance and reliability of data systems
  • Collaborate with development teams to align data architecture with application needs

Additional Information:

Job Posted:
January 18, 2026

Employment Type:
Fulltime
Work Type:
On-site work
Icon
Sopra Steria - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Apache Spark Technical Lead

Apache Spark Senior Technical Lead

We are looking for a skilled Data Engineer to build and maintain scalable data p...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.soprasteria.com Logo
Sopra Steria
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expertise in Spark and Scala for large-scale data processing
  • Proficiency in Python and SQL, including hands-on experience with PL/SQL
  • Experience in data integration/ETL workflows
  • Strong knowledge of relational databases such as Oracle and PostgreSQL
  • Excellent verbal and written communication skills
  • Result-oriented with strong analytical and problem-solving skills
  • Ability to work in a fast-paced, agile, and collaborative environment
Job Responsibility
Job Responsibility
  • Maintain, develop, and design data ingestion and transformation pipelines using Spark and Scala
  • Process and optimize SQL and PL/SQL queries for large datasets
  • Integrate and process data from multiple sources for analytics and reporting
  • Collaborate with BI and Analytics teams to support reporting and dashboard needs
  • Ensure data quality, performance, and security
  • Provide innovative solutions to complex business/technical problems
  • Identify and resolve technical, integration and development issues
  • Implement best practices, standards and processes to ensure quality of the final product
  • Responsible for development of features independently
  • Continuous build, automated testing, and release management
What we offer
What we offer
  • Inclusive and respectful work environment
  • Open to people with disabilities
  • Fulltime
Read More
Arrow Right

Tech Lead - Ab Initio / Spark ETL

The Applications Development Senior Programmer Analyst is an intermediate level ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BS or MS Degree in Computer Science, Information Technology, or equivalent
  • Minimum 10 years of Ab Initio application design and development experience
  • Minimum 6 years of experience in leading globally distributed teams successfully
  • Demonstrated people and technical management skills
  • Strong understanding of ETL analysis and design, frameworks on Ab Initio
  • Experience in developing and managing big data solutions using Apache Spark
  • Strong programming skills in Scala, Java, or Python
  • Hands on experience on Technologies like Apache Hive, Apache Kafka, HBase, Couchbase, Sqoop, Flume etc.
  • Demonstrated excellent software development skills
  • Experience in building enterprise ETL based system with focus on recovery, stability, reliability, scalability and performance
Job Responsibility
Job Responsibility
  • Responsible for providing technical leadership of multiple large scale/complex global software solutions
  • Experience of developing teams of permanent employees and vendors from 5 – 20 developers in size
  • Build and sustain strong relationships with the senior business leaders associated with the platform
  • Design, code, test, document and implement application release projects as part of development team
  • Work with onsite development partners to ensure design and coding best practices
  • Work closely with Program Management and Quality Control teams to deliver quality software to agreed project schedules
  • Proactively notify Development Project Manager of risks, bottlenecks, problems, issues, and concerns
  • Compliance with Citi's System Development Lifecycle and Information Security requirements
  • Oversee development scope, budgets, time line documents
  • Monitor, update and communicate project timelines and milestones
  • Fulltime
Read More
Arrow Right

Java / Spark Senior Lead Developer

The Applications Development Technology Lead Analyst is a senior level position ...
Location
Location
India , Pune/Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of relevant experience in Apps Development or systems analysis role
  • Extensive experience system analysis and in programming of software applications
  • Experience in managing and implementing successful projects
  • Subject Matter Expert (SME) in at least one area of Applications Development
  • Ability to adjust priorities quickly as circumstances dictate
  • Demonstrated leadership and project management skills
  • Consistently demonstrates clear and concise written and verbal communication
  • Highly experienced and skilled Java technical lead with 10+years of experience with software building and platform engineering
  • Extensive development expertise in building the high scaled and performant software platforms for data computation and processing
  • Expert level knowledge of core Java concepts and framework such as Spring Boot, Microservices and well versed with OOPs concepts and design patterns
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
What we offer
What we offer
  • Global Benefits
  • We bring the best to our people. We put our employees first and provide the best-in-class benefits they need to be well, live well and save well.
  • Fulltime
Read More
Arrow Right

Big Data / Scala / Python Engineering Lead

The Applications Development Technology Lead Analyst is a senior level position ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least two years (Over all 10+ hands on Data Engineering experience) of experience building and leading highly complex, technical data engineering teams
  • Lead data engineering team, from sourcing to closing
  • Drive strategic vision for the team and product
  • Experience managing an data focused product, ML platform
  • Hands on experience relevant experience in design, develop, and optimize scalable distributed data processing pipelines using Apache Spark and Scala
  • Experience managing, hiring and coaching software engineering teams
  • Experience with large-scale distributed web services and the processes around testing, monitoring, and SLAs to ensure high product quality
  • 7 to 10+ years of hands-on experience in big data development, focusing on Apache Spark, Scala, and distributed systems
  • Proficiency in Functional Programming: High proficiency in Scala-based functional programming for developing robust and efficient data processing pipelines
  • Proficiency in Big Data Technologies: Strong experience with Apache Spark, Hadoop ecosystem tools such as Hive, HDFS, and YARN
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Fulltime
Read More
Arrow Right

Java-Python Lead Developer

We're seeking a passionate and highly skilled Lead Java Developer to join our ta...
Location
Location
Canada , Mississauga
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of hands-on experience developing high-performance Java applications (Java 11+ preferred) with a strong foundation in core Java concepts, OOP, and OOAD
  • Proven experience building and maintaining data pipelines using technologies like Kafka, Apache Spark, or Apache Flink
  • Familiarity with event-driven architectures and experience in developing real-time, low-latency applications
  • Deep understanding of distributed systems concepts and experience with MPP platforms such as Trino (Presto), Pinot or Snowflake
  • Experience deploying and managing applications on container orchestration platforms like Kubernetes, OpenShift, or ECS
  • Demonstrated ability to lead and mentor engineering teams, communicate complex technical concepts effectively, and collaborate across diverse teams
  • Excellent problem-solving skills and a data-driven approach to decision-making
  • Python knowledge with exposure to Django or Flask
  • Bachelor’s degree/University degree or equivalent experience
  • Master’s degree preferred
Job Responsibility
Job Responsibility
  • Provide technical leadership and mentorship to a team of data engineers, fostering a culture of collaboration, innovation, and continuous learning
  • Lead the design and development of highly scalable, low-latency, fault-tolerant data pipelines and platform components that meet Citi's evolving business needs
  • Stay abreast of emerging open-source data technologies and evaluate their suitability for integration into Citi's platform
  • Continuously identify and implement performance optimizations across the data platform to ensure optimal efficiency and responsiveness
  • Partner closely with stakeholders across engineering, data science, and business teams to understand requirements and translate them into robust technical solutions
  • Drive the timely and high-quality delivery of data platform projects, adhering to agile methodologies and best practices
  • Fulltime
Read More
Arrow Right

Tech Lead – Scala/Spark

We are seeking a Spark, Big Data - ETL Tech Lead for Commercial Card’s Global Da...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or master’s degree in computer science, Information Technology, or equivalent
  • Minimum 10 years of Proven experience in developing and managing big data solutions using Apache Spark. Having strong hold on Spark-core, Spark-SQL & Spark Streaming
  • Minimum 6 years of experience in leading globally distributed teams successfully
  • Strong programming skills in Scala, Java, or Python
  • Hands on experience on Technologies like Apache Hive, Apache Kafka, HBase, Couchbase, Sqoop, Flume etc.
  • Proficiency in SQL and experience with relational (Oracle/PL-SQL) and NoSQL databases like mongoDB
  • Demonstrated people and technical management skills
  • Demonstrated excellent software development skills. Strong experiences in implementation of complex file transformations like positional, xmls
  • Experience in building enterprise system with focus on recovery, stability, reliability, scalability and performance
  • Experience in working on Kafka, JMS / MQ applications
Job Responsibility
Job Responsibility
  • Lead the design and implementation of large-scale data processing pipelines using Apache Spark on BigData Hadoop Platform
  • Develop and optimize Spark applications for performance and scalability
  • Responsible for providing technical leadership of multiple large scale/complex global software solutions
  • Integrate data from various sources, including Couchbase, Snowflake, and HBase, ensuring data quality and consistency
  • Experience of developing teams of permanent employees and vendors from 5 – 15 developers in size
  • Build and sustain strong relationships with the senior business leaders associated with the platform
  • Design, code, test, document and implement application release projects as part of development team
  • Work with onsite development partners to ensure design and coding best practices
  • Work closely with Program Management and Quality Control teams to deliver quality software to agreed project schedules
  • Proactively notify Development Project Manager of risks, bottlenecks, problems, issues, and concerns
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Inetum Polska is part of the global Inetum Group and plays a key role in driving...
Location
Location
Poland , Warsaw
Salary
Salary:
Not provided
https://www.inetum.com Logo
Inetum
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Expert-level proficiency in Databricks, Apache Spark, SQL, and Python/Scala
  • Extensive experience with cloud data platforms (AWS, Azure, or GCP) and big data technologies
  • Strong understanding of data architecture, data warehousing, and lakehouse concepts
  • Experience with real-time data processing and streaming technologies (Kafka, Delta Live Tables, Event Hubs)
  • Proficiency in automation, CI/CD, and Infrastructure as Code (Terraform, Bicep)
  • Leadership skills with the ability to drive strategic technical decisions
  • 6+ years of experience in data engineering, with a track record of designing and implementing complex data solutions
Job Responsibility
Job Responsibility
  • Architect and implement enterprise-grade data solutions using Databricks, Apache Spark, and cloud services
  • Lead data engineering initiatives, setting best practices and guiding technical decisions
  • Design, optimize, and scale data pipelines for performance, reliability, and cost efficiency
  • Define data governance policies and implement security best practices
  • Evaluate emerging technologies and recommend improvements to existing data infrastructure
  • Mentor junior and mid-level engineers, fostering a culture of continuous learning
  • Collaborate with cross-functional teams to align data strategy with business objectives
What we offer
What we offer
  • Flexible working hours
  • Hybrid work model
  • Cafeteria system
  • Generous referral bonuses
  • Additional revenue sharing opportunities
  • Ongoing guidance from a dedicated Team Manager
  • Tailored technical mentoring
  • Dedicated team-building budget
  • Opportunities to participate in charitable initiatives and local sports programs
  • Supportive and inclusive work culture
  • Fulltime
Read More
Arrow Right

Big Data Engineering Lead

The Senior Big Data engineering lead will play a pivotal role in designing, impl...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master’s degree in Computer Science, Information Technology, or related field
  • Atleast 10 -12 years overall software development experience on majorly working with handling application with large scale data volumes from ingestion, persistence and retrieval
  • Deep understanding of big data technologies, including Hadoop, Spark, Kafka, Flink, NoSQL databases, etc.
  • Experience with Bigdata technologies Developer Hadoop, Apache Spark, Python, PySpark
  • Strong programming skills in languages such as Java, Scala, or Python
  • Excellent problem-solving skills with a knack for innovative solutions
  • Strong communication and leadership abilities
  • Proven ability to manage multiple projects simultaneously and deliver results
Job Responsibility
Job Responsibility
  • Lead the design and development of a robust and scalable big data architecture handling exponential data growth while maintaining high availability and resilience
  • Design complex data transformation processes using Spark and other big data technologies using Java, Pyspark or Scala
  • Design and implement data pipelines that ensure data quality, integrity, and availability
  • Collaborate with cross-functional teams to understand business needs and translate them into technical requirements
  • Evaluate and select technologies that improve data efficiency, scalability, and performance
  • Oversee the deployment and management of big data tools and frameworks such as Hadoop, Spark, Kafka, and others
  • Provide technical guidance and mentorship to the development team and junior architects
  • Continuously assess and integrate emerging technologies and methodologies to enhance data processing capabilities
  • Optimize big data frameworks, such as Hadoop, Spark, for performance improvements and reduced processing time across distributed systems
  • Implement data governance frameworks to ensure data accuracy, consistency, and privacy across the organization, leveraging metadata management and data lineage tracking
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy