CrawlJobs Logo

Big Data Program Lead

https://www.citi.com/ Logo

Citi

Location Icon

Location:
India , Chennai

Category Icon

Job Type Icon

Contract Type:
Employment contract

Salary Icon

Salary:

Not provided

Job Description:

As part of Citi’s broad transformation strategy, Data Engineering group is undertaking a large-scale multi-year Agile transformation. This will need strong engineers, agile practitioners, and technical visionaries to drive the success. To this effect, Application Development Group Manager plays a pivotal role in the execution of data and technical strategy. A seasoned practitioner with experience of working with enterprise data warehouses and experience with data intensive systems. Excellent communication skills required in order to negotiate internally, often at a senior level. Necessitates a degree of responsibility over technical strategy. Responsible for handling staff management issues, including resource management and allocation of work within the team/project. The job will require partnership with stakeholders globally to develop, implement and roll out technology solutions to address a wide array of complex business problems.

Job Responsibility:

  • provides architectural vision, ensuring architecture conforms to enterprise blueprints
  • develops architecture, strategy, planning, and problem solving solutions on an enterprise level
  • interfaces across several channels, acting as a visionary to proactively assist in defining direction for future projects
  • maintains continuous awareness of business, technical, and infrastructure issues and acts as a sounding board or consultant to aid in the development of creative solutions
  • experience with developing metadata driven frameworks for data processing/transformation and built real-time processing solutions
  • hands-on data engineer with core skillset on Big Data stack of technologies including but not limited to, Spark with Scala, Hive, Impala, Kafka, Solace, Iceberg format tables etc.
  • position requires excellent communication skills to drive the change required and ability to translate the vision into technical artifacts
  • identify and apply optimization techniques to improve performance of existing applications
  • provides thought leadership in subjects that are key to the business
  • provides senior-level technical consulting and mentoring during design and development for highly complex and critical data projects
  • effectively collaborates with other members of the team, vendors and business stakeholders to align work efforts, develop and execute strategic and tactical plans that enable successful upgrade
  • knowledge of technology solutions in one or more of the functional areas is preferable– Banking or Trading Book products
  • data modeling experience in a financial services environment, preferably Enterprise Data warehouse Model based on Banking Model
  • understand the underlying technologies and applications utilized with the specified area of responsibility and stay abreast of industry leading practices to direct how to design, develop, test and implement priority technology requirement
  • provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • impacts the technology function through contribution to technical direction and strategic decisions
  • accountable for end-to-end results including such items as: budgeting, policy formulation as well as providing future state technology strategies for an effort
  • uses developed communication skills to negotiate and often at higher levels
  • performs other job duties and functions as assigned
  • appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency

Requirements:

  • 10+ years relevant experience on building data engineering solutions for large scale Operational and Data Warehouse implementations
  • consistently demonstrates clear and concise written and verbal communication
  • management and prioritization skills
  • 8+ years experience in building enterprise data warehouse systems in finance sector is preferable
  • 8+ years of relevant experience in Application Development for Enterprise
  • must Technical Skills - Java/Scala, Hadoop, Python, Hive, Impala, Kafka and Elastic
  • Apache Iceberg
  • Databases: Oracle
  • Netezza
  • must Core Skills - 10+ years experience in handling Large Teams: IT Projects Design and Development
  • Enterprise Architecture
  • Data & Database Architecture
  • Project Management
  • Software Development Life Cycle: Risk Management
  • On/Off Shore large teams management
  • knowledge on Ab Initio suite of products is preferable
  • ability to develop working relationships
  • ability to manage multiple activities and changing priorities
  • ability to work under pressure and to meet tight deadlines
  • self-starter with ability to take the initiative and master new tasks quickly
  • methodical, attention to detail

Nice to have:

knowledge on Ab Initio suite of products is preferable

Additional Information:

Job Posted:
April 29, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Big Data Program Lead

Big Data Lead Developer

We are seeking a highly skilled and experienced Big Data Lead Developer to estab...
Location
Location
Canada , Mississauga
Salary
Salary:
170.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of relevant experience in Big Data application development or systems analysis role
  • Experience in leading and mentoring big data engineering teams
  • Strong understanding of big data concepts, architectures, and technologies (e.g., Hadoop, PySpark, Hive, Kafka, NoSQL databases)
  • Proficiency in programming languages such as Java, Scala, or Python
  • Excellent problem-solving and analytical skills
  • Strong presentation, communication and interpersonal skills
  • Experience with data warehousing and business intelligence tools
  • Experience with data visualization and reporting
  • Knowledge of cloud-based big data platforms (e.g., AWS EMR, Azure HDInsight, Google Cloud Dataproc)
  • Proficiency in Unix/Linux environments
Job Responsibility
Job Responsibility
  • Lead and mentor a team of big data engineers, fostering a collaborative and high-performing environment
  • Provide technical guidance, code reviews, and support for professional development
  • Design and implement scalable and robust big data architectures and pipelines to handle large volumes of data from various sources
  • Evaluate and select appropriate big data technologies and tools based on project requirements and industry best practices
  • Implement and integrate these technologies into our existing infrastructure
  • Develop and optimize data processing and analysis workflows using technologies such as Spark, Hadoop, Hive, and other relevant tools
  • Implement data quality checks and ensure adherence to data governance policies and procedures
  • Continuously monitor and optimize the performance of big data systems and pipelines to ensure efficient data processing and retrieval
  • Collaborate effectively with cross-functional teams, including data scientists, business analysts, and product managers, to understand their data needs and deliver impactful solutions
  • Stay up to date with the latest advancements in big data technologies and explore new tools and techniques to improve our data infrastructure
What we offer
What we offer
  • Global benefits designed to support your well-being, growth, and work-life balance
  • Fulltime
Read More
Arrow Right

Big Data Engineering Lead

The Senior Big Data engineering lead will play a pivotal role in designing, impl...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's or Master’s degree in Computer Science, Information Technology, or related field
  • Atleast 10 -12 years overall software development experience on majorly working with handling application with large scale data volumes from ingestion, persistence and retrieval
  • Deep understanding of big data technologies, including Hadoop, Spark, Kafka, Flink, NoSQL databases, etc.
  • Experience with Bigdata technologies Developer Hadoop, Apache Spark, Python, PySpark
  • Strong programming skills in languages such as Java, Scala, or Python
  • Excellent problem-solving skills with a knack for innovative solutions
  • Strong communication and leadership abilities
  • Proven ability to manage multiple projects simultaneously and deliver results
Job Responsibility
Job Responsibility
  • Lead the design and development of a robust and scalable big data architecture handling exponential data growth while maintaining high availability and resilience
  • Design complex data transformation processes using Spark and other big data technologies using Java, Pyspark or Scala
  • Design and implement data pipelines that ensure data quality, integrity, and availability
  • Collaborate with cross-functional teams to understand business needs and translate them into technical requirements
  • Evaluate and select technologies that improve data efficiency, scalability, and performance
  • Oversee the deployment and management of big data tools and frameworks such as Hadoop, Spark, Kafka, and others
  • Provide technical guidance and mentorship to the development team and junior architects
  • Continuously assess and integrate emerging technologies and methodologies to enhance data processing capabilities
  • Optimize big data frameworks, such as Hadoop, Spark, for performance improvements and reduced processing time across distributed systems
  • Implement data governance frameworks to ensure data accuracy, consistency, and privacy across the organization, leveraging metadata management and data lineage tracking
  • Fulltime
Read More
Arrow Right

Data Quality & Controls Big Data Tech Lead

The Global Olympus Data Fabric team comprise of cross asset application used acr...
Location
Location
Canada , Mississauga
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of relevant experience in managing large scale applications including data quality and controls
  • Experience in managing and implementing successful projects
  • Knowledge of Big Data/Hadoop, Spark, SQL and scripting, MS Excel technology is required
  • Experience with Data Quality and Business/System Controls is a plus
  • Extensive experience system analysis and in programming of software applications
  • Subject Matter Expert (SME) in at least one area of Applications Development
  • Ability to adjust priorities quickly as circumstances dictate
  • Demonstrated leadership and project management skills
  • Consistently demonstrates clear and concise written and verbal communication
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
  • Fulltime
Read More
Arrow Right

Big Data Lead Developer (Hadoop/Java/Spark/Scala/Python)

The Applications Development Technology Lead Analyst is a senior level position ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8-10 years of relevant experience in Big Data Development
  • Sr. Java resource with experience in Java/J2EE, Hadoop, Scala, Hive, Impala, Kafka and Elastic
  • Good knowledge of design patterns and providing solutions to complex design issues, identification and resolution of code issues
  • Hands-On Experience in managing application development using Spark(Scala, Python or Java), SQL, Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.)
  • Experience as senior level in an Applications Development role
  • Proven Solution Delivery skills
  • Basic knowledge of finance industry practices and standards
  • Excellent analytical and process-based skills, i.e. process flow diagrams, business modelling, and functional design
  • Bachelor’s degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Manage one or more Applications in an effort to accomplish established goals as well as conduct personnel duties for team like hiring and training
  • Design and Develop real time and batch data transformation processes using wide range of technologies using Hadoop, Spark Stream, Spark SQL, Python, Hive etc.
  • Design and Develop programs to build functionalities, in the next generation Big-data platform which is also authorize data redistributor
  • Ability to translate architecture and low-level requirements to design and code using Big-data tools and processes
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Review and analyze proposed technical solutions for projects
  • Impact the Applications Development area through monitoring delivery of end results, participate in budget management, and handling day-to-day staff management issues, including resource management and allocation of work within the team/project
What we offer
What we offer
  • Best-in-class benefits
  • Global Benefits
  • Equal opportunity and affirmative action employer
  • Fulltime
Read More
Arrow Right

Big Data / Scala / Python Engineering Lead

The Applications Development Technology Lead Analyst is a senior level position ...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • At least two years (Over all 10+ hands on Data Engineering experience) of experience building and leading highly complex, technical data engineering teams
  • Lead data engineering team, from sourcing to closing
  • Drive strategic vision for the team and product
  • Experience managing an data focused product, ML platform
  • Hands on experience relevant experience in design, develop, and optimize scalable distributed data processing pipelines using Apache Spark and Scala
  • Experience managing, hiring and coaching software engineering teams
  • Experience with large-scale distributed web services and the processes around testing, monitoring, and SLAs to ensure high product quality
  • 7 to 10+ years of hands-on experience in big data development, focusing on Apache Spark, Scala, and distributed systems
  • Proficiency in Functional Programming: High proficiency in Scala-based functional programming for developing robust and efficient data processing pipelines
  • Proficiency in Big Data Technologies: Strong experience with Apache Spark, Hadoop ecosystem tools such as Hive, HDFS, and YARN
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Fulltime
Read More
Arrow Right

Technology and Data Risk Assurance Lead

Technology and Data Risk Assurance Lead is responsible for the assessment of out...
Location
Location
Canada , Mississauga
Salary
Salary:
120800.00 - 170800.00 USD / Year
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of experience in operational risk management, compliance, audit, or other control related functions in the financial services industry
  • ability to identify, measure, and manage key risks and controls
  • track record leading control related projects and programs
  • ability to see the big picture with high attention to critical details
  • develop and implement strategy and process improvement initiatives
  • comprehensive knowledge of Citi’s businesses and functions and their risk profiles
  • developing new ideas and improving current processes to proactively mitigate risks
  • requires an ability to provide challenge and make recommendation for risk and controls remediation
  • expert knowledge in the development and execution for controls
  • proven experience in control related functions in the financial industry
Job Responsibility
Job Responsibility
  • Responsible for the quality, completeness, and accuracy of the implementation of the control framework, including risk control policy, control standard, issue management policy, lesson learned policy and control inventory
  • lead the assessment of activities and processes as per required policies, standards and procedures to strengthen risk management quality
  • conduct routine testing of internal activities and processes to ensure adherence to established quality standards and identify areas of risk or non-compliance
  • review stakeholder/client feedback and respond to any quality assurance complaints or issues in a timely and efficient manner
  • support quality testing performed for business function quality control and transformation lead quality control post completion of an activity/process
  • develop and execute monitoring and testing for controls, including control design assessment and design of operational effectiveness for monitoring and testing tools, monitoring/testing design assessment, and execution of monitoring/testing tool
  • regularly report on quality control outcomes and control effectiveness to top management and relevant stakeholders.
  • Fulltime
Read More
Arrow Right

Tech Lead – Scala/Spark

We are seeking a Spark, Big Data - ETL Tech Lead for Commercial Card’s Global Da...
Location
Location
India , Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s or master’s degree in computer science, Information Technology, or equivalent
  • Minimum 10 years of Proven experience in developing and managing big data solutions using Apache Spark. Having strong hold on Spark-core, Spark-SQL & Spark Streaming
  • Minimum 6 years of experience in leading globally distributed teams successfully
  • Strong programming skills in Scala, Java, or Python
  • Hands on experience on Technologies like Apache Hive, Apache Kafka, HBase, Couchbase, Sqoop, Flume etc.
  • Proficiency in SQL and experience with relational (Oracle/PL-SQL) and NoSQL databases like mongoDB
  • Demonstrated people and technical management skills
  • Demonstrated excellent software development skills. Strong experiences in implementation of complex file transformations like positional, xmls
  • Experience in building enterprise system with focus on recovery, stability, reliability, scalability and performance
  • Experience in working on Kafka, JMS / MQ applications
Job Responsibility
Job Responsibility
  • Lead the design and implementation of large-scale data processing pipelines using Apache Spark on BigData Hadoop Platform
  • Develop and optimize Spark applications for performance and scalability
  • Responsible for providing technical leadership of multiple large scale/complex global software solutions
  • Integrate data from various sources, including Couchbase, Snowflake, and HBase, ensuring data quality and consistency
  • Experience of developing teams of permanent employees and vendors from 5 – 15 developers in size
  • Build and sustain strong relationships with the senior business leaders associated with the platform
  • Design, code, test, document and implement application release projects as part of development team
  • Work with onsite development partners to ensure design and coding best practices
  • Work closely with Program Management and Quality Control teams to deliver quality software to agreed project schedules
  • Proactively notify Development Project Manager of risks, bottlenecks, problems, issues, and concerns
  • Fulltime
Read More
Arrow Right

Big Data/Java Application Developer

The Big Data/Java Application Developer is an intermediate level position respon...
Location
Location
Canada , Mississauga
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5+ years of relevant experience
  • Experience in systems analysis and programming of software applications
  • Experience in managing and implementing successful projects
  • Working knowledge of consulting/project management techniques/methods
  • Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • Hands on relevant experience in Angular, HTML, CSS Java, Spring boot, Oracle, NoSQL OR Design, develop, and optimize scalable distributed data processing pipelines using Apache Spark and Scala.
  • Proficiency in Functional Programming: High proficiency in Scala-based functional programming for developing robust and efficient data processing pipelines.
  • Proficiency in Big Data Technologies: Strong experience with Apache Spark, Hadoop ecosystem tools such as Hive, HDFS, and YARN.
  • Programming and Scripting: Advanced knowledge of Scala and a good understanding of Python for data engineering tasks.
  • Data Modeling and ETL Processes: Solid understanding of data modeling principles and ETL processes in big data environments.
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Has the ability to operate with a limited level of direct supervision.
  • Can exercise independence of judgement and autonomy.
  • Experience managing an data focused product, ML platform and or UI/UX
  • Fulltime
Read More
Arrow Right
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.