This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We are seeking an experienced and highly motivated Lead Big Data Developer (C12) to drive the development, standardization, and governance of data across our Big Data Portfolio. This role is crucial in ensuring compliance with regulatory mandates, consent orders, and data governance policies, while also optimizing data pipelines and architectures for high-performance applications. The successful candidate will work closely with business stakeholders, data scientists, and engineering teams to establish enterprise-wide data consistency and improve data quality, lineage, and reconciliation processes. The ideal candidate will have a strong background in Big Data technologies, data standardization frameworks, and regulatory compliance related to financial data management.
Job Responsibility:
Lead the design, implementation, and optimization of scalable and standardized Big Data architectures
Drive data standardization efforts in alignment with regulatory requirements, consent orders, and enterprise data policies
Ensure data lineage, quality, and governance compliance across all critical data elements (CDEs)
Collaborate with Risk, Compliance, and Regulatory teams to address consent order requirements related to data controls, reconciliation, and validation
Implement data quality frameworks, metadata management, and lineage tracking for improved data transparency and regulatory reporting
Optimize data ingestion, transformation, and processing pipelines using streaming and batch processing methodologies
Develop and enforce data security and privacy controls to meet internal and external regulatory expectations
Work closely with cross-functional teams to automate data reconciliation and anomaly detection
Provide technical leadership to junior and mid-level engineers, fostering a culture of engineering excellence and regulatory adherence.
Requirements:
8+ years of experience in data engineering, Big Data platforms, and software development
Strong expertise in Big Data technologies (Spark, Hadoop, Hive, Impala, Kafka, Scala, Cloudera)
Experience with data governance, data standardization, and metadata management frameworks
Strong SQL and NoSQL experience (Oracle, MongoDB, PostgreSQL) for data extraction, reconciliation, and transformation
Proficiency in Python, Java, and Shell scripting for data processing and automation
Experience implementing data lineage and data quality monitoring solutions
Understanding of data privacy regulations (GDPR, CCPA) and financial regulatory frameworks (BCBS 239, CCAR, Basel, OCC Consent Orders)
Familiarity with cloud-based data solutions (AWS, GCP, or Azure)
Ability to translate complex regulatory requirements into actionable data strategies
Experience in Capital Markets, Risk, Finance, and Regulatory Reporting is a plus
Strong analytical and problem-solving skills with a compliance-driven mindset.
Nice to have:
Experience working with Consent Order Remediation Programs related to data management and governance
Expertise in Canonical Data Models and Data Mesh Architecture
Ability to liaise with regulators and internal audit teams to demonstrate data controls and compliance adherence
Strong technical documentation and communication skills for presenting data standardization strategies.
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.