CrawlJobs Logo

Data Engineer - Regulatory Reporting

clearstreet.io Logo

Clear Street

Location Icon

Location:
United States, New York

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

140000.00 - 190000.00 USD / Year

Job Description:

As an experienced Software Engineer on the Controls Engineering team, you will play an integral role in automating our Compliance & Finance regulatory processes. You'll build on your analytical skills to create solutions that process large amounts of data from our data warehouse to generate clean, correct reporting, including building out reconciliations. You will partner with key stakeholders across the Compliance, Finance, and Treasury teams to understand regulatory/financial obligations and business requirements, and translate them into clean designs and scalable solutions. As the tech lead in the team, you will provide technical guidance, prioritizing work, perform hands-on design and development and code review, as well as evolve our technical standards and best practices.

Job Responsibility:

  • Play an integral role in automating our Compliance & Finance regulatory processes
  • Create solutions that process large amounts of data from our data warehouse to generate clean, correct reporting, including building out reconciliations
  • Partner with key stakeholders across the Compliance, Finance, and Treasury teams to understand regulatory/financial obligations and business requirements, and translate them into clean designs and scalable solutions
  • Provide technical guidance, prioritizing work, perform hands-on design and development and code review, as well as evolve our technical standards and best practices

Requirements:

  • At least five (5) years of software design and development experience including CI/CD, source code control, testing, and quality management
  • Highly proficient in Python, SQL, database design
  • Experience working with data warehouses like Snowflake to generate complex solutions at scale
  • Self-starter with a sense of urgency and an eagerness to learn and explore new technologies
  • Strong communicator who can interact in a clear and concise manner with non-technical business stakeholders, product managers as well engineers
  • Ability to troubleshoot and logically assess problems and determine solutions

Nice to have:

  • Experience working in the post-trade automation space designing and architecting systems that deliver solutions to complex data problems
  • Experience generating complex financial industry regulatory reports like EMIR, MFID, SFTR, CPR, K Factor etc.
What we offer:
  • Competitive compensation, benefits, and perks
  • Company equity
  • 401k matching
  • Gender neutral parental leave
  • Full medical, dental and vision insurance
  • Lunch stipends
  • Fully stocked kitchens
  • Happy hours

Additional Information:

Job Posted:
December 07, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Job Link Share:

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data Engineer - Regulatory Reporting

New

Data Engineering & Analytics Lead

Premium Health is seeking a highly skilled, hands-on Data Engineering & Analytic...
Location
Location
United States , Brooklyn
Salary
Salary:
Not provided
premiumhealth.org Logo
Premium Health
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred
  • Proven track record and progressively responsible experience in data engineering, data architecture, or related technical roles
  • healthcare experience preferred
  • Strong knowledge of data engineering principles, data integration, ETL processes, and semantic mapping techniques and best practices
  • Experience implementing data quality management processes, data governance frameworks, cataloging, and master data management concepts
  • Familiarity with healthcare data standards (e.g., HL7, FHIR, etc), health information management principles, and regulatory requirements (e.g., HIPAA)
  • Understanding of healthcare data, including clinical, operational, and financial data models, preferred
  • Advanced proficiency in SQL, data modeling, database design, optimization, and performance tuning
  • Experience designing and integrating data from disparate systems into harmonized data models or semantic layers
  • Hands-on experience with modern cloud-based data platforms (e.g Azure, AWS, GCP)
Job Responsibility
Job Responsibility
  • Collaborate with the CDIO and Director of Technology to define a clear data vision aligned with the organization's goals and execute the enterprise data roadmap
  • Serve as a thought leader for data engineering and analytics, guiding the evolution of our data ecosystem and championing data-driven decision-making across the organization
  • Build and mentor a small data team, providing technical direction and performance feedback, fostering best practices and continuous learning, while remaining a hands-on implementor
  • Define and implement best practices, standards, and processes for data engineering, analytics, and data management across the organization
  • Design, implement, and maintain a scalable, reliable, and high-performing modern data infrastructure, aligned with the organizational needs and industry best practices
  • Architect and maintain data lake/lakehouse, warehouse, and related platform components to support analytics, reporting, and operational use cases
  • Establish and enforce data architecture standards, governance models, naming conventions ,and documentation
  • Develop, optimize, and maintain scalable ETL/ELT pipelines and data workflows to collect, transform, normalize, and integrate data from diverse systems
  • Implement robust data quality processes, validation, monitoring, and error-handling frameworks
  • Ensure data is accurate, timely, secure, and ready for self-service analytics and downstream applications
What we offer
What we offer
  • Paid Time Off, Medical, Dental and Vision plans, Retirement plans
  • Public Service Loan Forgiveness (PSLF)
  • Fulltime
Read More
Arrow Right

Audit Director – U.S. Regulatory Reporting Transaction Testing

The Audit Director is a senior level management position responsible for contrib...
Location
Location
India , Mumbai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • BA/BS or equivalent
  • Related certifications (CPA, ACA, CFA, CIA, CISA or similar) are a plus
  • Statistical, Computer Science or Computer Engineering qualifications will be an advantage
  • 15+ years of experience in a related role
  • Understanding of industry best practices and regulatory expectations for Data management (e.g. BCBS 239)
  • Knowledge of data quality software including Big Data (e.g. Paxata, Hadoop) will be an advantage
  • Detailed knowledge of substantive testing methodologies designed to assess the material accuracy of key reports, including data tracing and transaction vouching
  • Demonstrated experience in managing teams and managing integrated internal audit and assurance delivery within a matrix reporting environment
Job Responsibility
Job Responsibility
  • Development and completion (and ongoing update) of an effective audit strategy and plan (including budgets) that provides thorough, risk based substantive coverage of the data utilized in certain U.S. Regulatory Reports
  • Working closely with Product and Function Chief Auditors to ensure delivery of a plan of work that provides assurance for the accuracy of these reports
  • Interacting with U.S. regulators to provide updates and briefings on audit perspectives of the quality of the data utilized in report production
  • Contributes to strategic direction of Citi’s Internal Audit (IA) function in the establishment of reporting methodologies, organizational design and effective positioning of the function to ensure provision of independent assurance
  • Uses excellent communication, leadership and strong management skills to influence a wide range of internal audiences including respective product or, function, executive management partners and external audiences including regulators and external auditors
  • Responsible for the delivery of a high quality, value-added regulatory-required audits on time and to specification
  • Ensures the delivery of an audit reports that is complete, insightful, timely, error free and concise
  • Ensures timely delivery of high-quality comprehensive regulatory and internal audit issue validation, and, where determined appropriate, issue validation on other remediation actions, including issues arising from the external auditors, consultants and other parties
  • Contributes towards the delivery of high impact reports of IA's contributions to executive management, regulators, and Citigroup and Citibank boards' sub-committees, developing trend analyses and thematic reporting
  • Manages multiple teams of professionals
  • Fulltime
Read More
Arrow Right

Director, Data Architecture & Engineering

Are you looking for a role that motivates and challenges you? Are you ready for ...
Location
Location
United States
Salary
Salary:
162800.00 - 244200.00 USD / Year
3cloudsolutions.com Logo
3Cloud
Expiration Date
December 15, 2025
Flip Icon
Requirements
Requirements
  • 8-10+ years of relevant technology business leadership experience within a consultancy
  • Expertise in modern data engineering preferably Azure in data warehousing, data lakes, and lake house architecture
  • Broad experience in multiple competency areas of data and analytics delivery including data governance, data architecture, data integration, data classification, data analysis, data visualization, data quality management, data security and privacy, MDM, data standards, regulatory compliance and enterprise architecture frameworks
  • Deep knowledge of industry best practices
  • Exceptional written and verbal communication skills across multiple audiences, as well as demonstrated ability to manage business stakeholder relationships
  • Experience managing data practitioners, including definition of team processes, responsibilities and expectations
  • A high level of organization and the ability to prioritize tasks and keep projects on schedule
  • Bachelor's degree preferred
Job Responsibility
Job Responsibility
  • Delivery leadership that includes billable utilization, capacity planning, forecasting and project profitability of your team across one or more communities of 3Cloud’s Azure practice
  • Develop strong intercompany relationships, contribute to and drive company culture and help drive internal and growth initiatives
  • Conducting regular 1:1 meetings with your direct reports to monitor delivery/employee performance and establish management business objectives towards professional growth and advancement
  • Developing capability requirements and manage team upskilling and performance for technical and non-technical skills
  • Managing and delivering accountability and growth conversations that create positive results
  • Performing regular team performance management and reviews as needed/required
  • Recruit, hire and manage performance of consulting team in partnership with HR
  • Mindset focused on growth, creative solutions, team and personal development and a drive for action
  • Report on and analyze data and patterns from the team to improve outcomes, performance, and capabilities
  • Create and deliver updates on the team and other initiatives as necessary across the organization
What we offer
What we offer
  • Flexible work location with a virtual first approach to work
  • 401(K) with match up to 50% of your 6% contributions of eligible pay
  • Generous PTO providing a minimum of 15 days in addition to 9 paid company holidays and 2 floating personal days
  • Two medical plan options to allow you the choice to elect what works best for you
  • Option for vision and dental coverage
  • 100% employer paid coverage for life and disability insurance
  • Paid leave for birth parents and non-birth parents
  • Option for Healthcare FSA, HSA, and Dependent Care FSA
  • $67.00 monthly tech and home office allowance
  • Utilization and/or discretionary bonus eligibility based on role
  • Fulltime
Read More
Arrow Right
New

Principal Data Engineer

We are seeking an experienced Principal Data Engineer to define, lead, and scale...
Location
Location
United Kingdom , Thame; Leeds
Salary
Salary:
80000.00 - 100000.00 GBP / Year
pexa.co.uk Logo
PEXA UK
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Broad experience as a Data Engineer including technical leadership
  • Broad cloud experience, ideally both Azure and AWS
  • Deep expertise in PySpark and distributed data processing at scale
  • Extensive experience designing and optimising in Databricks
  • Advanced SQL optimisation and schema design for analytical workloads
  • Strong understanding of data security, privacy, and GDPR/PII compliance
  • Experience implementing and leading data governance frameworks
  • Proven experience leading the design and operation of a complex data platform
  • Track record of mentoring engineers and raising technical standards
  • Ability to influence senior stakeholders and align data initiatives with wider business goals
Job Responsibility
Job Responsibility
  • Design and oversee scalable, performant, and secure architectures on Databricks and distributed systems
  • Anticipate scaling challenges and ensure platforms are future-proof
  • Lead the design and development of robust, high-performance data pipelines using PySpark and Databricks
  • Define and ensure testing frameworks for data workflows
  • Ensure end-to-end data quality from raw ingestion to curated, trusted datasets powering analytics
  • Establish and enforce best practices for data governance, lineage, metadata, and security controls
  • Ensure compliance with GDPR and other regulatory frameworks
  • Act as a technical authority and mentor, guiding data engineers
  • Influence cross-functional teams to align on data strategy, standards, and practices
  • Partner with product, engineering, and business leaders to prioritise and deliver high-impact data initiatives
  • Fulltime
Read More
Arrow Right

Data Engineer, Solutions Architecture

We are seeking a talented Data Engineer to design, build, and maintain our data ...
Location
Location
United States , Scottsdale
Salary
Salary:
90000.00 - 120000.00 USD / Year
clearwayenergy.com Logo
Clearway Energy
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 2-4 years of hands-on data engineering experience in production environments
  • Bachelor's degree in Computer Science, Engineering, or a related field
  • Proficiency in Dagster or Airflow for pipeline scheduling, dependency management, and workflow automation
  • Advanced-level Snowflake administration, including virtual warehouses, clustering, security, and cost optimization
  • Proficiency in dbt for data modeling, testing, documentation, and version control of analytical transformations
  • Strong Python and SQL skills for data processing and automation
  • 1-2+ years of experience with continuous integration and continuous deployment practices and tools (Git, GitHub Actions, GitLab CI, or similar)
  • Advanced SQL skills, database design principles, and experience with multiple database platforms
  • Proficiency in AWS/Azure/GCP data services, storage solutions (S3, Azure Blob, GCS), and infrastructure as code
  • Experience with APIs, streaming platforms (Kafka, Kinesis), and various data connectors and formats
Job Responsibility
Job Responsibility
  • Design, deploy, and maintain scalable data infrastructure to support enterprise analytics and reporting needs
  • Manage Snowflake instances, including performance tuning, security configuration, and capacity planning for growing data volumes
  • Optimize query performance and resource utilization to control costs and improve processing speed
  • Build and orchestrate complex ETL/ELT workflows using Dagster to ensure reliable, automated data processing for asset management and energy trading
  • Develop robust data pipelines that handle high-volume, time-sensitive energy market data and asset generation and performance metrics
  • Implement workflow automation and dependency management for critical business operations
  • Develop and maintain dbt models to transform raw data into business-ready analytical datasets and dimensional models
  • Create efficient SQL-based transformations for complex energy market calculations and asset performance metrics
  • Support advanced analytics initiatives through proper data preparation and feature engineering
  • Implement comprehensive data validation, testing, and monitoring frameworks to ensure accuracy and consistency across all energy and financial data assets
What we offer
What we offer
  • generous PTO
  • medical, dental & vision care
  • HSAs with company contributions
  • health FSAs
  • dependent daycare FSAs
  • commuter benefits
  • relocation
  • a 401(k) plan with employer match
  • a variety of life & accident insurances
  • fertility programs
  • Fulltime
Read More
Arrow Right

Data Analyst - Regulatory

Guide Regulatory Reporting product strategy by connecting business, technical, a...
Location
Location
Brazil , São José dos Campos
Salary
Salary:
Not provided
adyen.com Logo
Adyen
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Availability to work 3 days in person on São José dos Campos (SP)
  • 4+ years of experience as a Data Analyst or in a related role
  • Proficiency in SQL, Python, and BI tools (e.g., Looker)
  • Familiarity with big data tools is a strong advantage
  • Expert executor able to break down complex problems, prioritize effectively, and align work with strategic goals
  • Strong collaborator and communicator able to manage diverse stakeholders and translate complex insights for technical and non-technical audiences in a global team
  • Curious and experimental mindset with a drive to iterate, improve, and find better solutions
Job Responsibility
Job Responsibility
  • Take ownership of high-impact data initiatives from start to finish
  • Shape business and product strategy by using deep customer understanding to challenge assumptions and identify new opportunities
  • Translate data into a compelling vision and communicate a clear technical vision and strategy to align technical and business leaders
  • Set the standard by finding simple and scalable solutions to complex problems and establishing best practices for data use across the company
  • Act as a multiplier across engineering by unblocking other teams and mentoring colleagues through feedback and code reviews
  • Fulltime
Read More
Arrow Right

Big Data Scala Engineering Developer

The Applications Development Senior Programmer/Lead Analyst is an senior level p...
Location
Location
India , Pune; Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
  • 9+ years of experience working with Hive, Impala and Hbase, Kudu Spark for data curation/conformance related work
  • Strong proficiency in Spark for development work related to curation/conformance
  • Strong Scala developer (with previous Java background) preferred
  • Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging
  • Strong data analysis skills and the ability to slice and dice the data as needed for business reporting
  • Experience working in an agile environment with a fast paced changing requirements
  • Excellent planning and organizational skills
  • Strong Communication skills
  • Bachelor's degree/University degree or equivalent experience
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation
  • Provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Interface with product teams to understand their requirements to build the ingestion pipelines and conformance layer
  • Work closely with the data ingestion team to track the requirements and drive the build out of the canonical models
  • Fulltime
Read More
Arrow Right

Data Engineer Senior

We are looking for a highly skilled professional to lead the industrialisation o...
Location
Location
Portugal , Lisbon
Salary
Salary:
Not provided
https://www.inetum.com Logo
Inetum
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Minimum of 5 years’ experience in MLOps, data engineering, or DevOps with a focus on ML/DL/LLM/AI agents in production environments
  • Strong proficiency in Python
  • Hands-on experience with CI/CD tools such as GitLab, Docker, Kubernetes, Jenkins
  • Solid understanding of ML, DL, and LLM models
  • Experience with ML lifecycle tools such as MLflow or DVC
  • Good understanding of model lifecycle, data traceability, and governance frameworks
  • Experience with on-premise and hybrid infrastructures
  • Excellent communication skills and ability to collaborate with remote teams
  • Proactive mindset, technical rigour, and engineering mentality
  • Willingness to learn, document, and standardise best practices
Job Responsibility
Job Responsibility
  • Analyse, monitor, and optimise ML models, tracking their performance
  • Design and implement CI/CD pipelines for ML models and data flows
  • Containerise and deploy models via APIs, batch processes, and streaming
  • Manage model versioning and traceability
  • Ensure continuous improvement and adaptation of AI use cases and ML models
  • Set up monitoring and alerting for model performance
  • Establish incident response protocols in collaboration with IT
  • Maintain dashboards and automated reports on model health
  • Implement validation frameworks for data and models (e.g., Great Expectations, unit tests, stress tests), in collaboration with Group Governance
  • Contribute to documentation and apply technical best practices
What we offer
What we offer
  • Work in a constantly evolving environment
  • Contribute to digital impact
  • Opportunity for growth and development
  • Fulltime
Read More
Arrow Right
Welcome to CrawlJobs.com
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.