CrawlJobs Logo

Data Engineer, Solutions Architecture

clearwayenergy.com Logo

Clearway Energy

Location Icon

Location:
United States, Scottsdale

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

90000.00 - 120000.00 USD / Year
Save Job
Save Icon
Apply Position

Job Description:

We are seeking a talented Data Engineer to design, build, and maintain our data infrastructure supporting mission-critical energy operations. You'll work at the intersection of renewable energy and data technology, developing pipelines that process everything from real-time asset performance data to complex trading and risk analytics. This hybrid role offers the opportunity to make a direct impact on clean energy operations while working with cutting-edge data platforms, including Snowflake, Dagster, dbt, and Modal.

Job Responsibility:

  • Design, deploy, and maintain scalable data infrastructure to support enterprise analytics and reporting needs
  • Manage Snowflake instances, including performance tuning, security configuration, and capacity planning for growing data volumes
  • Optimize query performance and resource utilization to control costs and improve processing speed
  • Build and orchestrate complex ETL/ELT workflows using Dagster to ensure reliable, automated data processing for asset management and energy trading
  • Develop robust data pipelines that handle high-volume, time-sensitive energy market data and asset generation and performance metrics
  • Implement workflow automation and dependency management for critical business operations
  • Develop and maintain dbt models to transform raw data into business-ready analytical datasets and dimensional models
  • Create efficient SQL-based transformations for complex energy market calculations and asset performance metrics
  • Support advanced analytics initiatives through proper data preparation and feature engineering
  • Implement comprehensive data validation, testing, and monitoring frameworks to ensure accuracy and consistency across all energy and financial data assets
  • Establish data lineage tracking and privacy controls to meet regulatory compliance requirements in the energy sector
  • Develop alerting and monitoring systems for data pipelines, including error handling, SLA monitoring, and incident response
  • Lead continuous integration and deployment initiatives for Dagster and dbt pipelines, and Streamlit/Gradio application deployments to Linux servers
  • Implement automated testing and deployment automation for data pipelines and analytics applications
  • Manage version control and infrastructure as code practices
  • Partner with Analytics Engineers, Data Scientists, and business stakeholders to understand requirements and deliver solutions
  • Work closely with asset management and trading groups to ensure real-time data availability for market operations and risk calculations
  • Collaborate with credit risk teams to develop data models supporting financial analysis and regulatory reporting
  • Translate business requirements into technical solutions and communicate data insights to stakeholders
  • Create and maintain technical documentation, data dictionaries, and onboarding materials for data assets
  • Implement role-based access controls, data encryption, and security best practices across the data stack
  • Monitor and optimize cloud infrastructure costs, implement resource allocation strategies, and provide cost forecasting

Requirements:

  • 2-4 years of hands-on data engineering experience in production environments
  • Bachelor's degree in Computer Science, Engineering, or a related field
  • Proficiency in Dagster or Airflow for pipeline scheduling, dependency management, and workflow automation
  • Advanced-level Snowflake administration, including virtual warehouses, clustering, security, and cost optimization
  • Proficiency in dbt for data modeling, testing, documentation, and version control of analytical transformations
  • Strong Python and SQL skills for data processing and automation
  • 1-2+ years of experience with continuous integration and continuous deployment practices and tools (Git, GitHub Actions, GitLab CI, or similar)
  • Advanced SQL skills, database design principles, and experience with multiple database platforms
  • Proficiency in AWS/Azure/GCP data services, storage solutions (S3, Azure Blob, GCS), and infrastructure as code
  • Experience with APIs, streaming platforms (Kafka, Kinesis), and various data connectors and formats
  • Strong analytical and troubleshooting skills with attention to detail
  • Ability to work effectively with both technical and business stakeholders
  • Comfortable with a hybrid work environment (2 days in office)

Nice to have:

  • Experience in the energy, utilities, or financial services industries
  • Knowledge of energy trading concepts, market data, or asset management
  • Familiarity with data governance frameworks and regulatory compliance (SOX, GDPR, CCPA)
  • Experience with Streamlit or Gradio for analytics application development
  • Experience with infrastructure as code (Terraform, CloudFormation)
  • Understanding of data security best practices and access controls
What we offer:
  • generous PTO
  • medical, dental & vision care
  • HSAs with company contributions
  • health FSAs
  • dependent daycare FSAs
  • commuter benefits
  • relocation
  • a 401(k) plan with employer match
  • a variety of life & accident insurances
  • fertility programs
  • adoption assistance
  • generous parental leave
  • tuition reimbursement
  • benefits for employees in same-sex marriages, civil unions & domestic partnerships
  • annual cash bonus, subject to personal and company performance goals

Additional Information:

Job Posted:
December 07, 2025

Employment Type:
Fulltime
Work Type:
Hybrid work
Icon
View All Jobs In This Company
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data Engineer, Solutions Architecture

New

Senior Data Engineer – Data Engineering & AI Platforms

We are looking for a highly skilled Senior Data Engineer (L2) who can design, bu...
Location
Location
India , Chennai, Madurai, Coimbatore
Salary
Salary:
Not provided
optisolbusiness.com Logo
OptiSol Business Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on expertise in cloud ecosystems (Azure / AWS / GCP)
  • Excellent Python programming skills with data engineering libraries and frameworks
  • Advanced SQL capabilities including window functions, CTEs, and performance tuning
  • Solid understanding of distributed processing using Spark/PySpark
  • Experience designing and implementing scalable ETL/ELT workflows
  • Good understanding of data modeling concepts (dimensional, star, snowflake)
  • Familiarity with GenAI/LLM-based integration for data workflows
  • Experience working with Git, CI/CD, and Agile delivery frameworks
  • Strong communication skills for interacting with clients, stakeholders, and internal teams
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms
  • Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers
  • Work closely with solutioning and pre-sales teams for technical evaluations and client-facing discussions
  • Lead squads of L0/L1 engineers—ensuring delivery quality, mentoring, and guiding career growth
  • Develop cloud-native data engineering solutions using Python, SQL, PySpark, and modern data frameworks
  • Ensure data reliability, performance, and maintainability across the pipeline lifecycle—from development to deployment
  • Support long-term ODC/T&M projects by demonstrating expertise during technical discussions and interviews
  • Integrate emerging GenAI tools where applicable to enhance data enrichment, automation, and transformations
What we offer
What we offer
  • Opportunity to work at the intersection of Data Engineering, Cloud, and Generative AI
  • Hands-on exposure to modern data stacks and emerging AI technologies
  • Collaboration with experts across Data, AI/ML, and cloud practices
  • Access to structured learning, certifications, and leadership mentoring
  • Competitive compensation with fast-track career growth and visibility
  • Fulltime
Read More
Arrow Right

Senior Architect - Data Architecture & Engineering

Senior Architect role dedicated to customer data strategy and advisory delivery....
Location
Location
United States
Salary
Salary:
143000.00 - 210500.00 USD / Year
3cloudsolutions.com Logo
3Cloud
Expiration Date
December 15, 2025
Flip Icon
Requirements
Requirements
  • Bachelor’s or Master’s Degree desired in Computer Science, Information Technology, or related field or equivalent experience
  • 8+ years of experience in data engineering, including 4+ years of experience architecting data solutions on Azure
  • Ability to apply technical knowledge to create a data modernization roadmap and architect solutions
  • Deep expertise in Microsoft Azure with experience with Databricks and/or Fabric
  • Proven ability to design and implement modern data architectures (data lakes, data warehouses, lakehouses, data mesh, streaming pipelines)
  • Proficiency in Python, PySpark, SQL, and data engineering frameworks
  • Experience with Azure DevOps (including building Stories and tasks, and using pipelines and ARM templates)
  • Knowledge of infrastructure as code, APIs, security, compliance, and master data management
  • Demonstrated ability to drive AI strategy and adoption, skilled at balancing AI innovation with responsible AI principles
  • Experience optimizing data pipelines, queries, and architectures for performance and cost
Job Responsibility
Job Responsibility
  • Design Azure based technical solutions leveraging a broad range of the available toolsets with considerations around functionality and performance
  • Act as team lead on projects and direct the technology process as well as manage client relationships and expectations
  • Implement end-to-end data platform solutions for clients
  • Manage client expectations with regard to scope, cost, and timeline
  • Actively support solution architects and sales directors in pre-sales activities
  • Author high quality project documentation and other project artifacts, including written case studies
  • Be an effective technical mentor to more junior level teammates
  • Deliver complex projects on-time and within budget, proactively identifying and mitigating gaps and risks
  • Be an advocate for the 3Cloud Data methodology, leading by example in following best practices and standards
  • Expand knowledge in multiple tools and technologies
What we offer
What we offer
  • Flexible work location with a virtual first approach to work
  • 401(K) with match up to 50% of your 6% contributions of eligible pay
  • Generous PTO providing a minimum of 15 days in addition to 9 paid company holidays and 2 floating personal days
  • Two medical plan options
  • Option for vision and dental coverage
  • 100% employer paid coverage for life and disability insurance
  • Paid leave for birth parents and non-birth parents
  • Option for Healthcare FSA, HSA, and Dependent Care FSA
  • $67.00 monthly tech and home office allowance
  • Utilization and/or discretionary bonus eligibility based on role
  • Fulltime
!
Read More
Arrow Right

Director, Data Architecture & Engineering

Are you looking for a role that motivates and challenges you? Are you ready for ...
Location
Location
United States
Salary
Salary:
162800.00 - 244200.00 USD / Year
3cloudsolutions.com Logo
3Cloud
Expiration Date
December 15, 2025
Flip Icon
Requirements
Requirements
  • 8-10+ years of relevant technology business leadership experience within a consultancy
  • Expertise in modern data engineering preferably Azure in data warehousing, data lakes, and lake house architecture
  • Broad experience in multiple competency areas of data and analytics delivery including data governance, data architecture, data integration, data classification, data analysis, data visualization, data quality management, data security and privacy, MDM, data standards, regulatory compliance and enterprise architecture frameworks
  • Deep knowledge of industry best practices
  • Exceptional written and verbal communication skills across multiple audiences, as well as demonstrated ability to manage business stakeholder relationships
  • Experience managing data practitioners, including definition of team processes, responsibilities and expectations
  • A high level of organization and the ability to prioritize tasks and keep projects on schedule
  • Bachelor's degree preferred
Job Responsibility
Job Responsibility
  • Delivery leadership that includes billable utilization, capacity planning, forecasting and project profitability of your team across one or more communities of 3Cloud’s Azure practice
  • Develop strong intercompany relationships, contribute to and drive company culture and help drive internal and growth initiatives
  • Conducting regular 1:1 meetings with your direct reports to monitor delivery/employee performance and establish management business objectives towards professional growth and advancement
  • Developing capability requirements and manage team upskilling and performance for technical and non-technical skills
  • Managing and delivering accountability and growth conversations that create positive results
  • Performing regular team performance management and reviews as needed/required
  • Recruit, hire and manage performance of consulting team in partnership with HR
  • Mindset focused on growth, creative solutions, team and personal development and a drive for action
  • Report on and analyze data and patterns from the team to improve outcomes, performance, and capabilities
  • Create and deliver updates on the team and other initiatives as necessary across the organization
What we offer
What we offer
  • Flexible work location with a virtual first approach to work
  • 401(K) with match up to 50% of your 6% contributions of eligible pay
  • Generous PTO providing a minimum of 15 days in addition to 9 paid company holidays and 2 floating personal days
  • Two medical plan options to allow you the choice to elect what works best for you
  • Option for vision and dental coverage
  • 100% employer paid coverage for life and disability insurance
  • Paid leave for birth parents and non-birth parents
  • Option for Healthcare FSA, HSA, and Dependent Care FSA
  • $67.00 monthly tech and home office allowance
  • Utilization and/or discretionary bonus eligibility based on role
  • Fulltime
!
Read More
Arrow Right

Senior Data Engineer

We are looking for a Senior Data Engineer to join our product DE team and report...
Location
Location
United States , Seattle; San Francisco; Mountain View
Salary
Salary:
135600.00 - 217800.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Partner across engineering teams to tackle company-wide initiatives
  • Mentor junior members of the team
  • Partner with leadership, engineers, program managers and data scientists to understand data needs
  • Apply expertise and build scalable data solution
  • Develop and launch efficient & reliable data pipelines to move and transform data (both large and small amounts)
  • Intelligently design data models for storage and retrieval
  • Deploy data quality checks to ensure high quality of data
  • Ownership of the end-to-end data engineering component of the solution
  • Support on-call shift as needed to support the team
  • Design and develop new systems in partnership with software engineers to enable quick and easy consumption of data
Job Responsibility
Job Responsibility
  • Build top-notch data solutions and data architecture to inform our most critical strategic and real-time decisions
  • Help translate business needs into data requirements and identify efficiency opportunities
What we offer
What we offer
  • Health coverage
  • Paid volunteer days
  • Wellness resources
  • Fulltime
Read More
Arrow Right

Senior Data Engineer

Atlassian is looking for a Senior Data Engineer to join their product DE team. T...
Location
Location
United States , Seattle; San Francisco; Mountain View
Salary
Salary:
135600.00 - 217800.00 USD / Year
https://www.atlassian.com Logo
Atlassian
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Partner across engineering teams to tackle company-wide initiatives
  • Mentor junior members of the team
  • Partner with leadership, engineers, program managers and data scientists to understand data needs
  • Apply expertise and build scalable data solution
  • Develop and launch efficient & reliable data pipelines to move and transform data (both large and small amounts)
  • Intelligently design data models for storage and retrieval
  • Deploy data quality checks to ensure high quality of data
  • Ownership of the end-to-end data engineering component of the solution
  • Support on-call shift to support the team
  • Design and develop new systems in partnership with software engineers to enable quick and easy consumption of data
Job Responsibility
Job Responsibility
  • Build top-notch data solutions and data architecture to inform our most critical strategic and real-time decisions
  • Help translate business needs into data requirements and identify efficiency opportunities
What we offer
What we offer
  • Health coverage
  • Paid volunteer days
  • Wellness resources
  • Fulltime
Read More
Arrow Right
New

Senior Data Engineering Architect

Location
Location
Poland
Salary
Salary:
Not provided
lingarogroup.com Logo
Lingaro
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Proven work experience as a Data Engineering Architect or a similar role and strong experience in in the Data & Analytics area
  • Strong understanding of data engineering concepts, including data modeling, ETL processes, data pipelines, and data governance
  • Expertise in designing and implementing scalable and efficient data processing frameworks
  • In-depth knowledge of various data technologies and tools, such as relational databases, NoSQL databases, data lakes, data warehouses, and big data frameworks (e.g., Hadoop, Spark)
  • Experience in selecting and integrating appropriate technologies to meet business requirements and long-term data strategy
  • Ability to work closely with stakeholders to understand business needs and translate them into data engineering solutions
  • Strong analytical and problem-solving skills, with the ability to identify and address complex data engineering challenges
  • Proficiency in Python, PySpark, SQL
  • Familiarity with cloud platforms and services, such as AWS, GCP, or Azure, and experience in designing and implementing data solutions in a cloud environment
  • Knowledge of data governance principles and best practices, including data privacy and security regulations
Job Responsibility
Job Responsibility
  • Collaborate with stakeholders to understand business requirements and translate them into data engineering solutions
  • Design and oversee the overall data architecture and infrastructure, ensuring scalability, performance, security, maintainability, and adherence to industry best practices
  • Define data models and data schemas to meet business needs, considering factors such as data volume, velocity, variety, and veracity
  • Select and integrate appropriate data technologies and tools, such as databases, data lakes, data warehouses, and big data frameworks, to support data processing and analysis
  • Create scalable and efficient data processing frameworks, including ETL (Extract, Transform, Load) processes, data pipelines, and data integration solutions
  • Ensure that data engineering solutions align with the organization's long-term data strategy and goals
  • Evaluate and recommend data governance strategies and practices, including data privacy, security, and compliance measures
  • Collaborate with data scientists, analysts, and other stakeholders to define data requirements and enable effective data analysis and reporting
  • Provide technical guidance and expertise to data engineering teams, promoting best practices and ensuring high-quality deliverables. Support to team throughout the implementation process, answering questions and addressing issues as they arise
  • Oversee the implementation of the solution, ensuring that it is implemented according to the design documents and technical specifications
What we offer
What we offer
  • Stable employment. On the market since 2008, 1500+ talents currently on board in 7 global sites
  • Workation. Enjoy working from inspiring locations in line with our workation policy
  • Great Place to Work® certified employer
  • Flexibility regarding working hours and your preferred form of contract
  • Comprehensive online onboarding program with a “Buddy” from day 1
  • Cooperation with top-tier engineers and experts
  • Unlimited access to the Udemy learning platform from day 1
  • Certificate training programs. Lingarians earn 500+ technology certificates yearly
  • Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly
  • Grow as we grow as a company. 76% of our managers are internal promotions
Read More
Arrow Right
New

Lead Data Engineer

As a Lead Data Engineer at Rearc, you'll play a pivotal role in establishing and...
Location
Location
United States
Salary
Salary:
Not provided
rearc.io Logo
Rearc
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 10+ years of experience in data engineering, data architecture, or related technical fields
  • Proven ability to design, build, and optimize large-scale data ecosystems
  • Strong track record of leading complex data engineering initiatives
  • Deep hands-on expertise in ETL/ELT design, data warehousing, and data modeling
  • Extensive experience with data integration frameworks and best practices
  • Advanced knowledge of cloud-based data services and architectures (AWS Redshift, Azure Synapse Analytics, Google BigQuery, or equivalent)
  • Strong strategic and analytical thinking
  • Proficiency with modern data engineering frameworks (Databricks, Spark, lakehouse technologies like Delta Lake)
  • Exceptional communication and interpersonal skills
Job Responsibility
Job Responsibility
  • Engage deeply with stakeholders to understand data needs, business challenges, and technical constraints
  • Translate stakeholder needs into scalable, high-quality data solutions
  • Implement with a DataOps mindset using tools like Apache Airflow, Databricks/Spark, Kafka
  • Build reliable, automated, and efficient data pipelines and architectures
  • Lead and execute complex projects
  • Provide technical direction and set engineering standards
  • Ensure alignment with customer goals and company principles
  • Mentor and develop data engineers
  • Promote knowledge sharing and thought leadership
  • Contribute to internal and external content
What we offer
What we offer
  • Comprehensive health benefits
  • Generous time away and flexible PTO
  • Maternity and paternity leave
  • Access to educational resources with reimbursement for continued learning
  • 401(k) plan with company contribution
Read More
Arrow Right

Senior Data Architect

The Senior Data Architect works with data engineers, business stakeholders, and ...
Location
Location
United States , Overland Park; Frisco
Salary
Salary:
Not provided
https://www.t-mobile.com Logo
T-Mobile
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree (preferred but not required)
  • 4-7 years Related work experience.
  • 4-7 years Progressive experience in software engineering/enterprise architecture/technology leadership across multiple products, systems and/or platforms coupled with strong business acumen and executive presence.
  • 4-7 years Experience working in data engineering, analytics, data science, or analytics engineering.
  • Software Engineering (Required)
  • Data Engineering (Required)
  • SQL
  • Enterprise Architecture (Required)
  • Solution Architecture (Required)
  • Technical Leadership (Required)
Job Responsibility
Job Responsibility
  • Design physical and conceptual data models
  • Uphold engineering excellence
  • Promote quality data analysis
  • Own solutions for comprehensive data models within domains
  • Translate requirements into well-governed data models
  • Prepare design deliverables such as architecture diagrams and API/micro-service architecture
  • Actively contribute to industry publications and professional forums
  • Maintain relationships with partner teams
  • Lead technical design and solution strategy
  • Ensure alignment of design to company standards
What we offer
What we offer
  • Medical, dental and vision insurance
  • Flexible spending account
  • 401(k)
  • Employee stock grants
  • Employee stock purchase plan
  • Paid time off
  • Up to 12 paid holidays
  • Paid parental and family leave
  • Family building benefits
  • Back-up care
  • Fulltime
Read More
Arrow Right
Welcome to CrawlJobs.com –
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Australia Jobs Canada Jobs Poland Jobs Ireland Jobs Spain Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
© 2025 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy