CrawlJobs Logo

Big Data Dbt/redshift Engineer

twocircles.com Logo

Two Circles

Location Icon

Location:
Canada , Vancouver

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

We are seeking a Lead Data Engineer to join a client-focused data pod delivering large-scale data engineering solutions within a cloud-native AWS environment. This is a delivery-first role requiring deep hands-on expertise in streaming data architectures, big data systems, and modern data warehousing practices. You will own streaming architectural direction while remaining actively involved in implementation. The environment is AWS-centric (Redshift, S3, Glue, Step Functions, Lambda, EMR), with DBT as the transformation framework. We are actively integrating streaming data from GCP sources into our AWS data platform. You will define engineering standards across data modeling, DBT implementation, testing, CI/CD, and production resiliency while collaborating directly with the client’s data team.

Job Responsibility:

  • Own the architectural direction for streaming data ingestion from GCP into AWS
  • Design resilient ingestion frameworks including error handling, retry strategies, monitoring, and failure isolation
  • Implement distributed processing pipelines using Spark / PySpark or similar frameworks
  • Create and maintain scalable data warehouses and associated ETL/ELT processes using DBT models in Amazon Redshift
  • Design and implement DBT projects including macros, tests, documentation, and reusable modeling patterns
  • Conduct Redshift query and DBT performance tuning to optimize warehouse efficiency and cost
  • Define and enforce best practices for: Data modeling
  • Version control (Git-based workflows)
  • CI/CD pipelines for DBT deployments
  • Automated testing at model, transformation, and pipeline levels
  • Ensure robust testing is embedded into every DBT model (schema tests, custom tests, data validation checks)
  • Lead code reviews and architectural design reviews
  • Work with AWS services including Redshift, S3, Glue, Step Functions, Lambda (Python), Athena, and EMR

Requirements:

  • 6+ years of data engineering experience in big data environments
  • Proven experience designing and implementing streaming architectures
  • Extensive hands-on DBT experience (models, macros, tests, documentation)
  • Strong Amazon Redshift architecture and performance optimization expertise
  • Experience building CI/CD pipelines for data platforms
  • Experience working in client-facing delivery contexts
  • AWS: Redshift, S3, Glue, Step Functions, Lambda (Python), Athena, EMR
  • Strong SQL and Redshift performance tuning expertise
  • Python and PySpark (or equivalent distributed processing frameworks)
  • Git-based version control workflows
  • Deep understanding of data warehousing, modeling, and big data systems

Nice to have:

Streaming experience preferred

Additional Information:

Job Posted:
March 04, 2026

Icon
Two Circles - All Job Offers
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Big Data Dbt/redshift Engineer

New

Customer Success Account Manager

With over 17,000 employees worldwide, the mission of the Customer Experience & S...
Location
Location
Italy , Rome
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Business, Sociology, Psychology, Computer Science or related field AND several years of customer success, solution delivery, practice management, customer-facing consulting, or portfolio management experience OR Master's Degree in Business, Sociology, Psychology, Computer Science, or related field AND several years of customer success, solution delivery, practice management, customer-facing consulting, or portfolio management experience OR equivalent experience
  • work experience within customer industry
  • Prosci OR Microsoft or competitor equivalent (e.g., AWS) certification in relevant technologies (e.g., Azure, 365)
  • Information Technology Infrastructure Library (ITIL) Foundation certification or equivalent service management certification
  • Project Management Institute (PMI) or equivalent Project Management certification is preferred
Job Responsibility
Job Responsibility
  • Customer Relationship Management: support foundational relationships with key customer stakeholders and technical professionals to enable quality solution delivery and health using partnerships with other account team leaders and with guidance from more experienced colleagues
  • Customer Success Leadership and Customer Strategy and Growth: listen to conversations with customers and begins to align objectives with the current Microsoft portfolio of work in the customer account
  • align with the account team to link Customer Success Plans (CSPs) with account plan priorities and develop bookable programs of work
  • Customer Success leadership - Delivery and program Management: support the delivery of program planning and customer-facing program reviews, prioritization of engagements, and engagement with key technical stakeholders to address agreed-upon customer outcomes and account priorities to deliver ongoing customer success
  • initiate conversations with customers to connect customer objectives and the current Microsoft portfolio of work in the customer account
  • adopt the organizational and customer success strategy and ensure you align Microsoft technology and services with the customer goals and objectives
  • meet consumption milestones as you track adoption and usage of Microsoft products and services, work with customers to identify areas where adoption could be improved and takes action to drive usage while you develop and leverage an understanding of retention and churn in their customer portfolio to begin identifying potential opportunities where retention may become an issue
  • Fulltime
Read More
Arrow Right
New

Senior Support Escalation Manager

In the Customer Service & Support (CSS) organization we are looking for people w...
Location
Location
South Korea , Seoul
Salary
Salary:
Not provided
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Master's Degree in technology, business, or related field AND 3+ years technology industry, customer service, or related experience
  • OR Bachelor's Degree in technology, business, or related field AND 4+ years technology industry, customer service, or related experience
  • OR 7+ years technology industry, customer service, or related experience
  • OR equivalent experience
  • 3+ years customer service, technology industry, or related experience
  • Business English written and Fluent verbal communication skills
  • English Language Level C1 as per CEFR
  • Korean Language - Written or Speaking, is a must
  • Excellent judgment, decision making skills, and the ability to work under continual deadline pressure
  • Ability to identify short term mitigation and propose options for longer term resolution
Job Responsibility
Job Responsibility
  • Primary contact managing escalated customer and partner issues
  • Handling customer/partner escalations that come to the team through various internal channels
  • Direct customer interaction with the goal of identifying and resolving issues related to Microsoft technology and services, ensuring they are resolved within established guidelines/policies
  • Dealing with highly sensitive customers and situations
  • Represent Microsoft by providing world class service and displaying our core principles in all their work
  • Fulltime
Read More
Arrow Right
New

Distribution Executive

This Partner Executive role will work centrally to support the Distribution team...
Location
Location
United Kingdom , London
Salary
Salary:
30000.00 - 35000.00 GBP / Year
careers.itv.com Logo
ITV Jobs
Expiration Date
March 26, 2026
Flip Icon
Requirements
Requirements
  • Highly data literate and ability to work with and manipulate multiple data sources including Looker, Tableau, Amplitude and external partner data sources
  • Creative thinker with an aptitude for creating clear, visually appealing presentation materials
  • Experience in the broadcast industry with understanding of crucial KPIs, particularly in Streaming
  • Problem solver with ability to form a strong cross-functional network
  • Strong storyteller
  • Highly data literate
  • Commercially minded
  • Strong networker
  • Highly organised and proactive
  • Problem solver and adaptable
Job Responsibility
Job Responsibility
  • Own Distribution's relationship with The Insights Group, briefing in and reviewing work where required
  • Creation and refinement of presentation materials for senior audiences according to the team’s needs, including for C-Suite, M&E Board and external partners
  • Commercial analysis of partner performance, spotting key trends and actively sharing with Distribution team and key partner teams (Marketing, TIG, Product)
  • Responsible for creation of materials, including spotting actionable insights, for all partner QBRs
  • Conduct or collate market research and insights on topics ranging from new distribution opportunities/platforms, competitor products/services and external reporting
  • Supporting senior members of the Distribution team with ad-hoc projects including Virgin re- engagement, Prime Video Channels opportunity etc.
  • Working with the Director of Distribution Strategy on projects including competitor research, insights analysis, deck preparation and scenario modelling
  • Organise and chair quarterly Distribution All-Hands meetings, including organising external speakers and pulling together presentation materials
  • Internal coordination and project management of a senior group of stakeholders for Freely, including co-ordinating agendas, taking minutes, following up on open actions, iterating performance data, and championing Freely internally
  • Building relationships with key stakeholders at Everyone TV including across Product, Data and Strategy to ensure co-ordination of strategies, answering of open questions or following up on
What we offer
What we offer
  • Flexible working with a range of options
  • Generous holiday allowance, plus you can buy more
  • Annual bonus opportunity
  • Competitive pension contribution
  • Save as you earn - with an opportunity to buy ITV shares
  • Wellbeing and volunteering days plus a wide range of opportunities to help you live a balanced and healthy life
  • Fulltime
!
Read More
Arrow Right
New

Onboarding Coordinator

The Onboarding Coordinator is a cross-functional role responsible for delivering...
Location
Location
United States , Redmond
Salary
Salary:
76800.00 - 151900.00 USD / Year
https://www.microsoft.com/ Logo
Microsoft Corporation
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's Degree in Business, Operations, Finance, or related field AND 2+ years experience in program management, process management, or process improvement OR equivalent experience
  • Experience supporting onboarding, recruitment coordination, business operations, or office/program administration in a fast‑paced environment
  • Strong organizational skills with the ability to manage multiple workstreams, priorities, and deadlines simultaneously
  • Clear and effective communicator with the ability to collaborate across diverse stakeholder groups
  • Detail-oriented and proactive, with a demonstrated ability to anticipate needs and surface risks or issues early
  • Comfortable working with office technology, collaboration tools, and basic troubleshooting for meetings and onboarding sessions
  • Demonstrated professionalism, discretion, and a service‑oriented mindset when engaging candidates, new hires, and leaders
Job Responsibility
Job Responsibility
  • Own and execute end-to-end onboarding logistics at the MAI Mountain View engineering site to ensure new hires are prepared, equipped, and welcomed with a consistent, best‑in‑class experience
  • Partner with onboarding admins and IT support to ensure devices are procured, prepared, allocated, and ready for Day 1. Communicate device readiness and issues proactively
  • Coordinate shipping, tracking, and delivery of devices and peripherals for remote hires and supported sites
  • Support and facilitate onboarding sessions (onsite and virtual), including room setup, materials preparation, and coordination with IT support
  • Prepare, send, and maintain updated pre-Day 1 and Day 1 onboarding templates
  • Maintain and monitor onboarding‑related inventory (devices, peripherals, onboarding materials) and coordinate bulk orders, as needed
  • Draft and distribute clear, concise communications related to onboarding processes, schedules, updates, and changes
  • Exercise discretion and professionalism when handling sensitive employee, candidate, and business information
  • Support onsite recruitment and interview experiences by coordinating room setup, technology readiness, Wi‑Fi access, and loaner device management
  • Host candidates and visitors onsite, providing a professional, welcoming experience and campus orientation as needed
  • Fulltime
Read More
Arrow Right
New

Technical Assistant

ProVision are one of the UK’s leading equipment hire companies, providing Lighti...
Location
Location
United Kingdom , Manchester
Salary
Salary:
Not provided
careers.itv.com Logo
ITV Jobs
Expiration Date
March 31, 2026
Flip Icon
Requirements
Requirements
  • Excellent theoretical and working knowledge of video, audio and grip equipment with the ability to offer technical advice and solutions
  • Ability to work under pressure and meet tight deadlines
  • Good communication skills with the ability to deal effectively with all levels of staff and management
  • Good computer skills with the ability to use google mail, google docs and google sheets
  • Full manual drivers licence is essential
  • Role involves lifting and carrying large lighting, camera sound and grip equipment
  • Potential short notice call out to support production requirements
  • Experience working in a customer focused environment
  • An interest in the TV Industry
  • Preferably previous experience in equipment rental
Job Responsibility
Job Responsibility
  • The preparation, first line maintenance and stock control of all technical equipment
  • Providing a high standard of service to all ProVision clients
  • Provide a complete technical solution, from day to day running of hire equipment to the preparation of daily additional extras
  • Delivering ProVision’s vast array of external Drama and Factual productions
  • Driving to various locations to collect and deliver equipment
What we offer
What we offer
  • Flexible working with a range of options
  • Generous holiday allowance, plus you can buy more
  • Annual bonus opportunity
  • Competitive pension contribution
  • Save as you earn - with an opportunity to buy ITV shares
  • Wellbeing and volunteering days plus a wide range of opportunities to help you live a balanced and healthy life
  • Fulltime
!
Read More
Arrow Right
New

Music Executive

As a Music Executive working within the ITV Music Team across both non scripted ...
Location
Location
United Kingdom , London
Salary
Salary:
35000.00 - 40000.00 GBP / Year
careers.itv.com Logo
ITV Jobs
Expiration Date
March 31, 2026
Flip Icon
Requirements
Requirements
  • 2 years plus experience working within the music industry preferably within a broadcast music team or for a music publisher, record label or music collecting society or for a music supervision company
  • A robust and demonstrable knowledge of direct licensing and music copyright including an understanding of the differences between masters and compositions, mechanical, synchronisation and performing rights and of the mandates held by the music societies which enable the use and exploitation of music in television programmes
  • An interest in creative music supervision with the ability to undertake music research and to supply and create music playlists
  • Ability to work proactively, independently and with initiative and to be reliable with an exceptional eye for detail, capable of working on multiple projects under pressure and within tight timeframes in a fast-paced production environment
  • Tech savvy and proficient in Gmail and Google Docs. Processing a strong understanding of ITV’s use of cloud based document and database systems including Silvermouse, My Clear, ITV Music Hub and Disco and familiarity with Google Gemini and other company approved AI tools
  • Willingness and enthusiasm to work both remotely and in the office as part of the wider music team and/or directly with productions on location and to travel within the UK and internationally depending on the needs of the business
Job Responsibility
Job Responsibility
  • Help provide high quality music supervision, reporting, licensing and administrative support to ITV Studios and other ITV group production companies, as well as to producers supplying content for broadcast on all ITV’s TV channels and online platforms, ensuring the smooth fulfilment of all production music requirements
  • Help deliver the ITV Music Team’s purpose and mission to balance creative and editorial choices with legal compliance, and to deliver high-quality music that enhances our programmes and programme brands whilst supporting revenue growth and monetisation opportunities
  • As well as identifying opportunities to utilise technology to drive efficiency while respecting the fundamentals of copyright and musical creativity
  • Play an important part of the implementation of ITV music policies across the group
What we offer
What we offer
  • Flexible working with a range of options
  • Generous holiday allowance, plus you can buy more
  • Annual bonus opportunity
  • Competitive pension contribution
  • Save as you earn - with an opportunity to buy ITV shares
  • Wellbeing and volunteering days plus a wide range of opportunities to help you live a balanced and healthy life
  • Fulltime
!
Read More
Arrow Right
New

Production Coordinator

The Production Coordinator role will support the live daily delivery of all Dayt...
Location
Location
United Kingdom , London
Salary
Salary:
Not provided
careers.itv.com Logo
ITV Jobs
Expiration Date
March 31, 2026
Flip Icon
Requirements
Requirements
  • Experience working as a Production Coordinator (or equivalent) level in live/studio TV Production
  • Proven production knowledge in the effective set-up and operational delivery of a range of production formats and genres (studio, location filming, outside broadcast), both domestically and internationally
  • Demonstrable skills to be proactive in the production environment, showing sensitivity to the needs and pressures of colleagues
  • Knowledgeable of a range of production broadcast technologies (e.g. LiveU, SNG) ways of working
  • Confidence to manage upwards effectively and communicate with the wider production team, drawing on a range of strategies and skills to persuade and influence
  • High level of integrity, particularly when dealing with confidential and sensitive issues
  • Strong knowledge of location logistics, PSC crew coordination, and call sheet creation
  • Experience in completing a multitude of risk assessments and various insurance documentation
Job Responsibility
Job Responsibility
  • Support the live daily delivery of all Daytime shows
  • Manage the smooth running of all studio operations, crew logistics, and day-to-day production processes
  • Work closely with the Senior Production Manager, Line Producer and wider production team to ensure that the studio crew, contributors, talent, and paperwork are fully coordinated and compliant
  • Support live output from the gallery
  • Work as either a Studio Production Coordinator or a Location Production Coordinator on an alternating roster
  • Work across This Morning, Lorraine & Loose Women on a rotational basis
  • For Studio: coordinate logistics, contracting, health & safety, crew rosters, budgeting, and post-production
  • For Location: support the Features and any Outside Broadcast (OB) content for Daytime shows
  • Support the smooth planning and delivery of pre-recorded VT packages, musical performances, showbiz junkets, and live OBs
What we offer
What we offer
  • Flexible working with a range of options
  • Generous holiday allowance, plus you can buy more
  • Annual bonus opportunity
  • Competitive pension contribution
  • Save as you earn - with an opportunity to buy ITV shares
  • Wellbeing and volunteering days plus a wide range of opportunities to help you live a balanced and healthy life
  • Fulltime
!
Read More
Arrow Right
New

Senior Java Developer

Location
Location
Germany , Düsseldorf
Salary
Salary:
Not provided
freshcells.de Logo
Freshcells
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Several years of hands-on experience in Software Engineering
  • Strong experience with Java, including versions 11 and 17
  • Experience with the Spring (Boot) framework
  • Ability to write and optimize SQL queries
  • Experience in Software Integration Development (SOAP/REST)
  • You are comfortable with microservices architectures, API-based and event-based communication
  • Experience with build and dependency management tools such as Maven and Gradle
  • Familiarity with reactive programming principles and hands-on experience using Project Reactor
  • Experience in agile development in a team and an organized and result-oriented work ethic for sustainable and scalable web systems
  • Good knowledge of how to design distributed systems
Job Responsibility
Job Responsibility
  • Design and improve our high-performance Java web applications with industry-standard frameworks
  • Conceptual design and implementation of new features for sophisticated software solutions in cooperation with the project management, design, and development teams
  • Writing automated software tests and setup deployments for web applications
  • Profiling and discovering performance bottlenecks in our Java applications
What we offer
What we offer
  • Flexible remote-work days
  • Flex-time for early risers and night owls
  • A dog-friendly working environment
  • A secure and long-term job
  • Company pension plan with employer subsidy possible
  • Regular exchange, feedbacks, team meetings & retrospectives
  • Monthly Company Breakfast
  • Room for own ideas and personal development
  • Digital training courses, available to every employee at his or her own discretion
  • Subsidy for Deutschlandticket
  • Fulltime
Read More
Arrow Right
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Canada Jobs Australia Jobs Germany Jobs Ireland Jobs Poland Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
CrawlJobs Group
ITFlashcards AllDevBlogs
© 2026 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy