Senior Data Engineer

• Lead the design and development of data pipelines for ingestion, transformation, and loading of data from various sources into the data warehouse/lake
• Develop and optimize data models for query performance and business requirements
• Write optimized and maintainable SQL queries for data retrieval and manipulation
• Implement robust data quality checks and monitoring systems
• Collaborate with Data Scientists, Data Analysts, and stakeholders to translate complex business requirements into efficient data solutions
• Research and implement new technologies and best practices to improve the data platform
• Deploy and monitor data pipelines and infrastructure on cloud platforms
• Occasionally work non-standard shifts and provide on-call support for critical data operations
• Mentor junior developers and foster a collaborative team environment.

• Bachelor's degree in Computer Science, Software Engineering, or a related field
• 6+ years of hands-on experience in a Data Engineering role
• Proven experience with database design, development, and administration
• Experience with data visualization tools and techniques for presenting data insights effectively
• Familiarity with agile development methodologies and experience working in agile teams
• Strong proficiency in Python (version 3.6+), with experience in Python packaging and shared libraries like Pandas and NumPy
• Experience implementing REST APIs in Python using microframeworks like Flask
• Extensive experience working with relational databases, writing complex SQL, and optimizing queries for performance
• Proven expertise with SQLAlchemy or similar ORM libraries for efficient database interaction
• Experience with workflow management tools like Airflow (experience with PySpark or PyFlink is a major plus)
• Solid understanding of data warehousing concepts and experience working with large datasets, including data modeling and ETL processes
• Ability to guide and mentor junior developers, fostering a collaborative team environment and promoting professional growth
• Strong communication skills, both written and verbal, with the ability to explain complex technical concepts to both technical and non-technical audiences
• Experience working in a Continuous Integration and Continuous Delivery environment and familiarity with tools like Jenkins, TeamCity, SonarQube, OpenShift, ECS, or Kubernetes
• Proficient in industry-standard best practices such as Design Patterns, Coding Standards, Coding modularity, and Prototyping.

• Experience with PySpark or PyFlink
• Data visualization tools and techniques
• Familiarity with agile methodologies.

Best-in-class benefits for wellness, living, and saving.