This list contains only the countries for which job offers have been published in the selected language (e.g., in the French version, only job offers written in French are displayed, and in the English version, only those in English).
We are seeking a highly skilled Senior Developer with deep expertise in Apache NiFi to lead the design, development, and implementation of critical data automation and integration initiatives. The core focus will be on leveraging NiFi to build scalable, secure, and efficient data pipelines for key initiatives, including data automation, historic data access, and auditing processes. The successful candidate will be responsible for the full lifecycle of development, from gathering requirements and design through to production rollout and support. This is a hybrid role based in Toronto, requiring the consultant to work seven (7) hours per day, five (5) days per week during normal business hours. Duration: 6 months (with potential 6-month extension).
Job Responsibility:
Leading the entire development lifecycle for data initiatives, including Stay Data Automation, Photo Card Automation, Historical Data Access, Data Scraping Service, and Bi-Weekly Audits
Gathering and validating requirements from stakeholders to ensure accurate and complete scope definition
Designing and developing complex data integration workflows using Apache NiFi, optimizing for high-throughput, low-latency data processing
Implementing ETL (Extract, Transform, Load) pipelines to integrate diverse data sources (APIs, databases, file systems) and sinks
Writing custom code and scripts (Java, Groovy, Python) for automation and complex transformation logic within NiFi
Configuring, managing, and optimizing NiFi dataflows, utilizing the NiFi Expression Language for dynamic processing
Contributing to the production rollout and ongoing support of all deployed data flows, including troubleshooting and defect resolution
Collaborating with cross-functional teams (DevOps, Data Engineers, Analysts) to ensure seamless integration and deployment
Developing and updating technical and business process documentation, including functional specifications
Mentoring junior team members and enforcing best practices for NiFi development, security, and performance
Requirements:
5+ years of hands-on experience working with Apache NiFi, including large-scale, production-grade deployments
Deep understanding of NiFi architecture, components, and dataflow concepts
Expertise in designing and implementing high-performance ETL pipelines for data from databases, APIs, and file systems
Proficiency in Java, Groovy, and/or Python for developing custom NiFi processors and scripts
Strong experience with relational databases (SQL) and knowledge of data formats (JSON, XML, CSV, etc.)
Experience with DevOps practices, including containerization (Docker/Kubernetes) and CI/CD pipelines (Jenkins/GitLab) for automating NiFi flow deployments
Strong ability to analyze complex data integration challenges, design efficient solutions, and conduct rigorous debugging and troubleshooting
Excellent written and verbal communication skills, with experience documenting data flows and communicating technical concepts to stakeholders
Nice to have:
Knowledge of Big Data Ecosystem tools (Kafka, Spark, Hadoop)
Understanding of cloud-based data platforms (AWS, Azure, or Google Cloud) and NiFi integration
Experience with NiFi security features (SSL/TLS, authentication, authorization)
Familiarity with monitoring and performance tuning tools (Prometheus, Grafana, or NiFi's built-in tools)
Experience with data governance, lineage, and data quality frameworks
What we offer:
Hybrid Work Model: Flexibility with remote work options combined with in-office collaboration in Toronto
High Impact Initiatives: Lead projects critical to automating key operational data, providing immediate and measurable value
Cutting-Edge Technology: Work at a senior level with Apache NiFi in a complex, high-volume data environment
Professional Leadership: Opportunity to lead development efforts, mentor others, and establish best practices
Welcome to CrawlJobs.com – Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
We use cookies to enhance your experience, analyze traffic, and serve personalized content. By clicking “Accept”, you agree to the use of cookies.