About this role
Elevate your career as a Big Data Engineer with a hybrid work model in Toronto, ON. Leverage your expertise in Spark and Scala to design scalable data pipelines. In this full-time role, you'll develop and optimize both batch and real-time data processing systems while utilizing the Hadoop ecosystem. Collaborating closely with data scientists, you'll ensure data quality and system scalability through effective ETL processes and troubleshooting efforts. Key Responsibilities:
• Design scalable data pipelines using Spark and Scala
• Build batch and real-time data processing systems
• Work with Hadoop ecosystem and distributed frameworks
• Develop and maintain large-scale ETL processes
• Collaborate across teams to solve data challenges Requirements:
• 6 years of big data experience required
• 1 year of experience with Scala
• 1 year of experience with Spark
• Familiarity with AWS or Azure is a plus
• Proven skills in performance tuning and data quality Maximize your big data expertise to drive innovative solutions in a hybrid environment.