Manager Data Engineer

Job Title: Manager, Data Engineer Location: Toronto, Ontario, Canada Work Model: Hybrid – 3 to 4 days/week from client office Duration: Long Term Contract Start Date: ASAP About the Role: We are looking for a highly skilled Manager, Data Engineer to design, develop, and optimize scalable cloud-native data platforms supporting enterprise-level investment and portfolio management workflows. This role requires strong hands-on expertise in modern big data technologies, distributed data processing, and lakehouse architectures. The ideal candidate will be comfortable operating independently in fast-paced and ambiguous environments while collaborating closely with stakeholders across investment, risk, and operations teams. Key Responsibilities: • Develop and optimize Spark-based workloads in cloud environments • Design and build scalable data pipelines using Python and PySpark • Work with large-scale datasets using modern storage formats such as Parquet and Iceberg • Collaborate with business and technical stakeholders to translate requirements into robust engineering solutions • Ensure high performance, scalability, reliability, and maintainability of data platforms • Support production readiness including deployment, monitoring, documentation, and operational excellence • Contribute to cloud-native data modernization initiatives and distributed data processing architectures • Independently manage delivery, proactively identify risks, and communicate progress effectively Required Skills & Experience: • Strong hands-on experience with Python and PySpark • Deep experience with Apache Spark in cloud-native environments • Hands-on experience with Databricks • Experience working with large-scale distributed data systems • Strong understanding of Parquet and Apache Iceberg table formats • Experience with AWS data services including Glue and Lake Formation • Experience with workflow orchestration tools such as Airflow • Strong understanding of distributed data processing architectures • Proven ability to independently deliver complex engineering solutions with minimal supervision • Prior consulting, advisory, or client-facing delivery experience • Strong analytical, problem-solving, and communication skills Preferred Qualifications: • Experience within capital markets, investment management, or financial services • Exposure to enterprise investment and portfolio management workflows • Experience supporting cloud-native lakehouse platforms and modern data ecosystems

Want to see how well you match this job?