Data Engineering Consultant

Here's a brief overview of the tasks and responsibilities you'll have :

• Develop transformations and data loading in the different layers of the platform using Databricks;
• Design and maintain data loading libraries in Spark/Python;
• Participate in the development of a data ingestion model based on Databricks Lakeflow Connect;
• Implement best practices for data quality validation;
• Collaborate with different teams to ensure consistency across the data platform;
• Carry out knowledge transfers and contribute to the sharing of best practices;
• Translate business needs into data specifications to support analytical products.

The profile you are looking for is as follows:

• Have a minimum of five (5) years of experience in Spark/Python development;
• Have a minimum of five (5) years of experience in data engineering for analytical platforms;
• Have more than four (4) years of experience with Databricks;
• Master Azure Data Lake;
• Be familiar with Azure DevOps Pipelines and have more than 3 years of experience with this environment;
• Develop analytical data solutions in the context of modernization and evolution of cloud computing platforms;
• Participate in the implementation of unified, secure and scalable data platforms based on Azure, Databricks and Spark/Python technologies;
• This position requires fluency in French and English for daily tasks, understanding documentation, and professional communication with customers, suppliers, and colleagues across Canada. Language skills in French and English are essential, both oral and written.