Data Engineer

Here is a brief overview of the tasks and responsibilities that will fall to you:

• Collaborate with the data science, analytics and governance teams to meet the organization's information needs;
• Design, document, and develop scalable data pipelines that enable the ingestion, transformation, and storage of data from multiple sources;
• Optimize data processing to ensure data performance, efficiency and availability;
• Diagnose and resolve incidents related to data pipelines and data quality issues;
• Participate in the definition and documentation of data pipeline service level objectives;
• Apply data quality, integration and modeling standards;
• Contribute to the estimation of user stories and the planning of data engineering work;
• Share best practices and participate in the evolution of working methods within the data community;
• Collaborate with governance teams to ensure compliance with organizational policies and standards.

The profile sought is as follows:

• Have more than five (5) years of experience as a data engineer;
• Be proficient in Python and SQL languages in a context of data processing and integration;
• Leverage Apache Spark for the development of large-scale data processing solutions;
• Demonstrate at least four (4) years of experience with the Databricks platform;
• Use Azure Data Factory for orchestration and automation of data flows;
• Administer Azure Data Lake environments for data storage and management;
• Develop and maintain pipelines using Azure DevOps;
• Design data models, data warehouses and performance optimization mechanisms;
• Apply agile methodologies in project delivery;
• Hold a bachelor's degree in information technology, computer science, statistics, mathematics or a related field;
• Communicate effectively and produce clear and structured documentation;
• Demonstrate excellent analytical, problem-solving and collaborative skills;
• This position requires fluency in French and English for daily tasks, understanding documentation and professional communication with customers, suppliers and colleagues internationally. Language skills in French and English are essential, both oral and written.