Azure Data Engineer (IoT & Cloud Data Streams) – East Flanders
We are looking for a Data Engineer to support the implementation of an emissions monitoring platform for a public sector organization in Belgium.
This project involves building IoT-enabled data streams in Azure, allowing for real-time remote sensing of vehicle emissions on public roads. The initiative will enable data-driven decision-making and targeted policies to improve air quality.
Beyond the initial project, additional work will involve migrating on-premise data infrastructure to the cloud, requiring expertise in ETL pipelines, data architecture, and cloud data processing.
Responsibilities:
* Design and implement data ingestion pipelines from various OLTP sources.
* Develop and optimize ETL processes in the Azure data platform.
* Build real-time and batch data streams for IoT emissions monitoring.
* Ensure data quality, security, and compliance with regulatory requirements.
* Design and implement scalable data models to support analytics and reporting.
* Provide data models for integration with Power BI and other reporting tools.
* Collaborate with cloud architects and DevOps teams to streamline data migration from on-premise systems to Azure.
* Monitor and troubleshoot data pipelines, ensuring performance and reliability.
Profile:
* 3+ years of experience as a Data Engineer.
* Strong knowledge of Azure Synapse, Azure Data Factory, and Databricks.
* Proficiency in Python for data processing and automation.
* Dutch Speaking
Additional Details:
SENIORITY: Medior/Senior
START DATE: Immediate
DURATION: End of September– Extended for other projects.
CONTRACT: Freelance
LOCATION: Aalst – 1 day on site per week
HOURS PER WEEK: 40
LANGUAGES: Dutch