The Principal Data Engineer (Microsoft Fabric) is the senior technical leader and domain expert responsible for the end-to-end architecture and more.
About our client:
A large and rapidly growing local government organisation in South East Queensland, responsible for delivering essential infrastructure and community services across a diverse and expanding region. Known for its strong focus on innovation, sustainability, and improving quality of life for its communities.
Position Purpose:
This role is pivotal in establishing the Fabric Lakehouse as the unified, trusted data foundation for strategic initiatives, enabling Copilot, real-time analytics, application integrations and advanced AI/ML capabilities.
Knowledge & Experience:
- Progressive technical data engineering experience, with a minimum of 3 years in a Lead or Principal capacity.
- Deep expertise in designing and deploying scalable, high-volume data platforms in a cloud environment (Azure/Fabric mandatory).
- Expert-level coding proficiency in Python (for Spark/Notebooks) and SQL (T-SQL/Spark SQL).
- Proven experience with DataOps, Infrastructure-as-Code (IaC), and implementing CI/CD for data assets (e.g., using GitHub, Azure DevOps, or Fabric Deployment Pipelines).
- Mandatory deep hands-on expertise across the Microsoft Fabric ecosystem: OneLake, Lakehouse/Delta, Data Engineering (Spark), Data Factory Pipelines, Eventstreams/Real-Time Analytics, and Power BI.
- Expert-level proficiency in Microsoft Purview for implementing comprehensive data governance, lineage, and compliance.
If you have experience in all the above, feel free to apply for the role or contact Carol Ferraz at cferraz@genesisit.com.au