C

Data Integration Engineer (Microsoft Fabric)

CIBA Industries t/a CIBA Industries
9 days ago
Part-time
On-site
Witkoppen, South Africa

Introduction

Job Title: Data Integration Engineer (Microsoft Fabric)

Location: Johannesburg

Contract type: Contract (6 Month Contract)

Hybrid

 

Our client is seeking a skilled Data Integration Engineer who has had strong experience and exposure to Microsoft Fabric. The Data Integration Engineer will design, build and maintain scalable data pipelines, integrations and analytics-ready data assets within the Microsoft Fabric ecosystem. The resource will support the movement of data from core business systems into a governed Fabric Lakehouse and related reporting structures, enabling trusted Power BI reporting, operational analytics, data quality monitoring and future AI initiatives.

Duties & Responsibilities

Roles and responsibilities:

  • Design, develop, test and maintain Microsoft Fabric Data Factory pipelines.
  • Build ETL/ELT processes for structured and semi-structured data sources.
  • Develop integrations across Dynamics 365, SharePoint Online, SQL databases, Excel/CSV sources, APIs other line-of-business systems.
  • Implement scheduled, automated and repeatable data ingestion processes.
  • Support incremental loading, change tracking and automated refresh patterns where required.
  • Troubleshoot failed pipelines and resolve data movement issues quickly and systematically.
  • Build and maintain Fabric Lakehouses, Warehouses and OneLake structures.
  • Implement Bronze, Silver and Gold data layers to support raw, cleansed and business-ready data.
  • Develop and optimise Delta Lake tables, notebooks and transformation logic.
  • Create reusable data assets for enterprise reporting and analytics.
  • Apply sound naming conventions, folder structures and environment management principles.
  • Design dimensional models, star schemas and curated datasets for Power BI reporting.
  • Support the development and optimisation of semantic models.
  • Work with business owners to translate reporting requirements into technical data models.
  • Document data definitions, business rules, lineage and transformation logic.
  • Build validation checks, reconciliation controls and exception reporting into pipelines.
  • Assist with data quality improvement initiatives across source systems and reporting layers.
  • Apply access controls, workspace security, dataset permissions and sensitivity requirements.
  • Support data governance, lineage, catalogue and compliance activities where required.

Desired Experience & Qualification

Experience and qualifications:

  • Bachelor's degree or diploma in Computer Science, Information Systems, Data Engineering, Data Science, Software Development or a related field.
  • Microsoft certifications are preferred, particularly Fabric Analytics Engineer Associate, Azure Data Engineer Associate, Power BI Data Analyst Associate or related Microsoft Data Platform certifications.
  • Minimum 5 years' experience in data engineering, data integration or business intelligence development.
  • Minimum 3 years' experience working with Microsoft Azure or Microsoft data platform technologies.
  • Hands-on experience building ETL/ELT pipelines and integrating multiple source systems.
  • Practical experience with APIs, JSON, file ingestion and cloud-based data movement.
  • Experience with Microsoft Fabric, Azure Data Factory, Synapse, Power BI or Lakehouse/Data Warehouse architectures is strongly preferred.
  • Strong analytical and problem-solving ability.
  • Attention to detail and commitment to data accuracy.
  • Ability to work independently and deliver technical outputs with limited supervision.
  • Good communication skills and ability to engage both technical and business stakeholders.
  • Process improvement mindset and ability to standardise repeatable technical patterns.
  • Strong ownership, accountability and support orientation.

 

Technical Skills:

Microsoft Fabric

Data Factory pipelines, Lakehouse, Warehouse, OneLake, Notebooks, Dataflows, shortcuts, deployment pipelines

Data Engineering

SQL, T-SQL, Python, PySpark, Spark concepts, ETL/ELT, incremental loads, data validation

Integration

APIs, JSON/XML, Azure Functions, Logic Apps, webhooks, file-based ingestion, database connectors

Interested?