Skip to main content
H

Senior Data Engineer - Databricks | Python | PySpark | SAP | Data Migration

Hileya Management Consulting
28 days ago
Full-time
On-site
Randburg, South Africa

The Opportunity

We are looking for an experienced Senior Data Engineer to join a leading organisation on a contract basis, supporting a significant data transformation and migration initiative.

This opportunity is suited to a senior data professional with strong Databricks, Python, PySpark and SQL expertise, together with experience in data migrations, SAP environments and Finance/Economics data.

The successful candidate will play a key role in supporting the migration from an on-premises data estate to Databricks, contributing to the development of a modern, governed data platform and working closely with senior stakeholders to ensure successful project outcomes.

What You’ll Be Doing

  • Support the migration of an on-premises data estate to Databricks.

  • Develop and contribute to a modern, governed data platform.

  • Build and implement data solutions using Databricks, PySpark, Python and SQL.

  • Work with Medallion Architecture and Data Vault modelling.

  • Translate complex business rules into effective data engineering solutions.

  • Work with Finance and Economics-related data.

  • Leverage SAP exposure to support data engineering and migration requirements.

  • Engage with stakeholders throughout the delivery lifecycle.

  • Manage and contribute to successful project outcomes.

  • Communicate technical and project-related matters effectively with senior and C-suite stakeholders.

Why This Opportunity?

This is an opportunity to be part of a significant data modernisation and migration initiative, working with Databricks to help transition an on-premises data estate into a modern, governed data platform.

The role offers the opportunity to combine hands-on data engineering, modern data architecture, migration expertise and senior stakeholder engagement within a large-scale retail environment.

If you are a Senior Data Engineer with strong Databricks expertise and experience delivering data migration initiatives, particularly within Finance, Economics or SAP-related environments, we would like to hear from you.

What We’re Looking For

We’re looking for a Senior Data Engineer who combines strong technical expertise with the ability to operate confidently in a stakeholder-facing environment.

The ideal candidate will have experience with:

  • Databricks

  • PySpark

  • Python

  • SQL

  • Data migration

  • SAP

  • Finance and/or Economics data

  • Medallion Architecture

  • Data Vault modelling

 

Data Migration & Modern Data Platforms

A key focus of this role is the migration from an on-premises data environment to Databricks.

Experience contributing to or delivering data migrations into Databricks will be highly relevant, together with an understanding of modern data platform architecture and governed data environments.

Experience with Medallion Architecture and Data Vault modelling is particularly important for this opportunity.

Finance & SAP Data Experience

Exposure to SAP and experience working with Finance and Economics data will be highly beneficial.

The ability to understand and translate complex business rules into robust technical data solutions will be an important part of the role.

Senior Stakeholder Engagement

This is a senior position requiring more than strong technical capability.

The successful candidate must be comfortable engaging with senior stakeholders and C-suite executives, communicating complex technical concepts clearly and managing expectations around project delivery and outcomes.

Strong stakeholder engagement, communication and project outcome management skills are therefore essential.

Your Technical Strengths

Core Technologies:

  • Databricks

  • PySpark

  • Python

  • SQL

Data Engineering & Architecture:

  • Data migration

  • Modern data platforms

  • Medallion Architecture

  • Data Vault modelling

  • Governed data platforms

Business & Data Exposure:

  • SAP

  • Finance data

  • Economics data

  • Complex business rules

Essential Experience at a Glance

Level: Senior Data Engineer
Key Technologies: Databricks | PySpark | Python | SQL
Key Expertise: Data Migration | Modern Data Platforms | Medallion Architecture | Data Vault
Business Exposure: SAP | Finance Data | Economics Data
Stakeholder Level: Senior Stakeholders & C-suite
Work Style: On-site 3 days per week
Location: Cape Town
Engagement: Contract

What You’ll Be Doing