Skip to content
All Projects
Data EngineeringDelivered

BI Dashboard Migration & Data-Mart Architecture

Securing a university master database while modernising reporting

Moved a South-African university’s reporting stack off QlikView querying a live Oracle master DB onto Power BI fed by purpose-built data marts and an orchestrated ETL pipeline.

SQLMeshDagsterMySQLOraclePower BIPythonSQL
Problem Statement

The BI team queried the Oracle master database directly for QlikView reports. That model was insecure, slow on raw data, prone to integrity issues, and limited by QlikView’s poor integration with other tools.

  • Direct master-DB access for reporting was a security risk.
  • Reporting on raw data made dashboards slow to load.
  • Raw data required heavy in-report manipulation, hurting integrity.
  • QlikView limited integration with other tools and systems.
Headline Outcomes
+80%master DB protected

Database security

−70%cleaned data

Dashboard load time

−35%orchestrated ETL

Operational cost

The Solution

Added staging and reporting data marts in MySQL, an orchestrated ETL pipeline that cleans and shapes data into reporting views, and Power BI dashboards sourced from those views. This decoupled reporting from the master DB.

Staging DB pulls raw data from the Oracle master; reporting DB holds refined, report-ready views.

SQLMesh + Dagster ETL performs quality checks, handles missing data and builds views.

Power BI dashboards consume the reporting views with rich filters and sorting.

Modular stages make the system easy for BI engineers to monitor and troubleshoot.

System Architecture

How the data flows

01

Oracle Master DB

Source of truth

02

Staging Mart

MySQL raw extract

03

ETL

SQLMesh + Dagster

04

Reporting Mart

Refined views

05

Power BI

Dynamic dashboards

Result 01

Secured the master database from unnecessary access and excessive read/write load.

Result 02

Standardised and orchestrated ETL with minimal human intervention.

Result 03

Gave stakeholders fast, reliable dashboards on cleaned, governed data.

Build Something Like ThisServices & PricingMore Case Studies
Further reading

From the blog

Data Engineering

AWS Cost Optimisation: In-House, a Tool, or a Consultant?

Fix your AWS bill in-house, buy an automated cost tool, or hire someone? A straight comparison of what each option reaches, and when each is wasted money.

AWSCost OptimizationFinOpsHiring
Read Article10 min read
Data Engineering

Dagster vs Airflow vs Prefect for ETL in 2026

Dagster vs Airflow vs Prefect for ETL in 2026, compared on the one thing they disagree on: what a pipeline is made of. Notes from a 50M-records/day build.

DagsterAirflowPrefectETL
Read Article13 min read
Taking on new projects · Outside IR35

Have a data pipeline or warehouse problem worth solving?

From messy source data to analytics-ready warehouses that cut cost. Let's scope it. I reply within one business day.

Start a ProjectConnect on LinkedIn