Data Warehouse Export

Data Warehouse Export schedules batch loads of mfi.* tables to a downstream warehouse. Destinations: BigQuery, Snowflake, Redshift, S3 Parquet, SFTP CSV. PII obfuscation is per-field.

DW destinations
Destinations — BigQuery / Snowflake / Redshift / S3 / SFTP with credentials.
DW pipelines
Pipelines — per-table cadence, mode (incremental vs full), PII obfuscation per column.

How to set up a daily export to BigQuery

Pick the tables, pick the cadence, pick the PII handling per column — the rest happens nightly.

How to set up a daily export to BigQuery
Export runs — every nightly run with rows-shipped, duration, success / failure log.
  1. Open Data Warehouse → Export profiles → New.
  2. Pick BigQuery as the destination; paste the service-account JSON.
  3. Pick the tables (mfi.member, mfi.loan, mfi.savings.account, etc.).
  4. For each PII column, pick handling: hash, mask, or drop.
  5. Set cadence (daily 02:00 is the default).
  6. Save. The first run fires on the next cron tick.

Reference

Feature checklist

  • 5 destination drivers
  • Incremental + full snapshot modes
  • PII obfuscation per field
  • Per-table cadence

Configuration reference

WhereWhat to set
Destination credentialsPer driver
Tables + cadencePer-table
PII mappingHash phone, mask ID, drop national_id_image

Roles & permissions

GroupCapability
mfi_data_warehouse_export.group_dw_adminConfigure, run, view

Accounting integration

Read-only.
Tip. Use SFTP CSV as the cheapest destination — useful for analyst teams who have no cloud-warehouse budget.
Was this page helpful?