Random Corp

This repo is a reference end-to-end example implementation of Data Products using Markdown Data Definition Language (MD-DDL). This project implements data products for sourcing and the Financial Crime Domain.

The project leverages:

• https://git.semprini.me/paul/semprini-core to provide I&AM, Code Repos
• https://git.semprini.me/paul/semprini-data for data management, data product metadata, real-time data sourcing, and data transform platforms.
• https://git.semprini.me/paul/semprini-data-domain for foundational and experience data products.

Project Goals

1. Synthetic data generators per source system - replicating realistic cadence of data change and system semantics in source systems. This will be achieved by:

• A single source system Postgres DB server for all sources
• Per source system database instances
• Python (faker) synthetic data generator per source system
  • Ability to set change cadence
• Use the MD-DDL source definitions to define schemas and synthetic generators as per md-ddl.

2. Per source system, source aligned data products. This will be defined once the synthetic data generators are running

3. Domain aligned data products. Detail to be defined later but will be:

• Party Core
• Financial Transaction
• Product Core

4. Consumer aligned data products. To be defined later.