# Sync support to Workflow Data

# Problem
The data generated during the workflow process is stored in json format and queried from the /data endpoint.

It needs a basic OLAP/OLTP integration for rapid query and reporting needs.

# Solution

## Seed Data Changes to Apache Kafka
Any operations that cause data changes are triggered by the workflow transition.
All data sent during the workflow migration execution process and created/updated within the workflow is seeded into a kafka topic as a result of the execution.

> Topic configuration is part of workflow definition

The seeding data is structured as part of the data json schema with the "$cdc" attribute.

### Sample Worflow Data Schema including "$cdc" configuration.

{
  "$id": "https://example.com/person.schema.json",
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "title": "Person",
  "type": "object",
  "properties": {
    "firstName": {
      "type": "string",
      "description": "The person's first name.",
      "$olap": true
    },
    "lastName": {
      "type": "string",
      "description": "The person's last name.",
      "$encrypt": true,
      "$olap": true
    },
    "age": {
      "description": "Age in years which must be equal to or greater than zero.",
      "type": "integer",
      "minimum": 0,
      "$olap": true
    }
  }
}