Skip to content
This repository was archived by the owner on Jan 20, 2025. It is now read-only.
This repository was archived by the owner on Jan 20, 2025. It is now read-only.

PSC-STM-B7: Switch over to live transformation #255

@tiredpixel

Description

@tiredpixel
  • Perform live transformation on all existing S3 files produced by the Kinesis Firehose attached to the ingester
  • Start the live transformer (which will default to the start of the stream, but will skip any records which have already been published).

Following this, it should be unnecessary to keep performing bulk imports, since the live transformer should immediately transform latest data.

Estimate: 4 hours

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions