Skip to content

Reduce duplicate detections when using async streaming #9

@manuGil

Description

@manuGil

The EPE detects multiple event for the same observation when using concurrent futures to stream data from each Datastream.

Good to know:

  • The number of event that is ducplicated is not consistent between runs.
  • Adding a delay between each post reduces the number of duplicates.
  • The SiddhiQL approach to reduce duplication is to filter events in the SiddhiApp using a unit identifier for each observation.

Metadata

Metadata

Assignees

Labels

bugSomething isn't workingenhancementNew feature or request

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions