Index Changes
This is version 1. It is not the current version, and thus it cannot be edited.
[Back to current version]   [Restore this version]

Message Ordering and Gap Detection

Gap Window Operator

The Gap Window Operator takes what it finds to be missing from a stream based on the sequencing index and a grouping key (what it calls the partition). So, for that group, it will look at events in the stream that are missing sequenced events. For example, if S=sequencer, K=key (name, country), so we have Ev x (Sequence,Name,Country)

Ev 1 = (2,"Serge","Canada")

Ev 2 = (1, "Jason","Norway")

The Gap Window Operator will see that Ev(1,"Serge","Canada") is missing, but that K("Jason", "Norway") doesn't miss any events. When Ev X (1,"Serge","Canada) will be received, the output of the GapWindow Operator will be empty.

Sequencing Operator

The sequencing operator works on the events with the same structure. Hence, it will use a sequencing index and a grouping key (what it calls the partition) just the same. So for the same example, before Ev X (1,"Serge","Canada) arrive, the output of this operator will only be Ev 2 (1, "Jason","Norway"). Once the missing event arrives, the output will be: { (1, "Jason","Norway"),(1,"Serge","Canada),(2,"Serge","Canada)}

Just Wink it...

If you would like, you can find a small movie showing the structure of what I did, including a sample of how it works (READ THE ADDENDUM!). You can also get the source code if you would like to play with it ourself. The zip file has the iep module, the composite application and the SOAP UI project file to test it.

Addendum

In the code sample, the output of the sequencing order is placed into an Attribute Based Window operator. This attribute base window serves as a grouping method that keeps a range of events, based on that value - the size as set in the customizer. After some discussions, we found that this operator is useless the use case we have for this sample. And the simpler model (see below) actually is better. So, if you're only looking at the movie and not reading this, you're missing this bit of information, sorry!

JSPWiki v2.4.100
[RSS]
« Home Index Changes Prefs
This particular version was published on 29-Feb-08 07:43 AM, -0800 by sblais