Stateful Stream Processing

When objects stored in the ScaleOut distributed data grid are large or subject to more frequent updates than reads, it can be advantageous to use an event-based update model rather than a conventional CRUD (Create/Read/Update/Delete) access model. When update data is smaller than the object, sending the relevant changes directly to the ScaleOut hosts where the objects reside in memory is often more efficient than pulling an entire object to a client, modifying it, and then sending the entire object back to the StateServer host via an update.

ScaleOut’s StreamServer product introduces the PostEvent operation, a method that allows messages to be sent directly to the server where an object resides. This enables a stream-oriented approach to handling incoming events; once the event reaches the server where an object resides, it can be analyzed and/or persisted in the associated StateServer object.