The Feed Engine concept encapsulates data reception aspects to let the Handler focus on market data processing. It also provides advanced facilities on utilizing system resources to achieve the best performance and latency characteristics.
The concept of the Feed Engine was designed to make things more efficient. The Feed Engine machinery pushes extracted market data to the associated Handler instances. Multiple Handler instances can share a single instance of the Feed Engine implementation.
The concept is exposed as a set of abstract classes. Implementing them allows users to build their machinery extracting market data from various sources, including network, file-based stores, etc.
The primary entity of the concept is the OnixS::CME::MDH::NetFeedEngine class. The given class serves as a factory for feed links. The Handler allocates feed links through the interface of the given class.
The OnixS::CME::MDH::NetFeedLink abstract class encapsulates manipulations related to market data transmission (extraction). The Feed Engine allocates instances of the given class descendants upon a request. The Handler passes an instance of the OnixS::CME::MDH::NetFeed class containing all feed attributes, including connectivity information. When a link is constructed, the Handler binds it to the feed instance and further manipulation is performed through the instance of the OnixS::CME::MDH::NetFeed class to which the allocated link was bound.
When the Handler needs to get data from a particular feed (source), it spawns data reception using the corresponding instance of the OnixS::CME::MDH::NetFeed class. That instance calls the OnixS::CME::MDH::NetFeedLink::link member to establish a connection or join a multicast group depending on the feed type. Once the feed is connected, the Handler expects the Feed Engine will push market data through the OnixS::CME::MDH::NetFeedConsumer class instance bound to the corresponding feed.
When the Handler needs to stop receiving data from a particular feed, it invokes the OnixS::CME::MDH::NetFeed::disconnect member, which, in its turn, calls the OnixS::CME::MDH::NetFeedLink::unlink member. Since that moment, the Feed Engine must stop pushing events of any kind to the OnixS::CME::MDH::NetFeedConsumer associated with the feed.
Feeds of OnixS::CME::MDH::FeedType::Historical feed type assumes sending requests while interacting with the counterpart. Therefore, the OnixS::CME::MDH::NetFeedLink::send member must support data transmission.
When the Handler stops processing market data, it destroys all feeds used during the session. That causes all allocated instances of the OnixS::CME::MDH::NetFeedLink class to be released using the OnixS::CME::MDH::NetFeedLink::release member. It is guaranteed no other members of the OnixS::CME::MDH::NetFeedLink class are invoked for the instance after it was released.
The OnixS::CME::MDH::NetFeedEngine::process member runs the Feed Engine machinery. The concept does not restrict implementations regarding whether the given member must be invoked cyclically or a single time only. It is all up to the implemention whether to choose single-threaded execution or to support simultaneous invocation by multiple threads to achieve maximal efficiency.
A few predefined implementations are exposed by the SDK as ready-to-use solutions for certain cases:
|OnixS::CME::MDH::SocketFeedEngine||This is the default implementation of the Feed Engine concept offered by the SDK for handling live network data. It uses standard socket API while manipulating the network layer. The implementation supports simultaneous invocation of the OnixS::CME::MDH::NetFeedEngine::process member and thus can be used in combination of the OnixS::CME::MDH::FeedEngineThreads class.|
This implementation is based on the Solarflare ef_vi SDK using zero-coping and kernel-bypass techniques.
|OnixS::CME::MDH::replayLogFiles||The given function uses internal implementation of the Feed Engine concept which extracts data from the previously recorded log files and pushes it into the given Handlers. The processing is synchronous. Advanced parameters are offered to customize the behavior of the replay.|
|OnixS::CME::MDH::replayPcapFiles||The given function uses internal implementation of the Feed Engine concept which extracts data from the .PCAP (Packet Captures) files and pushes it into the given Handlers. The processing is synchronous. Advanced parameters are offered to customize the behavior of the replay.|