Overview

Starting from FIXEdge v.5.12.0 there was added a business protection mechanism regulating incoming and outgoing traffic to optimize memory consumption and to prevent system from overloading. The mechanism includes monitoring of throughput and of number of incoming messages received during a session as well as outgoing queue monitoring for slow consumers detection.

Features

• FIXEdge takes measurements to protect itself from higher throughput that may risk of system overloading. Such incidents (i.e. of throughput higher than expected) are monitored and reported. It is essential that the incoming message flow will not exceed substantially the maximum daily expected number of messages from each inbound connection. It is possible to set:

  • The maximum number of messages per second a FIX session can send to FIXEdge

  • The maximum number of messages per day a FIX session can send to FIXEdge

• FIXEdge protects itself from slow consumers by monitoring and reporting the sessions with larger outgoing message queue. FIXEdge provides monitoring and alerting functionality for the outbound queue in order to provide the support team with advanced notice of any possible threat to the system

• In case either threshold is reached, the FIX session will be logged out manually in order to prevent further messages from being sent.

Management of Incoming queue

There is no an inbound queue in FIXEdge/FIX Antenna. A new message is read from TCP buffer after previous one is processed. In other words, a number of waiting messages are limited by TCP buffer size and controlled by the Operating System.

...

Default value for both parameters is '0' - unlimited, no events will be created on business level in such case.

Management of Outgoing queue

Slow consumers can cause excessive memory consumption, therefore there was added new session parameter in FIXEdge.properties file to control outgoing queue:

...

Default value for the parameter is '0' - unlimited, no events will be created on business level in such case.

Event Handling

An event OnNofificationEvent rises within FIXEdge BL each time when described thresholds are reached.

...

Real-time values of the parameters above can be got in a response to SessionStat request sent via admin-session to FIXEdge.

Slow Consumer Testing Example

Sessions configuration in FIXEdge.properties file:

...

function sleep(ms) {
  ms += new Date().getTime();
  while (new Date() < ms){}
}
sleep(100);

Steps to reproduce

1. Start FIXEdge with described configuration;
2. Connect 'TEST' (TEST/FIXEdge) session to FIXEdge;
3. Send bunch of 10 000 New Order Singles (35=D) messages with max speed to session 'TEST'

4. Session FIXEDGE/LOOP emulates slow consumer and process only 10 messages per second.

5. When the limits are reached FIXEdge send emails via SMTP

Recommendations

Actual parameters values are defined for each system individually and may vary depending on system requirements and current system load.

...