...
Benchmarks were run against two different versions of FIXEdge C++ (6.14.0 and 6.13.0), and the results were compared in order to detect possible regressions.
Versions
The following builds were tested:
- FIXEdge C++ 6.13.0.500
- FIXEdge C++ 6.14.0.527
...
- One acceptor session is configured on the FIXEdge C++ side.
- One initiator session is configured on the client application side.
The process:
- The client application connects to the FIXEdge C++ instance and sends 1000000 FIX 4.2 messages at a rate of 50000 messages per second.
- FIXEdge C++ receives the messages and matches them to the same session using business layer logic.
- FIXEdge C++ responds to the client application with the same message via the same TCP/IP connection (the same session).
- The client application collects the response time histogram.
- The process is repeated 3 times for each FIXEdge C++ release version.
The response time measured by the client application is the difference between timestamps:
- t1 - timestamp is taken right before sending a message to the socket
- t2 - timestamp is taken right after receiving the same message from the socket (from FIXEdge)
So the round-trip time formula is: RTT = t2 - t1 and the measurement unit is microseconds.
The test scenario diagram:
Drawio border false diagramName Benchmarks FE - 1 simpleViewer false width 600 links auto tbstyle hidden diagramDisplayName lbox false diagramWidth 540 revision 1
Two Sessions With Conversion Scenario
- Two acceptor sessions are configured on the FIXEdge C++ side.
- Two initiator sessions are configured on the client application side.
The process:
- The client application connects to the FIXEdge C++ instance (establishes session №1) and sends 1000000 FIX 4.2 messages with a rate of 50000 messages per second.
- The client application connects to the FIXEdge instance (establishes session №2) and starts to receive a message from another FIXEdge C++ session.
- FIXEdge C++ receives the messages sent to it from the client application (session №1).
- FIXEdge C++ uses Business Layer logic to route the message to another session and converts it from FIX 4.2 to FIX 4.4 protocol.
- FIXEdge C++ responds to the client application with the converted message via another TCP/IP connection (session №2).
- The client application collects the response time histogram.
- The process is repeated 3 times for each FIXEdge C++ release version.
The round-trip time measured by benchmark is the difference between timestamps:
- t1 - timestamp is taken right before sending a message to the socket
- t2 - timestamp is taken right after receiving the same message from the socket (from FIXEdge).
The round-trip time formula is: RTT = t2 - t1 and the measurement unit is microseconds.
The test scenario diagram:
Drawio border false diagramName Benchmarks FE - 2 simpleViewer false width links auto tbstyle hidden diagramDisplayName lbox false diagramWidth 730 revision 1
Results
The performance of the FIXEdge C++ 6.14.0 version is the same as the performance of the previous FIXEdge 6.13.0 version. There is no performance degradation.
Single Session Echo Scenario
Two Sessions With Conversion Scenario
Single Session Echo Scenario
Stability
Several series of tests have been performed with different orders of FIXEdge C++ versions during benchmarking. There was no significant spread of the results observed during benchmarking.