US-20260127102-A1 - SYSTEM AND METHOD FOR LATENCY LEVELING IN ELECTRONIC TEST ENVIRONMENTS

US20260127102A1US 20260127102 A1US20260127102 A1US 20260127102A1US-20260127102-A1

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for accessing, by a data processing system and from a hardware device, outbound latency data and inbound latency data defining an outbound latency and an inbound latency to control a transmission of electronic test orders from a plurality of test subject devices independent of the computational powers of multiple test subject devices. The outbound latency defined by the outbound latency data is restricted to execution of electronic test orders and transmission of an electronic test order is restricted to one or more times. An execution of electronic test orders is triggered by an electronic test environment.

Inventors

Matthew Krepps

Assignees

The Economist`s Advocate, Inc.

Dates

Publication Date: 20260507
Application Date: 20260105

Claims (20)

1 . A server system for communicating with client devices for simultaneously conducting tests over a network based on communications received from the client devices, with each of the tests being equally constrained by applying one or more boundary conditions, a time constraint, inbound latency constraints, and an outbound latency constraint, the server system comprising: a user interface sub-system that generates a user interface that renders on client devices a plurality of input test portions and input weighting portions, with an input test portion juxtaposed to an input weighting portion in the user interface, with an input test portion being for receiving input representing a testing event, and with an input weighting portion being for receiving input specifying a weight of a testing event represented by input into a input test portion juxtaposed to the input weighting portion, a memory that receives, from the client devices, communications comprising input for the input test portions and the input weighting portions, wherein the input received from a respective client device defines an order of testing events; and a processor configured to generate and constrain tests based on input specified for the input test portions and input weighting portions comprised in graphical user interfaces rendered on the client devices, with a test, for a given client device, comprising testing events specified by input test portions rendered on a graphical user interface displayed on the given client device, for each testing event, generate an associated weight specified by an input weight portion juxtaposed to a respective input test portion, with each of the tests being equally constrained in accordance with the one or more boundary conditions specifying a criteria for the testing events to satisfy to be comprised in the test, the time constraint, the inbound latency constraints, and the outbound latency constraint to control a transmission of electronic test orders from the client devices independent of the computational powers of the client devices, constrain the tests in accordance with the inbound latency constraints by, for each client device: as an item of input is received, applying one or more of the inbound latency constraints by: based on a weight input into an input weighting portion for a first testing event specified by an input testing portion, generate a notification of a maximum weight assignable to a second testing event that comes sequentially after the first testing event in the order, with the maximum weight being in accordance with the one or more boundary conditions, and based on a given testing event specified to be first in the order, cause rendering on a display of the client device in near real time relative to when input specifying the given testing event is received and ranked in descending order, visual representations of other testing events that are candidates for inclusion in the test, wherein juxtaposed to each visual representation is an indicator specifying a direction of a relationship between the given testing event and the testing event represented by that visual representation, and in response to receiving an indication of completion of selection of the testing events, apply one or more remaining inbound latency constraints to the lowest weighted testing event; and a testing engine configured, upon determining that each of the tests complies with the one or more boundary conditions, the time constraint, the inbound latency constraints, and the outbound latency constraint, to conduct the tests and determine performances of the tests relative to each other.
2 . The server system of claim 1 , wherein the testing engine comprises a prediction model that optimizes execution of the tests.
3 . The server system of claim 1 , wherein applying the time constraint comprises delaying a transmission of data packets originating from the client devices to impose substantially similar temporal delays.
4 . The server system of claim 1 , further comprising: prompting, through the graphical user interface, the test subject to select a prepopulated template from one or more prepopulated templates, where each prepopulated template of the one or more prepopulated templates specifies a plurality of concentrations for the test subject and that satisfy the constraints; and receiving a selection of the prepopulated template from one or more prepopulated templates.
5 . The server system of claim 4 , further comprising: accessing, from the hardware storage device, a plurality of data records that are structured to specify the plurality of concentrations and, for each of the plurality of concentrations, a respective security that is to be selected by the test subject; prompting the test subject, through the graphical user interface, to select, for each of the plurality of concentrations, a respective security for the concentration from a set of securities that satisfy the constraints; receiving, through the graphical user interface, selection data specifying selection of a visual representation of the selected respective securities, with the selection data being associated with the key that uniquely identifies the test subject associated with the selection data; parsing, by the parser of the data processing system, the plurality of data records to identify, based on the structure, data specifying the selected respective securities and data specifying the plurality of concentrations; and storing, in the hardware storage device, the plurality of keyed data records structured with data specifying the plurality of selected securities and the plurality of concentrations.
6 . The server system of claim 5 , wherein the one or more prepopulated templates comprises a maximally concentrated template, wherein the one or more prepopulated templates comprises an equally concentrated template.
7 . A computer-implemented method for inbound and outbound latency leveling in an electronic test environment, the computer-implemented method comprising: accessing, by a data processing system and from a hardware device, outbound latency data and inbound latency data defining an outbound latency and an inbound latency to control a transmission of electronic test orders from a plurality of test subject devices independent of the computational powers of the plurality of test subject devices; restricting, by the data processing system, the outbound latency defined by the outbound latency data to execution of electronic test orders by, for each of a plurality of test subject devices, restricting transmission of an electronic test order to one or more times; and restricting transmission of the electronic test order to an electronic test environment; imposing, by the data processing system, the inbound latency defined by the inbound latency data to submission of electronic test orders by, for each of the test subject devices, receiving, by the data processing system, an electronic test order comprising a weighted value; transmitting, in real-time, by the data processing system and to a test subject device of the plurality of test subject devices, an indication of one or more additional electronic test orders that are candidates for selection that satisfy one or more boundary conditions of the electronic test environment, with a boundary condition specifying a maximum weighted value of another electronic test order based on the weighted value of the electronic test order, with the indication, for each additional electronic test order, specifying a maximum weighted value assignable to that additional electronic test order based on the weighted value of the electronic test order and further specifying a cross correlation metric for that additional electronic test order; in accordance with imposing the outbound and inbound latencies, receiving, from each test subject device, a plurality of electronic test orders satisfying the one or more boundary conditions; and triggering an execution of the electronic test orders by an electronic test environment.
8 . The computer-implemented method of claim 7 , wherein the one or more boundary conditions comprise constraints specifying: no single component of the electronic test orders comprises more than 30 percent of the index's weighting; five highest weighted components of the electronic test orders together comprise no more than 60 percent of the index's weighting; and the lowest weighted component of the electronic test orders comprising, in an aggregate, 25 percent of the index's weighting have an aggregate value of average daily trading volume (ADTV) of a threshold value.
9 . The computer-implemented method of claim 7 , further comprising: generating, by the data processing system, a test in which a plurality of test subjects construct respective test subject specific broad-based index (BBSIs), with each test subject corresponding to one or more data structures (“test subject data structures”) stored in a hardware storage device, wherein the test has a start time, an end time, and a predetermined monetary budget for the test subject specific BBSIs, wherein The computer-implemented method comprises: prior to the start time, generating, by the data processing system, a graphical user interface with a plurality of input controls for receiving input specifying one or more of the electronic test orders from a pre-specified selection universe for inclusion in the test subject specific BBSI, with the graphical user interface being accessible before the start time and being inaccessible after the start time; and for a particular test subject data structure, upon receipt of input from the input controls, updating the test subject data structure with data specifying names of selected of the electronic test orders and concentrations of selected electronic test orders; determining whether a conflict exists among concentrations of the electronic test orders in the test subject data structure and the BBSI constraints; and if a conflict exists, receiving input to resolve the conflict; and at the end time, determining a rank ordering of the test subject data structures in accordance with respective monetary values of the test subject data structures.
10 . The computer-implemented method of claim 9 , further comprising: causing rendering, on a client device, of one or more graphical user interfaces with one or more visual representations of results of test subjects.
11 . The computer-implemented method of claim 7 , wherein the BBSI constraints specify: the BBSI has nine or more of the electronic test orders; and no single electronic test order comprises more than 30 percent of the index's weighting.
12 . The computer-implemented method of claim 7 , further comprising: prompting, through the graphical user interface, the test subject to select a prepopulated template from one or more prepopulated templates, where each prepopulated template of the one or more prepopulated templates specifies a plurality of concentrations for completing a BBSI for the user and that satisfy the constraints for constructing a BBSI; and in response to a selection of the prepopulated template: accessing, from the hardware storage device, a plurality of data records that are structured to specify the plurality of concentrations and, for each of the plurality of concentrations, a respective electronic test order that is to be selected; receiving a selection of data specifying selection of a visual representation of the selected respective electronic test order, with the selection data being associated with the key that uniquely identifies the test subject associated with the selection data; parsing, by the parser of the data processing system, the plurality of data records to identify, based on the structure, data specifying the selected respective electronic test order and data specifying the plurality of concentrations; and storing, in the hardware storage device, the plurality of keyed data records structured with data specifying the plurality of selected electronic test order and the plurality of concentrations.
13 . The computer-implemented method of claim 12 , further comprising: prompting a test subject, through the graphical user interface, to select, for each of the plurality of concentrations, a respective electronic test order for the concentration from a set of electronic test orders that satisfy the BBSI constraints.
14 . The computer-implemented method of claim 13 , further comprising: selecting, by a prediction model, for each of the plurality of concentrations, a respective electronic test order for the concentration from a set of electronic test orders that satisfy the BBSI constraints.
15 . The computer-implemented method of claim 13 , wherein the parser of the data processing system comprises a trained prediction model trained to identify, based on the structure, data specifying the selected respective electronic test orders and data specifying the plurality of concentrations.
16 . The computer-implemented method of claim 13 , wherein the one or more prepopulated templates comprise one or more maximally concentrated templates.
17 . The computer-implemented method of claim 16 , wherein the one or more prepopulated templates comprise one or more equally concentrated templates.
18 . A non-transitory computer storage media storing instructions that when executed by one or more computers cause the one or more computers to perform operations for constructing a maximally concentrated Broad-Based Security Index, the operations comprising: accessing, by a data processing system and from a hardware device, outbound latency data and inbound latency data defining an outbound latency and an inbound latency to control a transmission of electronic test orders from a plurality of test subject devices independent of computational powers of the plurality of test subject devices; restricting, by the data processing system, the outbound latency defined by the outbound latency data to execution of electronic test orders by, for each of a plurality of test subject devices, restricting transmission of an electronic test order to one or more times; and restricting transmission of the electronic test order to an electronic test environment; imposing, by the data processing system, the inbound latency defined by the inbound latency data to submission of electronic test orders by, for each of the test subject devices, receiving, by the data processing system, an electronic test order comprising a weighted value; transmitting, in real-time, by the data processing system and to a test subject device of the plurality of test subject devices, an indication of one or more additional electronic test orders that are candidates for selection that satisfy one or more boundary conditions of the electronic test environment, with a boundary condition specifying a maximum weighted value of another electronic test order based on the weighted value of the electronic test order, with the indication, for each additional electronic test order, specifying a maximum weighted value assignable to that additional electronic test order based on the weighted value of the electronic test order and further specifying a cross correlation metric for that additional electronic test order; in accordance with imposing the outbound and inbound latencies, receiving, from each test subject device, a plurality of electronic test orders satisfying the one or more boundary conditions; and triggering an execution of the electronic test orders by an electronic test environment.
19 . The non-transitory computer storage media of claim 18 , wherein the operations further comprise: prompting, through the graphical user interface, the test subject to select a prepopulated template from one or more prepopulated templates, where each prepopulated template of the one or more prepopulated templates specifies a plurality of concentrations for the test subject and that satisfy the constraints; and receiving a selection of the prepopulated template from one or more prepopulated templates.
20 . The non-transitory computer storage media of claim 19 , wherein the operations further comprise: accessing, from the hardware storage device, a plurality of data records that are structured to specify the plurality of concentrations and, for each of the plurality of concentrations, a respective security that is to be selected by the test subject; prompting the test subject, through the graphical user interface, to select, for each of the plurality of concentrations, a respective security for the concentration from a set of securities that satisfy the constraints; receiving, through the graphical user interface, selection data specifying selection of a visual representation of the selected respective securities, with the selection data being associated with the key that uniquely identifies the test subject associated with the selection data; parsing, by the parser of the data processing system, the plurality of data records to identify, based on the structure, data specifying the selected respective securities and data specifying the plurality of concentrations; and storing, in the hardware storage device, the plurality of keyed data records structured with data specifying the plurality of selected securities and the plurality of concentrations.

Description

RELATED APPLICATION This application claims priority to U.S. application Ser. No. 18/733,189, filed on Jun. 4, 2024, the entire contents of which are hereby incorporated by reference in its entirety. TECHNICAL FIELD The present disclosure relates to computer implemented methods and systems for providing inbound and outbound latency leveling in an electronic test environment. BACKGROUND The complexity of a network infrastructure utilizing multiple computing systems configured for high frequency queries and real time data processing has a direct effect on order execution latencies. Improvement in hardware performance of the computing systems has partly addressed the issues with low latency. Streamlining software algorithms and minimizing data processing delays can enhance system resilience to handle high frequency queries that can affect order execution latencies. SUMMARY Implementations of the present disclosure are directed to techniques and tools for providing inbound and outbound latency leveling in an electronic test environment. More particularly, implementations of the present disclosure are directed to eliminating order execution latencies and solving challenges associated with creating a testing platform that permits the introduction of realistic financial incentives, by leveling inbound information latencies to create a level playing field. A computational system and graphical user interface for effectuating a controlled and secured test of portfolio construction ability, along with a feedback system enables test systems to determine respective asset management capabilities and to improve the respective capabilities. Embodiments of the invention relate generally to testing a singular system's relative performance at investment portfolio construction and, in particular, to providing a realistic risk and reward simulation that tests the ability of a singular system to outperform other systems after correcting for inbound information latencies and outbound order execution latencies. A level regulated environment within a network including multiple computing systems with realistic incentives includes multiple latency control parameters. For example, in a first aspect, a system facilitates test subjects to optimize in real-time their respective portfolio weighting choices across assets to solve the constrained optimization problem of maximizing expected portfolio variance subject to the boundary conditions associated with the delineation of a “Broad-Based Security Index” hereafter “BBSI”. The optimization can be based on the percentage weighting of each security selected, sequentially for each of 9 or more securities, displaying information for the test subject regarding the maximum weighting that can be assigned to the test subject's preferred choice. The options presented can be customized based on the test subject's preference level (how many favorites are identified in a user input, which could be 1, 2, 3, or more). The displayed options can be adjusted according to permutations that facilitate portfolio variance within set limits. In another aspect, a system eliminates inbound information latencies instantaneously (e.g., within miliseconds). For example, the system can present to the test subject instantaneously, based on each of the test subject's asset selection inputs, an array of all other assets within the selection universe ranked in descending order of trailing 6-month price correlation, the compilation of which requires calculating, sorting, and selectively displaying from a universe of 18,000,000 data fields. Based on the first asset chosen, and each asset sequentially after the first, display in real-time and ranked in descending order, the other 6000 assets and their 6-month trailing Pearson correlation coefficient with the chosen asset. This information must be immediately available no matter which of the universe of 6000 assets the test subject initially selects, so the precise 6000 cross-correlations must be selected immediately from the 18,000,000 cross-correlations in the stock selection universe, then ranked in descending order, and presented in real-time to the test subject. As another example, the system can present to the test subject instantaneously, based on the test subject's final asset selection inputs, a confirmation of whether the lowest weighted assets in the test subject's chosen portfolio have the minimum required dollar value of average daily trading volume for the prior 6-month period. Specifically, after the test subject has selected the final portfolio component security, the system must instantaneously calculate whether either the lowest weighted component securities comprising, in the aggregate, 25 percent of the weighting of the index product have an aggregate dollar value of average daily trading volume (“ADTV”) of $50 million or more, or, in the case of an index product with 15 or more component securities, $30 million or more. Particular embodiments of the sub