US-12627844-B2 - Video-based analytics platform for real-time tracking of athlete and equipment movement

Abstract

The embodiments disclose a multi-camera live-streaming system including a plurality of synchronized capture devices configured to transmit live video data to a network server executing artificial-intelligence-based analytics that identify, segment, and classify discrete moments of athletic activity in real time, the network server further including a predictive analytics module coupled to an event-segmentation subsystem and a historical-footage database configured to employ neural-network models trained on prior gameplay to forecast probable upcoming actions and generate contextual playback recommendations synchronized with a live broadcast, wherein viewer devices coupled to the server display the resulting live stream with integrated highlight replays, adaptive advertisements, and automated camera prioritization providing real-time interactive viewing and monetization functions according to one embodiment.

Inventors

• Robert Bradley Burkhart
• Peter Christian MAURER
• Edmond Defrank

Assignees

• Robert Bradley Burkhart
• Peter Christian MAURER
• Edmond Defrank

Dates

Publication Date

20260512

Application Date

20251007

Claims (20)

1. 1 . A video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event, the system comprising: a plurality of video cameras positioned at different physical locations and oriented at distinct vantage points of the sporting event, each camera configured to capture continuous live-motion video images of athletes participating in the live sporting event and at least one corresponding piece of sports equipment during the sporting event; a remote computer server configured to receive and process the continuous live-motion video images, the server being further configured to generate synchronized video data streams; a video-recognition and tracking module executed by the remote computer server and configured to analyze the synchronized video data streams to automatically identify, segment, and track the location, orientation, speed, and movement trajectory of the participating athletes and of the at least one corresponding piece of sports equipment during the sporting event as current identified, segmented and tracked data; an analytics processor coupled to the remote computer server and configured to calculate, in real time, a projected path, speed, and a projected travel distance of the at least one corresponding piece of sports equipment during the sporting event; a comparison processor configured to compare the current identified, segmented and tracked data to historical identified, segmented and tracked previous data of the participating athletes and of the at least one corresponding piece of sports equipment to determine quantifiable variations and differences between the current identified, segmented and tracked data and the previous data; and a software application operatively coupled to the remote computer server and configured to display to users in real time, visual and numerical representations of the projected path, speed, and a projected travel distance of the at least one corresponding piece of sports equipment, the software application being further configured to display rendered three-dimensional graphical visualizations of the athletes participating in the live sporting event and the at least one corresponding piece of sports equipment during the sporting event.
2. 2 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 1 , wherein the remote computer server is further configured to temporally associate corresponding image frames from each camera with one another to enable comparative multi-view analysis of the same portion of the sporting event.
3. 3 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 1 , wherein the plurality of cameras are configured to operate such that their respective captured video streams collectively provide overlapping visual coverage of the sporting event.
4. 4 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 1 , wherein the video-recognition and tracking module is further configured to continuously operate across successive image frames from different cameras to maintain persistent identification of each participating athlete and the at least one piece of sports equipment during the sporting event.
5. 5 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 1 , wherein the analytics processor is further configured to determine a probability of a successful play outcome based on initial trajectory and movement data of the participating athletes and the at least one corresponding piece of sports equipment.
6. 6 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 1 , wherein the software application provides a user-selectable viewing interface configured to enable the user to select between different camera feeds.
7. 7 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 1 , wherein the network server further comprises an artificial-intelligence-based event detection and segmentation subsystem configured to analyze live video streams from the plurality of cameras in real time to identify, label, and classify discrete moments of athletic activity, each identified event being automatically time-stamped, indexed, and stored with metadata including event type, confidence score, player or object identification, and corresponding camera source.
8. 8 . A video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event, the system comprising: a plurality of video cameras positioned at different physical locations and oriented at distinct vantage points of the sporting event, each camera configured to capture continuous live-motion video images of athletes participating in the live sporting event and at least one corresponding piece of sports equipment during the sporting event; a remote computer server configured to receive and process the continuous live-motion video images, the server being further configured to generate synchronized video data streams; a video-recognition and tracking module executed by the remote computer server and configured to analyze the synchronized video data streams to automatically identify, segment, and track the location, orientation, speed, and movement trajectory of the participating athletes and of the at least one corresponding piece of sports equipment during the sporting event; an analytics processor coupled to the remote computer server and configured to calculate, in real time, a projected path, speed, and a projected travel distance of the at least one corresponding piece of sports equipment during the sporting event; a software application operatively coupled to the remote computer server and configured to display to users in real time, visual and numerical representations of the projected path, speed, and a projected travel distance of the at least one corresponding piece of sports equipment, the software application being further configured to display rendered three-dimensional graphical visualizations of the athletes participating in the live sporting event and the at least one corresponding piece of sports equipment during the sporting event; and a predictive analytics module coupled to the remote computer server further comprising an artificial-intelligence-based event detection and segmentation subsystem and configured to evaluate and compare live-stream data in combination with historical sports-footage datasets stored in at least one historical-footage database coupled to the predictive analytics module to determine quantifiable variations and differences between the live-stream data and the historical sports-footage datasets.
9. 9 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 8 , wherein the remote computer server is further configured to temporally associate corresponding image frames from each camera with one another to enable comparative multi-view analysis of the same portion of the sporting event.
10. 10 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 8 , wherein the plurality of cameras are configured to operate such that their respective captured video streams collectively provide overlapping visual coverage of the sporting event.
11. 11 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 8 , wherein the video-recognition and tracking module is further configured to continuously operate across successive image frames from different cameras to maintain persistent identification of each participating athlete and the at least one piece of sports equipment during the sporting event.
12. 12 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 8 , wherein the analytics processor is further configured to determine a probability of a successful play outcome based on initial trajectory and movement data of the participating athletes and the at least one corresponding piece of sports equipment.
13. 13 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 8 , wherein the software application provides a user-selectable viewing interface configured to enable the user to select between different camera feeds.
14. 14 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 8 , wherein the network server further comprises an artificial-intelligence-based event detection and segmentation subsystem configured to analyze live video streams from the plurality of cameras in real time to identify, label, and classify discrete moments of athletic activity, each identified event being automatically time-stamped, indexed, and stored with metadata including event type, confidence score, player or object identification, and corresponding camera source.
15. 15 . A video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event, the system comprising: a plurality of video cameras positioned at different physical locations and oriented at distinct vantage points of the sporting event, each camera configured to capture continuous live-motion video images of athletes participating in the live sporting event and at least one corresponding piece of sports equipment during the sporting event; a remote computer server configured to receive and process the continuous live-motion video images, the server being further configured to generate synchronized video data streams; a video-recognition and tracking module executed by the remote computer server and configured to analyze the synchronized video data streams to automatically identify, segment, and track the location, orientation, speed, and movement trajectory of the participating athletes and of the at least one corresponding piece of sports equipment during the sporting event; an analytics processor coupled to the remote computer server and configured to calculate, in real time, a projected path, speed, and a projected travel distance of the at least one corresponding piece of sports equipment during the sporting event; a software application operatively coupled to the remote computer server and configured to display to users in real time, visual and numerical representations of the projected path, speed, and a projected travel distance of the at least one corresponding piece of sports equipment, the software application being further configured to display rendered three-dimensional graphical visualizations of the athletes participating in the live sporting event and the at least one corresponding piece of sports equipment during the sporting event; a predictive analytics module coupled to the remote computer server further comprising an artificial-intelligence-based event detection and segmentation subsystem and configured to evaluate live-stream data in combination with historical sports-footage datasets stored in at least one historical-footage database coupled to the predictive analytics module to determine quantifiable variations and differences between the live-stream data and the historical sports-footage datasets; and wherein the predictive analytics module is further configured to employ trained neural-network models to compare detected motion vectors, player formations, and event sequences against previously analyzed gameplay patterns to forecast probable upcoming actions and generate contextual playback recommendations synchronized with the live broadcast.
16. 16 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 15 , wherein the remote computer server is further configured to temporally associate corresponding image frames from each camera with one another to enable comparative multi-view analysis of the same portion of the sporting event.
17. 17 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 15 , wherein the plurality of cameras are configured to operate such that their respective captured video streams collectively provide overlapping visual coverage of the sporting event.
18. 18 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 15 , wherein the video-recognition and tracking module is further configured to continuously operate across successive image frames from different cameras to maintain persistent identification of each participating athlete and the at least one piece of sports equipment during the sporting event.
19. 19 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 15 , wherein the analytics processor is further configured to determine a probability of a successful play outcome based on initial trajectory and movement data of the participating athletes and the at least one corresponding piece of sports equipment.
20. 20 . The video-based analytics system for automatically detecting, measuring, and evaluating athletic performance during a live sporting event of claim 15 , wherein the software application provides a user-selectable viewing interface configured to enable the user to select between different camera feeds.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This Patent Application is a Continuation-in-part and claims priority to United States Patent Application entitled: “VIDEO-BASED ANALYTICS PLATFORM FOR REAL-TIME TRACKING OF ATHLETE AND EQUIPMENT MOVEMENT”, U.S. Ser. No. 1 19/206,875 filed on May 13, 2025 by Robert Bradley Burkhart, which is a Continuation of and claims priority to United States Patent Application entitled: “MULTI-CAMERA LIVE-STREAMING METHOD AND DEVICES”, U.S. Ser. No. 18/761,276 filed on Jul. 1, 2024 filed by Robert Bradley Burkhart, which is a Continuation of and claims priority to United States Patent Application entitled: “MULTI-CAMERA LIVE-STREAMING METHOD AND DEVICES”, U.S. Ser. No. 18/401,487 filed on Dec. 30, 2023 filed by Robert Bradley Burkhart, which is a Continuation of and claims priority to United States Patent Application entitled: “MULTI-CAMERA LIVE-STREAMING METHOD AND DEVICES”, U.S. Ser. No. 18/208,368 filed on Jun. 12, 2023 filed by Robert Bradley Burkhart, which is a Continuation of and claims priority to United States Patent Application entitled: “MULTI-CAMERA LIVE-STREAMING METHOD AND DEVICES”, U.S. Ser. No. 17/977,998 filed on Oct. 31, 2022 filed by Robert Bradley Burkhart U.S. Pat. No. 11,677,990 issued on Jun. 13, 2023, which is a Continuation of and claims priority to United States Patent Application entitled: “MULTI-CAMERA LIVE-STREAMING METHOD AND DEVICES”, U.S. Ser. No. 17/374,874 filed on Oct. 31, 2022 filed by Robert Bradley Burkhart U.S. Pat. No. 11,490,130 issued on Nov. 1, 2022, which is a Continuation of and claims priority to United States Patent Application entitled: “MULTI-CAMERA LIVE-STREAMING METHOD AND DEVICES”, U.S. Ser. No. 16/199,175 filed on Nov. 24, 2018 filed by Robert Bradley Burkhart U.S. Pat. No. 11,064,221 issued on Jul. 13, 2021, all of the above cases being incorporated herein by reference. BACKGROUND Youth sports are an enormous untapped market for original content. Every parent wants to capture their kids' game on video. Coaches and players want video too. But it is not easy with a single camera, usually far away from the action. A single camera does not offer the best experience for events, especially sports. Multi-cam emulates what we all expect from watching sports on TV. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 shows for illustrative purposes only an example of an overview of a multi-camera live-streaming method and devices of one embodiment. FIG. 2 shows for illustrative purposes only an example of retail advertising mixed into streaming of one embodiment. FIG. 3 shows for illustrative purposes only an example of training advertising mixed into streaming of one embodiment. FIG. 4 shows for illustrative purposes only an example of interactive advertising with touch screen purchasing of one embodiment. FIG. 5 shows for illustrative purposes only an example of streaming advertiser ad revenue of one embodiment. FIG. 6 shows for illustrative purposes only an example of multi-camera live-streaming processing of one embodiment. FIG. 7A shows for illustrative purposes only an example of first camera live-streaming auto action prioritizing of one embodiment. FIG. 7B shows for illustrative purposes only an example of second camera live-streaming auto action prioritizing of one embodiment. FIG. 8 shows for illustrative purposes only an example of ad mixing into streaming of one embodiment. FIG. 9 shows for illustrative purposes only an example of record mode settings of one embodiment. FIG. 10 shows for illustrative purposes only an example of highlights playback settings of one embodiment. FIG. 11 shows for illustrative purposes only an example of split screen mode selection of one embodiment. FIG. 12A shows for illustrative purposes only an example of auto cross camera first view action targeting of one embodiment. FIG. 12B shows for illustrative purposes only an example of auto cross camera second view action targeting of one embodiment. FIG. 12C shows for illustrative purposes only an example of auto cross camera third view action targeting of one embodiment. FIG. 13 shows for illustrative purposes only an example of auto drone camera streaming tracking of one embodiment. FIG. 14 shows for illustrative purposes only an example of auto ad mixing timing of one embodiment. FIG. 15 shows for illustrative purposes only an example of a VIDGO cam user position selection of one embodiment. FIG. 16A shows for illustrative purposes only an example of a school location GPS search of one embodiment. FIG. 16B shows for illustrative purposes only an example of a school sports venue locator of one embodiment. FIG. 17A shows for illustrative purposes only an example of a school football field sports venue identification of one embodiment. FIG. 17B shows for illustrative purposes only an example of a sports venue N-S orientation of one embodiment. FIG. 17C shows for illustrative purposes only an example of a football field sports venue recognition template of one e