Search

CN-122027845-A - Live video optimization method, device, computer equipment and storage medium

CN122027845ACN 122027845 ACN122027845 ACN 122027845ACN-122027845-A

Abstract

The embodiment of the invention relates to a live video optimization method, a live video optimization device, computer equipment and a storage medium, wherein an element material package is loaded according to a game identifier corresponding to a live video stream, target game elements contained in a current frame are identified for the live video stream, target element characteristic points corresponding to the target game elements are determined from the element material package, picture optimization processing is performed on pixel areas corresponding to the target game elements in the current frame according to the target element characteristic points based on game categories corresponding to the game identifier, an enhanced current frame is obtained, and the enhanced current frame is output to a subsequent picture processing module for display after the processing is completed. Therefore, the element material package can be loaded based on the game identifier, the target game element in the current frame is identified by utilizing the element characteristic points, and the picture optimization processing matched with the game category is executed, so that the picture definition of the game element is improved, the processing of non-target areas is reduced, the calculation pressure is reduced, and the overall consistency of the enhanced picture is ensured.

Inventors

  • HUANG JIAHAO

Assignees

  • 深圳创维显示科技有限公司

Dates

Publication Date
20260512
Application Date
20251230

Claims (10)

  1. 1. A live video optimization method, comprising: loading an element material package according to a game identifier corresponding to a game live video stream, wherein the element material package at least comprises element characteristic points of a plurality of game elements corresponding to the game identifier; identifying a target game element contained in the current frame for the live game video stream, and determining a target element characteristic point corresponding to the target game element from the element material package; based on the game category corresponding to the game identifier, performing picture optimization processing on a pixel area corresponding to the target game element in the current frame according to the target element feature point to obtain an enhanced current frame after optimization processing; and outputting the enhanced current frame to a subsequent picture processing module for displaying after the processing is completed.
  2. 2. The method according to claim 1, wherein the loading the element material package according to the game identifier corresponding to the live video stream includes: acquiring a game live video stream, and analyzing an initial frame of the game live video stream to identify a corresponding game identifier; inquiring and loading an element material packet corresponding to the game identifier in a local element material packet cache based on the game identifier; Under the condition that the element material package corresponding to the game identifier does not exist in the local element material package cache, acquiring and loading the element material package corresponding to the game identifier from the cloud; and determining a game category corresponding to the game live video stream based on the game identifier while loading the element material package, and loading a processing configuration file corresponding to the game category.
  3. 3. The method according to claim 1, wherein the identifying the target game element included in the current frame for the live video stream, and determining the target element feature point corresponding to the target game element from the element material package, includes: matching the characteristic information of the game elements extracted from the current frame with element characteristic points corresponding to all the game elements in the element material package, wherein the characteristic information is information representing the outline and/or key structure position of the game elements in the current frame; and under the condition that the matching is successful, determining the game element which is successfully matched as the target game element, and determining the element characteristic point corresponding to the target game element as the target element characteristic point.
  4. 4. The method of claim 1, wherein prior to loading the element portfolio according to the game identifier corresponding to the game live video stream, the method further comprises: Under the condition that the game category is a fixed view game, element feature points and element key frames corresponding to game elements contained in the game are obtained for each fixed view game, wherein the element key frames are two-dimensional image data obtained by rendering a preset action state of the game elements under fixed virtual camera parameters, the element key frames are used for executing picture replacement on pixel areas of the corresponding game elements in the current frames, and the element feature points are punctiform or regional features representing the outline and/or geometric structure positions of the game elements in the two-dimensional images; storing a game identifier, a game category, element feature points and element key frames corresponding to the fixed-view game as element material packages; under the condition that the game category is a free view game, aiming at each free view game, element characteristic points and element images corresponding to game elements contained in the game are obtained; And storing the game identifier, the game category, the element image and the element characteristic point corresponding to the free view game as element material packages.
  5. 5. The method according to claim 4, wherein the performing, based on the game category corresponding to the game identifier, a picture optimization process on a pixel area corresponding to a target game element in the current frame according to the target element feature point, to obtain an enhanced current frame after the optimization process includes: When the game category is a fixed view game, determining a pixel area of the target game element in the current frame based on the target element feature points; according to the target element feature points, matching the target game elements in the current frame with corresponding element key frames in the element material package to determine target element key frames corresponding to the current action states of the target game elements; determining scaling parameters, position parameters and affine transformation parameters of the target element key frame relative to the current frame based on the target element feature points; and transforming the target element key frame according to the scaling parameter, the position parameter and the affine transformation parameter, and fusing the transformed target element key frame to the pixel region to finish the picture optimization processing of the current frame so as to obtain the enhanced current frame.
  6. 6. The method according to claim 4, wherein the performing, based on the game category corresponding to the game identifier, a picture optimization process on a pixel area corresponding to a target game element in the current frame according to the target element feature point, to obtain an enhanced current frame after the optimization process includes: When the game category is a free view game, taking the target element characteristic points and the element images corresponding to the target game elements as reference information; Inputting the reference information into a trained picture processing model, so that the picture processing model performs optimization processing on a pixel area corresponding to a target game element in the current frame to improve the contour definition of the target game element and obtain the enhanced current frame.
  7. 7. The method according to claim 1, wherein in performing the picture optimization process, the method further comprises: Determining the element type of each target game element based on the target element feature points corresponding to each target game element; Determining an optimization priority corresponding to each target game element according to the element type, and executing picture optimization processing on a pixel area corresponding to each target game element according to the optimization priority; After the screen optimization processing is completed, edge feathering processing is performed on the synthesized boundary between each of the pixel regions.
  8. 8. A live video optimization apparatus, comprising: the loading module is used for loading an element material package according to the game identifier corresponding to the game live video stream, wherein the element material package at least comprises element characteristic points of a plurality of game elements corresponding to the game identifier; The identification module is used for identifying target game elements contained in the current frame of the live game video stream and determining target element characteristic points corresponding to the target game elements from the element material package; The processing module is used for executing picture optimization processing on the pixel area corresponding to the target game element in the current frame according to the game category corresponding to the game identifier and the target element characteristic point to obtain an enhanced current frame after the optimization processing; And the output module is used for outputting the enhanced current frame to the subsequent picture processing module for displaying after the processing is completed.
  9. 9. A computer device comprising a processor and a memory, the processor configured to execute a live video optimization program stored in the memory, to implement the live video optimization method of any one of claims 1-7.
  10. 10. A storage medium storing one or more programs executable by one or more processors to implement the live video optimization method of any one of claims 1-7.

Description

Live video optimization method, device, computer equipment and storage medium Technical Field The embodiment of the invention relates to the technical field of video playing, in particular to a live video optimization method, a live video optimization device, computer equipment and a storage medium. Background With the rapid development of live games and video content of games, the requirements of users on definition and visual performance of live pictures are continuously improved. The existing live game pictures are usually directly derived from video streams after real-time rendering or encoding, and under the conditions of bandwidth limitation, encoding compression and equipment performance constraint, problems of blurring, sawtooth or insufficient definition easily occur in game roles, main body elements and detail areas in the pictures, so that the watching experience of audiences is affected. In order to improve the visual effect of the live broadcast picture, a general video enhancement or super-resolution processing mode is generally adopted in the prior art to uniformly process the whole frame of picture. However, the method generally lacks the capability of distinguishing different element types in a game picture, cannot identify differences among game roles, main body elements and scene backgrounds, easily inputs excessive computing resources to unimportant areas, causes high computing pressure, and has limited effects on key element detail recovery. In addition, different types of games have significant differences in view and picture structure, for example, fixed view games and freeview games have different characteristics in terms of element pose, view variation, and picture consistency. The existing picture enhancement scheme is not generally adapted for different game categories, so that the picture consistency is difficult to be considered while the processing efficiency is ensured, and the problems of unnatural element boundaries, inconsistent local definition and the like are easily generated after enhancement, so that the overall picture appearance is affected. Disclosure of Invention In view of this, in order to solve the above technical problems or part of the technical problems, embodiments of the present invention provide a live video optimization method, apparatus, computer device, and storage medium. In a first aspect, an embodiment of the present invention provides a live video optimization method, including: loading an element material package according to a game identifier corresponding to a game live video stream, wherein the element material package at least comprises element characteristic points of a plurality of game elements corresponding to the game identifier; identifying a target game element contained in the current frame for the live game video stream, and determining a target element characteristic point corresponding to the target game element from the element material package; based on the game category corresponding to the game identifier, performing picture optimization processing on a pixel area corresponding to the target game element in the current frame according to the target element feature point to obtain an enhanced current frame after optimization processing; and outputting the enhanced current frame to a subsequent picture processing module for displaying after the processing is completed. In one possible implementation manner, the loading the element material package according to the game identifier corresponding to the live video stream includes: acquiring a game live video stream, and analyzing an initial frame of the game live video stream to identify a corresponding game identifier; inquiring and loading an element material packet corresponding to the game identifier in a local element material packet cache based on the game identifier; Under the condition that the element material package corresponding to the game identifier does not exist in the local element material package cache, acquiring and loading the element material package corresponding to the game identifier from the cloud; and determining a game category corresponding to the game live video stream based on the game identifier while loading the element material package, and loading a processing configuration file corresponding to the game category. In one possible implementation manner, the identifying, for the live video stream, a target game element included in a current frame, and determining, from the element material package, a target element feature point corresponding to the target game element, includes: matching the characteristic information of the game elements extracted from the current frame with element characteristic points corresponding to all the game elements in the element material package, wherein the characteristic information is information representing the outline and/or key structure position of the game elements in the current frame; and under the condition th