CN-122002070-A - Message bar display method and device
Abstract
The application provides a message bar display method, a device, equipment, a medium and a program product. The method for displaying the message bars in the application comprises the steps of obtaining standard live video frames, carrying out target detection on the standard live video frames, determining the type and the original position of a target area, determining target paths of the message bars based on the type and the original position of the target area and the size of a screen and the size of the message bars, rendering the message bars, and moving the rendered message bars in the screen according to the target paths. According to the embodiment, through the on-end real-time detection and dynamic path decision, the accurate avoidance of the message strip to the sensitive area is realized, and the user experience and the message strip exposure effect are considered.
Inventors
- Yao Longkang
Assignees
- 上海哔哩哔哩科技有限公司
Dates
- Publication Date
- 20260508
- Application Date
- 20260204
Claims (18)
- 1. A message bar display method, comprising: Acquiring a standard live video frame; performing target detection on the standard live video frame, and determining the category and the original position of a target area; determining a target path of the message bar based on the category and original position of the target area, and the size of the screen and the size of the message bar; Rendering the message bar, and moving the rendered message bar in the screen according to the target path.
- 2. The method of claim 1, wherein the acquiring standard live video frames comprises: responding to the trigger condition, and capturing original live video frames from a live video rendering pipeline or live video decoding output at a preset sampling frequency; And carrying out standardized processing on the original live video frame to generate the standard live video frame.
- 3. The method of claim 2, wherein the trigger condition comprises at least one of reaching a preset trigger period, occurrence of a preset trigger event.
- 4. The method of claim 2, wherein the normalizing the original live video frame to generate the standard live video frame comprises: And carrying out coordinate transformation on the original live video frame by using a coordinate transformation matrix to generate the standard live video frame.
- 5. The method of claim 4, wherein the performing object detection on the standard live video frame to determine a category and an original location of an object region comprises: Inputting the standard live video frame into a target detection model, and outputting the category and standard position of the target area; And carrying out coordinate recovery on the standard position of the target area by using the coordinate transformation matrix to generate the original position of the target area.
- 6. The method of any of claims 1-5, wherein the target area comprises at least one of a portrait window of a host, a map window, a key head-up display.
- 7. The method of claim 1, wherein the determining the target path of the message bar based on the category and original location of the target area, as well as the size of the screen and the size of the message bar, comprises: Determining candidate positioning parameters according to the rolling direction of the message bar and the candidate display mode; Calculating a candidate path of the message bar based on the size of the screen, the size of the message bar, the off-screen margin and the candidate positioning parameters; Calculating the time domain overlapping area of the position of the candidate path in the rolling period and the original position of the target area; Calculating shielding loss based on the time domain overlapping area; The target path is determined from the candidate paths based on the occlusion loss.
- 8. The method of claim 7, wherein the method further comprises: and merging the target areas with the intersection ratio larger than a preset threshold value.
- 9. The method of claim 7, wherein the candidate presentation comprises at least one of top centered, bottom of screen, left side of target area, right side of target area, below target area, custom offset.
- 10. The method of claim 7, wherein the calculating occlusion losses based on the time domain overlap area comprises: Setting priority for the target area according to the category of the target area; and weighting the overlapping area of the time domains according to the priority to obtain the shielding loss.
- 11. The method of claim 7, wherein the determining the target path from the candidate paths based on the occlusion loss comprises: And selecting a candidate path with the path length not smaller than the minimum path length threshold and the minimum shielding loss as the target path.
- 12. The method of claim 11, wherein the method further comprises: If the occlusion loss of the target path is greater than an occlusion loss threshold, at least one of downsizing the message bar, adjusting the transparency of the message bar, and moving the message bar to the bottom of the screen is performed.
- 13. The method according to any one of claims 1-12, wherein the position switching of the message bars is required to meet a switching condition, the switching condition comprising at least one of detecting target areas of the same position and the same category in a continuous preset number of standard live video frames, an average confidence of the target areas being not less than a preset confidence threshold, a switching interval being not less than a minimum switching interval, a switching frequency not exceeding a maximum switching frequency, and a ratio of an occlusion area of the message bars to the target areas being not greater than a critical occlusion tolerance of the corresponding category of target areas.
- 14. The method of claim 5, wherein the method further comprises: de-identifying the standard live video frame to generate a de-identified live video frame; Generating a training sample based on the de-identified live video frames and the categories and original positions of the target area; and uploading the training sample to a cloud end for training the target detection model.
- 15. A message strip display apparatus comprising: The acquisition module is configured to acquire standard live video frames; The detection module is configured to carry out target detection on the standard live video frame and determine the category and the original position of a target area; a determining module configured to determine a target path of a message bar based on a category and an original location of the target area, and a size of a screen and a size of the message bar; And the display module is configured to render the message bar and move the rendered message bar in the screen according to the target path.
- 16. An electronic device, the electronic device comprising: At least one processor, and A memory communicatively coupled to the at least one processor, wherein, The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-14.
- 17. A computer readable medium having stored thereon computer program instructions executable by a processor to implement the method of any of claims 1-14.
- 18. A computer program product comprising a computer program which, when executed by a processor, implements the method of any of claims 1-14.
Description
Message bar display method and device Technical Field The present application relates to the field of live broadcasting technologies, and in particular, to a method, an apparatus, a device, a medium, and a program product for displaying a message bar. Background With the sustainable development and scale expansion of the online live broadcast industry, interaction forms and operation elements in a live broadcast room are more and more abundant. Message bars (such as broadcast bars) become important operation carriers of platforms, are widely applied to scenes such as push notification, activity popularization, user interaction and the like, and play an important role in improving information touch efficiency and operation conversion effect. Currently, the main stream display mode of the message bar is scrolling from the right side to the left side of the screen, and when a specific condition (such as the top of a live broadcasting room) is triggered by a platform, the message bar is uniformly displayed at the top of the total station related live broadcasting room or a preset fixed area, so that a standardized operation information transmission mode is formed. In various scenes such as live broadcasting of games, picture-in-Picture (PiP) live broadcasting, live broadcasting pictures often comprise important small areas with high information value and high look and feel sensitivity, such as a map small window (Mini-map), a host portrait window, a key HUD (Head-Up Display), and the like, and the areas are distributed at corner positions of a screen in many ways, so that the live broadcasting pictures are core visual elements for guaranteeing viewing experience of users. In the technical field of message bar display, the existing scheme mainly realizes display position control through preset static rules, for example, a message bar is fixed at the center of the top end of a screen or a fixed offset position is set for display, a part of platforms also adopt a manual configuration mode, a message bar display strategy is adjusted for individual live broadcasting rooms through a blacklist and whitelist mechanism, and in addition, a technical implementation mode of temporarily hiding the message bar to avoid interference to live broadcasting pictures exists. The prior art provides a feasible path for basic display of the message strip, can meet the transmission requirement of operation information in a conventional live broadcast scene, and ensures the exposure effect and basic use experience of the message strip to a certain extent. Disclosure of Invention Aspects of the present application provide a message bar display method, apparatus, device, medium, and program product for solving the problem that a conventional static display scheme easily obscures a sensitive area. According to one aspect of the application, a message bar display method is provided, which comprises the steps of obtaining a standard live video frame, carrying out target detection on the standard live video frame, determining the type and the original position of a target area, determining a target path of a message bar based on the type and the original position of the target area and the size of a screen and the size of the message bar, rendering the message bar, and moving the rendered message bar in the screen according to the target path. In another aspect of the application, a message bar display device is provided, which comprises an acquisition module configured to acquire standard live video frames, a detection module configured to perform target detection on the standard live video frames, determine the category and the original position of a target area, a determination module configured to determine a target path of a message bar based on the category and the original position of the target area, the size of a screen and the size of the message bar, and a display module configured to render the message bar and move the rendered message bar in the screen according to the target path. In another aspect of the application, an electronic device is provided that includes at least one processor and a memory communicatively coupled to the at least one processor, wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform a message strip presentation method as described above. In another aspect of the application, a computer readable storage medium having stored thereon computer program instructions executable by a processor to implement a message bar presentation method as described above is provided. In another aspect of the application, a computer program product is provided, comprising a computer program which, when executed by a processor, implements a message bar presentation method as described above. According to the scheme provided by the embodiment of the application, through real-time visual detection and dynamic path decision on the terminal, accurate avoidan