Search

JP-2026514520-A - Information processing methods, apparatus, devices, storage media, and computer programs

JP2026514520AJP 2026514520 AJP2026514520 AJP 2026514520AJP-2026514520-A

Abstract

Embodiments of this disclosure provide an information processing method, apparatus, device, and storage medium. The embodiment includes acquiring a plurality of subtitle information corresponding to a plurality of microphone-connected clients, wherein the subtitle information is assigned a microphone-connected client identifier and/or a target identifier corresponding to the microphone-connected client, and the subtitle information is determined by the audio data of the microphone-connected client; and transmitting the plurality of subtitle information to a target client so that the target client can distinguish and display the plurality of subtitle information based on the microphone-connected client identifier and/or the target identifier. [Selection Diagram] Figure 1

Inventors

  • ルー，ポン

Assignees

  • 北京字跳▲網▼絡技▲術▼有限公司

Dates

Publication Date
20260511
Application Date
20240410
Priority Date
20230427

Claims (18)

  1. The acquisition of multiple subtitle information corresponding to multiple microphone-connected clients, wherein the subtitle information is assigned a microphone-connected client identifier and/or a target identifier corresponding to the microphone-connected client, and the subtitle information is determined by the audio data of the microphone-connected client. The plurality of subtitle information is transmitted to the target client, causing the target client to distinguish and display the plurality of subtitle information based on the microphone connection client identifier and/or the target identifier. Information processing methods, including those mentioned above.
  2. The plurality of microphone connection clients include a target microphone connection caster side, and the method is performed by the target microphone connection caster side. Obtaining multiple subtitle information for multiple microphone-connected clients is possible. The first subtitle information is determined based on the audio data from the target microphone connected to the caster, This includes receiving second subtitle information transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients, The method according to claim 1.
  3. The aforementioned multiple microphone connection clients are multiple microphone connection caster sides, and the target microphone connection caster side is any of the above multiple microphone connection caster sides. Receiving second subtitle information transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients includes receiving second subtitle information transmitted by a microphone connection caster other than the target microphone connection caster among the plurality of microphone connection casters, Accordingly, transmitting the multiple subtitle information to the target client includes transmitting the first subtitle information and the second subtitle information to the viewer side corresponding to the target microphone-connected caster side. The method according to claim 2.
  4. The plurality of microphone connection clients include one microphone connection caster side and at least one microphone connection guest side, and the target microphone connection caster side is the one microphone connection caster side. Receiving second subtitle information transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients includes receiving second subtitle information transmitted by at least one guest microphone connection terminal. Accordingly, transmitting the multiple subtitle information to the target client includes transmitting the first subtitle information and the second subtitle information to the viewer side corresponding to the target microphone-connected caster side and to the at least one microphone-connected guest side. The method according to claim 2.
  5. The plurality of microphone connection clients include a plurality of microphone connection caster sides and at least one microphone connection guest side, and the target microphone connection caster side is any of the plurality of microphone connection caster sides. Receiving second subtitle information transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients includes receiving second subtitle information transmitted by a microphone connection caster other than the target microphone connection caster among the plurality of microphone connection caster sides and the at least one microphone connection guest side. Accordingly, transmitting the multiple subtitle information to the target client includes transmitting the first subtitle information and the second subtitle information to the viewer side corresponding to the target microphone-connected caster side and to the microphone-connected guest side corresponding to the target microphone-connected caster side. The method according to claim 2.
  6. The aforementioned method is performed by the service terminal, and the acquisition of multiple subtitle information corresponding to multiple microphone-connected clients is: To receive subtitle information transmitted by multiple microphone-connected clients and obtain multiple subtitle information, The method according to claim 1, including the method described in claim 1.
  7. The method according to claim 1, further comprising obtaining an audio-video composite stream corresponding to multiple microphone-connected clients.
  8. The plurality of microphone connection clients include a target microphone connection caster side, the method is performed by the target microphone connection caster side, and the audio-video synthesis stream includes a first audio-video stream and a second audio-video stream. Obtaining an audio-video composite stream that supports multiple microphone-connected clients is, To acquire the first audio/video stream from the target microphone connected caster, Receiving a second audio/video stream transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients, The method according to claim 7, including the method described in claim 7.
  9. The aforementioned multiple microphone connection clients are multiple microphone connection caster sides, and the target microphone connection caster side is any of the above multiple microphone connection caster sides. Receiving a second audio/video stream transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients is: Receiving a second audio/video stream transmitted by one of the multiple microphone connection caster sides other than the target microphone connection caster side, The method according to claim 8, including the method described in claim 8.
  10. The plurality of microphone connection clients include one microphone connection caster side and at least one microphone connection guest side, and the target microphone connection caster side is the one microphone connection caster side. Receiving a second audio/video stream transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients is: To receive a second audio/video stream transmitted by at least one microphone-connected guest, The method according to claim 8, including the method described in claim 8.
  11. The plurality of microphone connection clients include a plurality of microphone connection caster sides and at least one microphone connection guest side, and the target microphone connection caster side is any of the plurality of microphone connection caster sides. Receiving a second audio/video stream transmitted by a microphone connection client other than the target microphone connection caster among the plurality of microphone connection clients is: Receiving a second audio/video stream transmitted by the microphone connection guest side corresponding to the target microphone connection caster side and by other microphone connection caster sides other than the target microphone connection caster side. The method according to claim 8, including the method described in claim 8.
  12. Sending the aforementioned multiple subtitle information to the target client means Adding the aforementioned multiple subtitle information to the audio-video synthesis stream, wherein the audio-video synthesis stream is an audio-video synthesis stream corresponding to the aforementioned multiple microphone-connected clients, Sending the aforementioned audio-video composite stream, to which multiple subtitle information has been added, to the target client, The method according to claim 7, including the method described in claim 7.
  13. Adding the aforementioned multiple subtitle information to the audio-video composite stream is, The aforementioned multiple subtitle information is added to the audio-video composite stream as supplemental extended information (SEI). The method according to claim 12, including the method described in claim 12.
  14. Sending the aforementioned multiple subtitle information to a target client and causing the target client to distinguish and display the aforementioned multiple subtitle information based on the microphone connection client identifier and/or the target identifier is, The plurality of subtitle information is transmitted to the target client, causing the target client to display the subtitle information in the microphone position area corresponding to the microphone connection client identifier and/or the target identifier, or to display it in a position related to the microphone connection client identifier and/or the target identifier, based on the microphone connection client identifier and/or the target identifier. The method according to claim 1, including the method described in claim 1.
  15. Sending the aforementioned multiple subtitle information to a target client and causing the target client to distinguish and display the aforementioned multiple subtitle information based on the microphone connection client identifier and/or the target identifier is, The plurality of subtitle information is transmitted to the target client, and the target client is instructed to stitch together the subtitle information with the corresponding microphone-connected client identifier and/or target identifier based on the client identifier and/or target identifier, and then display it. The method according to claim 1, including the method described in claim 1.
  16. A subtitle information acquisition module for acquiring multiple subtitle information corresponding to multiple microphone-connected clients, wherein the subtitle information is assigned a microphone-connected client identifier and/or a target identifier corresponding to the microphone-connected client, and the subtitle information is determined by the audio data of the microphone-connected client; A subtitle information transmission module that transmits the multiple subtitle information to a target client and causes the target client to distinguish and display the multiple subtitle information based on the target identifier, Information processing device, including
  17. One or more processors, A storage device for storing one or more programs, An electronic device in which one or more of the aforementioned programs are executed by one or more processors, causing one or more processors to implement the information processing method described in any one of claims 1 to 15.
  18. A storage medium containing computer-executable instructions, used to execute the information processing method described in any one of claims 1 to 15 when the computer-executable instructions are executed by a computer processor.

Description

This application claims priority to the Chinese patent application filed on April 27, 2023, with application number 202310474964.9, and the title of the invention "Information Processing Method, Apparatus, Device, and Storage Medium." All contents of this application are incorporated into this application by reference. The embodiments of this disclosure relate to the technology of live streaming information processing, and more particularly to information processing methods, apparatus, devices, and storage media. In live streaming microphone connection (collaborative streaming) scenarios, subtitles are added to the live stream to improve the user's viewing experience. However, in related technologies, when multiple microphone-connected users speak simultaneously, the subtitle display effect may not meet user needs, negatively impacting the user experience. Referring to the embodiments for carrying out the invention described below, while linking the drawings, will make the above and other features, advantages and aspects of each embodiment of the present disclosure more apparent. Throughout the drawings, the same or similar symbols represent the same or similar elements. It should be understood that the drawings are schematic and parts and elements are not necessarily depicted in proportion. This is a flowchart of the information processing method according to the embodiments of this disclosure. This is an illustrative diagram of subtitle information processing according to an embodiment of the present disclosure. This is an illustrative diagram of subtitle information processing according to an embodiment of the present disclosure. This is an illustrative diagram of subtitle information processing according to an embodiment of the present disclosure. This is an illustrative diagram of the subtitle information display according to an embodiment of the present disclosure. This is an illustrative diagram of the subtitle information display according to an embodiment of the present disclosure. This is a schematic diagram of the structure of an information processing device according to an embodiment of the present disclosure. This is a schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure. The following describes embodiments of this disclosure in more detail with reference to the drawings. While several embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure may be implemented in various forms and should not be construed as being limited to the embodiments described herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure. It should be understood that the steps described in the method embodiments of this disclosure may be performed in a different order and/or in parallel. Furthermore, the method embodiments may include additional steps and/or omit the execution of the indicated steps. The scope of this disclosure is not limited in this respect. As used herein, the term "including" and its variations are open inclusions, i.e., "including, but not limited to." The term "based on" means "based at least partially." The term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one other embodiment," and the term "several embodiments" means "at least several embodiments." Relevant definitions of other terms are given in the following description. It should be noted that the concepts of “first,” “second,” etc., as used in this disclosure are used solely to distinguish different devices, modules, or units, and are not intended to limit the order or interdependence of the functions performed by these devices, modules, or units. It should be noted that the modifications “one” and “plural” as used in this disclosure are general, not restrictive, and should be understood as “one or plural” unless otherwise explicitly stated in the context, as should be understood by those skilled in the art. The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and do not limit the scope of such messages or information. To ensure understanding, before using any of the technical proposals disclosed in each embodiment of this disclosure, the user should be informed in an appropriate manner, in accordance with applicable laws and regulations, about the type of personal information related to this disclosure, the scope of use, and the usage scenarios, and their permission should be obtained. For example, when responding to a user's voluntary request, an operation that sends prompt information to the user, clearly prompting and requesting their action, req