JP-7856112-B2 - Broadcasting contextual information through modulation of audio and video interfaces

Inventors

• ハリー マイケル クローニン
• ジャン ジャスパー ヴァン デン バーグ
• クリストファー ジョン ライト
• デイビッド マイケル ダフィー
• フィル ピーター カットン

Assignees

• 株式会社ＪＶＣケンウッド

Dates

Publication Date

20260511

Application Date

20220325

Priority Date

20220318

Claims (12)

1. The first electronic device outputs a first signal that is visually perceptible to the user and represents a video signal displayed by the video output component of the first electronic device . The first electronic device receives an input indicating an instruction to communicate information about the content of the first signal to a second electronic device located in close proximity to the first electronic device. The first electronic device superimposes a second signal onto the first signal, which is not visually perceptible to the user but indicates information, so as to generate a third signal , wherein the superposition introduces visual modulation to the video signal over a time interval, and the visual modulation affects only a portion of each frame of the video signal included in the time interval , and The first electronic device outputs the third signal for detection by the second electronic device, so that the second electronic device can detect the second signal even though the second signal is not visually perceptible to the user. A method for providing this.
2. The method according to claim 1, wherein the second signal is superimposed on the first signal in such a manner that the modulation of the first signal is not visually perceptible to the user.
3. The aforementioned superposition is, Based on an analysis of the content of the first signal, the time interval in which the second signal is superimposed is determined, The first signal and the second signal are combined such that the second signal matches the time interval, The method according to claim 1, comprising:
4. The method according to claim 1, wherein (i) the content of the second signal, or (ii) the method by which the second signal is superimposed on the first signal, uniquely associates the second signal with the second electronic device.
5. When executed by the processor of an electronic device, the electronic device: To output a first signal that is visually detectable by the user and represents a video signal displayed by the video output component of the electronic device , Receiving input that indicates instructions to transmit information to other electronic devices, Superimposing a second signal onto the first signal that is not visually detectable by the user and contains information , thereby generating a third signal, wherein the superposition introduces visual modulation to the video signal over a time interval, and the visual modulation affects only a portion of each frame of the video signal included in the time interval , and Outputting the third signal for detection by the other electronic device so that the other electronic device can detect the second signal, even though the second signal is not visually detectable by the user . A non-temporary medium in which instructions for performing an action comprising the above are stored.
6. The aforementioned operation is, The non-temporary medium according to claim 5 , further comprising identifying a portion of the first signal superimposed with the second signal by examining the content of the first signal in real time.
7. The aforementioned operation is, Based on an analysis of the content of the first signal, the time interval for superimposing the second signal is determined, and The non-temporary medium according to claim 5 , further comprising combining the first signal and the second signal such that the second signal matches the time interval.
8. The aforementioned operation is, The further comprising specifying a modulation scheme for communicating the information to the other electronic device based on the characteristics of the electronic device, The superposition is performed according to the modulation scheme, in the non-temporary medium according to claim 5 .
9. The non-transient medium according to claim 8 , wherein the characteristics are display size, display type, model, or intended application.
10. The modulation scheme specifies at least one characteristic of the second signal, the non-transient medium according to claim 8 .
11. The non-transient medium according to claim 5 , wherein the second signal is one of a plurality of signals superimposed on the first signal and is therefore included in the third signal.
12. The non-transient medium according to claim 11 , wherein each of the plurality of signals corresponds to a different time interval at which the third signal is output for detection by the other electronic device.

Description

(Cross-reference of related applications) This application, titled "Contextual Data Broadcasts Via Audio-Visual Interface Modifications," claims priority to U.S. Provisional Application No. 63/167,461, filed on 29 March 2021, which is incorporated herein by reference in its entirety. (Technical field) This disclosure relates to wireless communication of information, and more specifically, to an approach to wirelessly communicating information between electronic devices through the modulation of auditory or visually detectable content. With the development of the Internet of Things (IoT), electronic devices are constantly available, and individuals expect to be constantly connected to the internet, their electronic devices, and each other. Historically, this has been achieved through wireless network protocols collectively known as "Wi-Fi®." These wireless network protocols enable multiple nearby electronic devices to exchange data using radio waves. Driven by the demand for superior connectivity, there is a growing expectation that virtually all electronic devices will have the capability to process audio or video in real time and perform local digital signal processing. With these capabilities in mind, companies have embarked on developing new technologies to facilitate wireless interaction between electronic devices. One such technology is data-over-sound. Data-over-sound enables data exchange between a first electronic device containing an audio output component (also known as the "source electronic device") and a second electronic device containing an audio input mechanism (also known as the "recipient electronic device"). At a high level, data over sound functions similarly to a quick-response (QR) code, except that the data is transmitted via an acoustic channel. In practice, the data is encoded by a first electronic device into an acoustic signal, for example, as a series of tones, forming an "acoustic barcode." The first electronic device then emits an acoustic signal for reception by a second electronic device. Upon reception, the second electronic device demodulates the acoustic signal to decode the data encoded therein. Figure 1 includes a high-level diagram showing how relevant information can be superimposed on the interface signal output by the source electronic device. Figure 2 includes a high-level representation of a system that can be used to broadcast machine-interpretable encoded data from one electronic device to one or more other electronic devices. Figure 3 shows an example of an electronic device that can implement an operating platform designed to manipulate interface signals to transfer information to a receiver electronic device. Figure 4 includes a schematic diagram of a procedure for transferring information from a first electronic device (also called the "source electronic device") to a second electronic device (also called the "receiver electronic device") through the modulation of an audible or visual signal. Figure 5 includes a high-level diagram of communication between a source electronic device and a receiver electronic device. Figure 6 includes a flowchart of the process performed by the source electronic device to transfer information to the receiver electronic device. Figure 7A includes a schematic diagram showing how the extraction algorithm can process interface signals to identify a suitable opportunity to transfer information to a receiver electronic device. Figure 7B includes a schematic diagram showing how a detection algorithm can examine the output generated by an extraction algorithm to determine whether it is appropriate to initiate the transfer of information from a source electronic device to a receiver electronic device. Figure 7C includes a schematic diagram showing how a modulation algorithm can modulate an interface signal in such a way that it overlays relevant information onto it. Figure 7D includes a schematic diagram showing how the superposition algorithm can superimpose the second signal output by the modulation algorithm onto the first signal broadcast by the source electronic device. Figure 8 shows how a link can be intelligently embedded in an audio signal based on an analysis of the audio contained within the audio signal. Figure 9 illustrates how the approach described herein can be used to facilitate the secure transfer of sensitive information. Figure 10 is a block diagram showing an example of a processing system capable of implementing at least some of the operations described herein. Various features of the technology described herein will become clearer to those skilled in the art from the detailed description accompanied by the drawings. Embodiments are shown in the drawings, without limitation, as examples. While the drawings depict various embodiments for illustrative purposes, those skilled in the art will recognize that alternative embodiments can be employed without departing from the principles of the art. Therefore, although spe