CN-121997092-A - System and method for providing feedback information based on audience response information for musical performance through artificial intelligence
Abstract
Embodiments provide a system and method for providing response information-based feedback information to viewers of a musical performance through artificial intelligence. The method according to one embodiment receives image information about a musical performance audience from a camera device mounted on a musical performance stage and biometric information about the musical performance audience from a sensing device worn on the musical performance audience. And, the biometric information of the musical performance includes heart rate data, body temperature data, respiratory rate data, and skin conductance data, and the movement information about the audience of the musical performance is obtained by using a movement analysis model based on the first neural network. Based on the motion information and the biometric information, reaction information of the audience of the musical performance is determined by using a reaction analysis model of the second neural network, and reaction information of the audience of the musical performance is determined based on the reaction. May include determining feedback information regarding the musical performance and transmitting the feedback information regarding the musical performance to the command terminal. The feedback information about the musical performance may include feedback information about the speech and songs included in each of the plurality of scenes constituting the musical performance.
Inventors
- YIN XIANGYUAN
Assignees
- 去岛上的蝴蝶株式会社
- 尹湘圆
Dates
- Publication Date
- 20260508
- Application Date
- 20241118
- Priority Date
- 20241105
Claims (1)
- 1. A method for a server to provide feedback information regarding a musical performance based on reaction information regarding a spectator of the musical performance, comprising: receiving video information about a musical performance audience from an image pickup apparatus mounted on a musical performance stage; Receiving biometric information of the musical performance audience from a sensing device worn by the musical performance audience, the biometric information including heart rate data, body temperature data, respiratory rate data, and skin conductance data; Determining motion information about a spectator of a musical performance through a motion analysis model using a first neural network based on the video information; Determining response information about a spectator of the musical performance by using a response analysis model of the second neural network based on the motion information and the biometric information; determining feedback information of the musical performance based on the response information and the preset expected response information, and Comprising transmitting feedback information of the musical performance to the director terminal, The feedback information about the musical performance includes feedback information about the speech and songs included in each of the plurality of scenes constituting the musical performance.
Description
System and method for providing feedback information based on audience response information for musical performance through artificial intelligence Technical Field The present invention relates to a technique for providing feedback information on a musical performance, and a system and method for providing feedback information based on reaction information to a viewer of the musical performance through artificial intelligence. Background In recent years, in the field of performance, musical performance is introducing various director skills and techniques to increase audience engagement and immersion. However, the existing performances are still mainly based on fixed production and storyline, and have limitations in reflecting audience reactions in real time. If a system is introduced that can analyze the audience response and adjust the direction of the performance immediately accordingly, the immersion of the performance can be increased, maximizing the audience experience. In addition, the existing performance feedback system mainly relies on evaluation after performance such as review and investigation to obtain improvement of performance, but the problems of difficult real-time reflection, incapability of immediate feedback and returnability exist. The audience reacts. In addition, it is difficult to expect high-quality feedback from the post-evaluation of the audience, and since there is a case where a good evaluation or a bad evaluation is intentionally made, it is limited to obtain accurate and reliable feedback. In addition, with small musical plays, there are many restrictions in terms of budget and infrastructure compared to large shows, so it may be difficult to set a budget to receive feedback from the audience. That is, small musical plays are operated with limited personnel and resources, and it is difficult to embody improvement of performance by means of conventional feedback, so that improvement of performance quality may be limited. Accordingly, there is a need for a system and method for providing feedback information based on audience response information to musical performances through artificial intelligence. Disclosure of Invention Problems to be solved by the invention Embodiments of the present disclosure may provide a system and method for providing feedback information based on reaction information to viewers of musical performances through artificial intelligence. The technical challenges to be achieved in the embodiments are not limited to the above, and other technical challenges not mentioned can be considered by those skilled in the art from the various embodiments described below. Means for solving the problems A method of a server for providing feedback information on a musical performance based on reaction information on a spectator of the musical performance according to an embodiment includes receiving video information on a spectator of the musical performance from a camera device installed on a stage of the musical performance, and receiving biometric information of the spectator of the musical performance from a sensing device worn by the spectator of the musical performance based on image information, the biometric information including heart rate data, body temperature data, respiratory rate data, and skin conductance data, determining the movement information of the spectator of the musical performance using a movement analysis model of a first neural network, determining the reaction information of the spectator of the musical performance by using a response analysis model of a second neural network based on the movement information and the biometric information, and determining a response may include determining the feedback information for feeding back the musical performance according to the information and preset desired response information, and transmitting the feedback information of the musical performance to a command terminal. The feedback information about the musical performance may include feedback information about the speech and songs included in each of the plurality of scenes constituting the musical performance. Effects of the invention As described above, the present invention has the following effects: According to an embodiment, the server may collect reaction information of the spectator during the performance by analyzing the facial expression, motion, and biometric information of the spectator in real time, and generate feedback information based on the reaction information of the spectator. Through this, the director can know the emotional state and the reaction mode of the audience in real time, and adjust the making of the performance according to the needs, so as to maximally improve the immersion of the audience. According to an embodiment, the server predicts in real-time the external emotional state (e.g., happy, sad, surprised, etc.) and the internal emotional state (e.g., immersed, strained, tired, etc.) of the audience through th