Search

CN-122019880-A - Intelligent screen interaction method, system and medium based on panoramic nursing and intelligent member service

CN122019880ACN 122019880 ACN122019880 ACN 122019880ACN-122019880-A

Abstract

The application provides an intelligent screen interaction method, system and medium based on panoramic nursing and intelligent member service, wherein the method comprises the steps of collecting all-visual-angle environment image data of a target area, and analyzing the environment image data in real time to obtain environment monitoring and user behavior characteristics; the method comprises the steps of obtaining user identity information, obtaining user history habit data and scene preference data, constructing a personalized service model, generating personalized member content and service information based on the personalized service model, obtaining user interaction instructions, obtaining user execution information, matching the personalized member content and the service information based on the user execution information to obtain push content, transmitting the push content to an intelligent screen for display in real time, realizing full-view environment coverage through an integrated panoramic camera, carrying out accurate identification of user behaviors and identity information by matching an image identification algorithm, meeting family nursing requirements, and realizing active push of the personalized content and service.

Inventors

  • Ye Renfa

Assignees

  • 特艺(中国)科技有限公司

Dates

Publication Date
20260512
Application Date
20260202

Claims (10)

  1. 1. An intelligent screen interaction method based on panoramic nursing and intelligent member service is characterized by comprising the following steps: Collecting all-visual-angle environment image data of a target area, and analyzing the environment image data in real time to obtain environment monitoring and user behavior characteristics; Invoking a user portrait database to obtain user identity information, and acquiring user history habit data and scene preference data based on the user identity information; Establishing a personalized service model based on the user history habit data, the scene preference data and the user behavior characteristics, and generating personalized member content and service information based on the personalized service model; Acquiring a user interaction instruction, and carrying out voice, touch control and gesture recognition based on the user interaction instruction to acquire user execution information; and matching the personalized member content with the service information based on the user execution information to obtain push content, and transmitting the push content to the intelligent screen for display in real time.
  2. 2. The intelligent screen interaction method based on panoramic nursing and intelligent member service according to claim 1, wherein the method is characterized by collecting all-visual-angle environment image data of a target area, analyzing the environment image data in real time to obtain environment monitoring and user behavior characteristics, and specifically comprises the following steps: collecting all-visual-angle environment image data of a target area, and dividing the environment image data into a plurality of sub-areas based on an image segmentation algorithm; Denoising each sub-region, and enhancing the denoised sub-regions to obtain enhanced images; analyzing the enhanced image of each sub-region, and dividing an environment region and a user target; Analyzing the user actions, gestures and activity tracks based on the user targets to obtain user behavior characteristics; And extracting environmental characteristics based on the environmental area to obtain environmental monitoring data.
  3. 3. The intelligent screen interaction method based on panoramic nursing and intelligent member service according to claim 2, wherein the method comprises the steps of calling a user portrait database to obtain user identity information, and obtaining user history habit data and scene preference data based on the user identity information, and specifically comprises the following steps: collecting a face image of a user, calling a user portrait database, and matching the face image based on the user portrait database to obtain a face matching degree; Judging whether the face matching degree is larger than or equal to a set face matching degree threshold value; if the user history habit data is greater than or equal to the scene preference data, obtaining user identity information, and obtaining user history habit data and scene preference data based on the user identity information; The user history habit data comprises history service reservation records, equity use tracks and cross-equipment interaction synchronization data; if the user identity is smaller than the preset value, at least one mode of account password verification, biometric feature comparison or equipment binding verification is carried out to confirm the user identity.
  4. 4. The intelligent screen interaction method based on panorama nursing and intelligent member service according to claim 3, wherein the method comprises constructing a personalized service model based on user history habit data, scene preference data and user behavior characteristics, and generating personalized member content and service information based on the personalized service model, and specifically comprises: Acquiring a user portrait, and extracting historical habit data, scene preference data and user behavior characteristics based on the user portrait; desensitizing and de-duplicating preprocessing is carried out on the history habit data, the scene preference data and the user behavior characteristics to obtain preprocessed data; dynamically assigning weights to the preprocessed data based on an analytic hierarchy process; And establishing a personalized service model based on the collaborative filtering and decision tree algorithm fusion data, and generating personalized member content and service information based on the personalized service model.
  5. 5. The intelligent screen interaction method based on panoramic nursing and intelligent member service according to claim 4, wherein obtaining user interaction instruction, and performing voice, touch control and gesture recognition based on the user interaction instruction, obtaining user execution information, specifically comprises: collecting a user voice command, a touch command and a gesture command, and synchronously marking a trigger time stamp of the voice command, the touch command and the gesture command and a collecting device identifier; classifying the voice command, the touch command and the gesture command of the user to obtain different types of voice commands, touch commands and gesture commands; Noise reduction and semantic analysis are carried out on the voice command, an analysis result is adjusted based on user dialect habit and command expression habit, and the analysis result is converted into a standardized text command, so that a voice recognition result is obtained; analyzing the touch instruction based on a touch recognition algorithm, recognizing the touch position, the touch strength, the touch duration and the continuous operation track of a user, and matching corresponding touch instruction logic to obtain a touch recognition result; Extracting gesture outlines, action tracks and gesture features based on gesture instructions, and comparing a preset gesture library to obtain gesture recognition results; cross-verifying a voice recognition result, a touch recognition result and a gesture recognition result, and screening out effective instructions based on interaction priority rules preset by a user if multi-mode instruction conflict exists; And analyzing the user intention corresponding to the effective instruction to generate the structured user execution information.
  6. 6. The intelligent screen interaction method based on panoramic nursing and intelligent member service according to claim 5, wherein the matching of personalized member content and service information based on user execution information to obtain push content, and the real-time transmission of push content to the intelligent screen for display specifically comprises: acquiring user execution information, and analyzing instruction types, execution objects and execution parameters based on the user execution information; matching the personalized member content and the service information based on the instruction type, the execution object and the execution parameter to obtain a matching result; generating correction information based on the historical habit of the user and the current scene preference information, and adjusting a matching result based on the correction information to obtain push content; and transmitting the push content to the intelligent screen for display in real time, and automatically adjusting the display position and the display mode based on the user interaction habit.
  7. 7. The intelligent screen interaction system based on the panoramic nursing and intelligent member service is characterized by comprising a memory and a processor, wherein the memory comprises a program of an intelligent screen interaction method based on the panoramic nursing and intelligent member service, and the program of the intelligent screen interaction method based on the panoramic nursing and intelligent member service realizes the following steps when being executed by the processor: Collecting all-visual-angle environment image data of a target area, and analyzing the environment image data in real time to obtain environment monitoring and user behavior characteristics; Invoking a user portrait database to obtain user identity information, and acquiring user history habit data and scene preference data based on the user identity information; Establishing a personalized service model based on the user history habit data, the scene preference data and the user behavior characteristics, and generating personalized member content and service information based on the personalized service model; Acquiring a user interaction instruction, and carrying out voice, touch control and gesture recognition based on the user interaction instruction to acquire user execution information; and matching the personalized member content with the service information based on the user execution information to obtain push content, and transmitting the push content to the intelligent screen for display in real time.
  8. 8. The intelligent screen interaction system based on panoramic nursing and intelligent member service according to claim 7, wherein the system is characterized by collecting the full view angle environment image data of the target area, and analyzing the environment image data in real time to obtain the environment monitoring and user behavior characteristics, and specifically comprising: collecting all-visual-angle environment image data of a target area, and dividing the environment image data into a plurality of sub-areas based on an image segmentation algorithm; Denoising each sub-region, and enhancing the denoised sub-regions to obtain enhanced images; analyzing the enhanced image of each sub-region, and dividing an environment region and a user target; Analyzing the user actions, gestures and activity tracks based on the user targets to obtain user behavior characteristics; And extracting environmental characteristics based on the environmental area to obtain environmental monitoring data.
  9. 9. The intelligent screen interaction system based on panorama nursing and intelligent member service according to claim 8, wherein the invoking of the user portrait database to obtain user identity information, obtaining user history habit data and scene preference data based on the user identity information, specifically comprises: collecting a face image of a user, calling a user portrait database, and matching the face image based on the user portrait database to obtain a face matching degree; Judging whether the face matching degree is larger than or equal to a set face matching degree threshold value; if the user history habit data is greater than or equal to the scene preference data, obtaining user identity information, and obtaining user history habit data and scene preference data based on the user identity information; The user history habit data comprises history service reservation records, equity use tracks and cross-equipment interaction synchronization data; if the user identity is smaller than the preset value, at least one mode of account password verification, biometric feature comparison or equipment binding verification is carried out to confirm the user identity.
  10. 10. A computer readable storage medium, wherein the computer readable storage medium includes a smart screen interaction method program based on panoramic nursing and intelligent member service, and when the smart screen interaction method program based on panoramic nursing and intelligent member service is executed by a processor, the steps of the smart screen interaction method based on panoramic nursing and intelligent member service according to any one of claims 1 to 6 are implemented.

Description

Intelligent screen interaction method, system and medium based on panoramic nursing and intelligent member service Technical Field The application relates to the technical field of intelligent screen interaction, in particular to an intelligent screen interaction method, an intelligent screen interaction system and an intelligent screen interaction medium based on panoramic nursing and intelligent member service. Background With the rapid development of intelligent interaction equipment technology, an intelligent screen is used as a core interaction terminal in a home scene, and is widely applied to multiple fields of video entertainment, information display, home control and the like. Meanwhile, most of member services of the intelligent screens on the market are pushed in a passive response mode, basic content recommendation is provided only based on a user history consumption record, and a service strategy cannot be dynamically adjusted by combining a real-time scene and user behaviors, so that individuation and suitability of the member services are insufficient. In addition, the existing intelligent screen is single in interaction mode, mainly based on voice or touch, low in integration level of emerging interaction modes such as gesture recognition and the like, and lack of collaborative adaptation capability among different interaction modes, and the cross-equipment data synchronization mechanism is imperfect, so that the nursing data and member service data of the intelligent screen are difficult to realize seamless butt joint with other intelligent household equipment and mobile terminals, a data island is formed, and deep fusion of home nursing and member service cannot be realized. Disclosure of Invention The embodiment of the application aims to provide an intelligent screen interaction method, an intelligent screen interaction system and an intelligent screen interaction medium based on panoramic nursing and intelligent member service, which are used for realizing full-view environment coverage through an integrated panoramic camera, carrying out accurate identification of user behavior and identity information by matching with an image identification algorithm, meeting the requirements of home nursing and realizing active pushing of personalized content and service. The embodiment of the application also provides an intelligent screen interaction method based on panoramic nursing and intelligent member service, which comprises the following steps: Collecting all-visual-angle environment image data of a target area, and analyzing the environment image data in real time to obtain environment monitoring and user behavior characteristics; Invoking a user portrait database to obtain user identity information, and acquiring user history habit data and scene preference data based on the user identity information; Establishing a personalized service model based on the user history habit data, the scene preference data and the user behavior characteristics, and generating personalized member content and service information based on the personalized service model; Acquiring a user interaction instruction, and carrying out voice, touch control and gesture recognition based on the user interaction instruction to acquire user execution information; and matching the personalized member content with the service information based on the user execution information to obtain push content, and transmitting the push content to the intelligent screen for display in real time. Optionally, in the intelligent screen interaction method based on panoramic nursing and intelligent member service according to the embodiment of the present application, full-view environmental image data of a target area is collected, and the environmental image data is analyzed in real time to obtain environmental monitoring and user behavior characteristics, which specifically includes: collecting all-visual-angle environment image data of a target area, and dividing the environment image data into a plurality of sub-areas based on an image segmentation algorithm; Denoising each sub-region, and enhancing the denoised sub-regions to obtain enhanced images; analyzing the enhanced image of each sub-region, and dividing an environment region and a user target; Analyzing the user actions, gestures and activity tracks based on the user targets to obtain user behavior characteristics; And extracting environmental characteristics based on the environmental area to obtain environmental monitoring data. Optionally, in the intelligent screen interaction method based on panoramic nursing and intelligent member service according to the embodiment of the present application, a user portrait database is called to obtain user identity information, and user history habit data and scene preference data are obtained based on the user identity information, which specifically includes: collecting a face image of a user, calling a user portrait database, and m