CN-115222975-B - Guest room cloud body building method, system, equipment and storage medium based on AR equipment

CN115222975BCN 115222975 BCN115222975 BCN 115222975BCN-115222975-B

Abstract

The invention provides a guest room cloud body-building method, a guest room cloud body-building system, guest room cloud body-building equipment and a guest room cloud body-building storage medium based on AR equipment, wherein the guest room cloud body-building method comprises the steps that a coach user wears first vision enhancement equipment, a cloud coach group is configured, and when a resident user connects a mobile terminal to second vision enhancement equipment in a guest room, a free coach is matched; the server respectively collects a first moving image shot by the first mobile terminal and a second moving image shot by the second mobile terminal, identifies the first moving image, at least sends an image representing a coach user to the second visual enhancement device and synchronously displays the images, the second visual enhancement device performs similarity matching on the moving postures of the first moving image and the second moving image, and the partial first moving image of the unmatched part is overlapped to the second moving image. The invention can provide a guest room cloud body-building scene for each hotel room on the premise of not increasing the cost basically, and greatly enhances the user experience.

Inventors

WANG JIAXIN
WU PENG
LI JIAN

Assignees

携程旅游信息技术（上海）有限公司

Dates

Publication Date: 20260508
Application Date: 20220719

Claims (5)

1. The guest room cloud body building method based on the AR equipment is characterized by comprising the following steps of: The method comprises the steps that a coach user wears first visual enhancement equipment, a server dynamically configures cloud coach groups according to real-time working states of coach users in a plurality of hotels, when a resident user connects a mobile terminal to second visual enhancement equipment in a guest room, the mobile terminal is triggered to send a guest room cloud body-building request to the server, and the server matches an idle coach for the resident user; The first visual enhancement device of the coach user shoots a first moving image with the first two-dimensional code through a first mirror in the gym; the front surface of the second visual enhancement device is provided with a second two-dimensional code, the second visual enhancement device of the resident user shoots a second moving image with the second two-dimensional code through a second reflecting surface in a guest room, the second two-dimensional code and the guest room where the second visual enhancement device is located have a mapping relation, the server collects the first moving image and the second moving image, identifies the first moving image to obtain an image representing the coach user, the server sends the image representing the coach user to the second visual enhancement device, the server synchronously displays the first moving image and the second moving image on the mobile terminal, extracts 17 skeleton key points of a human body based on the first moving image and the second moving image by utilizing a MoveNet pre-training model, establishes a mapping relation between the skeleton key points in the first moving image and the second moving image and local first moving images and local second moving images around the skeleton key points, converts the first moving image and the second moving image to obtain images representing the coach user, converts the first moving image and the second moving image to be a coordinate system of the second moving image, namely, the first moving image and the second moving image are overlapped to a certain coordinate system, and the second moving image is matched with the first skeleton coordinate system is obtained, and the first coordinate system is matched with the second coordinate system of the second moving image of the human body, namely the first moving image is matched with the second coordinate system of the first moving image, and generating a service bill corresponding to the guest room based on the second two-dimensional code.
2. The AR device-based room cloud fitness method of claim 1, wherein the superimposing the first moving image and the second moving image each corresponding to a partial first moving image of the portion of the first moving image that does not match the human skeletal key point into the second moving image is performed according to the mapping of the unmatched human skeletal key point in the first moving image to the same skeletal point in the second moving image, and then superimposing the partial first moving image of the portion of the first moving image that does not match the human skeletal key point into the region of the corresponding partial second moving image of the matched skeletal point in the second moving image.
3. A guest room cloud fitness system based on an AR device for implementing the guest room cloud fitness method based on an AR device of claim 1, comprising: the training system comprises a training matching module, a training user, a server, a mobile terminal, a server and a client, wherein the training user wears first visual enhancement equipment, and the server dynamically configures cloud training groups according to the real-time working states of training users of a plurality of hotels; The system comprises a moving image module, a second visual enhancement device, a server and a passenger room, wherein a first two-dimensional code is arranged on the front surface of the first visual enhancement device, the first visual enhancement device of a coach user shoots a first moving image with the first two-dimensional code through a first mirror in the gymnasium, a second two-dimensional code is arranged on the front surface of the second visual enhancement device, the second visual enhancement device of a resident user shoots a second moving image with the second two-dimensional code through a second reflecting surface in the passenger room, and the second two-dimensional code has a mapping relation with the passenger room where the second visual enhancement device is located; An image recognition module for recognizing the first moving image to obtain an image representing the coach user; the server transmitting at least an image representative of the coaching user to the second visual enhancement device; synchronously displaying the first moving image and the second moving image on the mobile terminal; The visual enhancement module is used for respectively extracting 17 skeleton key points of a human body based on the first moving image and the second moving image by utilizing a MoveNet pre-training model, establishing mapping relations between the skeleton key points in the first moving image and the second moving image and local first moving images and local second moving images around the skeleton key points, carrying out coordinate conversion on the 17 skeleton key points in the first moving image and the second moving image, namely, converting the coordinates of the 17 skeleton key points into a coordinate system taking a certain key point as an origin, inputting the 17 skeleton key points subjected to coordinate conversion into a multi-layer perceptron for training and carrying out similarity matching, superposing the first moving images and the second moving images which are respectively corresponding to local first moving images of unmatched parts of the skeleton key points of the human body to the second moving images, and generating service bills corresponding to the guest rooms based on the second two-dimensional codes.
4. A guest room cloud fitness device based on an AR device, comprising: A processor; A memory having stored therein executable instructions of the processor; wherein the processor is configured to perform the steps of the AR device-based guest room cloud fitness method of claim 1 via execution of the executable instructions.
5. A computer readable storage medium storing a program, wherein the program when executed by a processor implements the steps of the AR device-based guest room cloud fitness method of claim 1.

Description

Guest room cloud body building method, system, equipment and storage medium based on AR equipment Technical Field The invention relates to the field of fitness interaction, in particular to a guest room cloud fitness method, a guest room cloud fitness system, guest room cloud fitness equipment and a guest room cloud fitness storage medium based on AR equipment. Background Although intelligent gym mirrors and other devices are available on the market, the cost is high, and the hotel running cost can be greatly increased by simply configuring each room, so that the hotel has no commercial operability. In addition, the current augmented reality (Augmented Reality, AR) technology is a technology of skillfully fusing virtual information with the real world, and various technical means such as multimedia, three-dimensional modeling, real-time tracking and registering, intelligent interaction, sensing and the like are widely applied, and after virtual information such as characters, images, three-dimensional models, music, videos and the like generated by a computer is simulated, the virtual information is applied to the real world, and the two kinds of information are mutually complemented, so that the 'enhancement' of the real world is realized. Therefore, the invention provides a guest room cloud fitness method, a guest room cloud fitness system, guest room cloud fitness equipment and a guest room cloud fitness storage medium based on AR equipment. Disclosure of Invention Aiming at the problems in the prior art, the invention aims to provide a guest room cloud body-building method, a guest room cloud body-building system, guest room cloud body-building equipment and a guest room cloud body-building storage medium based on AR equipment, which overcome the difficulty of the prior art, and can provide guest room cloud body-building scenes for each hotel room on the premise of not increasing cost basically, thereby greatly enhancing user experience. The embodiment of the invention provides a guest room cloud body-building method based on AR equipment, which comprises the following steps of: The coach user wears a first visual enhancement device, a cloud coach group is configured, and when the resident user connects the mobile terminal to a second visual enhancement device in the guest room, the server matches an idle coach for the resident user; The server respectively collects a first moving image shot by a first mobile terminal connected with first visual enhancement equipment through a first reflecting surface and a second moving image shot by a second mobile terminal connected with second visual enhancement equipment through a second reflecting surface; Identifying based on the first moving image, transmitting at least an image representing the coaching user to the second visual enhancement device, and synchronously displaying the first moving image and the second moving image on the mobile terminal; The second visual enhancement device performs similarity matching on the motion postures of the first motion image and the second motion image, and superimposes partial first motion images of the unmatched parts to the second motion image. Preferably, the coach user wears a first vision enhancement device, configures a cloud coach group, and when the resident user connects the mobile terminal to a second vision enhancement device in the guest room, the server matches an idle coach for the resident user, including: The training user wears first visual enhancement equipment, and the server dynamically configures cloud training groups according to real-time working states of the training users of a plurality of hotels; triggering the mobile terminal to send a guest cloud fitness request to a server when a resident user connects the mobile terminal to second visual enhancement equipment in a guest room; The server matches an idle coach for the resident user. Preferably, the server collects a first moving image photographed by a first mobile terminal connected to a first visual enhancement device through a first reflection surface and a second moving image photographed by a second mobile terminal connected to a second visual enhancement device through a second reflection surface, respectively, and includes: The first visual enhancement device of the coach user shoots a first moving image with the first two-dimensional code through a first mirror in the gym; A second two-dimensional code is arranged on the front surface of the second visual enhancement device, the second visual enhancement device of the resident user shoots a second moving image with the second two-dimensional code through a second reflecting surface in a guest room, and the second two-dimensional code has a mapping relation with the guest room where the second visual enhancement device is located; The server acquires the first moving image and the second moving image. Preferably, the method further comprises the following steps: and generating a service