Search

CN-121985297-A - Vehicle key loss tracking method and device, vehicle, server, terminal and product

CN121985297ACN 121985297 ACN121985297 ACN 121985297ACN-121985297-A

Abstract

The application is suitable for the technical field of intelligent automobiles, and provides a vehicle key loss tracking method, a device, a vehicle, a server, a terminal and a product. The vehicle key loss tracking method comprises the steps of starting a target camera on a vehicle to record video of the surrounding environment of the vehicle if a vehicle key in a lost state is detected, calculating a relevance grade of a person and the vehicle key if the person is detected in a video frame recorded by the target camera, representing the possibility that the person carries the vehicle key by the relevance grade, marking the person in the video frame to obtain a marked video frame if the relevance grade is larger than a grading threshold, generating alarm information based on the marked video frame and first target information, and sending the alarm information to a server. The application can realize the effective tracking of the lost car key.

Inventors

  • GUO XINXIN
  • XU FEI
  • WANG BIN

Assignees

  • 深圳市锐明技术股份有限公司

Dates

Publication Date
20260505
Application Date
20260205

Claims (20)

  1. 1. A vehicle key loss tracking method, applied to a vehicle, comprising: if the vehicle key in the lost state is detected, starting a target camera on the vehicle to record video of the surrounding environment of the vehicle; If a person is detected in the video frame recorded by the target camera, calculating a relevance score of the person and the car key, wherein the relevance score characterizes the possibility that the person carries the car key; if the association degree score is larger than a score threshold, marking the personnel in the video frame to obtain a marked video frame; Generating alarm information based on the marked video frame and the first target information, and sending the alarm information to a server; The first target information at least comprises loss event identification information of the car key, position information when the car detects the car key, detection time and identification information of the car, the detection time refers to time when the car detects the car key, the alarm information is used for indicating the server to push the alarm information to the mobile terminal so that the mobile terminal can display second target information, and the second target information at least comprises the alarm information.
  2. 2. The vehicle key loss tracking method according to claim 1, wherein calculating a degree of association score of a person with the vehicle key if the person is detected in a video frame recorded by the target camera, comprises: If the person is detected in the video frame, calculating a first distance between the person and the vehicle and a first movement speed of the person, and a second distance between the vehicle key and the vehicle and a second movement speed of the vehicle key, wherein the second distance is acquired based on a positioning mode of the vehicle key, and the positioning mode is determined by a key type of the vehicle key; calculating a distance difference between the first distance and the second distance; calculating a speed difference between the first movement speed and the second movement speed; And calculating the relevance score based on the distance difference value, the speed difference value and the signal weight factor corresponding to the positioning mode.
  3. 3. The method for tracking lost car key according to claim 1, wherein if a lost car key is detected, starting a target camera on the vehicle to record video of surrounding environment of the vehicle, comprising: if the car key in the lost state is detected and the key type of the car key is a Bluetooth key, monitoring a received signal strength indication value of the car key; if the received signal strength indication value is monitored to be larger than a preset strength threshold value, starting the target camera to record video of the surrounding environment of the vehicle; Or if the vehicle key in the lost state is detected and the key type of the vehicle key is a key equipped with an ultra wideband module, detecting a third distance between the vehicle key and the vehicle through the ultra wideband module; And if the third distance is smaller than a preset distance threshold, starting the target camera to record video of the surrounding environment of the vehicle.
  4. 4. The method for tracking lost car key according to claim 3, wherein if the received signal strength indication value is greater than a preset strength threshold, starting the target camera to record video of the surrounding environment of the car, comprising: if the received signal strength indication value is monitored to be larger than the preset strength threshold value and the time for continuously detecting the car key exceeds the preset time, starting a 360-degree looking-around camera to record video of the surrounding environment of the car; if the third distance is smaller than a preset distance threshold, starting the target camera to record video of the surrounding environment of the vehicle, including: If the third distance is smaller than the preset distance threshold and the time for continuously detecting the car key exceeds the preset time, starting the 360-degree all-around camera to record video of the surrounding environment of the car, and/or calculating the azimuth angle of the car key relative to the car, and starting the camera corresponding to the azimuth angle to record video of the surrounding environment of the car.
  5. 5. The vehicle key loss tracking method according to any one of claims 1 to 4, further comprising, before starting a target camera on the vehicle to video record a surrounding environment of the vehicle: Receiving a key status update message from the server if the vehicle is a first vehicle associated with the vehicle key; If the vehicle key state update message indicates that the vehicle key is in the lost state, adding the identification information of the vehicle key carried in the vehicle key state update message to a local blacklist, and prohibiting the vehicle key from executing target operation on the first vehicle; If the key type of the car key is a Bluetooth key, acquiring identification information of the Bluetooth device when the Bluetooth device is detected, and if the identification information of the Bluetooth device is matched with any identification information in the local blacklist, determining the Bluetooth device as the car key in a lost state; If the key type of the car key is a key provided with an ultra-wideband module, acquiring the identification information of the ultra-wideband device when the ultra-wideband device is detected, and if the identification information of the ultra-wideband device is matched with any one of the identification information in the local blacklist, determining the ultra-wideband device as the car key in a lost state.
  6. 6. The vehicle key loss tracking method according to any one of claims 1 to 4, further comprising, before starting a target camera on the vehicle to video record a surrounding environment of the vehicle: Receiving a key-tracking message from the server for the vehicle key if the vehicle is a second vehicle connected to the server and not associated with the vehicle key; Adding the identification information of the car key carried in the key tracking message into a local monitoring list, wherein the car key in the local monitoring list is in the lost state; If the key type of the car key is a Bluetooth key, acquiring identification information of the Bluetooth device when the Bluetooth device is detected, and if the identification information of the Bluetooth device is matched with any identification information in the local monitoring list, determining the Bluetooth device as the car key in a lost state; If the key type of the car key is a key provided with an ultra-wideband module, acquiring the identification information of the ultra-wideband device when the ultra-wideband device is detected, and if the identification information of the ultra-wideband device is matched with any one of the identification information in the local monitoring list, determining the ultra-wideband device as the car key in a lost state.
  7. 7. The vehicle key loss tracking method according to any one of claims 1 to 4, further comprising, after the obtaining of the noted video frame: Updating the video frames in the video recorded by the target camera to the noted video frames to obtain a key video; Transmitting a target video to the server under the condition that the vehicle is connected to a target network, wherein the target video at least comprises the key video; Or when receiving a video acquisition instruction from the server, sending the target video to the server.
  8. 8. The car key loss tracking method according to any one of claims 1 to 4, further comprising, before detecting a person in the video frame: and if the video frame is a key frame, performing personnel detection on the video frame.
  9. 9. A vehicle key loss tracking method, which is applied to a server, the vehicle key loss tracking method comprising: The method comprises the steps of receiving alarm information aiming at a lost car key from each car, wherein the alarm information comprises marked video frames and first target information, and the first target information at least comprises lost event identification information of the car key, position information when the corresponding car detects the car key, detection time and identification information of the corresponding car, and the detection time refers to the time when the corresponding car detects the car key; determining a push token associated with the owner information of a first vehicle based on the loss event identification information of the vehicle key carried by any alarm information; And sending a push notification to a vehicle control application program on a corresponding mobile terminal based on the push token, wherein the push notification is used for indicating the mobile terminal to display second target information on a detail page of the vehicle control application program, and the second target information at least comprises the alarm information from each vehicle.
  10. 10. The vehicle key loss tracking method according to claim 9, further comprising, before the receiving of the warning information for the lost vehicle key from each vehicle: If a loss notification of the vehicle key from the mobile terminal is received, pushing a key state update message to the first vehicle and acquiring current position information of the first vehicle, wherein the key state update message is used for indicating the first vehicle to add the identification information of the vehicle key carried in the key state update message to a local blacklist, and the vehicle key in the local blacklist is in a loss state; determining a cooperative vehicle list based on the current position information of the first vehicle, wherein the cooperative vehicle list comprises second vehicles which are positioned in a preset range of the first vehicle and connected with the server; and the key tracking information is used for indicating the second vehicles to add the identification information of the vehicle keys carried by the key tracking information into a local monitoring list, wherein the vehicle keys in the local monitoring list are in a lost state.
  11. 11. The vehicle key loss tracking method of claim 10, further comprising, after pushing the key tracking message to the respective second vehicles: Based on the current position information of the vehicle key, updating the cooperative vehicle list, pushing the key tracking message to a second vehicle newly added in the cooperative vehicle list, and pushing a revocation message to a second vehicle deleted from the cooperative vehicle list, wherein the revocation message is used for indicating the corresponding second vehicle to delete the identification information of the vehicle key from the local monitoring list.
  12. 12. The vehicle key loss tracking method of claim 10, further comprising, after pushing the key tracking message to the respective second vehicles: And pushing a revocation message to the first vehicle and each second vehicle if a retrieved notification for the vehicle key from the mobile terminal is received, wherein the revocation message is used for indicating the first vehicle to delete the identification information of the vehicle key from the local blacklist, allowing the vehicle key to execute target operation and indicating each second vehicle to delete the identification information of the vehicle key from the local monitoring list.
  13. 13. The vehicle key loss tracking method according to any one of claims 9 to 12, further comprising, before sending a push notification to a vehicle control application on a corresponding mobile terminal based on the push token: receiving and storing target videos from the vehicles; generating a video link of the target video based on the storage location of the target video; the second target information is generated based on the alert information and the video link from the respective vehicles.
  14. 14. The vehicle key loss tracking method is characterized by being applied to a mobile terminal, and comprises the following steps of: receiving a push notification from a server for the lost car key; The method comprises the steps of responding to touch operation of push notification, controlling a corresponding vehicle control application program to jump to a detail page, and acquiring second target information from a server, wherein the second target information at least comprises alarm information for a vehicle key from each vehicle, the alarm information comprises marked video frames and first target information, and the first target information at least comprises loss event identification information of the vehicle key, position information when the corresponding vehicle detects the vehicle key, detection time and identification information of the corresponding vehicle, and the detection time refers to the time when the corresponding vehicle detects the vehicle key; and displaying the second target information on the detail page.
  15. 15. The vehicle key loss tracking method of claim 14, further comprising, after controlling the corresponding vehicle control application to jump to the details page: And generating a movement track of the car key based on the detection time and the position information when the corresponding car detects the car key in the alarm information from each car, and displaying the movement track on the detail page.
  16. 16. The vehicle key loss tracking method of claim 14, wherein the second target information further comprises a video link from a target video of the respective vehicle; responding to a video viewing instruction for any video link triggered on the detail page, and requesting a video access token from the server based on the video link; and receiving a video access token from the server, and accessing the corresponding target video stored by the server based on the video access token.
  17. 17. The car key loss tracking method according to any one of claims 14 to 16, further comprising, before receiving a push notification for a lost car key from a server: Responding to a loss report instruction of the car key, and acquiring identification information, key type, loss time, loss position information of the car key and identification information of a first vehicle associated with the car key; Generating a loss notification based on the identification information of the car key, the key type, the loss time, the loss position information and the identification information of the first car, and sending the loss notification to the server, wherein the loss notification is used for indicating the server to generate loss event identification information aiming at the car key.
  18. 18. The car key loss tracking method according to any one of claims 14 to 16, further comprising, after the receiving of the push notification for the lost car key from the server: The method comprises the steps of responding to a retrieved instruction of the car key, sending a retrieved notification to the server, wherein the retrieved notification is used for instructing the server to push a revocation message to each second vehicle in a first vehicle and a collaborative vehicle list associated with the car key, the revocation message is used for instructing the first vehicle to delete identification information of the car key from a local blacklist and allowing the car key to execute target operation, and instructing the corresponding second vehicle to delete the identification information of the car key from the local monitoring list.
  19. 19. A vehicle key loss tracking device, for use with a vehicle, the vehicle key loss tracking device comprising: the recording starting module is used for starting a target camera on the vehicle to record video of the surrounding environment of the vehicle if the vehicle key in a lost state is detected; The scoring calculation module is used for calculating the relevance score of the person and the car key if the person is detected in the video frame recorded by the target camera, wherein the relevance score characterizes the possibility that the person carries the car key; The personnel marking module is used for marking the personnel in the video frame if the association degree score is larger than a score threshold value to obtain a marked video frame; The alarm generation module is used for generating alarm information based on the marked video frame and the first target information and sending the alarm information to a server; The first target information at least comprises loss event identification information of the car key, position information when the car detects the car key, detection time and identification information of the car, the detection time refers to time when the car detects the car key, the alarm information is used for indicating the server to push the alarm information to the mobile terminal so that the mobile terminal can display second target information, and the second target information at least comprises the alarm information.
  20. 20. A vehicle key loss tracking device, applied to a server, comprising: The alarm receiving module is used for receiving alarm information of lost car keys from all vehicles, wherein the alarm information comprises marked video frames and first target information, and the first target information at least comprises lost event identification information of the car keys, position information when the corresponding vehicles detect the car keys, detection time and identification information of the corresponding vehicles, and the detection time refers to the time when the corresponding vehicles detect the car keys; The token determining module is used for determining a push token associated with the owner information of a first vehicle based on the loss event identification information of the vehicle key carried by any alarm information; the notification sending module is used for sending a push notification to a vehicle control application program on a corresponding mobile terminal based on the push token, wherein the push notification is used for indicating the mobile terminal to display second target information on a detail page of the vehicle control application program, and the second target information at least comprises the alarm information from each vehicle.

Description

Vehicle key loss tracking method and device, vehicle, server, terminal and product Technical Field The application belongs to the technical field of intelligent automobiles, and particularly relates to a vehicle key loss tracking method, a device, a vehicle, a server, a terminal and a product. Background With the rapid development of intelligent automobile technology, automobile keys have been developed from traditional mechanical keys to intelligent keys, mobile phone APP keys and other forms. When an intelligent car key or a mobile phone with a car key function is lost, specific personnel are difficult to locate, and effective tracking of the lost car key cannot be achieved. Disclosure of Invention The embodiment of the application provides a vehicle key loss tracking method, a device, a vehicle, a server, a terminal and a product, which can realize effective tracking of a lost vehicle key. In a first aspect, an embodiment of the present application provides a vehicle key loss tracking method, applied to a vehicle, where the vehicle key loss tracking method includes: if the vehicle key in the lost state is detected, starting a target camera on the vehicle to record video of the surrounding environment of the vehicle; If a person is detected in the video frame recorded by the target camera, calculating a relevance score of the person and the car key, wherein the relevance score characterizes the possibility that the person carries the car key; if the association degree score is larger than a score threshold, marking the personnel in the video frame to obtain a marked video frame; Generating alarm information based on the marked video frame and the first target information, and sending the alarm information to a server; The first target information at least comprises loss event identification information of the car key, position information when the car detects the car key, detection time and identification information of the car, the detection time refers to time when the car detects the car key, the alarm information is used for indicating the server to push the alarm information to the mobile terminal so that the mobile terminal can display second target information, and the second target information at least comprises the alarm information. In the embodiment of the application, when the lost car key is detected, the target camera on the car is started to record the video of the surrounding environment of the car, and when the person is detected in the video frame recorded by the target camera, the relevance degree score of the person and the car key is calculated, wherein the relevance degree score characterizes the possibility that the person carries the car key, and if the relevance degree score is larger than the scoring threshold value, the person is very likely to carry the lost car key, the person which is likely to carry the lost car key can be accurately positioned by marking the person in the video frame, the alarm information is generated based on the marked video frame and the first target information, and the alarm information is sent to the server, so that the mobile terminal of the car owner can display the second target information at least comprising the alarm information, and the car owner can conveniently check. According to the scheme, the target camera is actively started to record the video when the lost car key appears again, suspected persons with high association degree with the car key are intelligently identified based on video analysis and marked in real time, breakthrough tracking from passive positioning of the car key to active locking of the suspected persons can be achieved, then alarm information comprising marked video frames and first target information is pushed to a car owner in real time through the server, and complete tracking evidence containing the suspected persons, detection time and position information (namely, the position information when the car key is detected by the car) aiming at the lost car key is provided for the car owner, so that effective tracking of the lost car key is achieved, and tracking efficiency and success rate of the lost car key are greatly improved. In a second aspect, an embodiment of the present application provides a vehicle key loss tracking method, applied to a server, where the vehicle key loss tracking method includes: The method comprises the steps of receiving alarm information aiming at a lost car key from each car, wherein the alarm information comprises marked video frames and first target information, and the first target information at least comprises lost event identification information of the car key, position information when the corresponding car detects the car key, detection time and identification information of the corresponding car, and the detection time refers to the time when the corresponding car detects the car key; Determining a push token associated with the owner information of a first vehicle based on