Search

KR-102962275-B1 - LOST ARTICLE MANAGEMENT METHOD, DEVICE AND SYSTEM IN VEHICLE

KR102962275B1KR 102962275 B1KR102962275 B1KR 102962275B1KR-102962275-B1

Abstract

A method, device, and system for managing lost items in a vehicle are provided. The method for managing lost items in a vehicle may include: generating first detection information by using a first camera or a first sensor installed in the vehicle at a distance from the passenger's seating point by a first distance, thereby detecting said passenger or object; generating second detection information by using a second camera or a second sensor installed in the vehicle at a distance from the seating point by a second distance, thereby detecting said passenger or object, by a second distance longer than said first distance and at a distance from said second distance; generating third detection information by detecting a background excluding said passenger and object; receiving a lost status prediction model generated through learning; determining whether a lost item has occurred from said first detection information to said third detection information by using said lost status prediction model; and, if it is determined that a lost item has occurred, displaying a request to check for a lost item on a plurality of display devices installed in the vehicle.

Inventors

  • 박나현

Assignees

  • 현대자동차 주식회사
  • 기아 주식회사

Dates

Publication Date
20260507
Application Date
20210726

Claims (20)

  1. A step of generating first detection information that detects the passenger or object using a first camera or first sensor installed in the vehicle at a distance of a first distance from the passenger's seating point; A step of generating second detection information that detects the passenger or the object using a second camera or second sensor installed in the vehicle such that the second distance is longer than the first distance and is separated from the seating point by the second distance; A step of generating third detection information that detects a background excluding the above passenger and the above object; A step of receiving a lost state prediction model generated through learning; A step of determining whether a lost item has occurred from the first detection information to the third detection information using the above-described lost status prediction model; and If it is determined that the above lost item has occurred, the method includes the step of displaying a request to check the lost item on a plurality of display devices installed in the vehicle. At least one of the steps of generating the first detection information, generating the second detection information, and generating the third detection information is performed for an area defined by a first radius centered on the seating point, and then re-performed for an area defined by a second radius larger than the first radius. How to manage lost items in a vehicle.
  2. In paragraph 1, The step of generating the above-mentioned first detection information is, A step of detecting the passenger or the object using the first camera or the first sensor before the passenger boards the vehicle; A step of detecting the passenger or the object using the first camera or the first sensor at predetermined time intervals after the passenger boards the vehicle; and A method for managing lost items in a vehicle, comprising at least one step of detecting the passenger or the object using the first camera or the first sensor at a predetermined time before the passenger disembarks from the vehicle.
  3. In paragraph 1, The step of generating the above second detection information is, A step of detecting the passenger or the object using the second camera or the second sensor before the passenger boards the vehicle; A step of detecting the passenger or the object using the second camera or the second sensor at predetermined time intervals after the passenger boards the vehicle; and A method for managing lost items in a vehicle, comprising at least one step of detecting the passenger or the object using the second camera or the second sensor at a predetermined time before the passenger disembarks from the vehicle.
  4. In paragraph 1, The step of generating the above third detection information is, A method for managing lost items in a vehicle, further comprising the step of classifying the area in the above background where the passenger can place the object and the prohibited area where the object cannot be placed.
  5. In paragraph 1, The above-mentioned lost status prediction model includes a collection model, and The above collection model is a method for managing lost items in a vehicle, which is trained to classify cases where an object is dumped in a predetermined area and is not collected for a certain period of time.
  6. In paragraph 1, The above loss state prediction model includes a speculative model, and The above-mentioned disposal model is a method for managing lost items in a vehicle, which is trained to classify the action of a person placing an object in a predetermined area.
  7. In paragraph 1, The above-mentioned loss state prediction model includes a loss model, and A method for managing lost items in a vehicle, wherein the above-mentioned lost model is trained to classify cases where an object placed in a predetermined prohibited area is not collected.
  8. In paragraph 1, The above-mentioned lost state prediction model includes a distance difference model, and A method for managing lost items in a vehicle, wherein the above distance difference model is trained to determine whether an object is lost based on the positional difference between the vehicle and the object.
  9. delete
  10. In paragraph 1, A method for managing lost items in a vehicle, further comprising the step of providing a user interface for processing a lost item report through a plurality of display devices installed in the vehicle when it is determined that the above-mentioned lost item has occurred.
  11. A first detection information generation module that generates first detection information by using a first camera or first sensor installed in a vehicle at a distance of a first distance from the passenger's seating point, said passenger or object; A second detection information generation module that generates second detection information by using a second camera or second sensor installed in the vehicle such that the second distance is longer than the first distance and is separated from the seating point by the second distance, and detects the passenger or the object; A third detection information generation module that generates third detection information by detecting a background excluding the aforementioned passenger and the aforementioned object; Prediction model providing module that provides a lost state prediction model generated through learning; A lost item occurrence determination module that determines whether a lost item has occurred from the first detection information to the third detection information using the above lost item state prediction model; and When it is determined that the above-mentioned lost item has occurred, the lost item verification request display module includes a plurality of display devices installed in the vehicle that display a lost item verification request. At least one of the first detection information generation module to the third detection information generation module generates detection information for an area defined by a first radius centered on the seating point, and then regenerates detection information for an area defined by a second radius larger than the first radius. In-vehicle lost and found management device.
  12. In Paragraph 11, The above-mentioned first detection information generation module is, Before the passenger boards the vehicle, the first camera or the first sensor is used to detect the passenger or the object, or After the passenger boards the vehicle, at predetermined time intervals, the passenger or the object is detected using the first camera or the first sensor, or A vehicle-mounted lost-item management device that detects the passenger or the object using the first camera or the first sensor at a predetermined time before the passenger disembarks from the vehicle.
  13. In Paragraph 11, The above second detection information generation module is, Before the passenger boards the vehicle, the second camera or the second sensor is used to detect the passenger or the object, or After the passenger boards the vehicle, at predetermined time intervals, the passenger or the object is detected using the second camera or the second sensor, or A vehicle-mounted lost-item management device that detects the passenger or the object using the second camera or the second sensor at a predetermined time before the passenger disembarks from the vehicle.
  14. In Paragraph 11, The above third detection information generation module is, A vehicle-mounted lost and found management device that classifies, among the above backgrounds, an area where the passenger can place the object and a prohibited area where the object cannot be placed.
  15. In Paragraph 11, The above-mentioned lost status prediction model includes a collection model, and The above collection model is an in-vehicle lost and found management device trained to classify cases where an object is dumped in a predetermined area and is not collected for a certain period of time.
  16. In Paragraph 11, The above loss state prediction model includes a speculative model, and The above-mentioned dropping model is an in-vehicle lost and found management device trained to classify the action of a person placing an object in a predetermined area.
  17. In Paragraph 11, The above-mentioned loss state prediction model includes a loss model, and The above-mentioned lost model is a vehicle-mounted lost property management device trained to classify cases where objects placed in a predetermined prohibited area are not collected.
  18. In Paragraph 11, The above-mentioned lost state prediction model includes a distance difference model, and The above distance difference model is trained to determine whether an object is lost based on the positional difference between the vehicle and the object, in a vehicle lost-and-found management device.
  19. delete
  20. In Paragraph 11, A vehicle-mounted lost item management device further comprising a lost item report processing module that provides a user interface for processing lost item reports through a plurality of display devices installed in the vehicle when it is determined that the above-mentioned lost item has occurred.

Description

Method, Device, and System for Managing Lost Items in a Vehicle The present invention relates to a method, device, and system for managing lost items in a vehicle. Recently, companies providing car-sharing or ride-hailing services are shaping the car-sharing market. Along with this, personalization technologies are also gaining attention, including smartphone-based digital key technology that replaces physical keys for shared vehicle use, autonomous driving technology, fingerprint recognition key technology to provide personalized services even when shared with others, and technology for customizing the vehicle's interior environment. Along with the revitalization of the sharing market, research on technologies to predict, prevent, or handle lost items by passengers using vehicles is also active. For example, if a passenger leaves their belongings in a vehicle, they can report the loss using information provided by ride-hailing services (such as taxi services), such as the vehicle number and driver's contact details; however, this method of handling lost items has limitations because passengers generally realize the loss late. FIG. 1a is a drawing for explaining a lost and found management system in a vehicle according to an embodiment of the present invention, and FIG. 1b is a drawing for explaining a lost and found management device in a vehicle according to an embodiment of the present invention. FIG. 2 is a drawing illustrating a method for managing lost items in a vehicle according to an embodiment of the present invention. FIG. 3 is a drawing illustrating a method for managing lost items in a vehicle according to an embodiment of the present invention. FIG. 4 is a drawing illustrating a method for managing lost items in a vehicle according to an embodiment of the present invention. FIG. 5 is a drawing illustrating a method for managing lost items in a vehicle according to an embodiment of the present invention. FIG. 6 is a drawing illustrating a method for managing lost items in a vehicle according to an embodiment of the present invention. FIG. 7 is a drawing illustrating a method for managing lost items in a vehicle according to an embodiment of the present invention. FIG. 8 is a drawing illustrating a method for managing lost items in a vehicle according to an embodiment of the present invention. FIG. 9 is a drawing illustrating a method for managing lost items in a vehicle according to an embodiment of the present invention. FIG. 10 is a block diagram illustrating a computing device for implementing a method and system for managing lost items in a vehicle according to embodiments of the present invention. Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Identical or similar components are assigned identical or similar reference numerals, and redundant descriptions thereof will be omitted. The suffixes "module" and/or "part" for components used in the following description are assigned or used interchangeably solely for the ease of drafting the specification and do not have distinct meanings or roles in themselves. Furthermore, in describing the embodiments disclosed in this specification, if it is determined that a detailed description of related prior art could obscure the essence of the embodiments disclosed in this specification, such detailed description will be omitted. Additionally, the attached drawings are intended only to facilitate understanding of the embodiments disclosed in this specification; the technical concept disclosed in this specification is not limited by the attached drawings, and it should be understood that they include all modifications, equivalents, and substitutions that fall within the spirit and technical scope of the invention. Terms including ordinal numbers, such as first, second, etc., may be used to describe various components, but said components are not limited by said terms. These terms are used solely for the purpose of distinguishing one component from another. When it is stated that one component is "connected" or "connected" to another component, it should be understood that while it may be directly connected or connected to that other component, there may also be other components in between. On the other hand, when it is stated that one component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between. In this application, terms such as “comprising” or “having” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof. FIG. 1a is a drawing for explaining a lost and found management system in a vehicle according to an embodiment of the pr