Search

JP-2026074833-A - Data acquisition system, imaging device, and program

JP2026074833AJP 2026074833 AJP2026074833 AJP 2026074833AJP-2026074833-A

Abstract

[Problem] To collect information on target objects from images of the surroundings of a moving object captured by a moving object, while preventing the leakage of personal information. [Solution] In the data collection system, the imaging device 10 includes a camera, an image determination unit that determines the objects to be collected and privacy objects including personal information contained in the image, an image processing unit that processes the image, and an information output unit that can transmit information to a server. The image determination unit determines the objects to be collected and privacy objects contained in the image based on an image determination model learned using training images containing the objects to be collected and privacy objects. The image processing unit generates an image in which personal information cannot be identified by processing at least a portion of the privacy objects in the image so that the personal information of the privacy objects cannot be identified. The information output unit transmits the image in which personal information cannot be identified generated by the image processing unit and the information of the determined objects to be collected to the server, but does not transmit the image itself, which contains both the objects to be collected and privacy objects, to the server. [Selection Diagram] Figure 1

Inventors

  • 玉木　由浩
  • グイン クオック チン

Assignees

  • 株式会社サイバーコア

Dates

Publication Date
20260507
Application Date
20241021

Claims (11)

  1. A mobile body including an imaging device, The imaging device and a data acquisition server connected via a network are included. A data acquisition system for collecting information on objects to be collected in an image captured by the aforementioned imaging device, The imaging device includes a camera that images the area around the moving object, an image determination unit that determines the objects to be collected and the objects to be private, including personal information, that are included in the image captured by the camera, an image processing unit that processes the image captured by the camera, and an information output unit that can transmit information to the server via the network. The image determination unit includes an image determination model trained using training images containing objects to be collected and training images containing privacy objects, and determines the objects to be collected and privacy objects contained in the image captured by the camera from the output result obtained by inputting the image captured by the camera into the image determination model. The image processing unit generates an image in which personal information cannot be identified by processing at least a portion of the privacy object in the image captured by the camera so that the personal information of the determined privacy object cannot be identified. The information output unit transmits to the server, at least when the image captured by the camera includes both the object to be collected and the object to be protected from privacy, the image that does not allow for the identification of personal information generated by the image processing unit and the information of the object to be collected that has been determined, but does not transmit the image itself that includes both the object to be collected and the object to be protected from privacy to the server. Data collection system.
  2. The data collection system according to claim 1, characterized in that, if the information output unit captures an image that includes objects to be collected but does not include objects subject to privacy, it transmits the image captured by the camera and the information of the determined objects to be collected to the server.
  3. The data collection system according to claim 1, characterized in that the information output unit temporarily stores the image determination unit and the image processed by the image determination unit in storage, and then transmits them to the server.
  4. The data collection system according to claim 3, characterized in that the information output unit stores all images processed by the image determination unit in storage, but transmits only the images processed by the image determination unit and the image processing unit that contain the object to be collected to the server.
  5. The data collection system according to claim 1, wherein the image processing unit processes the region of an object or living organism that includes the determined privacy object.
  6. The data acquisition system according to claim 1, wherein the image processing unit processes only the area of the private object in the image captured by the camera.
  7. The data collection system according to claim 1, wherein the image processing unit processes the image to make it possible to identify the type or characteristics of an object or organism, including the determined privacy object.
  8. An imaging device that can be held by a mobile body and connected to a data acquisition server via a network, The imaging device includes a camera that images the area around the moving object, an image determination unit that determines the objects to be collected and the objects to be private, including personal information, that are included in the image captured by the camera, an image processing unit that processes the image captured by the camera, and an information output unit that can transmit information to the server via the network. The image determination unit includes an image determination model trained using training images containing objects to be collected and training images containing privacy objects, and determines the objects to be collected and privacy objects contained in the image captured by the camera from the output result obtained by inputting the image captured by the camera into the image determination model. The image processing unit generates an image in which personal information cannot be identified by processing at least a portion of the privacy object in the image captured by the camera so that the personal information of the determined privacy object cannot be identified. The information output unit transmits to the server, at least when the image captured by the camera includes both the object to be collected and the object to be protected from privacy, the image that does not allow for the identification of personal information generated by the image processing unit and the information of the object to be collected that has been determined, but does not transmit the image itself that includes both the object to be collected and the object to be protected from privacy to the server. Imaging device.
  9. A computer for an imaging device that can be held by a mobile body, can be connected to a data collection server via a network, and includes a camera that images the area around the mobile body, and an information output unit that can transmit information to the server via the network, A program that functions as an image determination means for determining objects to be collected and privacy objects including personal information contained in an image captured by the camera, and as an image processing means for processing an image captured by the camera, The image determination means includes an image determination model trained using training images containing objects to be collected and training images containing privacy objects, and determines the objects to be collected and privacy objects contained in the images captured by the camera from the output results obtained by inputting the images captured by the camera into the image determination model. The image processing means generates an image in which personal information cannot be identified by processing at least a portion of the privacy object in the image captured by the camera so that the personal information of the determined privacy object cannot be identified. The information output unit is configured to transmit to the server, at least when the image captured by the camera includes both the object to be collected and the object to be protected from privacy, the image that does not allow the identification of personal information generated by the image processing unit and the information of the object to be collected that has been determined, but not to transmit the image itself that includes both the object to be collected and the object to be protected from privacy to the server. program.
  10. A mobile body that moves along a road, including an imaging device, The imaging device and a data acquisition server connected via a network are included. A road infrastructure information collection system that collects road infrastructure information in an image captured by the aforementioned imaging device, The imaging device includes a camera that images the area around the moving object, an image determination unit that determines road infrastructure information and privacy-sensitive objects including personal information contained in the image captured by the camera, an image processing unit that processes the image captured by the camera, and an information output unit that can transmit information to the server via the network. The image determination unit includes an image determination model trained using training images containing road infrastructure information and training images containing privacy objects, and determines the road infrastructure information and privacy objects contained in the image captured by the camera from the output results obtained by inputting the image captured by the camera into the image determination model. The image processing unit generates an image in which personal information cannot be identified by processing at least a portion of the privacy object in the image captured by the camera so that the personal information of the determined privacy object cannot be identified. The information output unit transmits to the server, at least when the image captured by the camera includes both road infrastructure information and objects subject to privacy, the image that does not allow for the identification of personal information generated by the image processing unit and the determined road infrastructure information, but does not transmit the image itself, which includes both the road infrastructure information and objects subject to privacy, to the server. Road infrastructure information collection system.
  11. The system includes a camera, an image determination unit that determines objects to be collected and privacy objects including personal information contained in the image captured by the camera, an image processing unit that processes the image captured by the camera, and an information output unit. The image determination unit includes an image determination model trained using training images containing objects to be collected and training images containing privacy objects, and determines the objects to be collected and privacy objects contained in the image captured by the camera from the output result obtained by inputting the image captured by the camera into the image determination model. The image processing unit generates an image in which personal information cannot be identified by processing at least a portion of the privacy object in the image captured by the camera so that the personal information of the determined privacy object cannot be identified. The information output unit is characterized in that, at least when the image captured by the camera includes both the object to be collected and the object to be protected from privacy, it outputs the image generated by the image processing unit that does not allow for the identification of personal information and the information of the object to be collected that has been determined. Imaging device.

Description

This invention relates to a data acquisition system utilizing a mobile device, and more particularly to a data acquisition system, imaging device, and program that collect information on target objects, such as road infrastructure information, from images of the surroundings of a mobile device captured by the mobile device, including an imaging device. Regarding the deterioration and damage to road surfaces in Japan, particularly cracks, sinkholes, and potholes, multiple challenges and technical responses are being implemented. Leaving road surface damage unattended can lead to cracks and other damage progressing to the underlying roadbed, ultimately resulting in damage to the entire pavement structure; therefore, early repair is required. However, repair work is costly and time-consuming, making proper inspection and repair difficult, especially for local governments with limited budgets. Inspection of such road infrastructure includes visual inspections and advanced inspection methods using laser equipment. For example, since July 2014, a statutory inspection system has been established requiring road administrators to conduct close-range visual inspections of all bridges, tunnels, etc., every five years, and to diagnose their soundness on a four-level scale. However, inspections must be carried out by individuals with the necessary knowledge and skills. But the number of skilled technicians capable of conducting these inspections is limited, and the sheer number of bridges and tunnels to be inspected places a heavy burden on road administrators. Furthermore, since the inspection is based on the subjective judgment of the inspector, variations in individual standards can lead to inconsistent results. Also, prolonged inspection work can cause fatigue, leading to distraction and potentially affecting the results. On the other hand, inspections using "road surface condition measurement vehicles" equipped with laser devices provide detailed and accurate data, allowing for a comprehensive understanding of road deterioration. However, these vehicles have high initial costs, require maintenance, and may be obstructed by other vehicles or pedestrians, preventing accurate measurements. Patent Document 1 discloses a road information distribution system capable of collecting and distributing information related to road conditions, such as road surface conditions, fallen objects, and road construction. In the road information distribution system of Patent Document 1, a vehicle-mounted device transmits video information captured by a camera that images the area around the vehicle and location information detected by a vehicle position detection device to a road information distribution server. The road information distribution server compares the received video information with reference video information in a video database that corresponds to the location information to determine whether there are any differing regions (change regions) between the two images. If a change region exists, the system distributes the location information and video information contained in the received information to the vehicle-mounted device as distributed road information. Japanese Patent Publication No. 2006-318356 Schematic diagram of the data acquisition system of the present inventionAn example of an image captured by a cameraAn example image showing the state of detecting an object within the image.An example of an image where personal information has been anonymized, making it impossible to identify the individual.An example of an image where personal information has been anonymized, making it impossible to identify the individual.An example of a flowchart for image processing according to the present inventionAnother example of a flowchart for image processing according to the present inventionSchematic diagram of another embodiment of the imaging device of the present invention Embodiments of the present invention will be described in detail below with reference to the drawings. Figure 1 is a schematic diagram of the data acquisition system 1 of the present invention. The data acquisition system 1 includes a mobile body 2 (2a, 2b, 2c) containing imaging devices 10 (10a, 10b, 10c), and a data acquisition server 4 connected to the imaging devices 10 via a network 3, and may further include non-volatile storage 5. Each imaging device 10 includes a camera 11, an image determination unit 12, an image processing unit 13, and an information output unit 14, and may further include non-volatile storage 15. The image determination unit 12 includes an image determination model 16. The data collection system 1 is a system that collects image information captured by the imaging device 10 and information on objects to be collected within the image. For example, it can be used as a road infrastructure information collection system that collects road infrastructure information as objects to be collected. Road infrastructure information include