Search

JP-7856986-B2 - Manufacturing line monitoring system

JP7856986B2JP 7856986 B2JP7856986 B2JP 7856986B2JP-7856986-B2

Inventors

  • 武市 博樹
  • 今川 英則
  • 河相 大介
  • 中川 純希

Assignees

  • 三ツ星ベルト株式会社
  • 株式会社ジザイエ

Dates

Publication Date
20260512
Application Date
20240830

Claims (10)

  1. A manufacturing line monitoring system that monitors a manufacturing line that produces multiple products, Multiple surveillance cameras installed on the production line for monitoring the production line, A storage device that stores multiple images taken by at least two of the aforementioned multiple surveillance cameras , A control device is provided, The control device is Continuous storage processing involves continuously acquiring multiple images captured by at least two of the multiple surveillance cameras and storing them in the storage device as time-series data associated with each of the at least two of the multiple surveillance cameras , (i) When it is determined that information indicating a change in the manufacturing line has been acquired, (ii) for at least two of the multiple surveillance cameras , an event storage process is performed, in which, from the time-series data associated with each of the at least two of the multiple surveillance cameras stored in the storage device in the continuous storage process, a plurality of image sets are extracted that include the change time, which is the time when information indicating a change in the manufacturing line was acquired, and the change period includes at least the time before the change time among the time periods before and after the change time, and (iii) the extracted plurality of image sets are stored in the storage device as a plurality of clip images associated with each of the at least two of the multiple surveillance cameras , The system performs an output process that outputs images of at least two of the multiple clip images for at least a portion of the change period as data that can be displayed in a list on the screen of a display device owned by the manufacturing line monitoring system or a system outside the manufacturing line monitoring system, and plays them back. The aforementioned multiple surveillance cameras include multiple production line surveillance cameras installed along the production line, with the production line being the target of the surveillance. In the event storage processing, the control device, (a) From the images captured by the multiple manufacturing line monitoring cameras, it is determined by image analysis whether or not a change has occurred in the manufacturing line, and if it is determined that a change has occurred in the manufacturing line, it is determined that information indicating a change in the manufacturing line has been acquired, or (b) A manufacturing line monitoring system characterized in that, when a notification device monitoring camera, which is included in the plurality of monitoring cameras and photographs a notification device that visually notifies changes in the manufacturing line, determines from the image taken by the notification device that visually notifies changes in the manufacturing line, it determines that information indicating changes in the manufacturing line has been acquired .
  2. In the output processing, the control device, The manufacturing line monitoring system according to claim 1, characterized in that it extracts videos from at least two of the multiple video clips that are from the same time period, and outputs the extracted videos as simultaneous playback data that can be displayed in a list on the screen of the display device and played back in sync at the same time.
  3. In the output processing, the control device, The manufacturing line monitoring system according to claim 1, characterized in that it extracts images from multiple clip images corresponding to at least two of the multiple manufacturing line monitoring cameras , showing a specific product being transported on the manufacturing line at different time points, and outputs the extracted images as time-series playback data that can be displayed in a list on the screen of the display device and played back.
  4. In the event storage process described above, if it is determined that information indicating a change in the manufacturing line has been obtained from an image captured by at least one of the multiple manufacturing line monitoring cameras , The manufacturing line monitoring system according to claim 3, characterized in that the specific product is a product included in an image in which a change has been determined to have occurred in the manufacturing line.
  5. In the output processing, the control device, The manufacturing line monitoring system according to claim 1, characterized in that it extracts images of multiple products that are grouped according to predetermined conditions from multiple clip images corresponding to at least two of the multiple manufacturing line monitoring cameras, and outputs the extracted multiple images as group playback data that can be displayed in a list on the screen of the display device and played back.
  6. The manufacturing line monitoring system according to claim 5, characterized in that the extracted multiple images include at least an image of a product located at the downstream end in the transport direction among the multiple products grouped according to the predetermined conditions, and an image of a product located at the upstream end in the transport direction among the multiple products grouped according to the predetermined conditions.
  7. In the event storage process described above, if it is determined that information indicating a change in the manufacturing line has been obtained from an image taken by at least one of the multiple manufacturing line monitoring cameras , The manufacturing line monitoring system according to claim 5, characterized in that the extracted plurality of images include at least an image in which it is determined that a change has occurred in the manufacturing line.
  8. The control device is further equipped with an input device connected to the control device to which instructions are input, In the output processing, the control device, From multiple clip videos corresponding to at least two of the multiple manufacturing line monitoring cameras , extract videos from different time periods in which a specific product being transported on the manufacturing line is captured, and output the extracted videos as time-series playback data that can be displayed and played back in a list on the screen of the display device. From multiple video clips corresponding to at least two of the multiple surveillance cameras , extract video clips from the same time period, and output the extracted video clips as synchronized playback data that can be displayed in a list on the screen of the display device and played back in sync at the same time, or From multiple clip videos corresponding to at least two of the multiple manufacturing line monitoring cameras , the system extracts videos in which multiple products that are grouped according to predetermined conditions are captured, and outputs the extracted videos as group playback data that can be displayed in a list on the screen of the display device and played back. The manufacturing line monitoring system according to claim 1, characterized in that it selects based on instructions input to the input device.
  9. The control device is A manufacturing line monitoring system according to any one of claims 1 to 8, further characterized by performing a real-time output process that outputs a plurality of images taken by each of the plurality of surveillance cameras , which are continuously acquired by the continuous storage process, as data that can be displayed in a list on the screen of a display device owned by the manufacturing line monitoring system or a system outside the manufacturing line monitoring system.
  10. In the event storage process described above , if it is determined that information indicating a change in the manufacturing line has been obtained from the image captured by the notification device monitoring camera , The manufacturing line monitoring system according to any one of claims 1 to 3, 5, 6, or 8, characterized in that the plurality of clip videos stored in the event storage process include or do not include the clip videos corresponding to the notification device monitoring camera.

Description

This invention relates to a manufacturing line monitoring system for monitoring a manufacturing line. Conventionally, in factory manufacturing line systems, when any change occurs in the manufactured product or process (including not only abnormalities but also situations that deviate from the normal range), information indicating the change in the manufacturing line is acquired using state detection means (motion detection sensors (e.g., light sensors or ultrasonic sensors), abnormal sound detection sensors, cameras, temperature sensors, etc.). The acquisition of this change is then visually notified to managers, etc., by the illumination of notification devices such as three-color lights or warning lights (see Patent Documents 1-2). Furthermore, in such manufacturing line systems, while it's possible to detect changes in the production line, the nature and cause of those changes may not be known. This can lead to delays in restoring and improving the production line, resulting in decreased productivity due to reduced production line utilization. To address this problem of decreased productivity, conventional monitoring systems have been disclosed that use surveillance cameras to film the manufacturing line, and when changes in the manufacturing line are detected using state detection means, the system analyzes the state of the changes in the manufacturing line by reviewing the surveillance camera footage to determine the cause of the changes (see Patent Documents 1-3). International Publication No. 2022/239123Japanese Patent Publication No. 2023-24346Japanese Patent Publication No. 2023-075578 This diagram illustrates the manufacturing line monitoring system according to this embodiment and the manufacturing line system including the manufacturing line on which the manufacturing line monitoring system is installed.This is a block diagram of the manufacturing line monitoring system and the manufacturing line system according to this embodiment.This is a flowchart of the manufacturing line control process.This is a flowchart of the manufacturing line monitoring process by the manufacturing line monitoring system according to this embodiment.This is an explanatory diagram illustrating an example of playback data from the same time.Figure 5 is an explanatory diagram illustrating how the data is displayed on the device that displays the playback data at the same time.This is an explanatory diagram illustrating an example of time-series playback data.Figure 7 is an explanatory diagram illustrating how the time-series playback data is displayed on the display device.This is an explanatory diagram of an example of group playback data.Figure 9 is an explanatory diagram illustrating how the group playback data is displayed on the display device.This is an explanatory diagram illustrating a specific example of a notification device that visually notifies users of changes in a manufacturing line. (Embodiment) As shown in Figure 1, the manufacturing line monitoring system 1 according to this embodiment is installed on a manufacturing line M that transports a large number of products (industrial products Y1, etc.) by belt conveyors M1 to M4 according to a processing or assembly procedure. (Manufacturing line M) First, let's explain the manufacturing line M that will be monitored by the manufacturing line monitoring system 1. As shown in Figure 2, the manufacturing line M is included in the manufacturing line system 2. As shown in Figures 1 and 2, the manufacturing line system 2 includes belt conveyors M1 to M4, a state detection sensor (state detection means) A, an alarm device D including a three-color lamp D1, a manufacturing line management device 21 that controls the manufacturing line M, a manufacturing line input device 24, and a manufacturing line display device 25. As shown in Figure 2, the manufacturing line management device 21 includes a manufacturing line control device 22 and a manufacturing line storage device 23. (Belt conveyors M1 to M4) The belt conveyor M1 has a structure in which a conveyor belt is wrapped between a drive pulley connected to a drive motor and a driven pulley, but it may also be a roller conveyor or the like. Belt conveyors M2 to M4 have the same structure as belt conveyor M1. In this embodiment, for the sake of explanation, the layout is as shown in Figure 1, in which the four belt conveyors M1 to M4 are arranged in a straight line in order from the upstream side to the downstream side. However, the layout is not limited to a straight line and can be of various shapes. In this embodiment, for the sake of explanation, the manufacturing line M includes only belt conveyors M1 to M4, but other belt conveyors or work equipment may be present before and after belt conveyors M1 to M4. The industrial products Y1 and the like placed on belt conveyor M1 are transported by the belt conveyors M1 to M4 from belt conveyor M1 to belt conveyor M4 (i.e., from upstream to downstream). (State detection