EP-4056319-B1 - TOOL SYSTEM, TOOL MANAGEMENT METHOD, AND PROGRAM

Inventors

• Sasaki, Ryosuke
• KURITA, MASANORI
• IKEDA, KOUJI

Dates

Publication Date

20260506

Application Date

20201014

Claims (7)

1. A tool system (1, 1A) comprising: a portable fastening tool (2) including a driving unit (24), the driving unit (24) being configured to be activated with power supplied from a power source; an image capturing unit (5) provided for the tool (2) and configured to generate a captured image of a work target; an orientation detection unit (26) provided for the tool (2) and configured to detect an orientation of the tool (2); and a processing unit (34) configured to perform processing based on the captured image and the orientation, the processing unit (34) being configured to perform, as the processing, identification of the work target shot in the captured image characterised in that the identification is executed by directly using the captured image and the orientation of the tool (2) and by comparing a reference image and the captured image that are associated with the same orientation.
2. The tool system (1, 1A) of claim 1, wherein the processing unit (34) is configured to receive two pieces of input information that are first information based on the captured image and second information based on the orientation, and thereby perform the processing based on both the first information and the second information.
3. The tool system (1, 1A) of claim 1 or 2, further comprising an orientation presentation unit configured to present orientation information based on a result of detection obtained by the orientation detection unit (26).
4. The tool system (1, 1A) of claim 3, wherein the processing unit (34) is configured to perform, as the processing, determination of correspondence between the work target identified and a working instruction defined by a working procedure.
5. The tool system (1, 1A) of any one of claims 1 to 4, wherein the orientation detection unit (26) includes at least one of an acceleration sensor or a gyrosensor.
6. A tool management method comprising: a first step including acquiring a captured image of a work target from an image capturing unit (5) provided for a portable fastening tool (2), the tool (2) including a driving unit (24), the driving unit (24) being configured to be activated with power supplied from a power source; a second step including acquiring orientation information about an orientation of the tool (2) from an orientation detection unit (26) provided for the tool (2); and a third step including performing processing based on the captured image acquired in the first step and the orientation information acquired in the second step, the third step including performing as the processing, identification of the work target shot in the captured image characterised in that the identification is executed by directly using the captured image and the orientation of the tool (2) and by comparing a reference image and the captured image that are associated with the same orientation.
7. A program designed to cause one or more processors to perform the tool management method of claim 6.

Description

Technical Field The present disclosure generally relates to a tool system, a tool management method, and a program, and more particularly relates to a tool system including a portable tool, a tool management method, and a program. Background Art Patent Literature 1 discloses a tool system including a portable tool having a driving unit to be activated with power supplied from a battery pack and an image capturing unit provided for the tool. The image capturing unit is arranged to cover, for example, a socket, attached to an output shaft of the tool, within its image capturing range. The image capturing unit captures an image of a work target (which may be, for example, an object or a place on which work is conducted using the tool) while the work is conducted using the tool. According to Patent Literature 1, the image captured by the image capturing unit is used to identify the work target on which the tool is set in place (i.e., the work target that has been arranged to make the tool ready to start working on the work target). That is to say, the tool system of Patent Literature 1 includes an identification unit. The identification unit compares a captured image generated by the image capturing unit with a plurality of reference images stored in an image storage unit and identifies an actually shot work target, shot in the captured image, as the work target. In addition, according to Patent Literature 1, when finding the work target, identified by the identification unit, not conforming to a working procedure in terms of a working process step for the work target, the tool system performs processing of deactivating the driving unit, for example. However, the tool is used in various orientations (directions). Thus, depending on the orientation of the tool, the processing that uses a captured image generated by the image capturing unit provided for the tool (e.g., identification of the work target in Patent Literature 1) may be performed with decreased reliability or accuracy. WO 2020/223100 A1 discloses an endoscopic vessel harvesting tool that uses an optics system to present a video image to a user. As the tool is manipulated around all sides of the vessel to dissect and cut surrounding tissue and side branches, the orientation of the captured image rotates. A motion tracker (e.g., gyrosensor) in the tool detects the rotation. By detecting a rotational angular velocity of the harvester handle during the harvesting procedure, the camera view orientation is compensated before display to the user. When the handle is rotated, the detected rotation is used to provide an opposite (cancelling) rotation of the camera view so that a steady orientation is presented on the display. US 2017/197302 A1 discloses a control device provided with a communication unit and a processing unit. The communication unit makes communication with a tool that is used for the work of fastening a fastener (for example, a screw) and with an image pickup unit for capturing an image of the work site where the work is being performed. The processing unit executes a determination process of determining whether the work is being performed normally on the basis of the fastening torque applied to the fastener by the tool and the image captured by the image pickup unit. JP 2019 188599A discloses a control device capable of grasping the state of work using a tool, and to provide a work management system using the control device. The control device is provided with a communication part and a processing part. The communication part performs communication respectively with a tool used at the time of a work for fastening a fastening part, and with an imaging device for imaging a work portion where the work is performed. The processing part executes a determination processing for determining whether the work is normally performed, on the basis of a fastening torque to be given to the fastening part by the tool and of a captured image imaged by the imaging device. Document JP 2019/144965 A disclosing the preamble of claims 1 and 6 describes a tool control system configured to search an aggregation of search target images for an image similar to a question image obtained by photographing a work subject by a photographing part provided with a tool and to control the tool in accordance with a result of the search. The tool control system is further configured to question side position data indicating the positional relationship between a question side reference point and a question side feature part in the extracted question image. The image similar to the question image is searched from the aggregation of the search target images based on a result of comparison between the question side position data and search side position data indicating the positional relationship between a search side reference point and a search side feature part in a search target image. Citation List Patent Literature Patent Literature 1: JP 2018-108633 A Summary of Invention In