Search

JP-7854950-B2 - Work support system and work support method

JP7854950B2JP 7854950 B2JP7854950 B2JP 7854950B2JP-7854950-B2

Inventors

  • 山本 将史
  • 林 真悟
  • 上野 高明
  • 中道 拓也
  • 新岡 正彦

Assignees

  • 株式会社日立製作所

Dates

Publication Date
20260507
Application Date
20230203

Claims (12)

  1. Drawings that include parts and handwritten notes, A work record table that stores the handwritten notes for the aforementioned parts as work records, A handwriting display determination unit determines, based on the work record table, that the handwritten text not associated with the part is a candidate for writing, It includes a display control unit that displays the write candidates and the components on the display unit of the user's terminal, The display control unit displays the write candidates and the components on the display unit of the user's terminal so that they can be selected as write candidates associated with the components . The handwriting display determination unit includes a component-related handwriting extraction unit that calculates the distance between the corner of a rectangular region encompassing the handwritten point cloud coordinates and the corner of the region encompassing the component that is closest to the corner of the rectangular region, and extracts the writing candidates whose calculated distance falls within a predetermined range. Work support system.
  2. The handwriting display determination unit determines that the handwriting within a predetermined range from the component is the candidate for writing. The work support system according to claim 1.
  3. The predetermined range is an area that extends diagonally in all directions (up, down, left, right, and right) around the rectangular area, with an area equivalent to the rectangular area, so as to be adjacent to the rectangular area. The work support system according to claim 1 .
  4. The user's terminal display unit further includes a work record table update unit that updates the work record table by linking the component with the selected write candidate when the user selects the write candidate associated with the component via an input means. The work support system according to claim 1.
  5. In the aforementioned work record table, the information included in the part includes at least one of the following: whether or not it is linked, whether or not it is a candidate for writing, and comments on the part. The work support system according to claim 1.
  6. The display unit of the user's terminal further includes a display control unit that , when the user selects the component or the writing candidate via an input means , changes the color and transparency of the component or the writing candidate and highlights it based on the work record table. The work support system according to claim 1.
  7. The component-related handwriting extraction unit calculates the distance between the point on the side and the reference point of the writing candidate if the x or y coordinate of the reference point of the writing candidate is located between the coordinates of the first and second corners that form the ends of one side of the region of the component. The work support system according to claim 1 .
  8. The component-related handwriting extraction unit sets the reference point of the writing candidate to one of the starting point, the endpoint including the turning point, or the ending point among the point cloud coordinates of the writing candidate. The work support system according to claim 1 .
  9. The handwriting display determination unit includes a handwriting analysis unit that narrows down the components associated with the writing candidate to two or fewer from among characters, wiring diagrams, and drawing symbols, and outputs them to the component-related handwriting extraction unit. The work support system according to claim 1 .
  10. The handwriting analysis unit detects that the writing candidate is a check mark. The work support system according to claim 9 .
  11. The handwriting analysis unit analyzes the connected handwriting between the part and the handwriting separated from the part, associates the part with the handwriting , and records it as related information in the work record table. The work support system according to claim 9 .
  12. A determination step in which, based on a work record table that stores handwritten notes on parts constituting a drawing displayed on the user's terminal as work records, a handwritten note that is not associated with a part is determined to be a candidate for writing; The work support system is instructed to perform a display step, which involves displaying the write candidates and the components on the display unit of the user's terminal. The display step involves displaying the write candidates and the components on the display unit of the user's terminal so that they can be selected as write candidates associated with the components . When determining the writing candidates, the distance between the corner of the rectangular region encompassing the handwritten point cloud coordinates and the corner of the region encompassing the component that is closest to the corner of the rectangular region is calculated, and writing candidates whose calculated distance falls within a predetermined range are extracted. Work support method.

Description

This invention relates to a work support system. In recent years, digitalization in the workplace has accelerated, and the use of portable terminals for inputting work information has become widespread. Workers record their work on the portable terminal by hand, just as they would with traditional paper-based work. Meanwhile, managers collect worker data using their systems to track whether work has been completed, storing it on a server and analyzing it for effective use. To link whether work has been completed, it is necessary to link it to the handwritten work records. However, Patent Document 1 discloses a method of scanning answer sheets, analyzing the scanned image data, and linking question symbols and handwritten text using question symbol information and handwritten text information. Japanese Patent Publication No. 2022-42598 A diagram showing the drawing of the first embodiment.This diagram shows an example of a worker manually recording their work on a drawing.A diagram showing an example of a handwritten work record.A diagram showing an example of point cloud coordinates for a handwritten checkmark.A diagram showing the handwritten information that each handwritten entry holds as data.This diagram shows a UI screen where a worker links parts to handwritten labels.A magnified view of the area enclosed by the dotted line in Figure 6.A diagram showing a work record table after linking handwritten notes with parts.A diagram showing the configuration of the work support system.A diagram showing the details of the parts data table.A diagram showing the internal blocks of the handwriting recognition unit.This diagram shows an example of a screen displayed to the user after the work completion determination unit has finished processing.This diagram shows the screen display presented to the user after the work completion determination unit has processed the data.A diagram illustrating a method for linking handwritten notes, which are not present on the parts themselves, to the parts.A diagram showing the flowchart of the method for determining which handwritten candidate characters are available for a component.This diagram shows the information in the work record table after processing by the handwriting recognition unit.A diagram illustrating an example of a method for linking parts based on a single handwritten point.This figure illustrates an example of calculating the distance to a handwritten drawing using parts other than the corners of the component area.This diagram shows examples of how the UI displays before and after a user makes a handwritten selection.A diagram showing the configuration of the handwriting recognition unit in the second embodiment.This diagram shows point cloud data when check marks are drawn by hand.A diagram showing a handwritten internal table.This diagram shows an example of comments written next to text using leader lines.A diagram showing a work log table that incorporates comments. The following describes a specific example of a work support system according to an embodiment of the present invention, with reference to the drawings. Note that the present invention is not limited by this embodiment, but is defined by the claims. In this embodiment, the work support system displays writing candidates and components on the user's terminal display, allowing selection of writing associated with the components. According to this embodiment, the user can appropriately select a writing associated with a component from among the writing candidates, thereby suppressing user errors.