Search

EP-4071726-B1 - INFORMATION PROCESSING SYSTEM, POSITION MANAGEMENT METHOD, INFORMATION PROCESSING APPARATUS, AND CARRIER MEDIUM

EP4071726B1EP 4071726 B1EP4071726 B1EP 4071726B1EP-4071726-B1

Inventors

  • KAWASAKI, HAJIME
  • AOKI, MAKOTO

Dates

Publication Date
20260513
Application Date
20220315

Claims (9)

  1. An information processing apparatus (14) configured to recognize a code image corresponding to an object to be managed, from a captured image captured by an image capturing device (18) installed to capture an image of a range in which a position of the object is managed, to manage the position of the object, the information processing apparatus comprising: a position information generation unit (60) configured to generate spatial coordinate information of the code image based on a position of the code image recognized from the captured image, a size of the code image recognized from the captured image, and a size of a reference code image; a management unit (36) configured to manage the position of the object corresponding to the code image, with plane coordinate information of the code image corrected using the spatial coordinate information of the code image, said plane coordinate information indicating a plane position of the code image recognized from the captured image; and a reference code image size calculation unit (64) configured to calculate the size of the reference code image for each position of a reference plane on which the code image is recognized, from the size of the code image placed at a center of the reference plane in the captured image captured by the image capturing device.
  2. The information processing apparatus according to claim 1, wherein the position information generation unit (60) is configured to generate the spatial coordinate information of the code image, based on a ratio of the size of the code image recognized from the captured image to the size of the reference code image, such that spatial coordinates of the code image recognized from the captured image are located between the position of the code image recognized from the captured image and the image capturing device.
  3. The information processing apparatus according to claim 1 or 2, wherein the management unit (36) is configured to display the object corresponding to code images of different sizes captured so as to be present at a same position in the captured image such that the code images of different sizes are present at different plane coordinates, based on plane coordinate information of the code images corrected using spatial coordinate information of the code images generated by the position information generation unit (60).
  4. The information processing apparatus according to claim 1 or 2, wherein the management unit (36) is configured to display the object corresponding to code images captured so as to be present at different positions in the captured image such that the code images are present at the same plane coordinates, based on plane coordinate information of the code images corrected using spatial coordinate information of the code images generated by the position information generation unit (60).
  5. The information processing apparatus according to any one of claims 1 to 4, wherein the range in which the position of the object is managed is associated with a job process for the object, and wherein when the plane coordinate information of the code image corrected using the space coordinate information of the code image indicates a position within the range in which the position of the object is managed, the management unit (36) is configured to display status information of the job process indicating that the object corresponding to the code image is present in the job process associated with the range.
  6. The information processing apparatus according to claim 3 or 4, wherein in response to reception of a search request for the object to be managed from a user, the management unit (36) is configured to display a position of the object on an image of the range in which the position of the object is managed, based on plane coordinate information of the code image corrected using the spatial coordinate information of the code image.
  7. An information processing system (12) comprising: an image capturing device (18) installed to capture an image of a range in which a position of an object to be managed is managed; and the information processing apparatus (14) of any of claims 1-6.
  8. A position management method to be executed by an information processing system (12) that includes an image capturing device (18) installed to capture an image of a range in which a position of an object to be managed is managed and an information processing apparatus (14) configured to recognize a code image corresponding to the object from a captured image captured by the image capturing device (18) and manage the position of the object, the method comprising: generating spatial coordinate information of the code image based on a position of the code image recognized from the captured image, a size of the code image recognized from the captured image, and a size of a reference code image; managing the position of the object corresponding to the code image, with plane coordinate information of the code image corrected using the spatial coordinate information of the code image, said plane coordinate information indicating a plane position of the code image recognized from the captured image; and calculating the size of the reference code image for each position of a reference plane on which the code image is recognized, from the size of the code image placed at a center of the reference plane in the captured image captured by the image capturing device.
  9. A carrier medium carrying computer readable code which, when executed by the information processing system of claim 7, causes the information processing system to carry out the position management method of claim 8.

Description

BACKGROUND Technical Field Embodiments of the present disclosure relate to an information processing system, a location management method, an information processing apparatus, and a carrier medium. Related Art Technologies are known for managing the progress of a job including a plurality of work processes by using a barcode or the like. For example, a technology is known in which a code image associated with a job is captured at each location associated with a work process, the job is recognized from the code image, and the work process associated with the captured location and the job recognized from the code image are managed in association with each other. In addition, a technology is known for managing a work process associated with a captured place and a job recognized from a code image in association with each other and providing information on the progress of a plurality of jobs including a plurality of work processes to a user (for example, see Japanese Unexamined Patent Application Publication No. 2020-024658). When the plane position of a code image at each location associated with a work process is recognized from an image captured by a camera, the plane position of the code image may not be correctly recognized for the following reason. For example, a camera generates a captured image by projecting an object existing in space onto a planar image. Therefore, when there is a variation in the height of the code image, it would be determined that code images at different plane positions existing on a straight line in the image capturing direction of the camera exist at the same plane position. Further, when there is a variation in the height of the code image, it would be determined that the code images existing at the same plane position exist at different plane positions. EP 2 372 627 A2 proposes providing city services using mobile devices and a sensor network. US 2015/062640 Al discloses an image forming system and apparatus. SUMMARY An object of an embodiment of the present invention is to provide an information processing system capable of stably managing a position of an object to be managed. According to an aspect of the present disclosure, there is provided an information processing apparatus in accordance with claim 1. Further aspects and preferred embodiments are set out in claim 2 et seq. BRIEF DESCRIPTION OF THE DRAWINGS A more complete appreciation of the disclosure and many of the attendant advantages and features thereof can be readily obtained and understood from the following detailed description with reference to the accompanying drawings, wherein: FIG. 1 is a diagram illustrating a configuration of a job management system according to an embodiment of the present disclosure;FIGS. 2A and 2B are image diagrams illustrating examples of a work instruction form used in the job management system of FIG. 1;FIG. 3 is a diagram illustrating a hardware configuration of a computer according to an embodiment of the present disclosure;FIG. 4 is a diagram illustrating a functional configuration of a work process management system according to an embodiment of the present disclosure;FIGS. 5A and 5B are diagrams illustrating an example of a case where the position of a color code cannot be correctly recognized;FIGS. 6A, 6B, and 6C are diagrams illustrating an example of a method for correctly recognizing the position of a color code;FIG. 7 is a flowchart illustrating an example of a preparation process of an information processing system according to an embodiment of the present disclosure;FIG. 8 is an image diagram illustrating an example of a grid setting screen;FIG. 9 is an image diagram illustrating an example of an address setting screen;FIG. 10 is an image diagram illustrating an example of a camera setting screen;FIG. 11 is a diagram illustrating an example of the configuration of address setting information according to an embodiment of the present disclosure;FIG. 12 is a diagram illustrating an example of the configuration of camera setting information according to an embodiment of the present disclosure;FIG. 13 is a flowchart illustrating an example of a management process of an information processing system according to an embodiment of the present disclosure;FIG. 14 is a diagram illustrating an example of the configuration of job status information according to an embodiment of the present disclosure;FIG. 15 is a flowchart illustrating an example of a correction process of a position where a color code is recognized, according to an embodiment of the present disclosure;FIG. 16 is a diagram illustrating an example of a method of calculating the size of a color code in a reference plane from the size of the color code placed at the center of the reference plane, according to an embodiment of the present disclosure;FIG. 17 is a flowchart illustrating an example of update processing of job status information in a job management system according to an embodiment of the present disclosure