Search

JP-2026074640-A - Display device, display method, and display program

JP2026074640AJP 2026074640 AJP2026074640 AJP 2026074640AJP-2026074640-A

Abstract

[Problem] To provide a display device that can assist users with impaired visual function in switching the operation screen to an enlarged display without complicated procedures. [Solution] The display device according to the present invention includes a user interface unit 20 that displays a predetermined operation screen M1 and accepts touch operations from the user on the operation screen M1, and a control unit 1 that stores the operation history of touch operations, determines whether the user is a user with impaired visual function based on a series of consecutive operations performed within a predetermined time, and if the user is a user with impaired visual function, automatically switches the display mode of the operation screen M1 to an enlarged display or provides support for switching to the enlarged display. [Selection Diagram] Figure 10

Inventors

  • 伏屋 健吾

Assignees

  • コニカミノルタ株式会社

Dates

Publication Date
20260507
Application Date
20241021

Claims (12)

  1. A user interface unit that displays a predetermined operation screen and accepts user touch operations on the operation screen, A control unit that stores the operation history of the touch operations, determines whether the user is a user with impaired vision based on a series of consecutive operations performed within a predetermined time, and, if the user is a user with impaired vision, automatically switches the display mode of the operation screen to an enlarged display or provides assistance for switching to the enlarged display. A display device equipped with the following features.
  2. The display device according to claim 1, wherein the control unit determines that the user is a user with impaired vision if, in a predetermined number of consecutive operation histories performed within a predetermined time, invalid first touch operations on areas where icons are not placed within the operation screen are performed consecutively in close proximity to each other.
  3. The display device according to claim 1, wherein the control unit determines that the user is a user with impaired vision if, in a predetermined number of consecutive operation histories performed within a predetermined time, a second touch operation on the icon placement area in the operation screen and a third touch operation on the back button for returning to the previous screen from the state obtained by the second touch operation are repeated a predetermined number of times in a predetermined sequence.
  4. The display device according to claim 1, wherein the control unit, when switching the display mode of the operation screen to the enlarged display, sets the display items in the enlarged operation screen to be displayed immediately after the switch, based on the operation history data and the layout data of the operation screen.
  5. Applied to image forming apparatus, The aforementioned operation screen is an operation screen for selecting a job to be executed by the image forming apparatus through the touch operation on the function selection button. The display device according to claim 1, wherein the control unit switches the enlarged display of the operation screen to a normal size display when the execution of the job is completed by the touch operation.
  6. The display device according to claim 1, wherein the control unit determines whether the user is a user with impaired vision based on a plurality of consecutive operation histories within a predetermined time period, as well as camera image data obtained by capturing the user's face area.
  7. The display device according to claim 6, wherein the control unit sets as an additional condition for determining that the user is a user with impaired vision that the estimated age of the user identified by image processing of the camera image data is above a predetermined level.
  8. The image processing applied to the camera image data is as follows: A process for detecting the user's face region image from the camera image data, The display device according to claim 7, comprising the process of extracting the facial features of the user from the facial region image using a trained classifier model and estimating the user's age.
  9. The display device according to claim 6, wherein the control unit sets as an additional condition for determining that the user is a user with impaired vision that the physical distance between the user's face region detected by image processing of the camera image data and the operation screen is less than or equal to a predetermined distance.
  10. Applied to image forming apparatus, The display device according to claim 1, wherein the control unit determines whether the user is a user with impaired visual function based on the operation history of multiple consecutive operations within a predetermined time period, as well as user information registered in association with an external terminal that issued a job execution command to the image forming apparatus.
  11. The process includes displaying a predetermined operation screen and accepting user touch operations on the said operation screen, The process includes storing the operation history of the touch operations, determining whether the user is a user with impaired vision based on a series of consecutive operations performed within a predetermined time, and if the user is a user with impaired vision, automatically switching the display mode of the operation screen to an enlarged display or providing assistance for switching to the enlarged display. Display methods that include this.
  12. On the computer, The process includes displaying a predetermined operation screen and accepting user touch operations on the said operation screen, The process includes storing the operation history of the touch operations, determining whether the user is a user with impaired vision based on a series of consecutive operations performed within a predetermined time, and if the user is a user with impaired vision, automatically switching the display mode of the operation screen to an enlarged display or providing assistance for switching to the enlarged display. A display program that executes the command.

Description

This disclosure relates to a display device, a display method, and a display program. In recent years, there has been an increase in display devices that use touch panels as a user interface, such as mobile phones and multifunction printers. See, for example, Patent Document 1. Japanese Patent Publication No. 2022-182801 A schematic diagram showing an example of the overall configuration of an image forming apparatus.A schematic diagram showing an example of the overall configuration of an image forming apparatus.This diagram shows an example of an operation screen displayed in the UI section.This diagram shows how the display switching button is displayed as a pop-up on the operation screen using the display switching support function of the control unit.Figure 3 shows an example of the operation screen that appears when the operation screen is enlarged.This figure shows another example of the operation screen that appears when the operation screen in Figure 3 is enlarged.Figure 3 shows an example of the operation screen that appears when the copy button is selected.A diagram showing an example of operation history data.A diagram showing another example of operation history data.This diagram shows an example of the operation flow (main flow) of the display switching support function by the control unit.Figure 10 shows an example of the first subroutine processing in step S3 of the main flow.Figure 10 shows an example of the second subroutine processing in step S3 of the main flow.This figure shows an example of the magnification/display switching process performed by the control unit.This figure shows an example of the operation flow of the display switching support function by the control unit according to Modification 1.A diagram showing an example of an image captured by a camera.This figure shows an example of the operation flow of the display switching support function by the control unit according to Modification 2.This figure shows an example of the operation flow of the display switching support function by the control unit according to Modification 3.A diagram showing an example of user data. Preferred embodiments of this disclosure will be described in detail below with reference to the attached drawings. In this specification and the drawings, components having substantially the same functional configuration are denoted by the same reference numerals, thus omitting redundant descriptions. <Overall configuration of the image forming apparatus> First, the configuration of a display device according to one embodiment of the present invention will be described. In this embodiment, an example in which the display device of the present invention is applied to an image forming apparatus (hereinafter referred to as "image forming apparatus U") will be described. The image forming apparatus U is a multifunction device having multiple functions such as a copy function, a fax function, a printer function, and a scanner function. Figures 1 and 2 are schematic diagrams showing an example of the overall configuration of the image forming apparatus U. Image forming apparatus U is a color image forming apparatus that utilizes an intermediate transfer method based on electrophotographic process technology. Specifically, image forming apparatus U first transfers the toner images of each color—Y (yellow), M (magenta), C (cyan), and K (black)—formed on the photoreceptor drum 413 to the intermediate transfer belt 421. Then, after superimposing the four toner images on the intermediate transfer belt 421, a toner image is formed by secondary transfer to the paper S. Furthermore, the image forming apparatus U has photoreceptor drums 413 corresponding to the four YMCK colors arranged in series in the direction of travel of the intermediate transfer belt 421. A tandem system is employed, in which the toner images of each color are sequentially transferred to the intermediate transfer belt 421 in a single procedure. The image forming apparatus U comprises an image reading unit 10, a UI (User Interface) unit 20, an image processing unit 30, an image forming unit 40, a paper transport unit 50, a fixing unit 60, a communication unit 71, a storage unit 72, a camera 80, and a control unit 1, etc. Note that the "display device" of the present invention is composed of the UI unit 20 and the control unit 1. The control unit 1 includes a CPU 1a, ROM 1c, RAM 1b, etc. The control unit 1 uses the CPU 1a to read a program corresponding to the processing content from ROM 1c, load it into RAM 1b, and then, in cooperation with the loaded program, centrally controls the operation of each block of the image forming apparatus U. At this time, various data stored in the memory unit 72 are referenced. The storage unit 72 consists of a non-volatile semiconductor memory or hard disk, and stores various processing programs and data related to various processes. For example, the storage unit 72 stores layout data D1 of the operation screen displa