US-12625582-B2 - Information processing device, information processing system, information processing method, and computer-readable medium

Abstract

An information processing device according to an aspect of the present disclosure includes a memory and a processor. A program is stored in the memory. The processor coupled to the memory and, by executing the program, configured to: detect a position of an operator; detect a predetermined action of the operator in an operation region indicating a region that is defined by connecting the position of the operator and an operation target region set on at least one electronic device; execute processing associated with the operation target region when detecting the predetermined action; and expand the operation region in a case in which the position of the operator is outside a region in front of the at least one electronic device.

Inventors

• Atsushi Hirai
• Yuji Hashimoto

Assignees

• PANASONIC AUTOMOTIVE SYSTEMS CO., LTD.

Dates

Publication Date

20260512

Application Date

20241024

Priority Date

20231026

Claims (20)

1. 1 . An information processing device, comprising: a memory in which a program is stored; and a processor coupled to the memory and, by executing the program, configured to: detect a position of an operator; detect a predetermined action of the operator in an operation region that is defined by connecting the position of the operator and an operation target region set on at least one electronic device; execute processing associated with the operation target region when detecting the predetermined action in the operation region; and expand the operation region in a case in which the position of the operator is outside of a front region that is in front of the at least one electronic device, wherein when viewed from a lower direction of the at least one electronic device, a straight line connecting a center of a breadth of the front region and a center of a breadth of the at least one electronic device is orthogonal to a breadth direction of the front region, the breadth of the front region is equal to the breadth of the at least one electronic device, and the processing associated with the operation target region is executed when the predetermined action is detected in the expanded operation region, in the case in which the position of the operator is outside of the front region.
2. 2 . The information processing device according to claim 1 , wherein the at least one electronic device is a display, a first button region indicating a region in which a first button is arranged and a second button region indicating a region in which a second button is arranged are present on the display as at least two operation target regions, a length of the first button region is smaller than a length of the second button region in a direction of a center line connecting a center of the first button region and a center of the second button region, and the processor is configured to set the operation region corresponding to each of the first button region and the second button region such that a first angle indicating an angle formed by a first straight line and a second straight line is equal to a second angle indicating an angle formed by a third straight line and a fourth straight line, the first straight line connecting the position of the operator and one end part of the operation region corresponding to the first button region in the direction of the center line, the second straight line connecting the position of the operator and another end part of the operation region corresponding to the first button region in the direction of the center line, the third straight line connecting the position of the operator and one end part of the operation region corresponding to the second button region in the direction of the center line, the fourth straight line connecting the position of the operator and another end part of the operation region corresponding to the second button region in the direction of the center line.
3. 3 . The information processing device according to claim 1 , wherein the at least one electronic device includes a first electronic device and a second electronic device, and the processor is configured to expand the operation region of at least one of the first electronic device or the second electronic device in a second case in which the position of the operator is outside a front region corresponding to a front of the first electronic device and the second electronic device.
4. 4 . An information processing system comprising: a camera that images a user as the operator; and an information processing device according to claim 1 , wherein the processor is configured to detect the position of the operator based on an image taken by the camera.
5. 5 . The information processing device according to claim 1 , wherein the at least one electronic device is a display, a vicinity button region and a distant button region are present on the display as at least two operation target regions, the vicinity button region indicating a region closer to the operator, the distant button region indicating a region farther from the operator, and the processor is configured to set the operation region corresponding to each of the vicinity button region and the distant button region such that a first angle indicating an angle formed by a first straight line and a second straight line is equal to a second angle indicating an angle formed by a third straight line and a fourth straight line, the first straight line connecting the position of the operator and one end part of the operation region corresponding to the vicinity button region in a direction of a center line connecting a center of the vicinity button region and a center of the distant button region, the second straight line connecting the position of the operator and another end part of the operation region corresponding to the vicinity button region in the direction of the center line, the third straight line connecting the position of the operator and one end part of the operation region corresponding to the distant button region in the direction of the center line, the fourth straight line connecting the position of the operator and another end part of the operation region corresponding to the distant button region in the direction of the center line.
6. 6 . The information processing device according to claim 5 , wherein the first straight line connects a right end part of the vicinity button region and the position of the operator, the second straight line connects a left end part of the vicinity button region and the position of the operator, the third straight line connects a right end part of the distant button region and the position of the operator, and the fourth straight line connects a left end part of the distant button region and the position of the operator.
7. 7 . The information processing device according to claim 5 , wherein the first straight line connects an upper end part of the vicinity button region and the position of the operator, the second straight line connects a lower end part of the vicinity button region and the position of the operator, the third straight line connects an upper end part of the distant button region and the position of the operator, and the fourth straight line connects a lower end part of the distant button region and the position of the operator.
8. 8 . The information processing device according to claim 1 , wherein the processor is configured to determine a size of the operation region after being expanded based on a positional relation between the at least one electronic device and the operator.
9. 9 . The information processing device according to claim 8 , wherein the at least one electronic device is a display, and the processor is configured to determine the size of the operation region after being expanded based on an initial size of the operation region in a second case in which the display is disposed in front of the operator while a shortest distance between the display and the operator is kept equal.
10. 10 . The information processing device according to claim 1 , wherein the at least one electronic device is a display, and in a second case in which a plurality of operation regions is present on the display, the processor is configured to determine, when detecting an action selecting one of the plurality of operation regions, the size of the operation target region after being expanded in accordance with the predetermined action.
11. 11 . The information processing device according to claim 10 , wherein the processor is configured to: in a second case in which sizes of operation target regions after being expanded corresponding to the plurality of operation regions are equal to each other, expand the size of the operation target region after being expanded corresponding to the one of the plurality of operation regions selected; and reduce the size of the operation target region after being expanded corresponding to another one of the plurality of operation regions adjacent to the one of the plurality of operation regions selected.
12. 12 . The information processing device according to claim 10 , wherein the processor is configured to: in a third case in which sizes of operation target regions after being expanded corresponding to the plurality of operation regions are different from each other, expand the size of the operation target region after being expanded corresponding to the operation region selected, and reduce a size of the operation target region after being expanded corresponding to another operation region adjacent to the one of the plurality of operation regions selected.
13. 13 . The information processing device according to claim 10 , wherein the processor is configured to, when detecting an action selecting one of the plurality of operation regions, expand a size of an operation target region corresponding to the one of the plurality of operation regions selected and reduce a size of another operation target region adjacent to the operation target region corresponding to the one of the plurality of operation regions selected.
14. 14 . The information processing device according to claim 13 , wherein the processor is configured to, when detecting an action moving toward a third direction away from a front of the operation target region corresponding to the one of the plurality of operation regions selected, further expand the size of the operation target region corresponding to the one of the plurality of operation regions selected, and return the size of the operation target region to a size before being expanded after a certain time has elapsed.
15. 15 . The information processing device according to claim 1 , wherein the at least one electronic device is a display, and the processor is configured to, in a second case in which a plurality of operation regions is present on the display, move the operation target region after being expanded in accordance with the predetermined action, when detecting an action selecting one of the plurality of operation regions.
16. 16 . The information processing device according to claim 15 , wherein the processor is configured to, when detecting an action moving toward a first direction indicating left or right of a front of the plurality of operation regions, move the operation target region after being expanded toward the first direction.
17. 17 . The information processing device according to claim 15 , wherein the processor is configured to, when detecting an action selecting one of the plurality of operation regions, expand a size of an operation target region corresponding to the one of the plurality of operation regions selected and reduce a size of another operation target region adjacent to the operation target region corresponding to the one of the plurality of operation regions selected.
18. 18 . The information processing device according to claim 17 , wherein the processor is configured to, when detecting an action moving toward a third direction away from a front of the operation target region corresponding to the one of the plurality of operation regions selected, further expand the size of the operation target region corresponding to the one of the plurality of operation regions selected, and return the size of the operation target region to a size before being expanded after a certain time has elapsed.
19. 19 . An information processing method executed by an information processing device, the information processing method comprising: detecting a position of an operator; detecting a predetermined action of the operator in an operation region that is defined by connecting the position of the operator and an operation target region set on at least one electronic device; executing processing associated with the operation target region in a first case in which the predetermined action is detected in the operation region by the detecting; and expanding the operation region in a second case in which the position of the operator detected by the detecting is outside of a front region that is in front of the at least one electronic device, wherein when viewed from a lower direction of the at least one electronic device, a straight line connecting a center of a breadth of the front region and a center of a breadth of the at least one electronic device is orthogonal to a breadth direction of the front region, the breadth of the front region is equal to the breadth of the at least one electronic device, and the processing associated with the operation target region is executed when the predetermined action is detected in the expanded operation region, in the second case in which the position of the operator detected by the detecting is outside of the front region.
20. 20 . A non-transitory computer-readable medium on which programmed instructions are stored, wherein the programmed instructions, when executed by a computer, cause the computer to perform: detecting a position of an operator; detecting a predetermined action of the operator in an operation region that is defined by connecting the position of the operator and an operation target region set on at least one electronic device; executing processing associated with the operation target region in a first case in which the predetermined action is detected in the operation region by the detecting; and expanding the operation region in a second case in which the position of the operator detected by the detecting is outside of a front region that is in front of the at least one electronic device, wherein when viewed from a lower direction of the at least one electronic device, a straight line connecting a center of a breadth of the front region and a center of a breadth of the at least one electronic device is orthogonal to a breadth direction of the front region, the breadth of the front region is equal to the breadth of the at least one electronic device, and the processing associated with the operation target region is executed when the predetermined action is detected in the expanded operation region, in the second case in which the position of the operator detected by the detecting is outside of the front region.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2023-184239, filed on Oct. 26, 2023 and Japanese Patent Application No. 2024-156485, filed on Sep. 10, 2024, the entire contents of which are incorporated herein by reference. FIELD Embodiments described herein relate generally to an information processing device, an information processing system, an information processing method, and a computer-readable medium. BACKGROUND In the related art, regarding various electronic devices, there is known a technique of, when a user moves his/her hand without directly touching the electronic device, performing processing associated with an operation target of movement of the hand (for example, refer to Japanese Patent No. 6463963 and Japanese Patent No. 5341126). For example, in a case in which the electronic device is a display, there is known a technique of, when a user moves his/her hand without directly touching the display, changing display content on the display as the processing associated with an operation target of movement of the hand (for example, a button and the like disposed on a screen). In the technique as described above, for example, in a case in which a position of the user is outside a region in front of the electronic device, there is the problem that it is difficult for the user to perform processing associated with the operation target such as a button, that is, to perform operation, as compared with a case in which the position of the user is inside the front region. The present disclosure provides an information processing device, an information processing system, an information processing method, and a computer-readable medium that can improve operability for a user. SUMMARY An information processing device according to an aspect of the present disclosure includes a memory and a processor. A program is stored in the memory. The processor coupled to the memory and, by executing the program, configured to: detect a position of an operator; detect a predetermined action of the operator in an operation region indicating a region that is defined by connecting the position of the operator and an operation target region set on at least one electronic device; execute processing associated with the operation target region when detecting the predetermined action; and expand the operation region in a case in which the position of the operator is outside a region in front of the at least one electronic device. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a schematic diagram illustrating an example of an information processing device; FIG. 2 is a schematic diagram for explaining operation processing of an information processing device according to a first comparative example; FIG. 3 is a schematic diagram for explaining operation processing of an information processing device according to a first embodiment; FIG. 4 is a diagram illustrating a schematic configuration of an information system including a control device as the information processing device according to the first embodiment; FIG. 5 is a schematic diagram for explaining an example of an operation region to be expanded according to the first embodiment; FIG. 6 is a flowchart illustrating a processing procedure of the control device according to the first embodiment; FIG. 7 is a schematic diagram for explaining an example of an operation target region to be expanded according to a first modification; FIG. 8 is a schematic diagram for explaining an example of an operation region to be expanded according to a second modification; FIG. 9 is a schematic diagram for explaining an operation target region to be expanded according to a third modification; FIG. 10 is a schematic diagram for explaining an operation target region to be expanded according to the third modification; FIG. 11 is a schematic diagram for explaining an example of an operation region to be expanded according to a fourth modification; FIG. 12 is a schematic diagram for explaining an example of an operation region to be expanded according to a fifth modification; FIG. 13 is a schematic diagram for explaining an example of an operation region to be expanded according to a sixth modification; FIG. 14 is a schematic diagram for explaining an example of an operation region to be expanded according to the sixth modification; FIG. 15 is a schematic diagram for explaining operation processing of an information processing device according to a seventh modification; FIG. 16 is a schematic diagram for explaining operation processing of an information processing device according to a second comparative example; FIG. 17 is a schematic diagram for explaining operation processing of an information processing device according to a second embodiment; FIG. 18 is a diagram illustrating a schematic configuration of an information system including a control device as the information processing device according to