Search

JP-7855550-B2 - Information processing program, information processing device, and information processing method

JP7855550B2JP 7855550 B2JP7855550 B2JP 7855550B2JP-7855550-B2

Inventors

  • 渡辺 奈夕子
  • 岩田 憲治
  • 桑村 音晴

Assignees

  • 株式会社東芝

Dates

Publication Date
20260508
Application Date
20230613

Claims (20)

  1. An information acquisition unit acquires, for each item, one or more items and information regarding the values of the input fields for those one or more items from a recording data sheet that includes voice input fields. A format estimation unit estimates the input format of the input field , which is the format of the value to be entered into the input field, based on the aforementioned information. An information processing program that enables computers to realize this.
  2. The input procedure for entering values into multiple input fields included in the aforementioned recording data sheet is stored in the computer's memory. The input procedure includes an identifier that identifies the input field for the input item included in the recording data sheet, and the estimated input format. The information processing program according to claim 1.
  3. The computer further implements a range selection unit that selects a range of multiple input fields from the aforementioned recording data sheet. The information acquisition unit acquires the information corresponding to the input fields within the selected range. The format estimation unit estimates the input format common to the input fields in the range based on the correspondingly acquired information. The information processing program according to claim 2.
  4. The input procedure further includes guidance that includes the item name of the input target item , wherein the item name is used as content to be played back by speech synthesis at the start of each input procedure . The range selection unit selects the range of the input field based on the guidance or the identifier. The information processing program according to claim 3.
  5. A dictionary generation unit generates a speech recognition dictionary based on the estimated input format, A recognition control unit that performs speech recognition using the speech recognition dictionary in response to the user's utterance and inputs the resulting speech recognition text into the input field according to the identifier, The information processing program according to claim 2, further enabling the computer to perform the above.
  6. The aforementioned information is an example of an input value, which is an example of a value in the input field. The information acquisition unit acquires the values as input values from at least one of the following: the recording data sheet in which the values in the input fields are pre-entered, and the user interface that accepts the input of values into the input fields. The information processing program according to claim 1.
  7. The aforementioned information is the formatting used to display the value in the input field, The information acquisition unit acquires the formatting settings included in the recording data sheet as the information. The information processing program according to claim 1.
  8. The aforementioned information includes an example input value, which is an example of the value in the input field, and the formatting used to display the value in the input field. The information acquisition unit acquires the information, including the input value example and the formatting, from the recording data sheet. The information processing program according to claim 1.
  9. The format estimation unit estimates the input format for each input field within the range, and estimates one of the estimated input formats as the common input format. The information processing program according to claim 3.
  10. The format estimation unit estimates the input format for each input field within the range, and estimates an input format that encompasses multiple of the estimated input formats as the common input format. The information processing program according to claim 3.
  11. The format estimation unit adjusts the estimated input format based on the number of corresponding pieces of information obtained. The information processing program according to claim 3.
  12. The input procedure further includes upper and lower limits indicating the range of values in the input field. The format estimation unit adjusts the estimated input format based on the upper and lower limits included in the input procedure. The information processing program according to claim 3.
  13. The computer further implements a format checking unit. The input procedure further includes guidance regarding voice input to the input field , which includes text to be played back by speech synthesis at the start of the voice input . The format checking unit checks the estimated input format based on the guidance. The information processing program according to claim 2.
  14. A format checking unit checks the estimated input format by generating example input values from the estimated input format, performing speech synthesis on the generated example input values, performing speech recognition on the speech data obtained from the speech synthesis using the speech recognition dictionary, and determining whether the text of the obtained speech recognition result matches the generated example input values. The information processing program according to claim 5, further enabling the computer to perform the above.
  15. The format check unit, based on the results of the determination, classifies the situation in the case of a mismatch by determining whether or not a command was detected from the text of the speech recognition result. The information processing program according to claim 14.
  16. The format checking unit checks the input format by calculating the recognition rate or misrecognition rate of the speech recognition based on the number of times the judgment was made and the result of the judgment. The information processing program according to claim 14.
  17. The format checking unit notifies the results of the input format check in an identifiable manner. The information processing program according to claim 14.
  18. The format check unit, when it detects the command, modifies the voice input command to match the command in response to the user's operation. The information processing program according to claim 15.
  19. A display unit that displays the aforementioned recording data sheet and displays the estimated input format in the input fields included in the recording data sheet. The information processing program according to claim 1, further enabling the computer to perform the above.
  20. A display unit that generates one or more example input values from the estimated input format and displays the generated example input values in the input fields included in the recording data sheet. The information processing program according to claim 1, further enabling the computer to perform the above.

Description

Embodiments of the present invention relate to an information processing program, an information processing device, and an information processing method. In manufacturing and maintenance sites, measurement values from measuring instruments and visual inspection results are sometimes entered into record data sheets such as forms and tables. These data sheets are then shared among workers or with customers. In this case, the content to be entered into the record data sheet is predetermined, and workers perform their tasks according to the work procedures, entering the obtained data into the designated locations on the record data sheet. While typical form software requires text input, this can be time-consuming, creating a need for voice-based data entry. For example, a separate application can be used to configure input fields and their content. This allows users to input values into selected fields through speech, and even specify the next field to input, enabling continuous input. This voice input method allows for pre-defined input formats by speech recognition experts, enabling voice input based on these formats. While the above-described voice input method is generally fine, the inventors' research indicates that there is room for improvement, for example, in cases where a voice recognition expert is unavailable, as it can be difficult to determine an appropriate input format. Japanese Patent Publication No. 2008-52676 A block diagram showing the configuration of the information processing device according to the first embodiment.A figure showing an example of report data according to the first embodiment.A diagram showing an example of the initial settings of the input procedure storage unit according to the first embodiment.A figure showing an example of a word list according to the first embodiment.A diagram showing an example of a completed form according to the first embodiment.A diagram showing the automatically configured input procedure storage unit according to the first embodiment.A diagram showing an example of a correspondence table for the input format of the guidance according to the first embodiment.A flowchart showing the input procedure creation process according to the first embodiment.A diagram showing an example of range selection according to the first embodiment.A diagram showing an example of an alert according to the first embodiment.A diagram showing another example of an alert according to the first embodiment.A diagram showing an example of the input format display for a form according to the first embodiment.A figure showing an example of displaying example input values for a form according to the first embodiment.A diagram showing an example of the input order display for a form according to the first embodiment.A diagram showing another example of the input order display for a form according to the first embodiment.A diagram showing the formal estimation process (without concatenation) according to the first embodiment.A diagram showing an example of a format sorting rule according to the first embodiment.A diagram showing formal estimation (without linking) according to the first embodiment.A diagram showing the format check process according to the first embodiment.A diagram showing the voice input processing according to the first embodiment.A block diagram showing the configuration of an information processing device according to the second embodiment.A figure showing an example of automatic range selection according to the second embodiment.A flowchart showing the input procedure creation process according to the second embodiment.A block diagram showing the configuration of an information processing device according to the third embodiment.A flowchart showing the input procedure creation process according to the third embodiment.A flowchart showing the formal estimation process (without concatenation) according to the third embodiment.A flowchart illustrating the format check process according to the third embodiment.A block diagram showing the configuration of the information processing device according to the fourth embodiment.A flowchart showing the operation example display process according to the fourth embodiment.A diagram showing an example of the hardware configuration of an information processing device according to the fifth embodiment. The following describes each embodiment in detail with reference to the drawings. In the following description, we will use as an example the case in which an information processing device such as a tablet terminal with voice input functionality performs input procedure creation processing and voice input processing. Note that the information processing device is not limited to a tablet terminal; any computer such as a PC (Personal computer) or smartphone equipped with an external microphone and external speakers can be used as appropriate. Furthermore, the information processing device does not necessarily need to perform b