US-12625571-B2 - Content evaluation system, method, and program

US12625571B2US 12625571 B2US12625571 B2US 12625571B2US-12625571-B2

Abstract

Provided is a content evaluation system including an electronic pen, a data generation section that generates content data from writing operations performed by the electronic pen, a data acquisition section that acquires the content data, a first calculation section that calculates, from the acquired content data, a plurality of kinds of time-series feature amounts indicating a temporal change in a plurality of kinds of feature amounts related to a creation process of the handwritten content, a second calculation section that calculates an integrated feature amount related to the creation process of the handwritten content by using two or more kinds of time-series feature amounts from among the plurality of kinds of time-series feature amounts, and a content evaluation section that evaluates the handwritten content in reference to the integrated feature amount and outputs evaluation result information indicating the evaluation result of the handwritten content.

Inventors

Ipei Hung
Peter Bacher
Jin-Fu KO
Nobutaka Ide

Assignees

WACOM CO., LTD.

Dates

Publication Date: 20260512
Application Date: 20240918

Claims (11)

1 . A content evaluation system configured to evaluate a creation process of handwritten content, the content evaluation system comprising: an electronic pen; a data generation section that generates content data indicating handwritten content by accepting a writing operation using the electronic pen; a data acquisition section that acquires the content data generated by the data generation section; a first calculation section that calculates, from the content data acquired by the data acquisition section, a plurality of kinds of time-series feature amounts indicating temporal changes in a plurality of kinds of feature amounts related to the creation process of the handwritten content, including at least a first time-series feature amount indicating a temporal change in a pen position feature amount, a second time-series feature amount indicating a temporal change in a pen pressure feature amount, and a third time-series feature amount indicating a temporal change in a pen inclination angle; a second calculation section that calculates an integrated feature amount related to the creation process of the handwritten content by using at least the first, second and third time-series feature amounts from among the plurality of kinds of time-series feature amounts calculated by the first calculation section; a content evaluation section that evaluates the creation process of the handwritten content in reference to the integrated feature amount calculated by the second calculation section and outputs evaluation result information indicating an evaluation result of the creation process of the handwritten content, wherein the evaluation result information includes a degree of motivation of a user during the creation process; and a display section that displays the evaluation result information including the degree of motivation; wherein the content evaluation section continuously evaluates the creation process in real time to update the evaluation result information including the degree of motivation, and the display section displays the degree of motivation as updated in real time during the creation process, and wherein the integrated feature amount is calculated using a neural network operator trained on data sets representing high-motivation states during handwritten content creation.
2 . The content evaluation system according to claim 1 , wherein the handwritten content is an answer to a given problem.
3 . The content evaluation system according to claim 2 , wherein the content data includes stroke data indicating an aggregate of strokes, the first time-series feature amount indicates a temporal change in a position of the electronic pen corresponding to a stroke, and the two or more kinds of time-series feature amounts include a fourth time-series feature amount indicating a temporal change in a moving speed of the electronic pen corresponding to the stroke, and the evaluation result information includes the degree of motivation or a degree of concentration of a user.
4 . The content evaluation system according to claim 2 , wherein the content data includes stroke data indicating an aggregate of strokes, the two or more kinds of time-series feature amounts include a fourth time-series feature amount indicating a temporal change in a moving speed of the electronic pen corresponding to a stroke, and the second time-series feature amount indicates a temporal change in a pen pressure of the electronic pen corresponding to the stroke, and the evaluation result information includes the degree of motivation or a degree of concentration of a user.
5 . The content evaluation system according to claim 1 , wherein the handwritten content is an artwork.
6 . The content evaluation system according to claim 5 , wherein the content data includes stroke data indicating an aggregate of strokes, the first time-series feature amount indicates a temporal change in a position corresponding to a stroke and the second time-series feature amount indicates a temporal change in a pen pressure of the electronic pen corresponding to the stroke, and the evaluation result information includes a style or an authenticity of the artwork.
7 . The content evaluation system according to claim 5 , wherein the content data includes stroke data indicating an aggregate of strokes, the first time-series feature amount indicates a temporal change in a position corresponding to a stroke, and the two or more kinds of time-series feature amounts include a fifth time-series feature amount indicating a temporal change in color corresponding to the stroke, and the evaluation result information includes a style or an authenticity of the artwork.
8 . The content evaluation system according to claim 1 , wherein the display section displays the evaluation result information from the content evaluation section together with the handwritten content.
9 . The content evaluation system according to claim 8 , wherein the data generation section and the display section are provided in a user device, the data acquisition section, the first calculation section, the second calculation section, and the content evaluation section are provided in a server device configured to communicate with the user device, and the user device sequentially transmits the content data generated by the data generation section, receives the evaluation result information from the server device, and displays the evaluation result information by the display section each time the user device accepts the writing operation using the electronic pen.
10 . A content evaluation method configured to evaluate a creation process of handwritten content, the content evaluation method comprising: acquiring content data indicating handwritten content in an acquisition step; calculating, from the acquired content data, a plurality of kinds of time-series feature amounts indicating temporal changes in a plurality of kinds of feature amounts related to the creation process of the handwritten content in a first calculation step, including at least a first time-series feature amount indicating a temporal change in a pen position feature amount, a second time-series feature amount indicating a temporal change in a pen pressure feature amount, and a third time-series feature amount indicating a temporal change in a pen inclination angle; calculating an integrated feature amount related to the creation process of the handwritten content by using at least the first, second and third time-series feature amounts from among the plurality of kinds of calculated time-series feature amounts in a second calculation step; evaluating the creation process of the handwritten content in reference to the calculated integrated feature amount and outputting evaluation result information indicating the evaluation result of the creation process of the handwritten content in an evaluation step, wherein the evaluation result information includes a degree of motivation of a user during the creation process; displaying the evaluation result information including the degree of motivation; and continuously evaluating the creation process in real time to update the evaluation result information including the degree of motivation, and displaying the degree of motivation as updated in real time during the creation process, wherein the integrated feature amount is calculated using a neural network operator trained on data sets representing high-motivation states during handwritten content creation.
11 . A non-transitory computer readable medium including a content evaluation program to evaluate a creation process of handwritten content for one or more computers, the program, when executed, performs steps comprising: an acquisition step of acquiring content data indicating handwritten content; a first calculation step of calculating, from the acquired content data, a plurality of kinds of time-series feature amounts indicating temporal changes in a plurality of kinds of feature amounts related to the creation process of the handwritten content, including at least a first time-series feature amount indicating a temporal change in a pen position feature amount, a second time-series feature amount indicating a temporal change in a pen pressure feature amount, and a third time-series feature amount indicating a temporal change in a pen inclination angle; a second calculation step of calculating an integrated feature amount related to the creation process of the handwritten content by using at last the first, second, and third time-series feature amounts from among the plurality of kinds of calculated time-series feature amounts; an evaluation step of evaluating the creation process of the handwritten content in reference to the calculated integrated feature amount and outputting evaluation result information indicating the evaluation result of the creation process of the handwritten content, wherein the evaluation result information includes a degree of motivation of a user during the creation process; a display step of displaying the evaluation result information including the degree of motivation; and an update step of continuously evaluating the creation process in real time to update the evaluation result information including the degree of motivation, and displaying the degree of motivation as updated in real time during the creation process, wherein the integrated feature amount is calculated using a neural network operator trained on data sets representing high-motivation states during handwritten content creation.

Description

BACKGROUND Technical Field The present disclosure relates to a content evaluation system, a content evaluation method, and a content evaluation program. More particularly, the present disclosure relates to a content evaluation method, a content evaluation method, and a content evaluation program that collects data from the handwritten content performed by the user through an electronic pen, and then calculates and outputs from the evaluation result discerned characteristics of the creation process of the handwritten content. Description of the Related Art There is known a technique for evaluating handwritten content which makes it possible to, for example, automatically score an answer to an open-ended question. An example of this type of evaluation is disclosed in Japanese Patent No. 6717387, which comprises a sentence evaluation device that acquires a first logical relation established between first events configuring a first sentence, extracts a second logical relation established between second events configuring a second sentence from the second sentence to be evaluated, and evaluates the second sentence by comparing the first logical relation with the second logical relation. However, while academic ability can be evaluated by calculating a score or a percentage of correct answers by evaluating the completed answer, other factors related to the creation and execution of the answer cannot be evaluated, such as the learning motivation of the user throughout the creation of the answer. BRIEF SUMMARY The present disclosure has been made in view of the above circumstances to provide a content evaluation system, a content evaluation method, and a content evaluation program capable of evaluating more characteristics throughout the completion of the handwritten content rather than simply the finished product. According to a first aspect of the present disclosure, there is provided a content evaluation system including an electronic pen and a data generation section that takes the writing operations performed by the user through the electronic pen and generates content data corresponding to the handwritten content. A data acquisition section then acquires the content data and a first calculation section calculates from the content data a plurality of kinds of time-series feature amounts indicating a temporal change in a plurality of kinds of feature amounts related to the writing operations that constitute the handwritten content. A second calculation section then calculates an integrated feature amount related to the writing operations by using two or more kinds of time-series feature amounts from among the plurality of kinds of time-series feature amounts calculated by the first calculation section. A content evaluation section evaluates the handwritten content in reference to the integrated feature amount calculated by the second calculation section and outputs evaluation result information about the handwritten content. According to a second aspect of the present disclosure, one or more computers execute an acquisition step of acquiring content data corresponding to the handwritten content. A first calculation uses the content data to calculate a plurality of kinds of time-series feature amounts indicating a temporal change in a plurality of kinds of feature amounts related to the writing operations, and a second calculation step calculates an integrated feature amount related to the writing operations by using two or more kinds of time-series feature amounts from among the plurality of kinds of calculated time-series feature amounts. An evaluation step evaluates the handwritten content in reference to the calculated integrated feature amount and outputs evaluation result information indicating the evaluation result about the handwritten content. According to a third aspect of the present disclosure, there is also provided a content evaluation program where one or more computers execute an acquisition step of acquiring content data corresponding to the handwritten content. A first calculation step calculates, from the content data, a plurality of kinds of time-series feature amounts indicating a temporal change in a plurality of kinds of feature amounts related to the writing operations, and a second calculation step of calculates an integrated feature amount related to the writing operations by using two or more kinds of time-series feature amounts from among the plurality of kinds of calculated time-series feature amounts. An evaluation step evaluates the handwritten content in reference to the calculated integrated feature amount and outputs evaluation result information indicating the evaluation result of the handwritten content. BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS FIG. 1 is a diagram illustrating the content evaluation system according to an embodiment of the present disclosure; FIG. 2 is a block diagram illustrating an example of an embodiment of a server device depicted in FIG. 1;