CN-121996332-A - Written document based interaction methods, systems, devices, media and program products

Abstract

The present disclosure provides written document based interaction methods, systems, devices, media, and program products. The method comprises the steps of obtaining data capable of generating interaction instruction information according to a written document page, generating interaction instruction information according to the data capable of generating the interaction instruction information, obtaining electronic mapping document data corresponding to the written document page, determining interaction processing actions according to interaction instruction processing action information in the interaction instruction information, extracting interaction content data related to the interaction instruction position information from the electronic mapping document data corresponding to the written document page according to the interaction instruction position information in the interaction instruction information, and executing the interaction processing actions on the extracted interaction content data.

Inventors

• YANG HONGWEI

Assignees

• 杨宏伟

Dates

Publication Date

20260508

Application Date

20241105

Claims (20)

1. 1. A method of interaction based on written documents, comprising: Acquiring data capable of generating interaction instruction information according to a written document page; Generating interaction instruction information according to the data capable of generating the interaction instruction information; acquiring electronic mapping document data corresponding to the written document page; determining an interaction processing action according to interaction instruction processing action information in the interaction instruction information; Extracting interactive content data related to the interactive instruction position information from electronic mapping document data corresponding to the written document page according to the interactive instruction position information in the interactive instruction information; And executing the interaction processing action on the extracted interaction content data.
2. 2. The interaction method of claim 1, wherein The electronic map document data includes interactive content data corresponding to the written document page, and position information of the interactive content data in the written document page or the electronic map document page can be acquired, The interactive instruction information comprises interactive instruction processing action information and/or interactive instruction position information and/or information for acquiring electronic mapping document data corresponding to the written document page, The electronic mapping document data comprises one or more electronic mapping document pages; The interactive instruction location information refers to one or more location information on a written document page or an electronically mapped document page associated with the interactive instruction information, The interactive content data at least comprises one of document content, interactive preset data, interactive process data and interactive result data, The document content refers to the content visible to the written document page or the document content data stored in the electronically mapped document data corresponding thereto, The electronic map document page refers to an electronic document page stored or capable of being generated in electronic map document data corresponding to a written document page.
3. 3. The interactive method of claim 1, wherein the data capable of generating interactive instruction information comprises an image with a written document page having one or more visual identifications within the image, the visual identifications being either within or outside the written document page in the image, The generating the interaction instruction information according to the data capable of generating the interaction instruction information specifically comprises the following steps: identifying the one or more visual identifications within the image with the written document page; Acquiring a coordinate corresponding relation between a coordinate system of the image with the written document page and a coordinate system of the written document page, or acquiring a coordinate corresponding relation between a coordinate system of the image with the written document page and a coordinate system of the electronic mapping document page; And determining the interaction instruction information according to the visual identification and the acquired coordinate corresponding relation.
4. 4. The interactive method according to claim 1, wherein the data capable of generating interactive instruction information includes one or more first coordinate system coordinate information, which is coordinate information in the indicated first coordinate system intersecting or being parallel or coincident with the page of the written document, The generating the interaction instruction information according to the data capable of generating the interaction instruction information specifically comprises the following steps: acquiring a coordinate corresponding relation between the first coordinate system and a page coordinate system of the written document, or acquiring a coordinate corresponding relation between the first coordinate system and a page coordinate system of the electronic mapping document; and determining the interaction instruction information according to the coordinate information of the first coordinate system and the acquired corresponding relation of the coordinates.
5. 5. The method of interaction of claim 1, wherein, Extracting interactive content data related to the interactive instruction position information from the electronic mapping document data corresponding to the written document page according to the interactive instruction position information in the interactive instruction information, wherein the method specifically comprises the following steps of: Determining an interactive content area range according to the interactive instruction position information in the interactive instruction information; Acquiring interactive content data from electronic mapping document data, and acquiring position information of the interactive content data in the written document page or the electronic mapping document page; And selecting the interactive content data with the position information meeting the condition as the interactive content data related to the interactive instruction position information according to the position information of the interactive content data in the written document page or the electronic mapping document page and the interactive content area range, wherein the condition means that the position information is in the interactive content area range and/or has intersection with the interactive content area range.
6. 6. The method of interaction of claim 5, wherein, The interactive content data includes a document content element or a document content element combination, the electronically mapped document data includes a document content element or a document content element combination, and positional information of the document content element or document content element combination in the written document page or the electronically mapped document page can be acquired, the document content element is a unit constituting the written document content, the document content element combination is a combination of a plurality of the document content elements, The method specifically includes selecting the interactive content data with the position information meeting the condition as the interactive content data related to the interactive instruction position information according to the position information of the interactive content data in a written document page or an electronic mapping document page and the interactive content area range, wherein the method specifically includes the steps of: Determining a document content element or a document content element combination with the position information meeting the condition according to the interactive content area range and the position information of the document content element or the document content element combination in the written document page or the electronic mapping document page; And according to the position information of the document content elements or the document content element combinations in the written document page or the electronic mapping document page, arranging and combining the document content elements or the document content element combinations with the position information meeting the condition to generate the interactive content data related to the interactive instruction position information.
7. 7. The interactive method of claim 1, wherein the electronic map document data is provided with an image of an electronic map document page corresponding to the written document page or an electronic document capable of generating an electronic map document page corresponding to the written document page, Extracting interactive content data related to the interactive instruction position information from the electronic mapping document data corresponding to the written document page according to the interactive instruction position information in the interactive instruction information, wherein the method specifically comprises the following steps of: determining a corresponding interactive content area range in an electronic mapping document page according to the interactive instruction position information in the interactive instruction information; Intercepting a part in the interactive content area range from the electronic mapping document page according to the corresponding interactive content area range in the electronic mapping document page; And extracting the document content in the interactive content area range as the interactive content data related to the interactive instruction position information according to the part in the interactive content area range, which is intercepted from the electronic mapping document page.
8. 8. An interaction method according to claim 3, characterized in that, The step of determining the interaction instruction information according to the visual identification and the acquired coordinate correspondence, specifically includes: responsive to the type of at least one visual identifier included in the one or more visual identifiers being an interactive instruction location information identifier, determining a location of the interactive instruction location information identifier in the image with the written document page; And determining the interaction instruction position information in the interaction instruction information according to the position information identification in the image with the written document page and the acquired coordinate corresponding relation.
9. 9. The method of interaction of claim 1, wherein, The step of obtaining the electronic mapping document data corresponding to the written document page specifically comprises one or more of the following steps: determining electronic mapping document data corresponding to the written document page by comparing the similarity between the whole or part of the image of the written document page and the whole or part of the electronic mapping document data; Determining electronic mapping document data corresponding to the written document page in response to the type of at least one visual identifier included in the one or more visual identifiers being a written document identification identifier, and in response to the written document identification identifier being consistent with an identification identifier stored in the electronic mapping document data; Determining information recorded in the written document identification mark in response to the type including at least one visual mark in the one or more visual marks being the written document identification mark, and determining electronic mapping document data corresponding to the written document page in response to the recorded information being consistent with the information of the electronic mapping document data; electronic map document data corresponding to the written document page is determined in response to the entered information and in response to the entered information being consistent with the information of the electronic map document data.
10. 10. The method of interaction of claim 1, wherein, The performing the interaction processing action on the extracted interaction content data further includes: According to the interaction instruction position information in the interaction instruction information or a preset rule, acquiring the relative position relation between the projection or display position of the interaction processing result and the written document page or the image of the written document page; And according to the relative position relation between the projection or display position of the interaction processing result and the written document page or the image of the written document page, projecting or displaying the processing result of the interaction processing action to a designated position inside or outside the written document page or projecting or displaying the processing result of the interaction processing action to a designated position inside or outside the written document page in the field of view of a user.
11. 11. The interactive method according to claim 1, wherein the performing the interactive processing action on the extracted interactive content data further comprises: Obtaining position information on a written document page or an electronic mapping document page corresponding to the interaction result data of the interaction processing action according to the interaction instruction position information in the interaction instruction information or a preset interaction result data positioning rule; and storing the interaction result data of the interaction processing action in association with the obtained position information or the document content at the position of the position information.
12. 12. The method of interaction of claim 1, wherein, The performing the interaction processing action on the extracted interaction content data further includes: projecting or displaying the interactive content data at a designated position, or reading the interactive content data; And after confirming the interactive content data, executing the interactive processing action on the extracted interactive content data.
13. 13. The method of interaction of claim 1, wherein, The performing the interaction processing action on the extracted interaction content data further includes: Processing action information or preset rules according to the interaction instruction, and calling, sharing or copying interaction content data meeting the conditions in other electronic mapping document data locally or through a network; The interactive processing action is performed on the invoked, shared or copied interactive content data.
14. 14. The interactive method according to claim 1, wherein the interactive instruction processing action information includes at least one of processing action information, information of parameters, information of a calling program or service, address information of the calling program or service, name information of a calling model, user information, password information.
15. 15. The interaction method of claim 1, further comprising: And printing and generating the written document page according to the electronic mapping document data, or shooting the written document page to generate the electronic mapping document data.
16. 16. The interactive method according to claim 5, wherein the interactive instruction location information in the interactive instruction information includes coordinate information of one side of a quadrangular interactive content area range and a direction of the opposite side of the quadrangular interactive content area range, and the determining the interactive content area range according to the interactive instruction location information in the interactive instruction information specifically includes: obtaining the coordinates of one edge of the range of the quadrilateral interaction content area, and obtaining the direction of the opposite edge of the quadrilateral interaction content area; scanning from one side to the opposite side of the quadrangular interactive content area, wherein the area from the beginning of a pixel row meeting more than two colors for the first time to the end of a pixel row with only one color is used as the interactive content area, or selecting the area where a line of characters is located closest to one side of the quadrangular interactive content area from the one side to the opposite side of the quadrangular interactive content area as the interactive content area according to the position information of each character of document content.
17. 17. The interaction method according to claim 14, wherein the information of the parameter includes information added by a user on a page of a written document, and the determining the interaction processing action according to the interaction instruction processing action information in the interaction instruction information specifically includes: And removing the document content from the acquired image of the written document page according to the document content in the electronic mapping data, and acquiring information added by the user on the written document page from the image as information of the parameters.
18. 18. An interactive system based on written documents, comprising An interactive instruction information acquisition unit configured to acquire data capable of generating interactive instruction information from a written document page; a control unit configured to: Generating interaction instruction information according to the data capable of generating the interaction instruction information; acquiring electronic mapping document data corresponding to the written document page; determining an interaction processing action according to interaction instruction processing action information in the interaction instruction information; Extracting interactive content data related to the interactive instruction position information from electronic mapping document data corresponding to the written document page according to the interactive instruction position information in the interactive instruction information; And executing the interaction processing action on the extracted interaction content data.
19. 19. The interactive system of claim 18, wherein the interactive system comprises, The interactive instruction information acquisition unit comprises an imaging device, a display device and a display device, wherein the imaging device is configured to acquire an image with a written document page, and one or more visual identifications are arranged on the image with the written document page; Also included is a method of manufacturing a semiconductor device, An identification unit configured to identify the one or more visual identifications on the image with the written document page; the control unit generates the interactive instruction information from the data capable of generating the interactive instruction information by: Acquiring a coordinate corresponding relation between a coordinate system of the image with the written document page and a coordinate system of the written document page, or acquiring a coordinate corresponding relation between a coordinate system of the image with the written document page and a coordinate system of the electronic mapping document page; And determining the interaction instruction information according to the visual identification and the acquired coordinate corresponding relation.
20. 20. The interactive system of claim 18, wherein the interactive system comprises, The interactive instruction information acquisition unit includes a coordinate acquisition device configured to acquire coordinate information of the indicated position in a first coordinate system, the coordinate acquisition device having the first coordinate system intersecting or being parallel or coincident with the page of the written document, The control unit generates the interactive instruction information from the data capable of generating the interactive instruction information by: acquiring a coordinate corresponding relation between the first coordinate system and the page coordinate system of the written document or acquiring a coordinate corresponding relation between the first coordinate system and the page coordinate system of the electronic mapping document; and determining the interaction instruction information according to the coordinate information of the first coordinate system and the acquired corresponding relation of the coordinates.

Description

Written document based interaction methods, systems, devices, media and program products Technical Field The present disclosure relates to the field of information processing, and in particular to written document based interaction methods, systems, electronic devices, non-transitory computer readable storage media, and computer program products. Background At present, a large number of digital education and office tools exist, and digital and intelligent processing can be performed on electronic documents. However, since the backlight of the display screen can negatively affect the vision, in order to protect the vision, primary and secondary schools in China still mainly use written materials for learning, and adults learn and work in a scene of using a large amount of written materials. How to better utilize written materials to realize electronic data interaction, provide digital and intelligent support for such book surface learning or office scenes, promote the efficiency of interaction between teachers and students and team cooperation, and is a problem to be solved. Disclosure of Invention In view of this, the present disclosure provides a written document-based interaction method, system, electronic device, non-transitory computer-readable storage medium, and computer program product. Other features and advantages of the present disclosure will be apparent from the following detailed description, or may be learned in part by the practice of the disclosure. According to one aspect of the disclosure, an interaction method based on a written document is provided, which is characterized by comprising the steps of obtaining data capable of generating interaction instruction information according to a written document page, generating interaction instruction information according to the data capable of generating the interaction instruction information, obtaining electronic mapping document data corresponding to the written document page, determining interaction processing actions according to interaction instruction processing action information in the interaction instruction information, extracting interaction content data related to the interaction instruction position information from the electronic mapping document data corresponding to the written document page according to interaction instruction position information in the interaction instruction information, and executing the interaction processing actions on the extracted interaction content data. The electronic mapping document data comprises interaction content data corresponding to a written document page, and can acquire position information of the interaction content data in the written document page or the electronic mapping document page, the interaction instruction information comprises interaction instruction processing action information and/or interaction instruction position information and/or information for acquiring the electronic mapping document data corresponding to the written document page, the electronic mapping document data comprises one or more electronic mapping document pages, the interaction instruction position information refers to one or more position information on the written document page or the electronic mapping document page related to the interaction instruction information, the interaction content data at least comprises one of document content, interaction preset data, interaction process data and interaction result data, the document content refers to visible content of the written document page or document content data corresponding to the written document page and stored in the electronic mapping document data, and the electronic mapping document page refers to an electronic document page stored or capable of being generated in the electronic mapping document data corresponding to the written document page. The written document can be a document which is stored or displayed non-electronically and is presented on paper or other media, the content of the written document comprises characters, graphics, pictures and the like on the written document, or the page of the written document can be a page similar to paper which is presented in an electronic ink mode or the like, and the written document can also comprise documents which are presented on various objects (including documents displayed on other display devices), and the written document is essentially characterized in that the written document exists in the form of non-editable document images in the field of view of a user, and the written document is matched with the electronic mapping document data. The written document includes one or more written document pages that include written document content that is composed of one or more document content elements, which are units that make up the document content. In one embodiment, the display unit may be smart glasses and the written document page may not be a real paper document, but an image in the