CN-122018979-A - Method of generating an in-memory processing request for an in-memory operation, and electronic device and method for in-memory processing

Abstract

A method of generating an in-memory processing request for in-memory (PIM) operation, and an electronic device and method for in-memory processing are disclosed. A method of generating a PIM request for in-memory operation includes receiving configuration information from a processor for generating the PIM request, obtaining information about a PIM request command from a command table, the obtaining based on the configuration information, and generating the PIM request based on the obtained information about the PIM request command.

Inventors

• Bai Yunya
• Che Xiangxun

Assignees

• 三星电子株式会社

Dates

Publication Date

20260512

Application Date

20251110

Priority Date

20241112

Claims (20)

1. 1. A method of generating an in-memory processing request for an in-memory operation, the method comprising: Receiving configuration information from a processor for generating an in-memory processing request; Obtaining information about in-memory processing request commands from a command table, the step of obtaining being based on configuration information, and An in-memory processing request is generated based on the obtained information about the in-memory processing request command.
2. 2. The method of claim 1, wherein the step of obtaining information about the in-memory processing request command comprises: information on the in-memory processing request command is obtained from the command table based on the start address of the command table included in the configuration information.
3. 3. The method of claim 1, wherein generating the in-memory processing request comprises: Generating address information corresponding to the in-memory processing request based on information indicating an address range included in the information on the in-memory processing request command and address mapping information included in the configuration information, and An in-memory processing request including the generated address information is generated.
4. 4. The method of claim 3, wherein the address mapping information comprises: mapping information of bits of the memory field and the address, and increment mode information of the address of the memory field.
5. 5. The method of claim 1, wherein the step of obtaining information about the in-memory processing request command comprises: information about the in-memory processing request command is obtained from the command table further based on a trigger signal received from the processor for generating the in-memory processing request.
6. 6. The method of claim 1, further comprising: An in-memory processing request is sent to a memory controller, the memory controller configured to control an in-memory processing memory configured to perform in-memory operations.
7. 7. The method of claim 1, wherein the processor controls the storing of the command table.
8. 8. The method of claim 1, wherein the command table includes information regarding one or more in-memory processing request commands.
9. 9. The method of claim 1, wherein the information about the in-memory processing request command includes a type of the in-memory processing request command, an address of the in-memory processing request command, and/or data to be operated on by the in-memory processing request command.
10. 10. The method of claim 9, wherein the information regarding the in-memory processing request command further comprises fence information indicating whether to perform a memory fence operation on the in-memory processing request command.
11. 11. The method of claim 9, wherein the type indicates an in-memory operation type or indicates a general memory operation type.
12. 12. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform the method of any one of claims 1 to 11.
13. 13. An electronic device for in-memory processing, the electronic device comprising: A processor; A memory controller; in-memory processing memory, and An in-memory processing request generation module, Wherein the processor is configured to send configuration information to the in-memory processing request generation module, an The in-memory processing request generation module is configured to perform an operation of obtaining information about an in-memory processing request command from the command table based on the configuration information, and to perform an operation of generating an in-memory processing request based on the in-memory processing request command.
14. 14. The electronic device of claim 13, wherein the in-memory processing request is sent to a memory controller configured to control the in-memory processing memory.
15. 15. The electronic device of claim 13, wherein the step of obtaining information about the in-memory processing request command comprises: information on the in-memory processing request command is obtained from the command table based on the start address of the command table included in the configuration information.
16. 16. The electronic device of claim 13, wherein generating an in-memory processing request comprises: Generating address information corresponding to the in-memory processing request based on information indicating an address range included in the information on the in-memory processing request command and address mapping information included in the configuration information, and An in-memory processing request including the generated address information is generated.
17. 17. The electronic device of claim 16, wherein the address mapping information comprises: mapping information of bits of the memory field and the address, and increment mode information of the address of the memory field.
18. 18. The electronic device of claim 13, wherein the step of obtaining information about the in-memory processing request command comprises: information about the in-memory processing request command is obtained from the command table further based on a trigger signal received from the processor for generating the in-memory processing request.
19. 19. The electronic device of any of claims 13-18, wherein, The command table includes information regarding one or more in-memory processing request commands, and The information about the in-memory processing request command includes at least one of type information, address information, data information, and barrier information indicating whether to perform a memory barrier operation on the in-memory processing request command.
20. 20. A method for in-memory processing, comprising: Generating, by the processor, a table comprising entries comprising respective descriptions of in-memory processing request commands; storing the table at a location in a memory; storing a configuration indicating the location of the table; generating, by the processor, a trigger signal; In response to a trigger signal, accessing a configuration to obtain the location of the table; based on obtaining the location of the table, accessing an entry in the table to generate in-memory processing requests respectively corresponding to respective descriptions of in-memory processing request commands, each in-memory processing request including an indication of an in-memory processing operation type and an address; Receiving, by the memory controller, the in-memory processing requests, and generating, by the memory controller, in-memory processing commands respectively corresponding to the in-memory processing requests based on the in-memory processing requests, and The in-memory process command is received by the in-memory process memory device and executed by the in-memory process memory device.

Description

Method of generating an in-memory processing request for an in-memory operation, and electronic device and method for in-memory processing The present application claims the benefit of korean patent application No. 10-2024-0160432 filed on the 11 th month 12 of 2024 in the korean intellectual property office, the entire disclosure of which is incorporated herein by reference for all purposes. Technical Field The following description relates to methods and apparatus with in-memory processing request generation. Background In a typical computer system of the von neumann architecture, the functionality of the memory device may be separated from the functionality of the processor performing operations on data in the memory device. Thus, bottlenecks may occur when large amounts of data are exchanged between a memory device and a processor in a system for performing operations of a neural network, processing large data, or processing internet of things (IoT) data, which requires operations for the large amounts of data. To solve this problem, studies on in-memory Processing (PIM) of a memory device that combines the functions of a memory and the functions of a processor for performing arithmetic operations have been actively conducted. Disclosure of Invention This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter. Aspects provide for usable in-memory system technology in which an in-memory operating device operates as a dedicated memory command or not. Aspects provide in-memory system techniques that may be used without hardware modifications to a processor. Aspects provide for in-memory system techniques that may generate in-memory Processing (PIM) requests for in-memory operations in a module separate from a processor such that the processor may perform separate operations when generating PIM requests for in-memory operations. However, the technical aspects are not limited to the foregoing aspects, and other technical aspects may exist. In one general aspect, a method of generating a PIM request for in-memory operation includes receiving configuration information from a processor for generating the PIM request, obtaining information about PIM request commands from a command table, the obtaining based on the configuration information, and generating the PIM request based on the obtained information about PIM request commands. The step of obtaining information regarding the PIM request command may include obtaining information regarding the PIM request command from a command table based on a start address of the command table included in the configuration information. The generating of the PIM request may include generating address information corresponding to the PIM request based on the information indicating the address range included in the information on the PIM request command and the address mapping information included in the configuration information, and generating the PIM request including the generated address information. The address mapping information may include mapping information of bits of the memory field and the address and increment pattern information of the address of the memory field. The step of obtaining information regarding PIM request commands may include obtaining information regarding PIM request commands from a command table further based on a trigger signal received from the processor for generating a PIM request. The method may also include sending a PIM request to a memory controller configured to control a PIM memory configured to perform in-memory operations. The processor may store a command table. The command table may include information regarding one or more PIM request commands. The information regarding the PIM request command may include the type of PIM request command, the address of the PIM request command, and/or data to be operated upon by the PIM request command. The information regarding the PIM request command may also include fence information indicating whether a memory fence operation is performed on the PIM request command. The type may indicate an in-memory operation type or indicate a general memory operation type. In another general aspect, an electronic device for in-memory operation includes a processor, a memory controller, a PIM memory, and a PIM request generation module. The processor may send configuration information for generating the PIM request to the PIM request generation module, and the PIM request generation module may perform operations to obtain information about the PIM request command from the command table based on the configuration information and be configured to perform operations to generate the PIM request based on the PIM request command. The