External sorting method and device of SSD (Solid State Disk) and SSD memory
An external sorting, flash memory technology, applied in memory systems, instruments, input/output to record carriers, etc., can solve the problem of not being able to fully utilize the multi-channel concurrency of read and write inside SSD, occupying cache resources, and unpredictable read data block sequence, etc. problem, to achieve the effect of improving channel resource utilization, improving execution efficiency, and improving multi-channel read and write concurrency
Pending Publication Date: 2022-07-29
NAT UNIV OF DEFENSE TECH
View PDF0 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] However, there are two main problems with ActiveSort. First, ActiveSort does not save the final ordered results on the SSD side. Whenever the host side initiates a query request, the SSD side needs to perform a merge operation, which will increase computing overhead. Second, ActiveSort is merging It is impossible to predict the sequence of reading data blocks at this stage, and the next data block can only be read from the intermediate result file where the data block is located after the data block in the input cache is processed, which cannot fully utilize the internal read and write capacity of the SSD. Channel concurrency, especially in the scenario where the data is partially ordered, will cause large data blocks to stay in the DRAM of the SSD, occupying cache resources, and cannot improve the execution efficiency of the merge algorithm
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreExamples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0037] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. Based on the external sorting algorithm of Active SSD, the present invention proposes an external sorting algorithm called IndexSort.
[0038] In one embodiment, as figure 1 As shown, an external sorting method of SSD is provided, which includes the following steps:
[0039] Step 102: Acquire the small files read into the memory, sort the small files, obtain an ordered intermediate result, and write the ordered intermediate result back into the flash memory.
[0040] Small files are obtained by dividing the large file data. Due to the limited memory space, the large fi...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more PUM
Login to view more Abstract
The invention relates to an external sorting method and device for SSDs, computer equipment and a storage medium. The method comprises the steps that small files read into a memory are obtained, the small files are ranked to obtain an ordered intermediate result, the ordered intermediate result is written back into a flash memory, and the small files are obtained by segmenting large file data; according to the minimum value of each data page in the ordered intermediate result and the position information of the data pages on the flash memory, constructing an index table in the memory of the SSD; the index table comprises index information corresponding to the position information; and during data merging, sorting the index table according to the minimum value of the data page, performing data merging according to a sorting result of the index table and the index information to obtain an ordered result, and writing the ordered result back to the flash memory. By adopting the method, the read-write multi-channel concurrency of the SSD can be improved, and the channel resource utilization rate of the SSD can be improved.
Description
technical field [0001] The present application relates to the technical field of novel non-volatile storage, and in particular, to an external sorting method and device for SSD and SSD memory. Background technique [0002] With the development of new non-volatile storage technologies, flash memory has been widely used in large-scale servers, personal mobile devices, embedded sensing devices, and high-performance computing systems. Flash memory is block-addressable persistent external memory. The smallest granularity of read and write is flash block, and the read and write granularity of new non-volatile memory is even smaller. From the perspective of flash memory types, flash memory can be divided into NAND Flash and NOR Flash. Flash-based solid state drive (SSD) is a new type of semiconductor storage device based on flash memory chips, Active SSDs is an intelligent SSD that can perform some computing functions, ActiveSort is an external sorting algorithm based on Active SS...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more Application Information
Patent Timeline
Login to view more Patent Type & Authority Applications(China)
IPC IPC(8): G06F7/24G06F3/06G06F12/0882
CPCG06F7/24G06F3/0643G06F3/0679G06F12/0882
Inventor 肖侬欧洋陈文汉刘洋
Owner NAT UNIV OF DEFENSE TECH
Who we serve
- R&D Engineer
- R&D Manager
- IP Professional
Why Eureka
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Social media
Try Eureka
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap