This software abstracts large matrices that won't fit in memory.
Microarray::DataMatrix::BigDataMatrix is a software package designed to abstractly handle large matrices of data that would not fit into memory. This software offers an abstract class called bigDataMatrix that serves as an abstraction layer for handling such large matrices. It is not intended to be subclassed by concrete subclasses. Instead, the subclass anySizeDataMatrix provides the opportunity to create concrete subclasses that offer abstractions for data matrices stored in specific file formats, such as pcl files.
The overall logic of the software is to keep track of valid rows and columns as new filters or transformations are applied to data. In doing so, temp files are created to contain the results of these operations. bigDataMatrix then keeps track of which rows and columns are valid in the latest temp file, as well as the original file that was used for object construction. This information is used to map the appropriate meta data to each row and column.
When it is time to save data to disk, bigDataMatrix is able to instruct a concrete subclass about the original index of a row or column. This information helps the concrete subclass print out the appropriate meta data. Overall, Microarray::DataMatrix::BigDataMatrix offers an efficient and reliable software solution for managing large matrices of data that cannot be stored in memory.
The overall logic of the software is to keep track of valid rows and columns as new filters or transformations are applied to data. In doing so, temp files are created to contain the results of these operations. bigDataMatrix then keeps track of which rows and columns are valid in the latest temp file, as well as the original file that was used for object construction. This information is used to map the appropriate meta data to each row and column.
When it is time to save data to disk, bigDataMatrix is able to instruct a concrete subclass about the original index of a row or column. This information helps the concrete subclass print out the appropriate meta data. Overall, Microarray::DataMatrix::BigDataMatrix offers an efficient and reliable software solution for managing large matrices of data that cannot be stored in memory.
What's New
Version 0.11: N/A