阅读背景:

适用于numpy的大型磁盘阵列

来源:互联网 

I have a sparse array that seems to be too large to handel effectively in memory (2000x2500000, float). I can form it into a sparse lil_array (scipy) but if I try output a column or row compressed sparse array (A.tocsc(), A.tocsr()) my machine runs out of memory (and there's also a serious mismatch between the data in a text file 4.4G and the pickeled lil array 12G - it would be nice to have a disk format that more closely approximates the raw data size).I have a sparse array that seems to be too larg




你的当前访问异常,请进行认证后继续阅读剩余内容。

分享到: