Dot product of large dense matrices in Python 3

Question

Dot product of large dense matrices in Python 3

AAK18 (Aerospace)

(OP)

17 Jun 23 15:19

I am doing multiple operations of type A.dot(B), where A and B are dense matrices of the size of the order 10e6. What methods can I use to not run into memory issues while computing such matrices?

IRstuff (Aerospace) · Answer 1 · 2023-06-17 20:16:09

That should be transparent to you as the user, since that's a memory management task performed by the operating system, unless you've not allocated sufficient virtual memory. The only real issue is that going to SSD or HD is substantially slower than RAM. Obviously, you should populate your computer with as much RAM as it can handle for problems like this

TTFN (ta ta for now)
I can do absolutely anything. I'm an expert! https://www.youtube.com/watch?v=BKorP55Aqvg
FAQ731-376: Eng-Tips.com Forum Policies forum1529: Translation Assistance for Engineers Entire Forum list http://www.eng-tips.com/forumlist.cfm

driftLimiter (Structural) · Answer 2 · 2023-06-20 17:49:18

I did see that the numpy linalg package has special dot product function, looks like its made to improve calculations that include a sparse vector vs a non-sparse vector though.

MintJulep (Mechanical) · Answer 3 · 2023-06-22 01:05:22

Interesting discussion here:

https://stackoverflow.com/questions/25046076/pytho...

Come Join Us!

Posting Guidelines

Dot product of large dense matrices in Python 3