Tek-Tips is the largest IT community on the Internet today!

Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!

  • Congratulations cowski on being selected by the Eng-Tips community for having the most helpful posts in the forums last week. Way to Go!

Dot product of large dense matrices in Python 3

Status
Not open for further replies.

AAK18

Aerospace
Joined
Jun 17, 2023
Messages
1
Location
GB
I am doing multiple operations of type A.dot(B), where A and B are dense matrices of the size of the order 10e6. What methods can I use to not run into memory issues while computing such matrices?
 
That should be transparent to you as the user, since that's a memory management task performed by the operating system, unless you've not allocated sufficient virtual memory. The only real issue is that going to SSD or HD is substantially slower than RAM. Obviously, you should populate your computer with as much RAM as it can handle for problems like this

TTFN (ta ta for now)
I can do absolutely anything. I'm an expert! faq731-376 forum1529 Entire Forum list
 
I did see that the numpy linalg package has special dot product function, looks like its made to improve calculations that include a sparse vector vs a non-sparse vector though.
 
Status
Not open for further replies.

Part and Inventory Search

Sponsor

Back
Top