python - Operations on huge dense matrices in numpy -


for purpose of training neural network, @ point have huge 212,243 × 2500 dense matrix phi, , vectors y (212243) , w (2500), stored numpy arrays of doubles. i'm trying compute is

w = dot(pinv(phi), y) # serialize w... r = dot(w, transpose(phi)) # serialize r...

my machine has 6 gb of ram , 16 gb of swap on ubuntu x64. started computation twice , twice has ended system (not python) swap errors after hour of work.

is there way perform computation on computer? doesn't need done python.

if don't need pseudoinverse else computing w, replace line with:

w = np.linalg.lstsq(phi, y)[0]

on system runs 2x faster, , uses half intermediate storage.


Comments

Post a Comment

Popular posts from this blog

java - Cast from Object to List<String>: CastClassException -

i'm using touchdb ektorp in android app access couchdb the json document i'm accessing has array of categories: categories: ['cat1', 'cat2'] in view query i'm trying access array classcastexception when trying convert result object list: public void map(map<string, object> document, tdviewmapemitblock emitter) { object dateadded = document.get("dateadded"); object expirydate = document.get("expirydate"); boolean expired = false; if(expirydate!=null){ expired = comparedate.isitemexpired(expirydate); } list<string> test = (list<string>)document.get("categories"); the .get() method works fine single json fields. ideas? document declared map<string, object> so when .get() - return object. there's no direct mapping (list<string>) exception saying need cast object rather list. you ch...
Read more

How to set a border for android Imageview in Longpress? -

in android application want set border imageview when long pressed. want remove same(border) when user releases view. please anyone, me in this? @override public boolean ontouchevent(motionevent event) { switch (event.getaction()) { case motionevent.action_down: { mtouchdownx = (int) event.getx(); mtouchdowny = (int) event.gety(); break; } case motionevent.action_move: { int x = (int) event.getx(); int y = (int) event.gety(); if (mdraggeditem >= 0) { setdraggeditemposition(x, y); int index = getindexfromcoordinates(x, y); if (index == mdraggeditem || index < 0) break; if (index < mdraggeditem) { (int = index; < mdraggeditem; i++) { moveviewtoposition(i, i+1); } (int = mdraggeditem-1; >= index; i--) { ...
Read more

c# - Operator '==' incompatible with operand types 'Guid' and 'Guid' using DynamicExpression.ParseLambda<T, bool> -

i'm using dynamic linq library , there source code , basic docu , nuget version pm> install-package dynamiclinq i'm trying construct clause involves guids i have tried string "id == @0" . parameter array object[] value ( guid xxxx ) var whereclausesb = buildlogicalkeywhereclause2(entity, logicalkey); //build string var parms = buildparamarray(entity, logicalkey); // object[] var wherelambda = ofsi.bos.core.dynamicexpression.parselambda<t, bool>(whereclausesb.tostring(),parms); //parse an exception thrown in dynamicexpression.parselambda operator '==' incompatible operand types 'guid' , 'guid' i have tried guid , string.(fail) i tried , "id = @0" (fail). string == string works, int32==int32 not guid == guid not any ideas? try using equals method instead of == operator in string: "id.equals(@0)"
Read more