[NLPL Task Force (A)] early feedback

Asad Sayeed asayeed at mbl.ca
Wed Oct 3 22:55:17 UTC 2018


Hi,

I've started trying to use the cluster.  It's great but my current task 
seems to be impossible there, so I am running it for longer on local 
machines.  The most recent issue is that I wanted to run a neural 
semantic role labeller that requires a recent tensorflow that runs on 
python2.7.  I was only able to find a tensorflow that runs on python3, 
and my attempts to use a singularity container failed on abel even when 
I tried to package the container on my local system with the same 
singularity version that is on abel.  Also virtualenv and user-level 
package install did not work for me because of an incompatible glibc 
library. Would there be any chance of getting a tensorflow for python2.7 
working on abel, along with tensorflow_hub?

The purpose is to perform SRL on about 10 million sentences, which 
should take a day if I can run 400 processes with 10GB memory each (to 
hold glove vectors).  I may in the future have even larger SRL-related 
tasks.

Yours,
--Asad.




More information about the infrastructure mailing list