[NLPL Task Force (A)] early feedback
Asad Sayeed
asayeed at mbl.ca
Wed Oct 3 22:55:17 UTC 2018
Hi,
I've started trying to use the cluster. It's great but my current task
seems to be impossible there, so I am running it for longer on local
machines. The most recent issue is that I wanted to run a neural
semantic role labeller that requires a recent tensorflow that runs on
python2.7. I was only able to find a tensorflow that runs on python3,
and my attempts to use a singularity container failed on abel even when
I tried to package the container on my local system with the same
singularity version that is on abel. Also virtualenv and user-level
package install did not work for me because of an incompatible glibc
library. Would there be any chance of getting a tensorflow for python2.7
working on abel, along with tensorflow_hub?
The purpose is to perform SRL on about 10 million sentences, which
should take a day if I can run 400 processes with 10GB memory each (to
hold glove vectors). I may in the future have even larger SRL-related
tasks.
Yours,
--Asad.
More information about the infrastructure
mailing list