[NLPL Task Force (A)] OpenNMT installation for NLPL (on Abel)

Stephan Oepen oe at ifi.uio.no
Wed Sep 26 20:10:12 UTC 2018


hi again,

> i actually had a go at my own glibc and PyTorch installations on Taito, but
> so far gpu support is evasive.

actually, with a little more tinkering, i now believe i might have a
working installation of PyTorch 0.4.1 and OpenNMT-py 0.2.1 on Taito
too, seemingly functional on both cpu and gpu nodes:

[oe at taito-login4 ~]$ module purge
[oe at taito-login4 ~]$ module load nlpl-opennmt-py
Loading application python-3.5.3 environment with needed modules
[oe at taito-login4 ~]$ module list

Currently Loaded Modules:
  1) gcc/5.4.0   2) intelmpi/5.1.3   3) mkl/11.3.2   4) python/3.5.3
5) python-env/3.5.3   6) nlpl-pytorch/0.4.1   7) nlpl-opennmt-py/0.2.1

[oe at taito-login4 ~]$ type -all python
python is /proj/nlpl/software/opennmt-py/0.2.1/bin/python
python is /proj/nlpl/software/pytorch/0.4.1/bin/python
python is /appl/opt/python/3.5.3-gnu540/bin/python
python is /usr/bin/python
[oe at taito-login4 ~]$ python -c "import torch; import onmt;
print(torch.cuda.is_available());"
False

[oe at taito-login4 ~]$ srun -n 1 -p gputest --gres=gpu:k80:1 --mem 1G -t
15 --pty \
  python -c "import torch; import onmt; print(torch.cuda.is_available());"
True

—yves (or joerg), i would have a hard time testing things in much more
depth.  any chance you would have some time to try and replicate the
validation steps your are currently running on Abel on Taito too?

with a sense of accomplishment :-), oe




More information about the infrastructure mailing list