[NLPL Task Force (A)] Support request

[Stephan Oepen]

> RuntimeError: "mul_cpu" not implemented for ‘Half'

that sounds a bit like PyTorch when running on cpu?

https://github.com/pytorch/pytorch/issues/36318

but, either way, it almost seems that FP16 support requires more
modern gpus than what is available on Saga?

https://fairseq.readthedocs.io/en/latest/getting_started.html#training-with-half-precision-floating-point-fp16

> Tensorboard is also missing from nlpl-fairseq, so I do have to use my own virtualenv in addition to the module. I’ve attached my slurm file in case you notice any obvious issues.

i will look into providing tensorboard as a stand-alone module; i
understand it can be combined with either TensorFlow or PyTorch,
right?

cheers, oe