[NLPL Task Force (A)] rolling your own BERT (and maybe ELMo) on Saga

[Andrei Kutuzov]

27.01.2020 14:29, Stephan Oepen wrote:
>> Antti can tell about the exact GPU stuff needed. We will run the tutorial on puhti since this is a tried and tested environment for us, and we have little time to prepare, so we play it safe. But Antti can tell what it takes to run the BERT code.
> yes, if possible, i could see myself try and replicate your software
> environment on Saga ... the multi-gpu part sounds like an interesting
> new challenge :-)!
Hi all,

Well, at least TensorFlow has no problems with multi-GPU training on
Saga, works more or less out of the box.


-- 
Andrei
PhD Candidate at Language Technology Group (LTG)
University of Oslo