[NLPL Task Force (A)] rolling your own BERT (and maybe ELMo) on Saga

[Stephan Oepen]

> Ah, the program changed, last time I heard we had 60min, now it is 80. Surely we can try squeeze Andrei in, welcome on board!

not sure about that change, i think joakim has had you down for 80
minutes for at least the past week or two :-).  so, maybe a good thing
andrey will cover twenty of those!

i have posted the three of you on the wiki page for the winter school
(which i am about to point registered participants to later today).

> Antti can tell about the exact GPU stuff needed. We will run the tutorial on puhti since this is a tried and tested environment for us, and we have little time to prepare, so we play it safe. But Antti can tell what it takes to run the BERT code.

yes, if possible, i could see myself try and replicate your software
environment on Saga ... the multi-gpu part sounds like an interesting
new challenge :-)!

all best, oe