[NLPL Task Force (A)] rolling your own BERT (and maybe ELMo) on Saga

[Stephan Oepen]

across multiple nodes?  oe


On Mon, 27 Jan 2020 at 15:07 Andrei Kutuzov <andreku at ifi.uio.no> wrote:

> 27.01.2020 14:29, Stephan Oepen wrote:
> >> Antti can tell about the exact GPU stuff needed. We will run the
> tutorial on puhti since this is a tried and tested environment for us, and
> we have little time to prepare, so we play it safe. But Antti can tell what
> it takes to run the BERT code.
> > yes, if possible, i could see myself try and replicate your software
> > environment on Saga ... the multi-gpu part sounds like an interesting
> > new challenge :-)!
> Hi all,
>
> Well, at least TensorFlow has no problems with multi-GPU training on
> Saga, works more or less out of the box.
>
>
> --
> Andrei
> PhD Candidate at Language Technology Group (LTG)
> University of Oslo
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.nlpl.eu/archives/infrastructure/attachments/20200127/613e4978/attachment.htm>