[NLPL Task Force (A)] /proj/nlpl/modules/ on Taito
Stephan Oepen
oe at ifi.uio.no
Tue Sep 25 12:14:27 UTC 2018
> Just to make sure that I know what is happing to OPUS data:
> - the entire /proj/nlpl/data/OPUS is now synced with abel?
> - all of it is now also backed up to NIRD (in 2 places?)
only the latter is done to date: complete daily copies of the full
project directories on Abel and Taito to NIRD.
so far, there is no automated replication (of OPUS) from Taito to
Abel. disk space used to hold us back, and probably still does. i
managed to get one extra terabyte from USIT last week, which was
necessary to replicate ‘data/corpora/’ and increase the vectors
repository. they signaled we could ask for a little more later this
fall, as people are moving away from Abel ...
can you estimate how much space would be required for replicating OPUS
on Abel? are there parts that could be omitted, because they are not
so regularly needed? if we move towards more parallelism, including
NMT installations on Abel, i suppose OPUS would be a natural part of
that, right?
oe
More information about the infrastructure
mailing list