[NLPL Task Force (A)] [NLPL Board] Statistics NLPL

Stephan Oepen oe at ifi.uio.no
Fri Feb 22 12:28:08 UTC 2019


hi again, martin,

regarding allocations on Taito, i feel we should separate the ‘general’
NLPL project (for which i am the principal investigator) from actual
computation by project members at UiO.  the former project (2000582,
‘NeIC-NLPL’) is what we use to control write access to the project
directory.  i would actually prefer to tighten access control a little, so
as to reduce the risk of someone doing something by accident (e.g. a ‘pip
install’ might end up dropping or updating add-on wheels into our shared
modules below ‘/proj/nlpl/’).  to be able to do that, i would like to ask
for a separate project on Taito for computing by UiO users (and associates,
alright, for the time being :-).  is project creation something you could
initiate for us?  as for naming, my suggestion would be to start
streamlining a little, i.e. use something like ‘NLPL: University of Oslo’
for our computing project (i am inclined to not include NeIC in the name,
as NLPL is now headed for independence :-).  and while we are at it, would
it be feasible to rename some of the existing projects, e.g.

2000509: NLPL: Uppsala University
2000582: NLPL: Project Directory
2000661: NLPL: University of Helsinki
2000989: NLPL: University of Copenhagen
2001006: NLPL: IT University of Copenhagen

best wishes, und schoenes wochenende!  oe


On Fri, Jan 11, 2019 at 10:36 AM Martin Matthiesen <martin.matthiesen at csc.fi>
wrote:

> Hallo Stephan,
>
> ------------------------------
>
> *From: *"Stephan Oepen" <oe at ifi.uio.no>
> *To: *"Martin Matthiesen" <martin.matthiesen at csc.fi>
> *Sent: *Friday, 11 January, 2019 00:25:19
> *Subject: *Re: [NLPL Task Force (A)] [NLPL Board] Statistics NLPL
>
> wow, danke!  ich werde die analogie tabelle für Abel erstellen.
>
> aber was ist mit meinen leuten, farhad und eivind?  auf welchem projekt
> rechnen die bisher?  was soll ich tun, um ein projekt für UiO zu kriegen
> (unabhängig von den gruppe mit schreibrecht in /proj/nlpl/)?
>
> Du hast doch breits eins:
>
> IdProjectPrincipal InvestigatorActive Users 2017Units 2017Active Users
> 2018Units 2018Users 2019Units 2019
> 2000582 Neic-NLPL Stephan Oepen - - 3 62298
>
>
> (Ich habe gerade bermerkt, das der Projektcode ein Cut&Paste-Fehler war,
> repariert:
> http://wiki.nlpl.eu/index.php?title=Infrastructure%2Fresources&diff=548&oldid=547
> )
>
> Und genau dort rechnen Deine Leute auch (Robert ist der 3.):
>
> Stephan Oepen: 2000582(project_2000582, 22.03.2017-22.03.2019): NeIC-NLPL
>     Quota:610000     members:10     discipline:Tietojenkäsittely ja
> informaatiotieteet(Computer and information sciences)
>     Cost object code:
>     Description: Nordic Language Processing Laboratory (NLPL)
>     Project DN in LDAP:
> CN=Project_2000582,OU=Academic,OU=External,OU=Projects,ou=idm,dc=csc,dc=fi
>     Members:
>         oe(Stephan Oepen, oe at ifi.uio.no)
>         farhadno(Farhad Nooralahzadeh, farhadno at ifi.uio.no)
>         andreku(Andrey Kutuzov, andreku at ifi.uio.no)
>         tiedeman(Jörg Tiedemann, jorg.tiedemann at helsinki.fi)
>         yvessche(Yves Scherrer, yves.scherrer at helsinki.fi)
>         ginter(Filip Ginter, ginter at cs.utu.fi)
>         jmnybl(Jenna Kanerva, jmnybl at utu.fi)
>         ramatara(Taraka Rama, tarakark at ifi.uio.no)
>         rostling(Robert Östling, robert at ling.su.se)
>         eibergem(Bergem Eivind Alexander, eivinabe at ifi.uio.no)
>
>
> gute nacht :-).  oe
>
> Danke, bei uns ist es ja eine Stunde später :)
>
> Martin
>
>
>
> On Thu, 10 Jan 2019 at 13:39 Martin Matthiesen <martin.matthiesen at csc.fi>
> wrote:
>
>> Hi Stephan and all,
>>
>> I now compiled the list and it looks indeed quite impressive, I must say:
>>
>>
>> http://wiki.nlpl.eu/index.php/Infrastructure/resources#Taito_Usage_Statistics
>>
>> We almost doubled the active users on Taito and increased the billing
>> unit usage by 50%.
>>
>> Unfortunately there was quite a bit of cut and paste involved, so I hope
>> I got the numbers right, we should run them past the involved parties.
>>
>> Martin
>>
>> --
>> Martin Matthiesen
>> CSC - Tieteen tietotekniikan keskus
>> CSC - IT Center for Science
>> PL 405, 02101 Espoo, Finland
>> +358 9 457 2376, martin.matthiesen at csc.fi
>> Public key :
>> https://pgp.mit.edu/pks/lookup?op=get&search=0x74B12876FD890704
>> Fingerprint: AA25 6F56 5C9A 8B42 009F  BA70 74B1 2876 FD89 0704
>>
>> ----- Original Message -----
>> > From: "Martin Matthiesen" <martin.matthiesen at csc.fi>
>> > To: "Stephan Oepen" <oe at ifi.uio.no>
>> > Cc: "infrastructure" <infrastructure at nlpl.eu>
>> > Sent: Thursday, 10 January, 2019 10:42:48
>> > Subject: Re: [NLPL Task Force (A)] [NLPL Board] Statistics NLPL
>>
>> > Hi Stephan,
>> >
>> > I'll look into this later today, it is very possible that some projects
>> fell
>> > under the radar.
>> >
>> > Martin
>> >
>> > --
>> > Martin Matthiesen
>> > CSC - Tieteen tietotekniikan keskus
>> > CSC - IT Center for Science
>> > PL 405, 02101 Espoo, Finland
>> > +358 9 457 2376, martin.matthiesen at csc.fi
>> > Public key :
>> https://pgp.mit.edu/pks/lookup?op=get&search=0x74B12876FD890704
>> > Fingerprint: AA25 6F56 5C9A 8B42 009F  BA70 74B1 2876 FD89 0704
>> >
>> > ----- Original Message -----
>> >> From: "Stephan Oepen" <oe at ifi.uio.no>
>> >> To: "Martin Matthiesen" <martin.matthiesen at csc.fi>
>> >> Cc: "infrastructure" <infrastructure at nlpl.eu>
>> >> Sent: Wednesday, 9 January, 2019 15:32:06
>> >> Subject: Re: [NLPL Board] Statistics NLPL
>> >
>> >> hi martin,
>> >>
>> >> i feel it will be good for us to document HPC usage by NLPL
>> >> researchers better.  among others things, this will help, i hope, to
>> >> argue with the national providers for continued resource sharing past
>> >> the current NLPL project duration.
>> >>
>> >> your message below is the closes i can find to a year-end summary for
>> >> 2017, but truth be told i am still unsure how to extract the total
>> >> number of billing units used per year from that statistics?  could you
>> >> help provide those year totals, for both 2017 and 2018?
>> >>
>> >> i have started a summary table here:
>> >>
>> >>
>> http://wiki.nlpl.eu/index.php/Infrastructure/resources#Taito_Usage_Statistics
>> >>
>> >> also, i feel we are missing a few projects, e.g. for the university of
>> >> copenhagen (anders) and ITU copenhagen (leon)?  and what about the UiO
>> >> users, e.g. farhad and eivind?  i assume that a separate UiO project
>> >> had been created under the NLPL umbrella (in addition to project
>> >> 2000582, which is what we use solely to administer file and directory
>> >> permissions)?  but i am not seeing such a project in my project owner
>> >> summary on ‘sui.csc.fi’.
>> >>
>> >> with thanks in advance, oe
>> >>
>> >>
>> >> On Mon, Feb 26, 2018 at 12:26 PM Martin Matthiesen
>> >> <martin.matthiesen at csc.fi> wrote:
>> >>>
>> >>> Hello,
>> >>>
>> >>> Here the current stats of 26.2.18 with Jörg's and Filips projects.
>> For technical
>> >>> reasons the two lists (Projects/Quota Details) overlap a bit in
>> information.
>> >>> Let me know if only one is enough.
>> >>>
>> >>> Regards,
>> >>> Martin
>> >>>
>> >>> Projects:
>> >>>
>> >>> Joakim Nivre: 2000509(project_2000509, 04.01.2017-31.12.2019): Deep
>> learning for
>> >>> Natural Language Processing (NeIC-NLPL)
>> >>>         Quota:644901     members:10
>> discipline:Kielitieteet(Languages)
>> >>> Stephan Oepen: 2000582(project_2000582, 22.03.2017-22.03.2019):
>> NeIC-NLPL
>> >>>         Quota:10000      members:11      discipline:Tietojenkäsittely
>> ja
>> >>>         informaatiotieteet(Computer and information sciences)
>> >>> Jörg Tiedemann: 2000661(project_2000661, 09.06.2017-09.06.2018):
>> NLPL-OPUS
>> >>>         Quota:280901     members:2
>>  discipline:Kielitieteet(Languages)
>> >>> Bjorn Lindi: 2000760(project_2000760, 09.10.2017-09.10.2019): Nordic
>> Language
>> >>> Processing Lab (NLPL)
>> >>>         Quota:10000      members:1
>>  discipline:Kielitieteet(Languages)
>> >>> Jörg Tiedemann: 2000288(project_2000288, 29.03.2016-29.03.2017): BAULT
>> >>>         Quota:9008       members:8
>>  discipline:Kielitieteet(Languages)
>> >>> Jörg Tiedemann: 2000309(project_2000309, 28.04.2016-28.04.2019):
>> CrossNLP
>> >>>         Quota:470087     members:14      discipline:Muu
>> tekniikka(Other engineering and
>> >>>         technologies)
>> >>> Filip Ginter: tuy4622(textdat, 07.04.2005-15.03.2019): Textual Data
>> Mining for
>> >>> Bioinformation Management
>> >>>         Quota:291203     members:10
>> discipline:Biotieteet(Biological sciences)
>> >>> Filip Ginter: 2000391(project_2000391, 23.08.2016-10.01.2019):
>> TurkuNLP EDU
>> >>>         Quota:101324     members:2       discipline:Tietojenkäsittely
>> ja
>> >>>         informaatiotieteet(Computer and information sciences)
>> >>>
>> >>> Quota details:
>> >>>
>> >>> Project 2000509  Deep learning for Natural Language Processing
>> (NeIC-NLPL)
>> >>> Joakim Nivre
>> >>> start 04.01.2017      end: 31.12.2019       budget: 30.08.2017
>> >>> CSC budget: 644901    used: 28978           remain: 615923
>> >>> -----------------------------------------------------------------
>> >>> Project 2000582  NeIC-NLPL Stephan Oepen
>> >>> start 22.03.2017      end: 22.03.2019       budget: 22.03.2017
>> >>> CSC budget: 10000     used: 0               remain: 10000
>> >>> -----------------------------------------------------------------
>> >>> Project 2000661  NLPL-OPUS Jörg Tiedemann
>> >>> start 09.06.2017      end: 09.06.2018       budget: 14.12.2017
>> >>> CSC budget: 280901    used: 35946           remain: 244955
>> >>> -----------------------------------------------------------------
>> >>> Project 2000760  Nordic Language Processing Lab (NLPL) Bjorn Lindi
>> >>> start 09.10.2017      end: 09.10.2019       budget: 09.10.2017
>> >>> CSC budget: 10000     used: 0               remain: 10000
>> >>> -----------------------------------------------------------------
>> >>> Project 2000288  BAULT Jörg Tiedemann
>> >>> start 29.03.2016      end: 29.03.2017       budget: 29.03.2016
>> >>> CSC budget: 9008      used: 7089            remain: 1919
>> >>> -----------------------------------------------------------------
>> >>> Project 2000309  CrossNLP Jörg Tiedemann
>> >>> start 28.04.2016      end: 28.04.2019       budget: 21.02.2018
>> >>> CSC budget: 470087    used: 196167          remain: 273920
>> >>> -----------------------------------------------------------------
>> >>> Project 2000391  TurkuNLP EDU Filip Ginter
>> >>> start 23.08.2016      end: 10.01.2019       budget: 10.01.2018
>> >>> CSC budget: 101324    used: 26961           remain: 74363
>> >>> -----------------------------------------------------------------
>> >>> Project tuy4622  Textual Data Mining for Bioinformation Management
>> Filip Ginter
>> >>> start 07.04.2005      end: 15.03.2019       budget: 19.02.2018
>> >>> CSC budget: 291203    used: 99657           remain: 191546
>> >>> -----------------------------------------------------------------
>> >>>
>> >>>
>> >>> --
>> >>> Martin Matthiesen
>> >>> CSC - Tieteen tietotekniikan keskus
>> >>> CSC - IT Center for Science
>> >>> PL 405, 02101 Espoo, Finland
>> >>> +358 9 457 2376, martin.matthiesen at csc.fi
>> >>> Public key :
>> https://pgp.mit.edu/pks/lookup?op=get&search=0x74B12876FD890704
>> >>> Fingerprint: AA25 6F56 5C9A 8B42 009F  BA70 74B1 2876 FD89 0704
>> >>>
>> >>> ----- Original Message -----
>> >>> > From: "Jörg Tiedemann" <jorg.tiedemann at helsinki.fi>
>> >>> > To: "Stephan Oepen" <oe at ifi.uio.no>
>> >>> > Cc: "Martin Matthiesen" <martin.matthiesen at csc.fi>, "board" <
>> board at nlpl.eu>
>> >>> > Sent: Friday, 23 February, 2018 21:58:25
>> >>> > Subject: Re: [NLPL Board] Statistics NLPL
>> >>>
>> >>> > Just a note: I already had to extend the NLPL-OPUS project once
>> last year
>> >>> > because I was running out of the initial hours.
>> >>> >
>> >>> > Jörg
>> >>> >
>> >>> >> On 23 Feb 2018, at 20.48, Stephan Oepen <oe at ifi.uio.no> wrote:
>> >>> >>
>> >>> >> many thanks, martin!
>> >>> >>
>> >>> >> to complement the NLPL-specific numbers, i think it would also be
>> >>> >> valid to consider the usage of joerg and filip on their non-NLPL
>> >>> >> projects (and likewise for our group in oslo on Abel).  unless
>> joerg
>> >>> >> or filip object, could you pull out those additional numbers too?
>> >>> >>
>> >>> >> seeing as we are far from using up our NLPL allocations, arguably
>> we
>> >>> >> should all charge all our computing to NLPL accounts?
>> >>> >>
>> >>> >> best, oe
>> >>> >>
>> >>> >>
>> >>> >> On Fri, Feb 23, 2018 at 8:42 PM, Martin Matthiesen
>> >>> >> <martin.matthiesen at csc.fi> wrote:
>> >>> >>> Hello,
>> >>> >>>
>> >>> >>> It seems these statistics were never sent and kept in my drafts
>> folder. This
>> >>> >>> reflects the situation in January of the NLPL Project at CSC.
>> >>> >>>
>> >>> >>> Have a nice weekend!
>> >>> >>> Martin
>> >>> >>>
>> >>> >>>
>> >>> >>>
>> >>> >>> "Projects:"
>> >>> >>>
>> >>> >>> Joakim Nivre: 2000509(project_2000509, 04.01.2017-31.12.2019):
>> Deep learning for
>> >>> >>> Natural Language Processing (NeIC-NLPL)
>> >>> >>>        Quota:644901     members:10
>> discipline:Kielitieteet(Languages)
>> >>> >>> Stephan Oepen: 2000582(project_2000582, 22.03.2017-22.03.2019):
>> NeIC-NLPL
>> >>> >>>        Quota:10000      members:11
>> discipline:Tietojenkäsittely ja
>> >>> >>>        informaatiotieteet(Computer and information sciences)
>> >>> >>> Jörg Tiedemann: 2000661(project_2000661, 09.06.2017-09.06.2018):
>> NLPL-OPUS
>> >>> >>>        Quota:280901     members:2
>>  discipline:Kielitieteet(Languages)
>> >>> >>> Bjorn Lindi: 2000760(project_2000760, 09.10.2017-09.10.2019):
>> Nordic Language
>> >>> >>> Processing Lab (NLPL)
>> >>> >>>        Quota:10000      members:1
>>  discipline:Kielitieteet(Languages)
>> >>> >>>
>> >>> >>> These are stats from 1.1.2018:
>> >>> >>>
>> >>> >>> Project 2000509  Deep learning for Natural Language Processing
>> (NeIC-NLPL)
>> >>> >>> Joakim Nivre
>> >>> >>> start 04.01.2017      end: 31.12.2019       budget: 30.08.2017
>> >>> >>> CSC budget: 644901    used: 14379           remain: 630522
>> >>> >>> -----------------------------------------------------------------
>> >>> >>> Project 2000582  NeIC-NLPL Stephan Oepen
>> >>> >>> start 22.03.2017      end: 22.03.2019       budget: 22.03.2017
>> >>> >>> CSC budget: 10000     used: 0               remain: 10000
>> >>> >>> -----------------------------------------------------------------
>> >>> >>> Project 2000661  NLPL-OPUS Jörg Tiedemann
>> >>> >>> start 09.06.2017      end: 09.06.2018       budget: 14.12.2017
>> >>> >>> CSC budget: 280901    used: 18624           remain: 262277
>> >>> >>> -----------------------------------------------------------------
>> >>> >>> Project 2000760  Nordic Language Processing Lab (NLPL) Bjorn Lindi
>> >>> >>> start 09.10.2017      end: 09.10.2019       budget: 09.10.2017
>> >>> >>> CSC budget: 10000     used: 0               remain: 10000
>> >>> >>> -----------------------------------------------------------------
>> >>> >>>
>> >>> >>>
>> >>> >>>
>> >>> >>>
>> >>> >>> --
>> >>> >>> Martin Matthiesen
>> >>> >>> CSC - Tieteen tietotekniikan keskus
>> >>> >>> CSC - IT Center for Science
>> >>> >>> PL 405, 02101 Espoo, Finland
>> >>> >>> +358 9 457 2376, martin.matthiesen at csc.fi
>> >>> >>> Public key :
>> https://pgp.mit.edu/pks/lookup?op=get&search=0x74B12876FD890704
>> >>> >>> Fingerprint: AA25 6F56 5C9A 8B42 009F  BA70 74B1 2876 FD89 0704
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.nlpl.eu/archives/infrastructure/attachments/20190222/424c2d3f/attachment.htm>


More information about the infrastructure mailing list