[NLPL Task Force (A)] Operation not permitted?

[Stephan Oepen]

the operation that rsync(1) reported was not permitted, i believe, was
changing the owner on the ‘corpora/’ top-level directory on Taito
(which rsync(1) wanted to set to me, because i ask it to maximally
mirror permissions across the two copies).  for all i can see, that
problem is now resolved.

thanks for forwarding the CSC advice on cron(8) jobs, joerg!  i will
give that a shot then, but i worry that user cron(8) jobs will
disappear next time the node is being re-installed (which, on Abel at
least, appears to be done automatically at least several times a
year).

cheers, oe


On Mon, Sep 24, 2018 at 4:29 PM, Martin Matthiesen
<martin.matthiesen at csc.fi> wrote:
> Hello Jörg,
>
> "Operation not permitted" indicates that rsync does see the filesystem, but
> that there is an issue with permissions. I am not sure how the cron advice
> below is related to the error.
> The error is likely harmless, but it would be nice to know where it comes
> from.
>
> Martin
>
> --
> Martin Matthiesen
> CSC - Tieteen tietotekniikan keskus
> CSC - IT Center for Science
> PL 405, 02101 Espoo, Finland
> +358 9 457 2376, martin.matthiesen at csc.fi
> Public key : https://pgp.mit.edu/pks/lookup?op=get&search=0x74B12876FD890704
> Fingerprint: AA25 6F56 5C9A 8B42 009F  BA70 74B1 2876 FD89 0704
>
> ________________________________
>
> From: "Jörg Tiedemann" <jorg.tiedemann at helsinki.fi>
> To: "Stephan Oepen" <oe at ifi.uio.no>
> Cc: "Martin Matthiesen" <martin.matthiesen at csc.fi>, "infrastructure"
> <infrastructure at nlpl.eu>
> Sent: Monday, 24 September, 2018 17:13:16
> Subject: Re: [NLPL Task Force (A)] Operation not permitted?
>
>
> OPUS does not see the taito filesystem.
> But i asked about cronjobs before and got the following reply:
>
> Can I run cronjobs on taito? Yes it's possible. One needs to remember which
> server it's installed, so please use taito-login3.csc.fi or
> taito-login4.csc.fi instead of generic taito.csc.fi alias.
>
>
> Jörg
>
> ********************************************************************************************
> Jörg Tiedemann https://blogs.helsinki.fi/tiedeman/
> Language Technology https://blogs.helsinki.fi/language-technology/
> University of Helsinki
>
> On 24 Sep 2018, at 17:04, Stephan Oepen <oe at ifi.uio.no> wrote:
>
> hi martin,
>
> i am glad someone is reading those notifications :-).  the problem in
> this case was that i was not the owner of the ‘corpora/’ sub-directory
> on Taito, such that rsync(1) could not completely replicate all
> permissions.  i believe i have resolved that issue now (by acquiring
> ownership of that specific sub-directory).
>
> i have started to write down some of the essentials of our current
> approach to data replication; see:
>
> http://wiki.nlpl.eu/index.php/Infrastructure/replication
>
> martin and joerg, is there a machine that sees ‘/proj/nlpl/’ and could
> serve to run the nightly cron(8) jobs?  i would need to be able to
> login to that machine, to set up the ssh(1) keys and activate the
> crontab(5) entry.  what about the virtual machine behind the OPUS
> service, for example?  i had installed cron(8) jobs on Abel and Taito
> login nodes before the summer, but it appears these nodes are
> relatively frequently re-installed, or something else caused my
> crontab(5) entries to disappear without me noticing ...
>
> more soon!  oe
>
>
> On Mon, Sep 24, 2018 at 11:09 AM, Martin Matthiesen
> <martin.matthiesen at csc.fi> wrote:
>
> Hello Stephan,
>
> rsync failed:
>
> rsync: failed to set times on "/proj/nlpl/data/corpora/.": Operation not
> permitted (1)
>
> Is that a known issue?
>
> Martin
>
> --
> Martin Matthiesen
> CSC - Tieteen tietotekniikan keskus
> CSC - IT Center for Science
> PL 405, 02101 Espoo, Finland
> +358 9 457 2376, martin.matthiesen at csc.fi
> Public key : https://pgp.mit.edu/pks/lookup?op=get&search=0x74B12876FD890704
> Fingerprint: AA25 6F56 5C9A 8B42 009F  BA70 74B1 2876 FD89 0704
>
> ----- Forwarded Message -----
> From: "Stephan Oepen" <oe at ifi.uio.no>
> To: "infrastructure" <infrastructure at nlpl.eu>
> Sent: Monday, 24 September, 2018 12:07:22
> Subject: [NLPL Task Force (A)] data/corpora update to taito
>
> starting rsync(1) at 18-09-24 (11:07:00)
>
> opening connection using: ssh -l oe taito.csc.fi rsync --server
> -vvlHgtprze.iLs --delete . /proj/nlpl/data/corpora/
> sending incremental file list
> delta-transmission enabled
> ./
> rsync: failed to set times on "/proj/nlpl/data/corpora/.": Operation not
> permitted (1)
> total: matches=0  hash_hits=0  false_alarms=0 data=0
>
> sent 490651 bytes  received 63097 bytes  24611.02 bytes/sec
> total size is 953770764087  speedup is 1722391.35
> rsync error: some files/attrs were not transferred (see previous errors)
> (code 23) at main.c(1039) [sender=3.0.6]
>
> completed rsync(1) at 18-09-24 (11:07:22)
>
>
>
>