[mrp-users] moving towards the evaluation period

[Stephan Oepen]

dear colleagues,

another week has passed since our last public email, and the
evaluation period for the cross-framework meaning representation
parsing task is approaching fast..

(0) we are still receiving new subscription requests to this mailing
list, hence would like to remind everyone that previous postings are
available from the public list archives:

http://lists.nlpl.eu/mailman/private/mrp-organizers/

(1) the task web pages now include additional information on the
evaluation period and instructions for how to access the on-line
registration and submission interface on CodaLab:

http://mrp.nlpl.eu/index.php?page=6

please note that for each team at least one participant needs to
create a user account on CodaLab and register for the task (or
‘competition’ in CodaLab terms).  the MRP evaluation data will be
distributed via the LDC, to teams who have previously obtained a
no-cost evaluation license from the LDC.  to avoid last-minute delays
or technical problems, please make sure to (a) obtain the data and (b)
register on CodaLab at the start of the evaluation period, i.e. early
next week.

(2) over the past several days, we have made several enhancements to
the MRP support software, including bug fixes and efficiency
improvements in the scorer and validator.  we are grateful to everyone
who has given feedback or made suggestions for revisions.  please make
sure to obtain the latest version as of today, and please continue to
monitor the mtool repository on Microsoft GitHub for further
development:

https://github.com/cfmrp/mtool

(3) we would like to kindly remind everyone of the ‘closed track’
interpretation of the task: in system development, training, and
tuning, only the (training and companion) data provided directly from
the task co-organizers can be used, as well as those resources
explicitly white-listed for the task:

http://svn.nlpl.eu/mrp/2019/public/resources.txt

no other data or pre-trained models must be used while preparing your
system submissions.

once again, please do not hesitate to contact us with any
clarification requests or suggestions you might have!

stephan oepen, omri abend, jan hajič, daniel hershcovich,
marco kuhlmann, tim o'gorman, and nianwen xue