[mrp-users] initial scoring software; closing date for white-listing additional resources

Stephan Oepen oe at ifi.uio.no
Mon Jun 3 22:57:25 CEST 2019


dear colleagues,

a quick note to announce an initial release of the support software
for the MRP 2019 shared task, which above all provides a first
implementation of common graph similarity metrics, viz.:

EDM: for EDS graphs
SDP: for DM and PSD graphs
SMATCH: for AMR graphs
UCCA: for UCCA graphs

we hope you will find the scorer useful in system development, and we
expect to continue to improve this software over the next couple of
weeks.  in particular, we are currently working to implement a
generalization of the above framework-specific metrics that is
well-defined and applicable across different graph flavors and
frameworks.

to enable community involvement in developing this tool further, we
are hosting it on Microsoft GitHub:

  https://github.com/cfmrp/mtool

please use the full GitHub suite of services to give feedback and
suggest improvements to the software, for example filing issues in the
repository or submitting pull requests.

also, please remember that today is the closing date for nominating
additional third-party data or models to ‘white-list’ for legitimate
use in system development.  the list has grown considerably this past
week, thanks to many of you who have sent suggestions:

  http://svn.nlpl.eu/mrp/2019/public/resources.txt

best wishes, oe



More information about the mrp-users mailing list