<div dir="ltr"><div>Dear EPE 2018 organisers,</div><div><br></div><div>I have just learned that our UniMelb submission for EPE 2018 used illegitimate training data. </div><div><br></div><div>I was not aware of the restriction of using only English UD treebanks. </div><div><br></div><div>From your (previous) email, I initially thought that participating teams could use any treebank available for English (i.e., similar to EPE 2017):</div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">On Fri, Jul 6, 2018 at 11:54 AM, Stephan Oepen <<a href="mailto:oe@ifi.uio.no" target="_blank">oe@ifi.uio.no</a>> wrote:<br><br>><br>> furthermore, it appears that some teams struggle with the unusual<br>> ‘tcode’ values in the EPE data set (which does not correspond to one<br>> of the english UD treebanks, meaning that <b>teams are free to decide<br>> freely on which of the available treebanks to train)</b>, or maybe also<br>> stumble over the missing ‘goldfile’ entries in our ‘metadata.json’.<br>> in case any of these throw up your scripts from the core parsing task,<br>> please use the public EPE trial data (available on TIRA) to debug, so<br>> that you can easily inspect system behavior.<br>><br><br></blockquote><div><br></div><div>It was my mistake for not carefully double-checking the EPE website. </div><div><br></div><div>I understand that our UniMelb submission scores are likely not officially ranked. So in this email I would like to ask you that whether our scores will be mentioned in the EPE overview paper ? </div><div>(i.e. will there be any option for unofficial rank in the overview paper?)</div><div><br></div><div>I completed camera ready version for our CoNLL 2018 shared task paper (as in the attachment file), including our EPE scores with a comparison analysis to the EPE 2017 Stanford-Paris system (for which I followed the data used by this system).</div><div><br></div><div>Your response will help me to decide: either removing the EPE 2018 section in our shared task paper in case our UniMelb scores not mentioned in the overview paper, or modifying this section to mention an unofficial rank.</div><div><br></div><div>Thank you very much.</div><div><br></div><div>Best regards,</div><div><br></div><div>Dat Quoc Nguyen<br></div><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div dir="ltr"><div>Research Fellow</div><div>School of Computing and Information Systems</div><div>The University of Melbourne</div><div><a href="https://datquocnguyen.github.io" target="_blank">https://people.eng.unimelb.edu.au/dqnguyen</a></div></div></div></div></div></div><div dir="ltr"><div class="gmail_quote"><div><br></div></div></div></div>