輔助建立混合性系統之自然語言處理系統深度評估平台──以評估依存關係分析器為例

The Platform providing NLP System Deep Comparative Evaluation and Auxiliary Information for Hybrid NLP System Building: Trial on Dependency Parser Evaluation

本平台包含兩大概念。 一， 提供自然語言處理（NLP）系統（如Syntaxnet或CoreNLP）的多面向且深度的衡量，以期協助系統使用者挑選適合其需求的最佳系統。 二，獨立地評量單一NLP階段（如詞性標注或依存關係分析），以提供在組建比一般的系統表現更好的混合型NLP系統（不同的階段使用不同的NLP系統）時，所需的輔助資訊。 本論文將圍繞此兩個目標展開說明和展示。

This platform includes two main concepts. One, provide multifaceted and deep evaluation for users of Natural Language Processing (NLP) System (such as Syntaxnet or CoreNLP), to help them choose the best one for their needs. Two, independently evaluate single NLP stage of a NLP system (such as pos tagging or dependency parsing), to provide needed auxiliary information for building up a hybrid NLP system (NLP system which composes multiple NLP system for different NLP stages) which is better than a normal NLP system. This paper will be explanation and demonstration centered on these two goals.