Affordable Access

Prevent Low-Quality Analytics by Automatic Selection of the Best-Fitting Training Data

Authors
  • Kiefer, Cornelia
  • Reimann, Peter
  • Mitschang, Bernhard
Publication Date
Jan 07, 2020
Source
Universität Stuttgart, Fakultät 5, Germany, Computer Science Archive
Keywords
Language
English
License
Unknown
External links

Abstract

Data analysis pipelines consist of a sequence of various analysis tools. Most of these tools are based on supervised machine learning techniques and thus rely on labeled training data. Selecting appropriate training data has a crucial impact on analytics quality. Yet, most of the times, domain experts who construct analysis pipelines neglect the task of selecting appropriate training data. They rely on default training data sets, e.g., since they do not know which other training data sets exist and what they are used for. Yet, default training data sets may be very different from the domain-specific input data that is to be analyzed, leading to low-quality results. Moreover, these input data sets are usually unlabeled. Thus, information on analytics quality is not measurable with evaluation metrics. Our contribution comprises a method that (1) indicates the expected quality to the domain expert while constructing the analysis pipeline, without need for labels and (2) automatically selects the best-fitting training data. It is based on a measurement of the similarity between input and training data. In our evaluation, we consider the part-of-speech tagger tool and show that Latent Semantic Analysis (LSA) and Cosine Similarity are suited as indicators for the quality of analysis results and as basis for an automatic selection of the best-fitting training data.

Report this publication

Statistics

Seen <100 times