OutlierFlag: A Tool for Scientific Data Quality Control by Outlier Data Flagging

Authors

  • Shuai Huang Northwest University; Chinese Academy of Meteorological Sciences https://orcid.org/0000-0002-3723-8464
  • Yaqiang Wang Chinese Academy of Meteorological Sciences,
  • Yuanli Xie Northwest University
  • Peng Zhao University of Bayreut; University of Innsbruck
  • Johannes Lüers University of Bayreuth

DOI:

https://doi.org/10.5334/jors.90

Keywords:

data quality control, observational data, outlier data, Java, Sofware development

Abstract

Scientific datasets collected by instruments usually include outliers which have to be flagged in data quality control process. OutlierFlag was developed to make this process accurate and simple by providing a suitable outlier data flagging algorithm and a user friendly GUI. The algorithm consists of three steps performed one by one: limitation check, error check and standard deviation check. Several parameters are configurable so the algorithm can be used for various datasets. OutlierFlag is an open source software written in Java and the MeteoInfo library was used for data plotting function.

Author Biographies

Shuai Huang, Northwest University; Chinese Academy of Meteorological Sciences

Master graduate student at Northwestern University

Yaqiang Wang, Chinese Academy of Meteorological Sciences,

Dr.Wang, senior engineer of Institute of Atmospheric Composition, CAMS. He is mainly engaged in the study of atmospheric aerosol, GIS development and application.

Yuanli Xie, Northwest University

Professor of Collage of Urban and Environment Science, Northwest University. He is working at digital photogrammetry, remote sensing and geographic information system and related application in landscape ecology.

Peng Zhao, University of Bayreut; University of Innsbruck

ZHAO Peng Dr. rer. nat. M.Sc. B.Sc University of Bayreuth, now at University of Innsbruck, Institute of Ecology Research Group: Biometeorology

Johannes Lüers, University of Bayreuth

Professor of University of Bayreuth.

Downloads

Published

2016-05-31

Issue

Vol. 4 No. 1 (2016)

Section

Software Metapapers

License

Copyright (c) 2016 The Author(s)

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms:
  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).