MAIA - A machine learning assisted image annotation method for environmental monitoring and exploration

Zurowietz M, Langenkämper D, Hosking B, Ruhl H, Nattkemper TW (2018)
PLoS ONE 13(11): e0207498.

Zeitschriftenaufsatz | Veröffentlicht | Englisch
 
Download
OA 2.38 MB
Abstract / Bemerkung
Digital imaging has become one of the most important techniques in environmental monitoring and exploration. In the case of the marine environment, mobile platforms such as autonomous underwater vehicles (AUVs) are now equipped with high-resolution cameras to capture huge collections of images from the seabed. However, the timely evaluation of all these images presents a bottleneck problem as tens of thousands or more images can be collected during a single dive. This makes computational support for marine image analysis essential. Computer-aided analysis of environmental images (and marine images in particular) with machine learning algorithms is promising, but challenging and different to other imaging domains because training data and class labels cannot be collected as efficiently and comprehensively as in other areas. In this paper, we present Machine learning Assisted Image Annotation (MAIA), a new image annotation method for environmental monitoring and exploration that overcomes the obstacle of missing training data. The method uses a combination of autoencoder networks and Mask Region-based Convolutional Neural Network (Mask R-CNN), which allows human observers to annotate large image collections much faster than before. We evaluated the method with three marine image datasets featuring different types of background, imaging equipment and object classes. Using MAIA, we were able to annotate objects of interest with an average recall of 84.1% more than twice as fast as compared to “traditional” annotation methods, which are purely based on software-supported direct visual inspection and manual annotation. The speed gain increases proportionally with the size of a dataset. The MAIA approach represents a substantial improvement on the path to greater efficiency in the annotation of large benthic image collections.
Stichworte
Marine Biology; Computer Vision; Remote Sensing; Machine Learning; Deep Learning
Erscheinungsjahr
2018
Zeitschriftentitel
PLoS ONE
Band
13
Ausgabe
11
Art.-Nr.
e0207498
eISSN
1932-6203
Finanzierungs-Informationen
Article Processing Charge funded by the Deutsche Forschungsgemeinschaft and the Open Access Publication Fund of Bielefeld University.
Page URI
https://pub.uni-bielefeld.de/record/2932066

Zitieren

Zurowietz M, Langenkämper D, Hosking B, Ruhl H, Nattkemper TW. MAIA - A machine learning assisted image annotation method for environmental monitoring and exploration . PLoS ONE. 2018;13(11): e0207498.
Zurowietz, M., Langenkämper, D., Hosking, B., Ruhl, H., & Nattkemper, T. W. (2018). MAIA - A machine learning assisted image annotation method for environmental monitoring and exploration . PLoS ONE, 13(11), e0207498. doi:10.1371/journal.pone.0207498
Zurowietz, M., Langenkämper, D., Hosking, B., Ruhl, H., and Nattkemper, T. W. (2018). MAIA - A machine learning assisted image annotation method for environmental monitoring and exploration . PLoS ONE 13:e0207498.
Zurowietz, M., et al., 2018. MAIA - A machine learning assisted image annotation method for environmental monitoring and exploration . PLoS ONE, 13(11): e0207498.
M. Zurowietz, et al., “MAIA - A machine learning assisted image annotation method for environmental monitoring and exploration ”, PLoS ONE, vol. 13, 2018, : e0207498.
Zurowietz, M., Langenkämper, D., Hosking, B., Ruhl, H., Nattkemper, T.W.: MAIA - A machine learning assisted image annotation method for environmental monitoring and exploration . PLoS ONE. 13, : e0207498 (2018).
Zurowietz, Martin, Langenkämper, Daniel, Hosking, Brett, Ruhl, Henry, and Nattkemper, Tim Wilhelm. “MAIA - A machine learning assisted image annotation method for environmental monitoring and exploration ”. PLoS ONE 13.11 (2018): e0207498.
Alle Dateien verfügbar unter der/den folgenden Lizenz(en):
Creative Commons Namensnennung 4.0 International Public License (CC-BY 4.0):
Volltext(e)
Access Level
OA Open Access
Zuletzt Hochgeladen
2019-09-06T09:19:02Z
MD5 Prüfsumme
56c2fc1473602bb254805d4e9f1bc1ac

Link(s) zu Volltext(en)
Access Level
OA Open Access

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Web of Science

Dieser Datensatz im Web of Science®

Quellen

PMID: 30444917
PubMed | Europe PMC

Suchen in

Google Scholar