We are not ready yet: limitations of transfer learning for Disease Named Entity Recognition

Langnickel L, Fluck J (2021)
bioRxiv.

Preprint | Veröffentlicht | Englisch
 
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Autor*in
Langnickel, Lisa; Fluck, Juliane
Abstract / Bemerkung
Intense research has been done in the area of biomedical natural language processing. Since the breakthrough of transfer learning-based methods, BERT models are used in a variety of biomedical and clinical applications. For the available data sets, these models show excellent results – partly exceeding the inter-annotator agreements. However, biomedical named entity recognition applied on COVID-19 preprints shows a performance drop compared to the results on available test data. The question arises how well trained models are able to predict on completely new data, i.e. to generalize. Based on the example of disease named entity recognition, we investigate the robustness of different machine learning-based methods – thereof transfer learning – and show that current state-of-the-art methods work well for a given training and the corresponding test set but experience a significant lack of generalization when applying to new data. We therefore argue that there is a need for larger annotated data sets for training and testing.
Erscheinungsjahr
2021
Zeitschriftentitel
bioRxiv
Page URI
https://pub.uni-bielefeld.de/record/2959088

Zitieren

Langnickel L, Fluck J. We are not ready yet: limitations of transfer learning for Disease Named Entity Recognition. bioRxiv. 2021.
Langnickel, L., & Fluck, J. (2021). We are not ready yet: limitations of transfer learning for Disease Named Entity Recognition. bioRxiv. https://doi.org/10.1101/2021.07.11.451939
Langnickel, L., and Fluck, J. (2021). We are not ready yet: limitations of transfer learning for Disease Named Entity Recognition. bioRxiv.
Langnickel, L., & Fluck, J., 2021. We are not ready yet: limitations of transfer learning for Disease Named Entity Recognition. bioRxiv.
L. Langnickel and J. Fluck, “We are not ready yet: limitations of transfer learning for Disease Named Entity Recognition”, bioRxiv, 2021.
Langnickel, L., Fluck, J.: We are not ready yet: limitations of transfer learning for Disease Named Entity Recognition. bioRxiv. (2021).
Langnickel, Lisa, and Fluck, Juliane. “We are not ready yet: limitations of transfer learning for Disease Named Entity Recognition”. bioRxiv (2021).

Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar