{"conference":{"location":"Valencia, Spain","name":"25th International Conference on Intelligent Data Engineering and Automated Learning","start_date":"2024-11-20","end_date":"2024-11-22"},"status":"public","publication":"Intelligent Data Engineering and Automated Learning – IDEAL 2024, PT I","author":[{"id":"231000504","first_name":"Robert","department":[{"_id":"10037"}],"full_name":"Feldhans, Robert","last_name":"Feldhans"},{"last_name":"Hammer","orcid":"0000-0002-0935-5591","id":"18302458","full_name":"Hammer, Barbara","first_name":"Barbara","department":[{"_id":"10037"}]}],"type_old":["conference"],"publication_status":"published","abstract":[{"lang":"eng","text":"When delivered to the market, machine learning models face new data which are possibly subject to novel characteristics - a phenomenon known as concept drift. As this might lead to performance degradation, it is necessary to detect such drift and, if required, adapt the model accordingly. While a variety of drift detection and adaptation methods exists for standard vectorial data, a suitable treatment of text data is less researched. In this work we present a novel approach which detects and explains drift in text data based on their representation via transformer embeddings. In a nutshell, the method generates suitable statistical features from the original distribution and the possibly shifted variation. Based on these representations, drift scores can be assigned to individual data points, allowing a visualization and human-readable characterization of the type of drift. We demonstrate the approach's effectiveness in reliably detecting drift in several experiments."}],"date_updated":"2025-03-27T09:51:44Z","external_id":{"isi":["001422227800028"]},"volume":15346,"isi":"1","quality_controlled":"1","year":"2025","doi":"10.1007/978-3-031-77731-8_28","_id":"3001606","place":"Cham","user_id":"30564","first_contributor":"Feldhans, Robert","language":[{"iso":"eng"}],"title":"Towards Reliable Drift Detection and Explanation in Text Data","citation":{"wels":"Feldhans, R.; Hammer, B. (2025): Towards Reliable Drift Detection and Explanation in Text Data. In: Intelligent Data Engineering and Automated Learning – IDEAL 2024, PT I. Cham: Springer . (Lecture Notes in Computer Science, 15346). S. 301-312.","chicago":"<div style=\"text-indent:-25px; padding-left:25px;padding-bottom:0px;\">Feldhans, Robert, and Hammer, Barbara. 2025. “Towards Reliable Drift Detection and Explanation in Text Data”. In <em>Intelligent Data Engineering and Automated Learning – IDEAL 2024, PT I</em>, 15346:301-312. Lecture Notes in Computer Science. Cham: Springer .</div>","angewandte-chemie":"R. Feldhans, and B. Hammer, in <em>Intelligent Data Engineering and Automated Learning – IDEAL 2024, PT I</em>, Springer , Cham, <strong>2025</strong>, p. 301-312.","mla":"Feldhans, Robert, and Hammer, Barbara. “Towards Reliable Drift Detection and Explanation in Text Data”. <em>Intelligent Data Engineering and Automated Learning – IDEAL 2024, PT I</em>. Cham: Springer , 2025.Vol. 15346. Lecture Notes in Computer Science. 301-312.","frontiers":"Feldhans, R., and Hammer, B. (2025). “Towards Reliable Drift Detection and Explanation in Text Data” in <em>Intelligent Data Engineering and Automated Learning – IDEAL 2024, PT I</em> Lecture Notes in Computer Science, vol. 15346, (Cham: Springer ), 301-312.","apa_indent":"<div style=\"text-indent:-25px; padding-left:25px;padding-bottom:0px;\">Feldhans, R., & Hammer, B. (2025). Towards Reliable Drift Detection and Explanation in Text Data. <em>Intelligent Data Engineering and Automated Learning – IDEAL 2024, PT I</em>, Lecture Notes in Computer Science, <em>15346</em>, 301-312. Cham: Springer . <a href=\"https://doi.org/10.1007/978-3-031-77731-8_28\" target=\"_blank\">https://doi.org/10.1007/978-3-031-77731-8_28</a></div>","apa":"Feldhans, R., & Hammer, B. (2025). Towards Reliable Drift Detection and Explanation in Text Data. <em>Intelligent Data Engineering and Automated Learning – IDEAL 2024, PT I</em>, Lecture Notes in Computer Science, <em>15346</em>, 301-312. Cham: Springer . <a href=\"https://doi.org/10.1007/978-3-031-77731-8_28\" target=\"_blank\">https://doi.org/10.1007/978-3-031-77731-8_28</a>","bio1":"Feldhans R, Hammer B (2025) <br />Towards Reliable Drift Detection and Explanation in Text Data. <br />In: Intelligent Data Engineering and Automated Learning – IDEAL 2024, PT I. Lecture Notes in Computer Science, 15346. Cham: Springer : 301-312.","harvard1":"Feldhans, R., & Hammer, B., 2025. Towards Reliable Drift Detection and Explanation in Text Data. In <em>Intelligent Data Engineering and Automated Learning – IDEAL 2024, PT I</em>. Lecture Notes in Computer Science. no.15346 Cham: Springer , pp. 301-312.","lncs":" Feldhans, R., Hammer, B.: Towards Reliable Drift Detection and Explanation in Text Data. Intelligent Data Engineering and Automated Learning – IDEAL 2024, PT I. Lecture Notes in Computer Science. 15346, p. 301-312. Springer , Cham (2025).","default":"Feldhans R, Hammer B (2025) <br />In: Intelligent Data Engineering and Automated Learning – IDEAL 2024, PT I. Lecture Notes in Computer Science, 15346. Cham: Springer : 301-312.","ama":"Feldhans R, Hammer B. Towards Reliable Drift Detection and Explanation in Text Data. In: <em>Intelligent Data Engineering and Automated Learning – IDEAL 2024, PT I</em>. Lecture Notes in Computer Science. Vol 15346. Cham: Springer ; 2025: 301-312.","ieee":" R. Feldhans and B. Hammer, “Towards Reliable Drift Detection and Explanation in Text Data”, <em>Intelligent Data Engineering and Automated Learning – IDEAL 2024, PT I</em>, Lecture Notes in Computer Science, vol. 15346, Cham: Springer , 2025, pp.301-312.","dgps":"<div style=\"text-indent:-25px; padding-left:25px;padding-bottom:0px;\">Feldhans, R. & Hammer, B. (2025). Towards Reliable Drift Detection and Explanation in Text Data (Lecture Notes in Computer Science). <em>Intelligent Data Engineering and Automated Learning – IDEAL 2024, PT I</em> (S. 301-312). Gehalten auf der 25th International Conference on Intelligent Data Engineering and Automated Learning, Cham: Springer . doi:10.1007/978-3-031-77731-8_28.</div>"},"department":[{"_id":"10037"}],"page":"301-312","publication_identifier":{"issn":["0302-9743"],"isbn":["978-3-031-77730-1","978-3-031-77731-8"],"eissn":["1611-3349"]},"publisher":"Springer ","intvolume":" 15346","unibi_person":"1","date_created":"2025-03-18T07:05:47Z","type":"conference","keyword":["Drift Explanation","Text Data","Transformer","Visualization"],"series_title":"Lecture Notes in Computer Science"}