Federated Many-Task Bayesian Optimization
Zhu H, Wang X, Jin Y (2023)
IEEE Transactions on Evolutionary Computation: 1-1.
Zeitschriftenaufsatz
| E-Veröff. vor dem Druck | Englisch
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Autor*in
Abstract / Bemerkung
Bayesian optimization is a powerful surrogate-assisted algorithm for solving expensive black-box optimization problems. While Bayesian optimization was developed for centralized optimization, the availability of massive distributed data has attracted increased interests in exploring federated Bayesian optimization that can use data on multiple clients without leaking the raw data. However, existing federated Bayesian optimization (FBO) approaches assume that either all clients jointly solve the same optimization task, or only one client solves one target optimization task by transferring knowledge from others in a federated way, making them unsuited for many real-world applications. In this paper, we consider FBO for the scenario where multiple related local black-box tasks associated with different clients are jointly optimized by sharing knowledge between tasks without leaking the data privacy. An efficient federated many-task Bayesian optimization framework is proposed to address not independent and identically distributed (non-IID) data while protecting the data privacy in the federated setting. A novel federated knowledge transfer paradigm is developed for dynamic many-task model aggregation according to a dissimilarity matrix. The dissimilarity is measured based on the rank of the predictions and only the hyperparameters in the local Gaussian process models are shared. In addition, a federated ensemble acquisition function is constructed by integrating the predictions of two surrogates using the global and local hyperparameters, respectively, to effectively search for the optimal solution. Experimental results show that our proposed method has reliable performance on both benchmark problems and a real machine learning problem also in the presence of non-IID data.
Erscheinungsjahr
2023
Zeitschriftentitel
IEEE Transactions on Evolutionary Computation
Seite(n)
1-1
ISSN
1089-778X
eISSN
1941-0026
Page URI
https://pub.uni-bielefeld.de/record/2979669
Zitieren
Zhu H, Wang X, Jin Y. Federated Many-Task Bayesian Optimization. IEEE Transactions on Evolutionary Computation. 2023:1-1.
Zhu, H., Wang, X., & Jin, Y. (2023). Federated Many-Task Bayesian Optimization. IEEE Transactions on Evolutionary Computation, 1-1. https://doi.org/10.1109/TEVC.2023.3279775
Zhu, Hangyu, Wang, Xilu, and Jin, Yaochu. 2023. “Federated Many-Task Bayesian Optimization”. IEEE Transactions on Evolutionary Computation, 1-1.
Zhu, H., Wang, X., and Jin, Y. (2023). Federated Many-Task Bayesian Optimization. IEEE Transactions on Evolutionary Computation, 1-1.
Zhu, H., Wang, X., & Jin, Y., 2023. Federated Many-Task Bayesian Optimization. IEEE Transactions on Evolutionary Computation, , p 1-1.
H. Zhu, X. Wang, and Y. Jin, “Federated Many-Task Bayesian Optimization”, IEEE Transactions on Evolutionary Computation, 2023, pp. 1-1.
Zhu, H., Wang, X., Jin, Y.: Federated Many-Task Bayesian Optimization. IEEE Transactions on Evolutionary Computation. 1-1 (2023).
Zhu, Hangyu, Wang, Xilu, and Jin, Yaochu. “Federated Many-Task Bayesian Optimization”. IEEE Transactions on Evolutionary Computation (2023): 1-1.
Link(s) zu Volltext(en)
Access Level
Closed Access
Export
Markieren/ Markierung löschen
Markierte Publikationen
Web of Science
Dieser Datensatz im Web of Science®Suchen in