Streamlined Training of GCN for Node Classification with Automatic Loss Function and Optimizer Selection

Ullah S, Koravuna S, Rückert U, Jungeblut T (2023)
In: Engineering Applications of Neural Networks. 24th International Conference, EAAAI/EANN 2023, León, Spain, June 14–17, 2023, Proceedings. Iliadis L, Maglogiannis I, Alonso S, Jayne C, Pimenidis E (Eds); Communications in Computer and Information Science. Cham: Springer Nature Switzerland: 191-202.

Sammelwerksbeitrag | Veröffentlicht | Englisch
 
Download
Es wurden keine Dateien hochgeladen. Nur Publikationsnachweis!
Herausgeber*in
Iliadis, Lazaros; Maglogiannis, Ilias; Alonso, Serafin; Jayne, Chrisina; Pimenidis, Elias
Abstract / Bemerkung
Graph Neural Networks (GNNs) are specialized neural networks that operate on graph-structured data, utilizing the connections between nodes to learn and process information. To achieve optimal performance, GNNs require the automatic selection of the best loss and optimization functions, which allows the model to adapt to the unique features of the dataset being used. This eliminates the need for manual selection, saving time and minimizing the requirement for domain-specific knowledge. The automatic selection of loss and optimization functions is a crucial factor in achieving state-of-the-art results when training GNNs. In this study, we trained Graph Convolutional Networks (GCNs) and Graph Attention Networks (GAT) models for node classification on three benchmark datasets. To automatically select the best loss and optimization functions, we utilized performance metrics. We implemented a learning rate scheduler to adjust the learning rate based on the model’s performance, which led to improved results. We evaluated the model’s performance using multiple metrics and reported the best loss function and performance metric, enabling users to compare its performance to other models. Our approach achieved state-of-the-art results, highlighting the importance of selecting the appropriate loss and optimizer functions. Additionally, we developed a real-time visualization of the GCN model during training, providing users with a detailed understanding of the model’s behavior. Overall, this study provides a comprehensive understanding of GNNs and their application to graph-structured data, with a specific focus on real-time visualization of GNN behavior during training.
Erscheinungsjahr
2023
Buchtitel
Engineering Applications of Neural Networks. 24th International Conference, EAAAI/EANN 2023, León, Spain, June 14–17, 2023, Proceedings
Serientitel
Communications in Computer and Information Science
Seite(n)
191-202
ISBN
978-3-031-34203-5
eISBN
978-3-031-34204-2
ISSN
1865-0929
eISSN
1865-0937
Page URI
https://pub.uni-bielefeld.de/record/2982809

Zitieren

Ullah S, Koravuna S, Rückert U, Jungeblut T. Streamlined Training of GCN for Node Classification with Automatic Loss Function and Optimizer Selection. In: Iliadis L, Maglogiannis I, Alonso S, Jayne C, Pimenidis E, eds. Engineering Applications of Neural Networks. 24th International Conference, EAAAI/EANN 2023, León, Spain, June 14–17, 2023, Proceedings. Communications in Computer and Information Science. Cham: Springer Nature Switzerland; 2023: 191-202.
Ullah, S., Koravuna, S., Rückert, U., & Jungeblut, T. (2023). Streamlined Training of GCN for Node Classification with Automatic Loss Function and Optimizer Selection. In L. Iliadis, I. Maglogiannis, S. Alonso, C. Jayne, & E. Pimenidis (Eds.), Communications in Computer and Information Science. Engineering Applications of Neural Networks. 24th International Conference, EAAAI/EANN 2023, León, Spain, June 14–17, 2023, Proceedings (pp. 191-202). Cham: Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-34204-2_17
Ullah, Sana, Koravuna, Shamini, Rückert, Ulrich, and Jungeblut, Thorsten. 2023. “Streamlined Training of GCN for Node Classification with Automatic Loss Function and Optimizer Selection”. In Engineering Applications of Neural Networks. 24th International Conference, EAAAI/EANN 2023, León, Spain, June 14–17, 2023, Proceedings, ed. Lazaros Iliadis, Ilias Maglogiannis, Serafin Alonso, Chrisina Jayne, and Elias Pimenidis, 191-202. Communications in Computer and Information Science. Cham: Springer Nature Switzerland.
Ullah, S., Koravuna, S., Rückert, U., and Jungeblut, T. (2023). “Streamlined Training of GCN for Node Classification with Automatic Loss Function and Optimizer Selection” in Engineering Applications of Neural Networks. 24th International Conference, EAAAI/EANN 2023, León, Spain, June 14–17, 2023, Proceedings, Iliadis, L., Maglogiannis, I., Alonso, S., Jayne, C., and Pimenidis, E. eds. Communications in Computer and Information Science (Cham: Springer Nature Switzerland), 191-202.
Ullah, S., et al., 2023. Streamlined Training of GCN for Node Classification with Automatic Loss Function and Optimizer Selection. In L. Iliadis, et al., eds. Engineering Applications of Neural Networks. 24th International Conference, EAAAI/EANN 2023, León, Spain, June 14–17, 2023, Proceedings. Communications in Computer and Information Science. Cham: Springer Nature Switzerland, pp. 191-202.
S. Ullah, et al., “Streamlined Training of GCN for Node Classification with Automatic Loss Function and Optimizer Selection”, Engineering Applications of Neural Networks. 24th International Conference, EAAAI/EANN 2023, León, Spain, June 14–17, 2023, Proceedings, L. Iliadis, et al., eds., Communications in Computer and Information Science, Cham: Springer Nature Switzerland, 2023, pp.191-202.
Ullah, S., Koravuna, S., Rückert, U., Jungeblut, T.: Streamlined Training of GCN for Node Classification with Automatic Loss Function and Optimizer Selection. In: Iliadis, L., Maglogiannis, I., Alonso, S., Jayne, C., and Pimenidis, E. (eds.) Engineering Applications of Neural Networks. 24th International Conference, EAAAI/EANN 2023, León, Spain, June 14–17, 2023, Proceedings. Communications in Computer and Information Science. p. 191-202. Springer Nature Switzerland, Cham (2023).
Ullah, Sana, Koravuna, Shamini, Rückert, Ulrich, and Jungeblut, Thorsten. “Streamlined Training of GCN for Node Classification with Automatic Loss Function and Optimizer Selection”. Engineering Applications of Neural Networks. 24th International Conference, EAAAI/EANN 2023, León, Spain, June 14–17, 2023, Proceedings. Ed. Lazaros Iliadis, Ilias Maglogiannis, Serafin Alonso, Chrisina Jayne, and Elias Pimenidis. Cham: Springer Nature Switzerland, 2023. Communications in Computer and Information Science. 191-202.
Export

Markieren/ Markierung löschen
Markierte Publikationen

Open Data PUB

Suchen in

Google Scholar
ISBN Suche