Development of graph neural networks for multi-modal data processing