https://arxiv.org/abs/1706.02216?context=cs

University of Michigan - Ann Arbor

To use mini-batch training, one can work with a subset of nodes during message passing.

Subsampling of Graph-level Message Passing

Graph-level message passing requires operating on the entire graph and all node features simultaneously, which may not be feasible due to memory limitations. In addition, using the graph-level equations essentially limits one to full-batch (as opposed to minibatched) gradient descent.


Why Subsampling of Graph-level Message Passing is Needed?

We can not run message passing on a subset without losing information. Because when we remove nodes, we also delete edges.

Challenge of Subsampling of Graph-level Message Passing

Inductive representation learning on large graphs. 

First select a set of target nodes for a batch and then to recursively sample the neighbors of these nodes in order to ensure that the connectivity of the graph is maintained.

Learn Before

Related