The GraphRNN model still generates unrealistic artifacts (e.g., long chains) when trained on samples of grids. Moreover, GraphRNN can be difficult to train and scale to large graphs due to the need to back-propagate through many steps of RNN recurrence.

Hamilton College

The basic idea in the GraphRNN approach is to use a hierarchical RNN to model the edge dependencies in the equation shown below. The first RNN in the hierarchical model is used to model the state of the graph that has been generated so far. The second RNN generates the entries of L[vi, :] in an autoregressive manner. The overall GraphRNN approach is called hierarchical because the node-level RNN is initialized at each time-step with the current hidden state of the graph-level RNN.

GraphRNN

Hamilton, W.L. Graph Representation Learning. *Synthesis Lectures on Artificial Intelligence and Machine Learning*. 2020, 14(3), 1–159. https://doi.org/10.2200/S01045ED1V01Y202009AIM046

Graph Representation Learning by William Hamilton

Limitations of GraphRNN

The key benefit of the GraphRNN approach is that it models dependencies between edges. Using an autoregressive modeling assumption, GraphRNN can condition the generation of edges at generation step i based on the state of the graph that has already been generated during generation steps 1, ...i − 1, which makes it much easier to generate complex motifs and regular graph structures, such as grids.

Learn Before

Related