Graph Machine Learning research groups: Xavier Bresson

I do a series of posts on the groups in graph research, previous post is here. The 12th is Xavier Bresson, conference and tutorial organizers on graph machine learning.


Xavier Bresson (~1975)
- Affiliation: NTU Singapore
- Education: Ph.D. at EPFL, Switzerland in 2005 (supervised by Jean-Philippe Thiran);
- h-index: 38;
- Awards: Singapore NRF fellowship, best paper at IVMSP;
- Interests: signal processing on graphs, GNN, combinatorial optimization.

Temporal Graph Networks

Another blog post by Michael Bronstein with Emanuele Rossi on applying graph nets on dynamic graphs (represented as the stream of edges). Apparently this problem is much more realistic in many business contexts such as social networks and it has not been studied at depth until that paper.

Fresh picks from ArXiv
This week we have novel GNN architectures, Turing test for graph drawing, and graph exploration of git repositories 💻

GNN
• Quaternion Graph Neural Networks
• Representative Graph Neural Network ECCV 20
• DensE: An Enhanced Non-Abelian Group Representation for Knowledge Graph Embedding

Applications
• Graph Edit Distance Reward: Learning to Edit Scene Graph
• HOSE-Net: Higher Order Structure Embedded Network for Scene Graph Generation
• Bipartite Graph Reasoning GANs for Person Image Generation
• Graph Polish: A Novel Graph Generation Paradigm for Molecular Optimization
• Graph Drawing via Gradient Descent, (GD)2
• The Turing Test for Graph Drawing Algorithms
• GraphRepo: Fast Exploration in Software Repository Mining

Node regression problem

I asked on twitter what the available node regression data sets there and found quite a few interesting responses.

1. There are pure node regression data sets, but not so many. One can use Wikipedia, Pokec, or data sets from this paper. I hope to release a couple more data sets like these soon.

2. You can also find data sets in spatiotemporal prediction on graphs (eg. traffic forecasting). You are given graph + velocity on each lane and you are asked to predict velocity in the future. My opinion is that the problem is a toy problem: there are no features associated with the nodes (except for a speed). But you can take a look at DCRNN, STGCN, GaAN, Graph WaveNet, STGRAT, etc. models that deal with that.

3. You can find node regression in the work of simulating physics. A node is a particle, it has a few features (eg. position+velocity) you are asked to predict acceleration. This is an interesting problem, but I haven't found data sets. You probably need to write your own simulator.

4. Next scene prediction. Essentially the same as previous, but the objects can be anything: for example, a camera view in a self-driving car. You are asked to predict next position of every object. I don't know if anyone tried to solve this problem.

5. Action prediction for RL agent. NerveNet did it. Each object is a graph and you predict an action for each node.

Brief analytics of KDD papers

Here are some plots for upcoming KDD 2020 (only research track). It's interesting to compare it against ICML 2020. You can check out git repo with the analysis. Here is highlights:

1. Top affiliations at KDD are different than at ICML, with several "small" names at the top.
2. Leading authors are almost all from China.
3. There are more authors per paper (~4-5) at KDD than at ICML (~3-4). Only a single paper with a single author.
4. There are ~65 graph papers, with a handful batch on pure algorithms.
5. In total there are 217 research papers. Graphs comprise about 30% of all papers.
6. Wordcloud confirms: graphs are the most used word in titles.
7. "Geodesic Forests" is the shortest title appeared.

Symposium on Graph Drawing and Network Visualization

It's cool to see there is a small conference on how you can visualize graphs. Registration is free until 10 September.

KDD 2020 Highlights

I haven't found highlights about KDD 2020, so did my own. What's interesting there are many papers on scalability of GNNs, intersection of graphs and recommendation, and clustering algorithms. Paper digest allows you to browse quickly through the papers.

Fresh picks from ArXiv
This week in ArXiv new graph data sets for language recommendation, new optimization methods of GNNs, and applications to RL 🕹

GNN
• Optimization of Graph Neural Networks with Natural Gradient Descent
• Training Matters: Unlocking Potentials of Deeper Graph Convolutional Neural Networks

Data sets
• VisualSem: a high-quality knowledge graph for vision and language
• COOKIE: A Dataset for Conversational Recommendation over Knowledge Graphs in E-commerce

Applications
• Multi-Agent Reinforcement Learning with Graph Clustering
• SF-GRASS: Solver-Free Graph Spectral Sparsification
• Learning Graph Edit Distance by Graph Neural Networks
• Community-Aware Graph Signal Processing

Graph Machine Learning Books

For a long time I was thinking that the community lacks proper books on graph machine learning and even thought maybe I should write one. But luckily there are other active people. With the difference of one day 2 (!) books were announced.

Graph Representation Learning Book by Will Hamilton, which so far has 3 main chapters on node embeddings, GNNs, and generative models. While the drafts are ready, there is still a long way to make it comprehensive book and the author promises to work on that. Great start.

Deep Learning on Graphs by Yao Ma and Jiliang Tang. This should be available next month and should focus on foundations of GNNs as well as applications.


That's great, hopefully they will become handbooks for those who want to start in this area. Now waiting the same but for educational courses 🙏

Mining and Learning with Graphs Workshop

MLG workshop is a regular workshop on various ML solutions for graphs. The videos for each poster can be found here. Keynotes should be available soon (except for Danai Koutra, which is available now).

Graph Machine Learning research groups: Pietro Liò

I do a series of posts on the groups in graph research, previous post is here. The 13th is Pietro Liò, a computational biologist and a supervisor of Petar Veličković. He has also been very active in GML recently (with 54 papers in 2020) so he could be a good choice if you want to do a PhD in this area.


Pietro Liò (~1965)
- Affiliation: University of Cambridge
- Education: Ph.D. in Theoretical Genetics at University of Firenze, Italy in 1995 and Ph.D. in Engineering at University of Pavia, Italy in 2007;
- h-index: 50;
- Awards: Lagrange Fellowship, best papers at ISEM, MCED, FET;
- Interests: graph neural networks, computational biology, signal processing.

JuliaCon2020 Graph Videos

While Python is a default language for analyzing graphs, there are numerous other languages that provide packages for dealing with graphs. In the recent JuliaCon, devoted to a programming language Julia, many talks were about new graph packages with applications to transportation networks, dynamical systems, geometric deep learning, knowledge graphs, and others. Check out the full program here.

Fresh picks from ArXiv
This week ArXiv presents papers on visualization of graphs, robustness certificates, and a survey on combinatorial optimization ♟

GNN
• All About Knowledge Graphs for Actions
• The Effectiveness of Interactive Visualization Techniques for Time Navigation of Dynamic Graphs on Large Displays
• Argo Lite: Open-Source Interactive Graph Exploration and Visualization in Browsers
• Accelerating Force-Directed Graph Drawing with RT Cores
• Learning Robust Node Representation on Graphs
• Certified Robustness of Graph Neural Networks against Adversarial Structural Perturbation
• Efficient Robustness Certificates for Discrete Data: Sparsity-Aware Randomized Smoothing for Graphs, Images and More

Survey
• Graph Embedding for Combinatorial Optimization: A Survey

Number of papers in GML: Aug 2020

There are 277 new GML papers in CS section of ArXiv in Aug 2020 (vs 339 in July).

Topology-Based Papers at ICML 2020

Topological data analysis studies the applications of topological methods to real-world data, for example constructing and studying a proper manifold given only 3D points. This topic is increasingly gaining attention and a new post by Bastian Rieck discusses topological papers at ICML 2020 that includes graph filtration techniques, topological autoencoders, and normalizing flows.