Multi-Agent Thompson Sampling for Bandit Applications with Sparse Neighbourhood Structures.

Multi-agent coordination is prevalent in many real-world applications. However, such coordination is challenging due to its combinatorial nature. An important observation in this regard is that agents in the real world often only directly affect a limited set of neighbouring agents.