An agreement of a group to follow a common purpose is manifested by its coalescence into a coordinated behavior. The process of initiating this behavior and the period of decision-making by the group members necessarily precedes the coordinated behavior. Given time series of group members’ behavior, the goal is to find these periods of decision-making and identify the initiating individual, if one exists.

Image Source:  [Amornbunchornvej et al.](https://arxiv.org/pdf/1603.01570v2.pdf)

**Single-Headed Attention** is a single-headed attention module used in the [SHA-RNN](https://paperswithcode.com/method/sha-rnn) language model. The principle design reasons for single-headedness were simplicity (avoiding running out of memory) and scepticism about the benefits of using multiple heads.

Single-Headed Attention

Single Headed Attention RNN: Stop Thinking With Your Head

FLICA

Coordination Event Detection and Initiator Identification in Time Series Data

**PonderNet** is an adaptive computation method that learns to adapt the amount of computation based on the complexity of the problem at hand. PonderNet learns end-to-end the number of computational steps to achieve an effective compromise between training prediction accuracy, computational cost and generalization.

Source	Coordination Event Detection and Initiator Identification in Time Series Data
Year	2000
Data Source	CC BY-SA - https://paperswithcode.com