Self-similarity matrix

In data analysis, the self-similarity matrix is a graphical representation of similar sequences in a data series.

Similarity can be explained by different measures, like spatial distance (distance matrix), correlation, or comparison of local histograms or spectral properties (e.g. IXEGRAM[1]).

A similarity plot can be the starting point for dot plots or recurrence plots.

To construct a self-similarity matrix, one first transforms a data series into an ordered sequence of feature vectors

describes the relevant features of a data series in a given local interval.

Then the self-similarity matrix is formed by computing the similarity of pairs of feature vectors where

is a function measuring the similarity of the two vectors, for instance, the inner product

Then similar segments of feature vectors will show up as path of high similarity along diagonals of the matrix.

[2] Similarity plots are used for action recognition that is invariant to point of view [3] and for audio segmentation using spectral clustering of the self-similarity matrix.