In-crowd algorithm

The in-crowd algorithm is a numerical method for solving basis pursuit denoising quickly; faster than any other algorithm for large, sparse problems.

[1] This algorithm is an active set method, which minimizes iteratively sub-problems of the global basis pursuit denoising:

is the regularization parameter trading off signal fidelity and simplicity.

The active set strategies are very efficient in this context as only few coefficient are expected to be non-zero.

Thus, if they can be identified, solving the problem restricted to these coefficients yield the solution.

Here, the features are greedily selected based on the absolute value of their gradient at the current estimate.

Other active-set methods for the basis pursuit denoising includes BLITZ,[2] where the selection of the active set is performed using the duality gap of the problem, and The Feature Sign Search,[3] where the features are included based on the estimate of their sign.

It consists of the following: Since every time the in-crowd algorithm performs a global search it adds up to

faster than the best alternative algorithms when this search is computationally expensive.

A theorem[1] guarantees that the global optimum is reached in spite of the many-at-a-time nature of the in-crowd algorithm.