Hadamard product (matrices)
5 or Schur product[2]) is a binary operation that takes in two matrices of the same dimensions and returns a matrix of the multiplied corresponding elements.
It is attributed to, and named after, either French mathematician Jacques Hadamard or German mathematician Issai Schur.
The Hadamard product is associative and distributive.
Unlike the matrix product, it is also commutative.
[3] For two matrices A and B of the same dimension m × n, the Hadamard product
[4][5][6]) is a matrix of the same dimension as the operands, with elements given by[3] For matrices of different dimensions (m × n and p × q, where m ≠ p or n ≠ q), the Hadamard product is undefined.
For two positive-semidefinite matrices A and B, it is also known that the determinant of their Hadamard product is greater than or equal to the product of their respective determinants:[8]
Other Hadamard operations are also seen in the mathematical literature,[15] namely the Hadamard root and Hadamard power (which are in effect the same thing because of fractional indices), defined for a matrix such that: For
Most scientific or numerical programming languages include the Hadamard product, under various names.
In MATLAB, the Hadamard product is expressed as "dot multiply": a .
The programming language Julia has similar syntax as MATLAB, where Hadamard multiplication is called broadcast multiplication and also denoted with a .
* b, and other operators are analogously defined element-wise, for example Hadamard powers use a .^ b.
[20] But unlike MATLAB, in Julia this "dot" syntax is generalized with a generic broadcasting operator .
Thus, any function in prefix notation f can be applied as f.(x).
[21] Python does not have built-in array support, leading to inconsistent/conflicting notations.
The NumPy numerical library interprets a*b or a.multiply(b) as the Hadamard product, and uses a@b or a.matmul(b) for the matrix product.
With the SymPy symbolic library, multiplication of array objects as either a*b or a@b will produce the matrix product.
The Hadamard product can be obtained with the method call a.multiply_elementwise(b).
[22] Some Python packages include support for Hadamard powers using methods like np.power(a, b), or the Pandas method a.pow(b).
In C++, the Eigen library provides a cwiseProduct member function for the Matrix class (a.cwiseProduct(b)), while the Armadillo library uses the operator % to make compact expressions (a % b; a * b is a matrix product).
In GAUSS, and HP Prime, the operation is known as array multiplication.
In Fortran, R, APL, J and Wolfram Language (Mathematica), the multiplication operator * or × apply the Hadamard product, whereas the matrix product is written using matmul, %*%, +.×, +/ .
The R package matrixcalc introduces the function hadamard.prod() for Hadamard Product of numeric matrices or vectors.
[23] The Hadamard product appears in lossy compression algorithms such as JPEG.
[citation needed] In image processing, the Hadamard operator can be used for enhancing, suppressing or masking image regions.
It is used in the machine learning literature, for example, to describe the architecture of recurrent neural networks as GRUs or LSTMs.
[24] It is also used to study the statistical properties of random vectors and matrices.
[25][26] According to the definition of V. Slyusar the penetrating face product of the p×g matrix
denotes the face-splitting product of matrices, The penetrating face product is used in the tensor-matrix theory of digital antenna arrays.
[27] This operation can also be used in artificial neural network models, specifically convolutional layers.
