initial release
This commit is contained in:
@@ -0,0 +1,61 @@
|
||||
## Simple
|
||||
|
||||
This example simply performs a matrix multiplication, solely for the purpose of demonstrating a basic usage of ggml and backend handling. The code is commented to help understand what each part does.
|
||||
|
||||
Traditional matrix multiplication goes like this (multiply row-by-column):
|
||||
|
||||
$$
|
||||
A \times B = C
|
||||
$$
|
||||
|
||||
$$
|
||||
\begin{bmatrix}
|
||||
2 & 8 \\
|
||||
5 & 1 \\
|
||||
4 & 2 \\
|
||||
8 & 6 \\
|
||||
\end{bmatrix}
|
||||
\times
|
||||
\begin{bmatrix}
|
||||
10 & 9 & 5 \\
|
||||
5 & 9 & 4 \\
|
||||
\end{bmatrix}
|
||||
\=
|
||||
\begin{bmatrix}
|
||||
60 & 90 & 42 \\
|
||||
55 & 54 & 29 \\
|
||||
50 & 54 & 28 \\
|
||||
110 & 126 & 64 \\
|
||||
\end{bmatrix}
|
||||
$$
|
||||
|
||||
In `ggml`, we pass the matrix $B$ in transposed form and multiply row-by-row. The result $C$ is also transposed:
|
||||
|
||||
$$
|
||||
ggml\\_mul\\_mat(A, B^T) = C^T
|
||||
$$
|
||||
|
||||
$$
|
||||
ggml\\_mul\\_mat(
|
||||
\begin{bmatrix}
|
||||
2 & 8 \\
|
||||
5 & 1 \\
|
||||
4 & 2 \\
|
||||
8 & 6 \\
|
||||
\end{bmatrix}
|
||||
,
|
||||
\begin{bmatrix}
|
||||
10 & 5 \\
|
||||
9 & 9 \\
|
||||
5 & 4 \\
|
||||
\end{bmatrix}
|
||||
)
|
||||
\=
|
||||
\begin{bmatrix}
|
||||
60 & 55 & 50 & 110 \\
|
||||
90 & 54 & 54 & 126 \\
|
||||
42 & 29 & 28 & 64 \\
|
||||
\end{bmatrix}
|
||||
$$
|
||||
|
||||
The `simple-ctx` doesn't support gpu acceleration. `simple-backend` demonstrates how to use other backends like CUDA and Metal.
|
||||
Reference in New Issue
Block a user