21.02
|
OpenCL kernel to multiply matrices when both the input matrices LHS (input0) and RHS (input1) have been reshaped. More...
#include <CLGEMMMatrixMultiplyReshapedKernel.h>
Public Member Functions | |
CLGEMMMatrixMultiplyReshapedKernel () | |
Default Constructor. More... | |
CLGEMMMatrixMultiplyReshapedKernel (const CLGEMMMatrixMultiplyReshapedKernel &)=delete | |
Prevent instances of this class from being copied (As this class contains pointers) More... | |
CLGEMMMatrixMultiplyReshapedKernel & | operator= (const CLGEMMMatrixMultiplyReshapedKernel &)=delete |
Prevent instances of this class from being copied (As this class contains pointers) More... | |
CLGEMMMatrixMultiplyReshapedKernel (CLGEMMMatrixMultiplyReshapedKernel &&)=default | |
Allow instances of this class to be moved. More... | |
CLGEMMMatrixMultiplyReshapedKernel & | operator= (CLGEMMMatrixMultiplyReshapedKernel &&)=default |
Allow instances of this class to be moved. More... | |
void | configure (const ICLTensor *input0, const ICLTensor *input1, const ICLTensor *input2, ICLTensor *output, float alpha, float beta, const GEMMLHSMatrixInfo &lhs_info, const GEMMRHSMatrixInfo &rhs_info, const GEMMKernelInfo &gemm_info) |
Initialise the kernel's input and output. More... | |
void | configure (const CLCompileContext &compile_context, const ICLTensor *input0, const ICLTensor *input1, const ICLTensor *input2, ICLTensor *output, float alpha, float beta, const GEMMLHSMatrixInfo &lhs_info, const GEMMRHSMatrixInfo &rhs_info, const GEMMKernelInfo &gemm_info) |
Initialise the kernel's input and output. More... | |
void | run (const Window &window, cl::CommandQueue &queue) override |
Enqueue the OpenCL kernel to process the given window on the passed OpenCL command queue. More... | |
Public Member Functions inherited from ICLKernel | |
ICLKernel () | |
Constructor. More... | |
cl::Kernel & | kernel () |
Returns a reference to the OpenCL kernel of this object. More... | |
template<typename T > | |
void | add_1D_array_argument (unsigned int &idx, const ICLArray< T > *array, const Strides &strides, unsigned int num_dimensions, const Window &window) |
Add the passed 1D array's parameters to the object's kernel's arguments starting from the index idx. More... | |
void | add_1D_tensor_argument (unsigned int &idx, const ICLTensor *tensor, const Window &window) |
Add the passed 1D tensor's parameters to the object's kernel's arguments starting from the index idx. More... | |
void | add_1D_tensor_argument_if (bool cond, unsigned int &idx, const ICLTensor *tensor, const Window &window) |
Add the passed 1D tensor's parameters to the object's kernel's arguments starting from the index idx if the condition is true. More... | |
void | add_2D_tensor_argument (unsigned int &idx, const ICLTensor *tensor, const Window &window) |
Add the passed 2D tensor's parameters to the object's kernel's arguments starting from the index idx. More... | |
void | add_2D_tensor_argument_if (bool cond, unsigned int &idx, const ICLTensor *tensor, const Window &window) |
Add the passed 2D tensor's parameters to the object's kernel's arguments starting from the index idx if the condition is true. More... | |
void | add_3D_tensor_argument (unsigned int &idx, const ICLTensor *tensor, const Window &window) |
Add the passed 3D tensor's parameters to the object's kernel's arguments starting from the index idx. More... | |
void | add_4D_tensor_argument (unsigned int &idx, const ICLTensor *tensor, const Window &window) |
Add the passed 4D tensor's parameters to the object's kernel's arguments starting from the index idx. More... | |
virtual void | run_op (ITensorPack &tensors, const Window &window, cl::CommandQueue &queue) |
Enqueue the OpenCL kernel to process the given window on the passed OpenCL command queue. More... | |
template<typename T > | |
void | add_argument (unsigned int &idx, T value) |
Add the passed parameters to the object's kernel's arguments starting from the index idx. More... | |
void | set_lws_hint (const cl::NDRange &lws_hint) |
Set the Local-Workgroup-Size hint. More... | |
cl::NDRange | lws_hint () const |
Return the Local-Workgroup-Size hint. More... | |
void | set_wbsm_hint (const cl_int &wbsm_hint) |
Set the workgroup batch size modifier hint. More... | |
cl_int | wbsm_hint () const |
Return the workgroup batch size modifier hint. More... | |
const std::string & | config_id () const |
Get the configuration ID. More... | |
void | set_target (GPUTarget target) |
Set the targeted GPU architecture. More... | |
void | set_target (cl::Device &device) |
Set the targeted GPU architecture according to the CL device. More... | |
GPUTarget | get_target () const |
Get the targeted GPU architecture. More... | |
size_t | get_max_workgroup_size () |
Get the maximum workgroup size for the device the CLKernelLibrary uses. More... | |
template<unsigned int dimension_size> | |
void | add_tensor_argument (unsigned &idx, const ICLTensor *tensor, const Window &window) |
template<typename T , unsigned int dimension_size> | |
void | add_array_argument (unsigned &idx, const ICLArray< T > *array, const Strides &strides, unsigned int num_dimensions, const Window &window) |
Add the passed array's parameters to the object's kernel's arguments starting from the index idx. More... | |
Public Member Functions inherited from IKernel | |
IKernel () | |
Constructor. More... | |
virtual | ~IKernel ()=default |
Destructor. More... | |
virtual bool | is_parallelisable () const |
Indicates whether or not the kernel is parallelisable. More... | |
virtual BorderSize | border_size () const |
The size of the border for that kernel. More... | |
const Window & | window () const |
The maximum window the kernel can be executed on. More... | |
Static Public Member Functions | |
static Status | validate (const ITensorInfo *input0, const ITensorInfo *input1, const ITensorInfo *input2, const ITensorInfo *output, float alpha, float beta, const GEMMLHSMatrixInfo &lhs_info, const GEMMRHSMatrixInfo &rhs_info, const GEMMKernelInfo &gemm_info) |
Static function to check if given info will lead to a valid configuration of CLGEMMMatrixMultiplyReshapedKernel. More... | |
Static Public Member Functions inherited from ICLKernel | |
static constexpr unsigned int | num_arguments_per_1D_array () |
Returns the number of arguments enqueued per 1D array object. More... | |
static constexpr unsigned int | num_arguments_per_1D_tensor () |
Returns the number of arguments enqueued per 1D tensor object. More... | |
static constexpr unsigned int | num_arguments_per_2D_tensor () |
Returns the number of arguments enqueued per 2D tensor object. More... | |
static constexpr unsigned int | num_arguments_per_3D_tensor () |
Returns the number of arguments enqueued per 3D tensor object. More... | |
static constexpr unsigned int | num_arguments_per_4D_tensor () |
Returns the number of arguments enqueued per 4D tensor object. More... | |
static cl::NDRange | gws_from_window (const Window &window) |
Get the global work size given an execution window. More... | |
OpenCL kernel to multiply matrices when both the input matrices LHS (input0) and RHS (input1) have been reshaped.
input0
and input1
must be reshaped through CLGEMMReshapeLHSMatrixKernel and CLGEMMReshapeRHSMatrixKernel Definition at line 39 of file CLGEMMMatrixMultiplyReshapedKernel.h.
Default Constructor.
Definition at line 206 of file CLGEMMMatrixMultiplyReshapedKernel.cpp.
|
delete |
Prevent instances of this class from being copied (As this class contains pointers)
Allow instances of this class to be moved.
void configure | ( | const ICLTensor * | input0, |
const ICLTensor * | input1, | ||
const ICLTensor * | input2, | ||
ICLTensor * | output, | ||
float | alpha, | ||
float | beta, | ||
const GEMMLHSMatrixInfo & | lhs_info, | ||
const GEMMRHSMatrixInfo & | rhs_info, | ||
const GEMMKernelInfo & | gemm_info | ||
) |
Initialise the kernel's input and output.
[in] | input0 | Input tensor containing the LHS reshaped matrix. Data type supported: F16/F32 (only F32 if rhs_info.export_to_cl_image = true). The number of dimensions for the LHS matrix must be less or equal than 4 |
[in] | input1 | Input tensor containing the RHS reshaped matrix. Data type supported: same as input0 . The number of dimensions for the RHS matrix must be less or equal than 3 |
[in] | input2 | Input tensor containing the bias matrix. Data type supported: same as input0 . |
[out] | output | Output tensor to store the result of matrix multiplication. Data type supported: same as input0 |
[in] | alpha | Weight of the matrix product |
[in] | beta | Weight of the matrix bias |
[in] | lhs_info | LHS matrix information used for reshaping the input0 tensor. Only the following values are supported: lhs_info.m0: 2,3,4,5,6,7,8 lhs_info.k0: 2,3,4,8,16 lhs_info.transpose: false |
[in] | rhs_info | RHS matrix information used for reshaping the input1 tensor. Only the following values are supported: rhs_info.n0: 2,3,4,8,16 (only 4, 8 and 16 if rhs_info.export_to_cl_image = true) rhs_info.k0: 2,3,4,8,16 (only 4, 8 and 16 if rhs_info.export_to_cl_image = true) rhs_info.transpose: true |
[in] | gemm_info | GEMM information used to retrieve the original dimensions of the input matrices |
Definition at line 212 of file CLGEMMMatrixMultiplyReshapedKernel.cpp.
References CLKernelLibrary::get().
void configure | ( | const CLCompileContext & | compile_context, |
const ICLTensor * | input0, | ||
const ICLTensor * | input1, | ||
const ICLTensor * | input2, | ||
ICLTensor * | output, | ||
float | alpha, | ||
float | beta, | ||
const GEMMLHSMatrixInfo & | lhs_info, | ||
const GEMMRHSMatrixInfo & | rhs_info, | ||
const GEMMKernelInfo & | gemm_info | ||
) |
Initialise the kernel's input and output.
[in] | compile_context | The compile context to be used. |
[in] | input0 | Input tensor containing the LHS reshaped matrix. Data type supported: F16/F32 (only F32 if rhs_info.export_to_cl_image = true). The number of dimensions for the LHS matrix must be less or equal than 4 |
[in] | input1 | Input tensor containing the RHS reshaped matrix. Data type supported: same as input0 . The number of dimensions for the RHS matrix must be less or equal than 3 |
[in] | input2 | Input tensor containing the bias matrix. Data type supported: same as input0 . |
[out] | output | Output tensor to store the result of matrix multiplication. Data type supported: same as input0 |
[in] | alpha | Weight of the matrix product |
[in] | beta | Weight of the matrix bias |
[in] | lhs_info | LHS matrix information used for reshaping the input0 tensor. Only the following values are supported: lhs_info.m0: 2,3,4,5,6,7,8 lhs_info.k0: 2,3,4,8,16 lhs_info.transpose: false |
[in] | rhs_info | RHS matrix information used for reshaping the input1 tensor. Only the following values are supported: rhs_info.n0: 2,3,4,8,16 (only 4, 8 and 16 if rhs_info.export_to_cl_image = true) rhs_info.k0: 2,3,4,8,16 (only 4, 8 and 16 if rhs_info.export_to_cl_image = true) rhs_info.transpose: true |
[in] | gemm_info | GEMM information used to retrieve the original dimensions of the input matrices |
Definition at line 219 of file CLGEMMMatrixMultiplyReshapedKernel.cpp.
References ARM_COMPUTE_ERROR_ON_NULLPTR, ARM_COMPUTE_ERROR_THROW_ON, arm_compute::get_padding_info(), ITensor::info(), arm_compute::helpers::float_ops::is_zero(), and arm_compute::validate_arguments().
|
delete |
Prevent instances of this class from being copied (As this class contains pointers)
|
default |
Allow instances of this class to be moved.
|
overridevirtual |
Enqueue the OpenCL kernel to process the given window on the passed OpenCL command queue.
[in] | window | Region on which to execute the kernel. (Must be a valid region of the window returned by window()). |
[in,out] | queue | Command queue on which to enqueue the kernel. |
Reimplemented from ICLKernel.
Definition at line 355 of file CLGEMMMatrixMultiplyReshapedKernel.cpp.
References ARM_COMPUTE_ERROR_ON, ARM_COMPUTE_ERROR_ON_INVALID_SUBWINDOW, ARM_COMPUTE_ERROR_ON_UNCONFIGURED_KERNEL, Window::DimX, Window::DimY, Window::first_slice_window_3D(), ITensor::info(), ITensorInfo::num_dimensions(), Window::set(), arm_compute::test::validation::reference::slice(), ITensorInfo::strides_in_bytes(), and IKernel::window().
|
static |
Static function to check if given info will lead to a valid configuration of CLGEMMMatrixMultiplyReshapedKernel.
[in] | input0 | Input tensor containing the LHS reshaped matrix. Data type supported: F16/F32 (only F32 if rhs_info.export_to_cl_image = true). The number of dimensions for the LHS matrix must be less or equal than 4 |
[in] | input1 | Input tensor containing the RHS reshaped matrix. Data type supported: same as input0 . The number of dimensions for the RHS matrix must be less or equal than 3 |
[in] | input2 | Input tensor info containing the bias matrix. Data type supported: same as input0 . |
[in] | output | Output tensor to store the result of matrix multiplication. Data type supported: same as input0 |
[in] | alpha | Weight of the matrix product |
[in] | beta | Weight of the matrix bias |
[in] | lhs_info | LHS matrix information used for reshaping the input0 tensor. Only the following values are supported: lhs_info.m0: 2,3,4,5,6,7,8 lhs_info.k0: 2,3,4,8,16 lhs_info.transpose: false |
[in] | rhs_info | RHS matrix information used for reshaping the input1 tensor. Only the following values are supported: rhs_info.n0: 2,3,4,8,16 (only 4, 8 and 16 if rhs_info.export_to_cl_image = true) rhs_info.k0: 2,3,4,8,16 (only 4, 8 and 16 if rhs_info.export_to_cl_image = true) rhs_info.transpose: true |
[in] | gemm_info | GEMM information used to retrieve the original dimensions of the input matrices |
Definition at line 336 of file CLGEMMMatrixMultiplyReshapedKernel.cpp.
References ARM_COMPUTE_RETURN_ON_ERROR, ICloneable< T >::clone(), and arm_compute::validate_arguments().
Referenced by CLGEMMReshapeRHSMatrixKernelManaged::configure(), and arm_compute::test::validation::DATA_TEST_CASE().