Compute Library
 21.08
CpuGemmLowpMatrixBReductionKernel Class Reference

Kernel used to compute the row-vectors of sums of all the entries in each column of Matrix B. More...

#include <CpuGemmLowpMatrixReductionKernel.h>

Collaboration diagram for CpuGemmLowpMatrixBReductionKernel:
[legend]

Public Member Functions

 CpuGemmLowpMatrixBReductionKernel ()=default
 Default constructor. More...
 
 ARM_COMPUTE_DISALLOW_COPY_ALLOW_MOVE (CpuGemmLowpMatrixBReductionKernel)
 
void configure (const ITensorInfo *src, ITensorInfo *dst, const GEMMLowpReductionKernelInfo &info)
 Initialise the kernel's input and output. More...
 
void run_op (ITensorPack &tensors, const Window &window, const ThreadInfo &info) override
 Execute the kernel on the passed window. More...
 
const char * name () const override
 Name of the kernel. More...
 
- Public Member Functions inherited from ICPPKernel
virtual ~ICPPKernel ()=default
 Default destructor. More...
 
virtual void run (const Window &window, const ThreadInfo &info)
 Execute the kernel on the passed window. More...
 
virtual void run_nd (const Window &window, const ThreadInfo &info, const Window &thread_locator)
 legacy compatibility layer for implemantions which do not support thread_locator In these cases we simply narrow the interface down the legacy version More...
 
- Public Member Functions inherited from IKernel
 IKernel ()
 Constructor. More...
 
virtual ~IKernel ()=default
 Destructor. More...
 
virtual bool is_parallelisable () const
 Indicates whether or not the kernel is parallelisable. More...
 
virtual BorderSize border_size () const
 The size of the border for that kernel. More...
 
const Windowwindow () const
 The maximum window the kernel can be executed on. More...
 
bool is_window_configured () const
 Function to check if the embedded window of this kernel has been configured. More...
 

Static Public Member Functions

static Status validate (const ITensorInfo *src, const ITensorInfo *dst, const GEMMLowpReductionKernelInfo &info)
 Static function to check if given info will lead to a valid configuration. More...
 

Detailed Description

Kernel used to compute the row-vectors of sums of all the entries in each column of Matrix B.

Note
This stage is needed to handle the offset of matrix product https://github.com/google/gemmlowp/blob/master/doc/low-precision.md

Definition at line 101 of file CpuGemmLowpMatrixReductionKernel.h.

Constructor & Destructor Documentation

◆ CpuGemmLowpMatrixBReductionKernel()

Default constructor.

Member Function Documentation

◆ ARM_COMPUTE_DISALLOW_COPY_ALLOW_MOVE()

ARM_COMPUTE_DISALLOW_COPY_ALLOW_MOVE ( CpuGemmLowpMatrixBReductionKernel  )

◆ configure()

void configure ( const ITensorInfo src,
ITensorInfo dst,
const GEMMLowpReductionKernelInfo info 
)

Initialise the kernel's input and output.

Parameters
[in]srcInput tensor. Data type supported: Data type supported: QASYMM8/QASYMM8_SIGNED/QSYMM8/QSYMM8_PER_CHANNEL
[out]dstOutput row-vector of sums of all the entries in each column of mtx_b. Data type supported: S32
[in]infoKernel metadata:
  • k (num_mtx_b_rows) Number of matrix B rows.
  • is_reshaped (is_transposed1xW) True if the input tensor is transposed 1xW.
  • scalar Scalar value to multiply each reduced row by.
  • mul_byscalar True if each reduced row must be multiplied by a scalar value.

Definition at line 192 of file CpuGemmLowpMatrixReductionKernel.cpp.

References ARM_COMPUTE_ERROR, ARM_COMPUTE_ERROR_ON_NULLPTR, ARM_COMPUTE_ERROR_THROW_ON, arm_compute::auto_init_if_empty(), arm_compute::calculate_max_window_horizontal(), ITensorInfo::data_type(), ITensorInfo::dimension(), GEMMLowpReductionKernelInfo::k, GEMMLowpReductionKernelInfo::mul_by_scalar, num_elems_processed_per_iteration, arm_compute::QASYMM8, arm_compute::QASYMM8_SIGNED, arm_compute::QSYMM8, arm_compute::QSYMM8_PER_CHANNEL, arm_compute::S32, and GEMMLowpReductionKernelInfo::scalar.

193 {
195  ARM_COMPUTE_ERROR_THROW_ON(validate_arguments_matrix_b_reduction(src, dst, info));
196 
197  _k = info.k;
198  _scalar = info.scalar;
199  _mul_by_scalar = info.mul_by_scalar;
200 
201  // Configure kernel window
202  constexpr unsigned int num_elems_processed_per_iteration = 16;
203 
204  switch(src->data_type())
205  {
206  case DataType::QASYMM8:
207  _func = &CpuGemmLowpMatrixBReductionKernel::run_internal<uint8_t>;
208  break;
210  case DataType::QSYMM8:
212  _func = &CpuGemmLowpMatrixBReductionKernel::run_internal<int8_t>;
213  break;
214  default:
215  ARM_COMPUTE_ERROR("Unsupported data type");
216  }
217 
218  // Output auto initialization if not yet initialized
219  auto_init_if_empty(*dst, TensorShape(src->dimension(0)), 1, DataType::S32);
220 
221  // Configure kernel window
222  Window win = calculate_max_window_horizontal(*dst, Steps(num_elems_processed_per_iteration));
223  ICpuKernel::configure(win);
224 }
#define ARM_COMPUTE_ERROR(msg)
Print the given message then throw an std::runtime_error.
Definition: Error.h:352
#define ARM_COMPUTE_ERROR_THROW_ON(status)
Definition: Error.h:455
Window calculate_max_window_horizontal(const ValidRegion &valid_region, const Steps &steps, bool skip_border, BorderSize border_size)
SimpleTensor< float > src
Definition: DFT.cpp:155
1 channel, 1 S32 per channel
quantized, asymmetric fixed-point 8-bit number unsigned
unsigned int num_elems_processed_per_iteration
bool auto_init_if_empty(ITensorInfo &info, const TensorShape &shape, int num_channels, DataType data_type, QuantizationInfo quantization_info=QuantizationInfo())
Auto initialize the tensor info (shape, number of channels and data type) if the current assignment i...
quantized, symmetric fixed-point 8-bit number
quantized, symmetric per channel fixed-point 8-bit number
ScaleKernelInfo info(interpolation_policy, default_border_mode, PixelValue(), sampling_policy, false)
#define ARM_COMPUTE_ERROR_ON_NULLPTR(...)
Definition: Validate.h:157
quantized, asymmetric fixed-point 8-bit number signed

◆ name()

const char * name ( ) const
overridevirtual

Name of the kernel.

Returns
Kernel name

Implements ICPPKernel.

Definition at line 390 of file CpuGemmLowpMatrixReductionKernel.cpp.

391 {
392  return "CpuGemmLowpMatrixBReductionKernel";
393 }

◆ run_op()

void run_op ( ITensorPack tensors,
const Window window,
const ThreadInfo info 
)
overridevirtual

Execute the kernel on the passed window.

Warning
If is_parallelisable() returns false then the passed window must be equal to window()
Note
The window has to be a region within the window returned by the window() method
The width of the window has to be a multiple of num_elems_processed_per_iteration().
Parameters
[in]tensorsA vector containing the tensors to operate on.
[in]windowRegion on which to execute the kernel. (Must be a region of the window returned by window())
[in]infoInfo about executing thread and CPU.

Reimplemented from ICPPKernel.

Definition at line 378 of file CpuGemmLowpMatrixReductionKernel.cpp.

References arm_compute::ACL_DST, arm_compute::ACL_SRC, ARM_COMPUTE_ERROR_ON_INVALID_SUBWINDOW, ARM_COMPUTE_ERROR_ON_UNCONFIGURED_KERNEL, ARM_COMPUTE_UNUSED, ITensorPack::get_const_tensor(), ITensorPack::get_tensor(), and IKernel::window().

379 {
383 
384  auto src = tensors.get_const_tensor(TensorType::ACL_SRC);
385  auto dst = tensors.get_tensor(TensorType::ACL_DST);
386 
387  (this->*_func)(src, dst, window, info);
388 }
const Window & window() const
The maximum window the kernel can be executed on.
Definition: IKernel.cpp:28
SimpleTensor< float > src
Definition: DFT.cpp:155
#define ARM_COMPUTE_UNUSED(...)
To avoid unused variables warnings.
Definition: Error.h:152
#define ARM_COMPUTE_ERROR_ON_UNCONFIGURED_KERNEL(k)
Definition: Validate.h:915
ScaleKernelInfo info(interpolation_policy, default_border_mode, PixelValue(), sampling_policy, false)
#define ARM_COMPUTE_ERROR_ON_INVALID_SUBWINDOW(f, s)
Definition: Validate.h:201

◆ validate()

Status validate ( const ITensorInfo src,
const ITensorInfo dst,
const GEMMLowpReductionKernelInfo info 
)
static

The documentation for this class was generated from the following files: