Compute Library
 19.08
NEGEMMLowpOffsetContributionKernel Class Reference

NEON kernel used to add the offset contribution after NEGEMMLowpMatrixMultiplyKernel. More...

#include <NEGEMMLowpOffsetContributionKernel.h>

Collaboration diagram for NEGEMMLowpOffsetContributionKernel:
[legend]

Public Member Functions

const char * name () const override
 Name of the kernel. More...
 
 NEGEMMLowpOffsetContributionKernel ()
 Constructor. More...
 
 NEGEMMLowpOffsetContributionKernel (const NEGEMMLowpOffsetContributionKernel &)=delete
 Prevent instances of this class from being copied (As this class contains pointers) More...
 
NEGEMMLowpOffsetContributionKerneloperator= (const NEGEMMLowpOffsetContributionKernel &)=delete
 Prevent instances of this class from being copied (As this class contains pointers) More...
 
 NEGEMMLowpOffsetContributionKernel (NEGEMMLowpOffsetContributionKernel &&)=default
 Allow instances of this class to be moved. More...
 
NEGEMMLowpOffsetContributionKerneloperator= (NEGEMMLowpOffsetContributionKernel &&)=default
 Allow instances of this class to be moved. More...
 
void configure (ITensor *mm_result, const ITensor *vector_sum_col, const ITensor *vector_sum_row, int32_t k, int32_t a_offset, int32_t b_offset)
 Initialise the kernel's input and output. More...
 
void run (const Window &window, const ThreadInfo &info) override
 Execute the kernel on the passed window. More...
 
- Public Member Functions inherited from ICPPKernel
virtual ~ICPPKernel ()=default
 Default destructor. More...
 
- Public Member Functions inherited from IKernel
 IKernel ()
 Constructor. More...
 
virtual ~IKernel ()=default
 Destructor. More...
 
virtual bool is_parallelisable () const
 Indicates whether or not the kernel is parallelisable. More...
 
virtual BorderSize border_size () const
 The size of the border for that kernel. More...
 
const Windowwindow () const
 The maximum window the kernel can be executed on. More...
 

Static Public Member Functions

static Status validate (const ITensorInfo *mm_result, const ITensorInfo *vector_sum_col, const ITensorInfo *vector_sum_row, int32_t a_offset, int32_t b_offset)
 Static function to check if given info will lead to a valid configuration of NEGEMMLowpOffsetContributionKernel. More...
 

Detailed Description

NEON kernel used to add the offset contribution after NEGEMMLowpMatrixMultiplyKernel.

The computation is performed in-place

This kernel takes a final int32 accumulator value (the output of NEGEMMLowpMatrixMultiplyKernel), and adds to it the offset contribution of matrix A and matrix B in-place.

The final result is:

mm_result[i][k] = mm_result[i][k] + (vector_sum_col[k] * a_offset) + (vector_sum_row[i] * b_offset) + (a_offset * b_offset * k)

Definition at line 46 of file NEGEMMLowpOffsetContributionKernel.h.

Constructor & Destructor Documentation

◆ NEGEMMLowpOffsetContributionKernel() [1/3]

Constructor.

Definition at line 338 of file NEGEMMLowpOffsetContributionKernel.cpp.

339  : _vector_sum_col(nullptr), _vector_sum_row(nullptr), _mm_result(nullptr), _a_offset(0), _b_offset(0), _k_offset(0), _slide_vector_sum_col(true)
340 {
341 }

◆ NEGEMMLowpOffsetContributionKernel() [2/3]

Prevent instances of this class from being copied (As this class contains pointers)

◆ NEGEMMLowpOffsetContributionKernel() [3/3]

Allow instances of this class to be moved.

Member Function Documentation

◆ configure()

void configure ( ITensor mm_result,
const ITensor vector_sum_col,
const ITensor vector_sum_row,
int32_t  k,
int32_t  a_offset,
int32_t  b_offset 
)

Initialise the kernel's input and output.

Parameters
[in,out]mm_resultInput tensor containing the result of NEGEMMLowpMatrixMultiplyKernel. Data type supported: S32
[in]vector_sum_colInput row-vector of sums of all the entries in each column of matrix B. Note: vector_sum_col can be a nullptr in case a_offset = 0. Data type supported: same as mm_result
[in]vector_sum_rowInput row-vector of sums of all the entries in each row of matrix A. Note: vector_sum_row can be a nullptr in case b_offset = 0. Data type supported: same as mm_result
[in]kNumber of matrix A columns or Matrix B rows
[in]a_offsetOffset to be added to each element of the matrix A.
[in]b_offsetOffset to be added to each element of the matrix B.

Definition at line 343 of file NEGEMMLowpOffsetContributionKernel.cpp.

344 {
345  // Perform validate step
346  ARM_COMPUTE_ERROR_ON_NULLPTR(mm_result);
347  ARM_COMPUTE_ERROR_THROW_ON(validate_arguments(mm_result->info(),
348  vector_sum_col != nullptr ? vector_sum_col->info() : nullptr, // NOLINT
349  vector_sum_row != nullptr ? vector_sum_row->info() : nullptr, // NOLINT
350  a_offset, b_offset)); // NOLINT
351 
352  _vector_sum_col = vector_sum_col;
353  _vector_sum_row = vector_sum_row;
354  _mm_result = mm_result;
355  _a_offset = a_offset;
356  _b_offset = b_offset;
357  _k_offset = a_offset * b_offset * k;
358 
359  // If a_offset == 0, vector_sum_col can be a nullptr
360  if(a_offset != 0)
361  {
362  // Check if vector_sum_col_shape should be slidden or not
363  // Don't slide vector_sum_col_shape along the y dimension if vector_sum_col_shape has just 1 dimension and vector_sum_row_shape more than 1
364  // This scenario can happen when the the matrix multiplication is used to perform a convolution operation
365  _slide_vector_sum_col = vector_sum_col->info()->tensor_shape().num_dimensions() > 1;
366  }
367 
368  // Configure kernel window
369  auto win_config = validate_and_configure_window(mm_result->info(),
370  vector_sum_col != nullptr ? vector_sum_col->info() : nullptr, // NOLINT
371  vector_sum_row != nullptr ? vector_sum_row->info() : nullptr, // NOLINT
372  a_offset, b_offset);
373  ARM_COMPUTE_ERROR_THROW_ON(win_config.first);
374  INEKernel::configure(win_config.second);
375 }
std::pair< Status, Window > validate_and_configure_window(ITensorInfo *input, ITensorInfo *weights, ITensorInfo *biases, ITensorInfo *output, const PadStrideInfo &conv_info, unsigned int depth_multiplier, const Size2D &dilation)
#define ARM_COMPUTE_ERROR_THROW_ON(status)
Definition: Error.h:327
virtual const TensorShape & tensor_shape() const =0
Size for each dimension of the tensor.
virtual ITensorInfo * info() const =0
Interface to be implemented by the child class to return the tensor's metadata.
#define ARM_COMPUTE_ERROR_ON_NULLPTR(...)
Definition: Validate.h:161
unsigned int num_dimensions() const
Returns the effective dimensionality of the tensor.
Definition: Dimensions.h:122

References ARM_COMPUTE_ERROR_ON_NULLPTR, ARM_COMPUTE_ERROR_THROW_ON, ITensor::info(), Dimensions< T >::num_dimensions(), ITensorInfo::tensor_shape(), and arm_compute::validate_and_configure_window().

Referenced by NEGEMMLowpMatrixMultiplyCore::configure().

◆ name()

const char* name ( ) const
inlineoverridevirtual

Name of the kernel.

Returns
Kernel name

Implements ICPPKernel.

Definition at line 49 of file NEGEMMLowpOffsetContributionKernel.h.

50  {
51  return "NEGEMMLowpOffsetContributionKernel";
52  }

◆ operator=() [1/2]

Prevent instances of this class from being copied (As this class contains pointers)

◆ operator=() [2/2]

Allow instances of this class to be moved.

◆ run()

void run ( const Window window,
const ThreadInfo info 
)
overridevirtual

Execute the kernel on the passed window.

Warning
If is_parallelisable() returns false then the passed window must be equal to window()
Note
The window has to be a region within the window returned by the window() method
The width of the window has to be a multiple of num_elems_processed_per_iteration().
Parameters
[in]windowRegion on which to execute the kernel. (Must be a region of the window returned by window())
[in]infoInfo about executing thread and CPU.

Implements ICPPKernel.

Definition at line 390 of file NEGEMMLowpOffsetContributionKernel.cpp.

391 {
395 
396  // Check if input is a 3D reinterpretation
397  const bool reinterpret_as_3d = _vector_sum_row != nullptr
398  && _mm_result->info()->num_dimensions() > 1
399  && _mm_result->info()->tensor_shape().y() != _vector_sum_row->info()->tensor_shape().x();
400 
401  if(reinterpret_as_3d)
402  {
403  run_offset_contribution<true>(window, _mm_result, _vector_sum_col, _vector_sum_row, _a_offset, _b_offset, _k_offset, _slide_vector_sum_col);
404  }
405  else
406  {
407  run_offset_contribution<false>(window, _mm_result, _vector_sum_col, _vector_sum_row, _a_offset, _b_offset, _k_offset, _slide_vector_sum_col);
408  }
409 }
virtual size_t num_dimensions() const =0
The number of dimensions of the tensor (rank)
const Window & window() const
The maximum window the kernel can be executed on.
Definition: IKernel.cpp:28
T x() const
Alias to access the size of the first dimension.
Definition: Dimensions.h:81
#define ARM_COMPUTE_UNUSED(...)
To avoid unused variables warnings.
Definition: Error.h:160
virtual const TensorShape & tensor_shape() const =0
Size for each dimension of the tensor.
virtual ITensorInfo * info() const =0
Interface to be implemented by the child class to return the tensor's metadata.
T y() const
Alias to access the size of the second dimension.
Definition: Dimensions.h:86
#define ARM_COMPUTE_ERROR_ON_INVALID_SUBWINDOW(f, s)
Definition: Validate.h:205
#define ARM_COMPUTE_ERROR_ON_UNCONFIGURED_KERNEL(k)
Definition: Validate.h:940

References ARM_COMPUTE_ERROR_ON_INVALID_SUBWINDOW, ARM_COMPUTE_ERROR_ON_UNCONFIGURED_KERNEL, ARM_COMPUTE_UNUSED, ITensor::info(), arm_compute::test::validation::info, ITensorInfo::num_dimensions(), ITensorInfo::tensor_shape(), IKernel::window(), Dimensions< T >::x(), and Dimensions< T >::y().

◆ validate()

Status validate ( const ITensorInfo mm_result,
const ITensorInfo vector_sum_col,
const ITensorInfo vector_sum_row,
int32_t  a_offset,
int32_t  b_offset 
)
static

Static function to check if given info will lead to a valid configuration of NEGEMMLowpOffsetContributionKernel.

Parameters
[in]mm_resultInput tensor containing the result of NEGEMMLowpMatrixMultiplyKernel. Data type supported: S32
[in]vector_sum_colInput row-vector of sums of all the entries in each column of matrix B. Note: vector_sum_col can be a nullptr in case a_offset = 0. Data type supported: same as mm_result
[in]vector_sum_rowInput row-vector of sums of all the entries in each row of matrix A. Note: vector_sum_row can be a nullptr in case b_offset = 0. Data type supported: same as mm_result
[in]a_offsetOffset to be added to each element of the matrix A.
[in]b_offsetOffset to be added to each element of the matrix B.
Returns
a status

Definition at line 377 of file NEGEMMLowpOffsetContributionKernel.cpp.

379 {
380  ARM_COMPUTE_RETURN_ON_ERROR(validate_arguments(mm_result, vector_sum_col, vector_sum_row, a_offset, b_offset));
382  vector_sum_col != nullptr ? vector_sum_col->clone().get() : nullptr,
383  vector_sum_row != nullptr ? vector_sum_row->clone().get() : nullptr,
384  a_offset, b_offset)
385  .first); // NOLINT
386 
387  return Status{};
388 }
std::pair< Status, Window > validate_and_configure_window(ITensorInfo *input, ITensorInfo *weights, ITensorInfo *biases, ITensorInfo *output, const PadStrideInfo &conv_info, unsigned int depth_multiplier, const Size2D &dilation)
#define ARM_COMPUTE_RETURN_ON_ERROR(status)
Checks if a status contains an error and returns it.
Definition: Error.h:193
Status class.
Definition: Error.h:52
virtual std::unique_ptr< T > clone() const =0
Provide a clone of the current object of class T.

References ARM_COMPUTE_RETURN_ON_ERROR, ICloneable< T >::clone(), and arm_compute::validate_and_configure_window().

Referenced by NEGEMMLowpMatrixMultiplyCore::validate().


The documentation for this class was generated from the following files: