Compute Library
 21.02
NEQuantizationLayerKernel Class Reference

Interface for the quantization layer kernel. More...

#include <NEQuantizationLayerKernel.h>

Collaboration diagram for NEQuantizationLayerKernel:
[legend]

Public Member Functions

const char * name () const override
 Name of the kernel. More...
 
 NEQuantizationLayerKernel ()
 Default constructor. More...
 
 NEQuantizationLayerKernel (const NEQuantizationLayerKernel &)=delete
 Prevent instances of this class from being copied (As this class contains pointers) More...
 
NEQuantizationLayerKerneloperator= (const NEQuantizationLayerKernel &)=delete
 Prevent instances of this class from being copied (As this class contains pointers) More...
 
 NEQuantizationLayerKernel (NEQuantizationLayerKernel &&)=default
 Default Move Constructor. More...
 
NEQuantizationLayerKerneloperator= (NEQuantizationLayerKernel &&)=default
 Default move assignment operator. More...
 
 ~NEQuantizationLayerKernel ()=default
 Default destructor. More...
 
void configure (const ITensor *input, ITensor *output)
 Set the input, output. More...
 
void run (const Window &window, const ThreadInfo &info) override
 Execute the kernel on the passed window. More...
 
- Public Member Functions inherited from ICPPKernel
virtual ~ICPPKernel ()=default
 Default destructor. More...
 
virtual void run_nd (const Window &window, const ThreadInfo &info, const Window &thread_locator)
 legacy compatibility layer for implemantions which do not support thread_locator In these cases we simply narrow the interface down the legacy version More...
 
virtual void run_op (ITensorPack &tensors, const Window &window, const ThreadInfo &info)
 Execute the kernel on the passed window. More...
 
- Public Member Functions inherited from IKernel
 IKernel ()
 Constructor. More...
 
virtual ~IKernel ()=default
 Destructor. More...
 
virtual bool is_parallelisable () const
 Indicates whether or not the kernel is parallelisable. More...
 
virtual BorderSize border_size () const
 The size of the border for that kernel. More...
 
const Windowwindow () const
 The maximum window the kernel can be executed on. More...
 

Static Public Member Functions

static Status validate (const ITensorInfo *input, const ITensorInfo *output)
 Static function to check if given info will lead to a valid configuration of NEQuantizationLayerKernel. More...
 

Detailed Description

Interface for the quantization layer kernel.

Note
The implementation supports only 3D input tensors

Definition at line 38 of file NEQuantizationLayerKernel.h.

Constructor & Destructor Documentation

◆ NEQuantizationLayerKernel() [1/3]

Default constructor.

Definition at line 107 of file NEQuantizationLayerKernel.cpp.

Referenced by NEQuantizationLayerKernel::name().

108  : _input(nullptr), _output(nullptr), _func(nullptr)
109 {
110 }

◆ NEQuantizationLayerKernel() [2/3]

Prevent instances of this class from being copied (As this class contains pointers)

◆ NEQuantizationLayerKernel() [3/3]

Default Move Constructor.

◆ ~NEQuantizationLayerKernel()

Default destructor.

Referenced by NEQuantizationLayerKernel::name().

Member Function Documentation

◆ configure()

void configure ( const ITensor input,
ITensor output 
)

Set the input, output.

Parameters
[in]inputSource tensor. The dimensions over the third will be interpreted as batches. Data types supported: QASYMM8/QASYMM8_SIGNED/F32/F16.
[out]outputDestination tensor with the same dimensions of input. Data types supported: QASYMM8/QASYMM8_SIGNED/QASYMM16.
Note
Output auto initialization is not supported by this kernel

Definition at line 112 of file NEQuantizationLayerKernel.cpp.

References ARM_COMPUTE_ERROR, ARM_COMPUTE_ERROR_ON_NULLPTR, ARM_COMPUTE_ERROR_THROW_ON, arm_compute::calculate_max_window(), ITensorInfo::data_type(), ITensor::info(), arm_compute::test::validation::input, ITensorInfo::num_dimensions(), Dimensions< T >::set_num_dimensions(), ITensorInfo::set_valid_region(), arm_compute::string_from_data_type(), ITensorInfo::tensor_shape(), and arm_compute::validate_arguments().

Referenced by NEQuantizationLayerKernel::name().

113 {
115  ARM_COMPUTE_ERROR_THROW_ON(validate_arguments(input->info(), output->info()));
116 
117  _input = input;
118  _output = output;
119 
120  static const std::map<std::string, QuantizationFunctionExecutorPtr> quant_map =
121  {
122  { "op_QASYMM8_QASYMM8", &NEQuantizationLayerKernel::run_quantize_qasymm8<uint8_t, uint8_t> },
123  { "op_QASYMM8_QASYMM8_SIGNED", &NEQuantizationLayerKernel::run_quantize_qasymm8<uint8_t, int8_t> },
124  { "op_QASYMM8_QASYMM16", &NEQuantizationLayerKernel::run_quantize_qasymm16<uint8_t> },
125 
126  { "op_QASYMM8_SIGNED_QASYMM8", &NEQuantizationLayerKernel::run_quantize_qasymm8<int8_t, uint8_t> },
127  { "op_QASYMM8_SIGNED_QASYMM8_SIGNED", &NEQuantizationLayerKernel::run_quantize_qasymm8<int8_t, int8_t> },
128  { "op_QASYMM8_SIGNED_QASYMM16", &NEQuantizationLayerKernel::run_quantize_qasymm16<int8_t> },
129 
130  { "op_F32_QASYMM8", &NEQuantizationLayerKernel::run_quantize_qasymm8<float, uint8_t> },
131  { "op_F32_QASYMM8_SIGNED", &NEQuantizationLayerKernel::run_quantize_qasymm8<float, int8_t> },
132  { "op_F32_QASYMM16", &NEQuantizationLayerKernel::run_quantize_qasymm16<float> },
133 
134 #ifdef __ARM_FEATURE_FP16_VECTOR_ARITHMETIC
135  { "op_F16_QASYMM8", &NEQuantizationLayerKernel::run_quantize_qasymm8<float16_t, uint8_t> },
136  { "op_F16_QASYMM8_SIGNED", &NEQuantizationLayerKernel::run_quantize_qasymm8<float16_t, int8_t> },
137  { "op_F16_QASYMM16", &NEQuantizationLayerKernel::run_quantize_qasymm16<float16_t> },
138 #endif /* __ARM_FEATURE_FP16_VECTOR_ARITHMETIC*/
139  };
140 
141  std::string function_to_call("op_");
142  function_to_call += string_from_data_type(_input->info()->data_type()) + "_";
143  function_to_call += string_from_data_type(_output->info()->data_type());
144 
145  auto it = quant_map.find(function_to_call);
146 
147  if(it == quant_map.end())
148  {
149  ARM_COMPUTE_ERROR("Unsupported combination of input and output data types");
150  }
151  _func = it->second;
152 
153  // Configure kernel window
154  Window win_config = calculate_max_window(*input->info(), Steps());
155 
156  Coordinates coord;
157  coord.set_num_dimensions(output->info()->num_dimensions());
158  output->info()->set_valid_region(ValidRegion(coord, output->info()->tensor_shape()));
159 
160  INEKernel::configure(win_config);
161 }
Window calculate_max_window(const ValidRegion &valid_region, const Steps &steps, bool skip_border, BorderSize border_size)
#define ARM_COMPUTE_ERROR(msg)
Print the given message then throw an std::runtime_error.
Definition: Error.h:352
virtual DataType data_type() const =0
Data type used for each element of the tensor.
#define ARM_COMPUTE_ERROR_THROW_ON(status)
Definition: Error.h:455
const std::string & string_from_data_type(DataType dt)
Convert a data type identity into a string.
Definition: Utils.cpp:135
virtual ITensorInfo * info() const =0
Interface to be implemented by the child class to return the tensor&#39;s metadata.
Status validate_arguments(const ITensorInfo *input, const ITensorInfo *bias, const ITensorInfo *output, const GEMMLowpOutputStageInfo *output_stage)
#define ARM_COMPUTE_ERROR_ON_NULLPTR(...)
Definition: Validate.h:161

◆ name()

◆ operator=() [1/2]

NEQuantizationLayerKernel& operator= ( const NEQuantizationLayerKernel )
delete

Prevent instances of this class from being copied (As this class contains pointers)

Referenced by NEQuantizationLayerKernel::name().

◆ operator=() [2/2]

Default move assignment operator.

◆ run()

void run ( const Window window,
const ThreadInfo info 
)
overridevirtual

Execute the kernel on the passed window.

Warning
If is_parallelisable() returns false then the passed window must be equal to window()
Note
The window has to be a region within the window returned by the window() method
The width of the window has to be a multiple of num_elems_processed_per_iteration().
Parameters
[in]windowRegion on which to execute the kernel. (Must be a region of the window returned by window())
[in]infoInfo about executing thread and CPU.

Reimplemented from ICPPKernel.

Definition at line 257 of file NEQuantizationLayerKernel.cpp.

References ARM_COMPUTE_ERROR_ON, ARM_COMPUTE_ERROR_ON_INVALID_SUBWINDOW, ARM_COMPUTE_ERROR_ON_UNCONFIGURED_KERNEL, ARM_COMPUTE_UNUSED, and IKernel::window().

Referenced by NEQuantizationLayerKernel::name().

258 {
262  ARM_COMPUTE_ERROR_ON(_func == nullptr);
263 
264  (this->*_func)(window);
265 }
const Window & window() const
The maximum window the kernel can be executed on.
Definition: IKernel.cpp:28
#define ARM_COMPUTE_ERROR_ON(cond)
If the condition is true then an error message is printed and an exception thrown.
Definition: Error.h:466
#define ARM_COMPUTE_UNUSED(...)
To avoid unused variables warnings.
Definition: Error.h:152
#define ARM_COMPUTE_ERROR_ON_UNCONFIGURED_KERNEL(k)
Definition: Validate.h:941
ScaleKernelInfo info(interpolation_policy, default_border_mode, PixelValue(), sampling_policy, false)
#define ARM_COMPUTE_ERROR_ON_INVALID_SUBWINDOW(f, s)
Definition: Validate.h:205

◆ validate()

Status validate ( const ITensorInfo input,
const ITensorInfo output 
)
static

Static function to check if given info will lead to a valid configuration of NEQuantizationLayerKernel.

Parameters
[in]inputInput tensor info. Data types supported: QASYMM8/QASYMM8_SIGNED/F32/F16.
[in]outputOutput tensor info. Data types supported: QASYMM8/QASYMM8_SIGNED/QASYMM16.
Returns
a status

Definition at line 163 of file NEQuantizationLayerKernel.cpp.

References ARM_COMPUTE_RETURN_ON_ERROR, Window::collapse_if_possible(), arm_compute::compute_requantization_scale_offset(), ITensorInfo::data_type(), Window::DimX, Window::DimZ, Window::Dimension::end(), arm_compute::execute_window_loop(), ITensor::info(), arm_compute::test::validation::input, arm_compute::is_data_type_quantized_asymmetric(), Iterator::ptr(), ITensorInfo::quantization_info(), Qasymm8QuantizationHelper< QUANTIZED_TYPE >::quantize(), arm_compute::quantize_qasymm16(), Window::set(), Window::Dimension::start(), arm_compute::TO_NEAREST_EVEN, arm_compute::TO_ZERO, QuantizationInfo::uniform(), arm_compute::validate_arguments(), arm_compute::vquantize_qasymm16(), arm_compute::wrapper::vstore(), IKernel::window(), and Window::x().

Referenced by NEQuantizationLayerKernel::name(), and NEQuantizationLayer::validate().

164 {
166  return Status{};
167 }
#define ARM_COMPUTE_RETURN_ON_ERROR(status)
Checks if a status contains an error and returns it.
Definition: Error.h:204
Status validate_arguments(const ITensorInfo *input, const ITensorInfo *bias, const ITensorInfo *output, const GEMMLowpOutputStageInfo *output_stage)

The documentation for this class was generated from the following files: