Compute Library
 21.02
GCGEMMInterleave4x4Kernel Class Reference

OpenGL ES kernel which interleaves the elements of a matrix A in chunk of 4x4. More...

#include <GCGEMMInterleave4x4Kernel.h>

Collaboration diagram for GCGEMMInterleave4x4Kernel:
[legend]

Public Member Functions

 GCGEMMInterleave4x4Kernel ()
 Default constructor. More...
 
 GCGEMMInterleave4x4Kernel (const GCGEMMInterleave4x4Kernel &)=delete
 Prevent instances of this class from being copied (As this class contains pointers) More...
 
GCGEMMInterleave4x4Kerneloperator= (const GCGEMMInterleave4x4Kernel &)=delete
 Prevent instances of this class from being copied (As this class contains pointers) More...
 
 GCGEMMInterleave4x4Kernel (GCGEMMInterleave4x4Kernel &&)=default
 Allow instances of this class to be moved. More...
 
GCGEMMInterleave4x4Kerneloperator= (GCGEMMInterleave4x4Kernel &&)=default
 Allow instances of this class to be moved. More...
 
void configure (const IGCTensor *input, IGCTensor *output)
 Initialise the kernel's input and output. More...
 
void run (const Window &window) override
 Enqueue the OpenGL ES shader to process the given window. More...
 
- Public Member Functions inherited from IGCKernel
 IGCKernel ()
 Constructor. More...
 
GCKernelkernel ()
 Returns a reference to the GLES kernel of this object. More...
 
void add_1D_tensor_argument (unsigned int &idx, const IGCTensor *tensor, const unsigned int binding_point, const Window &window)
 Add the passed 1D tensor's parameters to the object's kernel's arguments starting from the index idx. More...
 
void add_2D_tensor_argument (unsigned int &idx, const IGCTensor *tensor, const unsigned int binding_point, const Window &window)
 Add the passed 2D tensor's parameters to the object's kernel's arguments starting from the index idx. More...
 
void add_3D_tensor_argument (unsigned int &idx, const IGCTensor *tensor, const unsigned int binding_point, const Window &window)
 Add the passed 3D tensor's parameters to the object's kernel's arguments starting from the index idx. More...
 
unsigned int num_arguments_per_1D_tensor () const
 Returns the number of arguments enqueued per 1D tensor object. More...
 
unsigned int num_arguments_per_2D_tensor () const
 Returns the number of arguments enqueued per 2D tensor object. More...
 
unsigned int num_arguments_per_3D_tensor () const
 Returns the number of arguments enqueued per 3D tensor object. More...
 
void set_lws_hint (gles::NDRange &lws_hint)
 Set the Local-Workgroup-Size hint. More...
 
void set_target (GPUTarget target)
 Set the targeted GPU architecture. More...
 
GPUTarget get_target () const
 Get the targeted GPU architecture. More...
 
- Public Member Functions inherited from IKernel
 IKernel ()
 Constructor. More...
 
virtual ~IKernel ()=default
 Destructor. More...
 
virtual bool is_parallelisable () const
 Indicates whether or not the kernel is parallelisable. More...
 
virtual BorderSize border_size () const
 The size of the border for that kernel. More...
 
const Windowwindow () const
 The maximum window the kernel can be executed on. More...
 

Detailed Description

OpenGL ES kernel which interleaves the elements of a matrix A in chunk of 4x4.

This function puts the values in a 4x4 block of Matrix A on the same row (Interleaved values)

\[ \left( \begin{array}{cccc} a00 & a01 & a02 & a03 \\ a10 & a11 & a12 & a13 \\ a20 & a21 & a22 & a23 \\ a30 & a31 & a32 & a33 \\ \end{array} \right) \rightarrow \left( \begin{array}{ccccccccccccccccc} a00 & a10 & a20 & a30 & a01 & a11 & a21 & a31 & a02 & a12 & a22 & a32 & a03 & a13 & a23 & a33 \\ \end{array} \right) \]

After this operation, the output matrix will have the following shape: [ height * 4, ceil(width / 4.0f) ]

Definition at line 52 of file GCGEMMInterleave4x4Kernel.h.

Constructor & Destructor Documentation

◆ GCGEMMInterleave4x4Kernel() [1/3]

Default constructor.

Definition at line 42 of file GCGEMMInterleave4x4Kernel.cpp.

43  : _input(nullptr), _output(nullptr)
44 {
45 }

◆ GCGEMMInterleave4x4Kernel() [2/3]

Prevent instances of this class from being copied (As this class contains pointers)

◆ GCGEMMInterleave4x4Kernel() [3/3]

Allow instances of this class to be moved.

Member Function Documentation

◆ configure()

void configure ( const IGCTensor input,
IGCTensor output 
)

Initialise the kernel's input and output.

Parameters
[in]inputInput tensor. Data types supported: F16, F32
[out]outputOutput tensor. Data type supported: same as input

Definition at line 47 of file GCGEMMInterleave4x4Kernel.cpp.

References ARM_COMPUTE_ERROR_ON_DATA_TYPE_CHANNEL_NOT_IN, ARM_COMPUTE_ERROR_ON_MISMATCHING_DATA_TYPES, ARM_COMPUTE_ERROR_ON_MISMATCHING_DIMENSIONS, ARM_COMPUTE_ERROR_ON_NULLPTR, arm_compute::auto_init_if_empty(), arm_compute::calculate_max_window(), GCKernelLibrary::create_kernel(), arm_compute::data_size_from_type(), ITensorInfo::data_type(), ITensorInfo::dimension(), arm_compute::F16, arm_compute::F32, GCKernelLibrary::get(), ITensor::info(), arm_compute::test::validation::input, arm_compute::test::validation::output_shape, TensorShape::set(), ITensorInfo::set_valid_region(), ITensorInfo::tensor_shape(), arm_compute::support::cpp11::to_string(), and arm_compute::update_window_and_padding().

Referenced by GCGEMM::configure().

48 {
51 
53  output_shape.set(0, input->info()->dimension(0) * 4);
54  output_shape.set(1, std::ceil(input->info()->dimension(1) / 4.0f));
55 
56  // Output auto inizialitation if not yet initialized
57  auto_init_if_empty(*output->info(), output_shape, 1, input->info()->data_type());
58 
61 
62  _input = input;
63  _output = output;
64 
65  std::set<std::string> build_opts;
66  std::string dt_name = (input->info()->data_type() == DataType::F32) ? "DATA_TYPE_FP32" : "DATA_TYPE_FP16";
67  build_opts.emplace(("#define " + dt_name));
68  build_opts.emplace("#define LOCAL_SIZE_X " + support::cpp11::to_string(1));
69  build_opts.emplace("#define LOCAL_SIZE_Y " + support::cpp11::to_string(1));
70  build_opts.emplace("#define LOCAL_SIZE_Z " + support::cpp11::to_string(1));
71 
72  // Create kernel
73  build_opts.emplace("#define GEMM_INTERLEAVE4x4");
74  _kernel = static_cast<GCKernel>(GCKernelLibrary::get().create_kernel("gemm_interleave4x4", build_opts));
75 
76  // Configure kernel window
77  const unsigned int num_elems_processed_per_iteration_x = max_gc_vector_width / data_size_from_type(input->info()->data_type());
78  constexpr unsigned int num_elems_processed_per_iteration_y = 4;
79  const unsigned int num_elems_written_per_iteration = num_elems_processed_per_iteration_x * num_elems_processed_per_iteration_y;
80 
81  Window win = calculate_max_window(*input->info(), Steps(num_elems_processed_per_iteration_x, num_elems_processed_per_iteration_y));
82 
83  AccessWindowRectangle input_access(input->info(), 0, 0, num_elems_processed_per_iteration_x, num_elems_processed_per_iteration_y);
84  AccessWindowRectangle output_access(output->info(), 0, 0, num_elems_written_per_iteration, 1, 4.f, 0.25f);
85 
86  update_window_and_padding(win, input_access, output_access);
87 
88  output->info()->set_valid_region(ValidRegion(Coordinates(), output->info()->tensor_shape()));
89 
90  IGCKernel::configure(win);
91 }
Window calculate_max_window(const ValidRegion &valid_region, const Steps &steps, bool skip_border, BorderSize border_size)
Shape of a tensor.
Definition: TensorShape.h:39
virtual size_t dimension(size_t index) const =0
Return the size of the requested dimension.
std::string to_string(T &&value)
Convert integer and float values to string.
virtual DataType data_type() const =0
Data type used for each element of the tensor.
1 channel, 1 F32 per channel
GCKernel class.
virtual void set_valid_region(const ValidRegion &valid_region)=0
Set the valid region of the tensor.
1 channel, 1 F16 per channel
Implementation of a rectangular access pattern.
bool update_window_and_padding(Window &win, Ts &&... patterns)
Update window and padding size for each of the access patterns.
Definition: WindowHelpers.h:46
virtual const TensorShape & tensor_shape() const =0
Size for each dimension of the tensor.
#define ARM_COMPUTE_ERROR_ON_MISMATCHING_DATA_TYPES(...)
Definition: Validate.h:543
Class to describe a number of elements in each dimension.
Definition: Steps.h:40
Coordinates of an item.
Definition: Coordinates.h:37
bool auto_init_if_empty(ITensorInfo &info, const TensorShape &shape, int num_channels, DataType data_type, QuantizationInfo quantization_info=QuantizationInfo())
Auto initialize the tensor info (shape, number of channels and data type) if the current assignment i...
virtual ITensorInfo * info() const =0
Interface to be implemented by the child class to return the tensor&#39;s metadata.
size_t data_size_from_type(DataType data_type)
The size in bytes of the data type.
Definition: Utils.h:106
#define ARM_COMPUTE_ERROR_ON_DATA_TYPE_CHANNEL_NOT_IN(t, c,...)
Definition: Validate.h:790
static GCKernelLibrary & get()
Get the static instance of GCKernelLibrary.
#define ARM_COMPUTE_ERROR_ON_MISMATCHING_DIMENSIONS(...)
Definition: Validate.h:286
GCKernel create_kernel(const std::string &shader_name, const StringSet &build_options_set={}) const
Creates a kernel from the kernel library.
#define ARM_COMPUTE_ERROR_ON_NULLPTR(...)
Definition: Validate.h:161
Container for valid region of a window.
Definition: Types.h:188
Describe a multidimensional execution window.
Definition: Window.h:39
TensorShape & set(size_t dimension, size_t value, bool apply_dim_correction=true, bool increase_dim_unit=true)
Accessor to set the value of one of the dimensions.
Definition: TensorShape.h:79

◆ operator=() [1/2]

GCGEMMInterleave4x4Kernel& operator= ( const GCGEMMInterleave4x4Kernel )
delete

Prevent instances of this class from being copied (As this class contains pointers)

◆ operator=() [2/2]

Allow instances of this class to be moved.

◆ run()

void run ( const Window window)
overridevirtual

Enqueue the OpenGL ES shader to process the given window.

Parameters
[in]windowRegion on which to execute the kernel. (Must be a valid region of the window returned by window()).

Implements IGCKernel.

Definition at line 93 of file GCGEMMInterleave4x4Kernel.cpp.

References IGCKernel::add_2D_tensor_argument(), ARM_COMPUTE_ERROR_ON_INVALID_SUBWINDOW, ARM_COMPUTE_ERROR_ON_UNCONFIGURED_KERNEL, Window::DimX, Window::DimY, arm_compute::enqueue(), Window::first_slice_window_2D(), Window::scale(), Window::slide_window_slice_2D(), and IKernel::window().

94 {
97 
98  _kernel.use();
99 
100  /*
101  * This kernel puts the values in a 4x4 block of Matrix A on the same row (Interleaved values)
102  * |a00 a01 a02 a03|
103  * |a10 a11 a12 a13|
104  * |a20 a21 a22 a23| = | a00 a10 a20 a30 || a01 a11 a21 a31 || a02 a12 a22 a32 || a03 a13 a23 a33 |
105  * |a30 a31 a32 a33|
106  *
107  * After this operation, the output matrix will have the following shape: [ height * 4, width / 4 ]
108  */
109  Window in_slice = window.first_slice_window_2D();
110  Window out_slice = window.first_slice_window_2D();
111 
112  // Change x and y steps for the slide of output tensor
113  out_slice.scale(Window::DimX, 4.f);
114  out_slice.scale(Window::DimY, 0.25f);
115 
116  do
117  {
118  unsigned int idx = 0;
119  add_2D_tensor_argument(idx, _input, 1, in_slice);
120  add_2D_tensor_argument(idx, _output, 2, out_slice);
121 
122  _kernel.update_shader_params();
123 
124  enqueue(*this, in_slice);
125  }
126  while(window.slide_window_slice_2D(in_slice) && window.slide_window_slice_2D(out_slice));
127 }
Window first_slice_window_2D() const
First 2D slice of the window.
Definition: Window.h:283
void scale(size_t dimension, float scale_value)
Scale the values of a given dimension by the given scale_value.
Definition: Window.inl:155
const Window & window() const
The maximum window the kernel can be executed on.
Definition: IKernel.cpp:28
void enqueue(IGCKernel &kernel, const Window &window, const gles::NDRange &lws=gles::NDRange(1U, 1U, 1U))
Add the kernel to the command queue with the given window.
Definition: IGCKernel.cpp:41
bool slide_window_slice_2D(Window &slice) const
Slide the passed 2D window slice.
Definition: Window.h:323
static constexpr size_t DimX
Alias for dimension 0 also known as X dimension.
Definition: Window.h:43
void add_2D_tensor_argument(unsigned int &idx, const IGCTensor *tensor, const unsigned int binding_point, const Window &window)
Add the passed 2D tensor&#39;s parameters to the object&#39;s kernel&#39;s arguments starting from the index idx...
Definition: IGCKernel.cpp:127
#define ARM_COMPUTE_ERROR_ON_UNCONFIGURED_KERNEL(k)
Definition: Validate.h:941
static constexpr size_t DimY
Alias for dimension 1 also known as Y dimension.
Definition: Window.h:45
Describe a multidimensional execution window.
Definition: Window.h:39
#define ARM_COMPUTE_ERROR_ON_INVALID_SUBWINDOW(f, s)
Definition: Validate.h:205

The documentation for this class was generated from the following files: