NeonBackendModelContext Class Reference

The NeonBackendModelContext is used to pass in Neon specific backend ModelOptions. More...

#include <NeonBackendModelContext.hpp>

Inheritance diagram for NeonBackendModelContext:

Collaboration diagram for NeonBackendModelContext:

Public Member Functions
	NeonBackendModelContext (const ModelOptions &modelOptions)
bool	IsFastMathEnabled () const
unsigned int	GetNumberOfThreads () const
void	ApplyAclIsaPolicy () const
Public Member Functions inherited from IBackendModelContext
virtual	~IBackendModelContext ()

Detailed Description

The NeonBackendModelContext is used to pass in Neon specific backend ModelOptions.

The supported backend ModelOptions are:

• "FastMathEnabled"
  Using the fast_math flag can lead to performance improvements in fp32 and fp16 layers but may result in
  results with reduced or different precision. The fast_math flag will not have any effect on int8 performance.
• "NumberOfThreads"
  Specify the number of threads used by the CpuAcc backend.
• "SveEnabled"
  Specify whether SVE/SVE2 implementations may be selected by the CpuAcc backend.
• "SmeEnabled"
  Specify whether SME/SME2 implementations may be selected by the CpuAcc backend.

Definition at line 23 of file NeonBackendModelContext.hpp.

Constructor & Destructor Documentation

NeonBackendModelContext()

NeonBackendModelContext

(

const ModelOptions &

modelOptions

)

Definition at line 63 of file NeonBackendModelContext.cpp.

    : m_IsFastMathEnabled(false), m_NumberOfThreads(0), m_IsSveEnabled(true), m_IsSmeEnabled(true)
{
   if (!modelOptions.empty())
   {
       ParseOptions(modelOptions, "CpuAcc", [&](std::string name, const BackendOptions::Var& value)
       {
           if (name == "FastMathEnabled")
           {
               m_IsFastMathEnabled = ParseBool(value, m_IsFastMathEnabled);
           }
           if (name == "NumberOfThreads")
           {
               m_NumberOfThreads = ParseUnsignedInt(value, m_NumberOfThreads);
           }
           if (name == "SmeEnabled")
           {
               m_IsSmeEnabled = ParseBool(value, m_IsSmeEnabled);
           }
           if (name == "SveEnabled")
           {
               m_IsSveEnabled = ParseBool(value, m_IsSveEnabled);
           }
       });
   }
}

References armnn::ParseOptions().

Member Function Documentation

ApplyAclIsaPolicy()

void ApplyAclIsaPolicy

(

)

const

Definition at line 100 of file NeonBackendModelContext.cpp.

{
    arm_compute::CPUInfo& cpuInfo = arm_compute::CPUInfo::get();
    SetSveAllowed(cpuInfo, m_IsSveEnabled, 0);
    SetSmeAllowed(cpuInfo, m_IsSmeEnabled, 0);
}

GetNumberOfThreads()

unsigned int GetNumberOfThreads

(

)

const

Definition at line 95 of file NeonBackendModelContext.cpp.

{
    return m_NumberOfThreads;
}

IsFastMathEnabled()

bool IsFastMathEnabled

(

)

const

Definition at line 90 of file NeonBackendModelContext.cpp.

{
    return m_IsFastMathEnabled;
}

Referenced by NeonWorkloadFactory::CreateWorkload(), NeonLayerSupport::IsBatchMatMulSupported(), NeonLayerSupport::IsConvolution2dSupported(), and NeonLayerSupport::IsConvolution3dSupported().

---

The documentation for this class was generated from the following files:

• src/backends/neon/NeonBackendModelContext.hpp
• src/backends/neon/NeonBackendModelContext.cpp