21.08
|
#include <IRuntime.hpp>
Classes | |
struct | ExternalProfilingOptions |
Public Member Functions | |
CreationOptions () | |
Public Attributes | |
std::shared_ptr< IGpuAccTunedParameters > | m_GpuAccTunedParameters |
If set, uses the GpuAcc tuned parameters from the given object when executing GPU workloads. More... | |
bool | m_EnableGpuProfiling |
Setting this flag will allow the user to obtain GPU profiling information from the runtime. More... | |
std::string | m_DynamicBackendsPath |
Setting this value will override the paths set by the DYNAMIC_BACKEND_PATHS compiler directive Only a single path is allowed for the override. More... | |
bool | m_ProtectedMode |
Setting this flag will allow the user to create the Runtime in protected mode. More... | |
std::map< BackendId, std::shared_ptr< ICustomAllocator > > | m_CustomAllocatorMap |
A map to define a custom memory allocator for specific backend Ids. More... | |
ExternalProfilingOptions | m_ProfilingOptions |
std::vector< BackendOptions > | m_BackendOptions |
Pass backend specific options. More... | |
Definition at line 101 of file IRuntime.hpp.
|
inline |
Definition at line 103 of file IRuntime.hpp.
std::vector<BackendOptions> m_BackendOptions |
Pass backend specific options.
For example, to enable GpuAcc tuning add the following
Execute representative workloads through the runtime to generate tuning data. The tuning file is written once the runtime is destroyed To execute with the tuning data, start up with just the tuning file specified.
The following backend options are available: GpuAcc: "TuningLevel" : int [0..3] (0=UseOnly(default) | 1=RapidTuning | 2=NormalTuning | 3=ExhaustiveTuning) "TuningFile" : string [filenameString] "KernelProfilingEnabled" : bool [true | false]
Definition at line 192 of file IRuntime.hpp.
Referenced by ClBackendContext::ClBackendContext(), ProgramOptions::ParseOptions(), and TEST_SUITE().
std::map<BackendId, std::shared_ptr<ICustomAllocator> > m_CustomAllocatorMap |
A map to define a custom memory allocator for specific backend Ids.
A Custom Allocator is used for allocation of working memory in the backends. Set this if you need to take control of how memory is allocated on a backend. Required for Protected Mode in order to correctly allocate Protected Memory
Definition at line 136 of file IRuntime.hpp.
Referenced by RuntimeImpl::RuntimeImpl(), and TEST_SUITE().
std::string m_DynamicBackendsPath |
Setting this value will override the paths set by the DYNAMIC_BACKEND_PATHS compiler directive Only a single path is allowed for the override.
Definition at line 120 of file IRuntime.hpp.
Referenced by InferenceModel< IParser, TDataType >::InferenceModel(), main(), ProgramOptions::ParseOptions(), ProgramOptions::ProgramOptions(), RuntimeImpl::RuntimeImpl(), and RuntimeInvalidOverridePathTestImpl().
bool m_EnableGpuProfiling |
Setting this flag will allow the user to obtain GPU profiling information from the runtime.
Definition at line 116 of file IRuntime.hpp.
Referenced by ClBackendContext::ClBackendContext(), GetSoftmaxProfilerJson(), InferenceModel< IParser, TDataType >::InferenceModel(), and ProgramOptions::ParseOptions().
std::shared_ptr<IGpuAccTunedParameters> m_GpuAccTunedParameters |
If set, uses the GpuAcc tuned parameters from the given object when executing GPU workloads.
It will also be updated with new tuned parameters if it is configured to do so.
Definition at line 113 of file IRuntime.hpp.
Referenced by ClBackendContext::ClBackendContext().
ExternalProfilingOptions m_ProfilingOptions |
Definition at line 160 of file IRuntime.hpp.
Referenced by ProgramOptions::ProgramOptions(), RuntimeImpl::RuntimeImpl(), TEST_SUITE(), ProgramOptions::ValidateRuntimeOptions(), and VerifyPostOptimisationStructureTestImpl().
bool m_ProtectedMode |
Setting this flag will allow the user to create the Runtime in protected mode.
It will run all the inferences on protected memory and will make sure that INetworkProperties::m_ImportEnabled set to true with MemorySource::DmaBufProtected option This requires that the backend supports Protected Memory and has an allocator capable of allocating Protected Memory associated with it.
Definition at line 127 of file IRuntime.hpp.
Referenced by RuntimeImpl::RuntimeImpl().