ArmNN
 25.11
Loading...
Searching...
No Matches
OptimizerOptionsOpaqueImpl Struct Reference

#include <Network.hpp>

Public Member Functions

 ~OptimizerOptionsOpaqueImpl ()=default
 OptimizerOptionsOpaqueImpl ()
 OptimizerOptionsOpaqueImpl (bool reduceFp32ToFp16, bool debug, bool reduceFp32ToBf16, bool importEnabled, ModelOptions modelOptions={}, bool exportEnabled=false, bool debugToFile=false)
 OptimizerOptionsOpaqueImpl (bool reduceFp32ToFp16, bool debug, bool reduceFp32ToBf16, ShapeInferenceMethod shapeInferenceMethod, bool importEnabled, ModelOptions modelOptions, bool exportEnabled, bool debugToFile, bool allowExpandedDims)

Public Attributes

bool m_ReduceFp32ToFp16 = false
 Reduces all Fp32 operators in the model to Fp16 for faster processing.
bool m_Debug = false
 Add debug data for easier troubleshooting.
bool m_DebugToFile = false
 Pass debug data to separate output files for easier troubleshooting.
bool m_ReduceFp32ToBf16 = false
 @Note This feature has been replaced by enabling Fast Math in compute library backend options.
ShapeInferenceMethod m_shapeInferenceMethod = armnn::ShapeInferenceMethod::ValidateOnly
 Infer output size when not available.
bool m_ImportEnabled = false
 Enable Import.
ModelOptions m_ModelOptions
 Enable Model Options.
bool m_ProfilingEnabled = false
 Enable profiling dump of the optimizer phase.
bool m_ExportEnabled = false
 Enable Export.
bool m_AllowExpandedDims = false
 When calculating tensor sizes, dimensions of size == 1 will be ignored.

Detailed Description

Definition at line 310 of file Network.hpp.

Constructor & Destructor Documentation

◆ ~OptimizerOptionsOpaqueImpl()

◆ OptimizerOptionsOpaqueImpl() [1/3]

OptimizerOptionsOpaqueImpl ( )
inlineexplicit

Definition at line 314 of file Network.hpp.

315 : m_ReduceFp32ToFp16(false)
316 , m_Debug(false)
317 , m_DebugToFile(false)
318 , m_ReduceFp32ToBf16(false)
319 , m_shapeInferenceMethod(armnn::ShapeInferenceMethod::ValidateOnly)
320 , m_ImportEnabled(false)
321 , m_ModelOptions()
322 , m_ProfilingEnabled(false)
323 , m_ExportEnabled(false)
324 , m_AllowExpandedDims(false)
325 {
326 }
@ ValidateOnly
Validate all output shapes.
Definition Types.hpp:239

References m_AllowExpandedDims, m_Debug, m_DebugToFile, m_ExportEnabled, m_ImportEnabled, m_ModelOptions, m_ProfilingEnabled, m_ReduceFp32ToBf16, m_ReduceFp32ToFp16, m_shapeInferenceMethod, and armnn::ValidateOnly.

◆ OptimizerOptionsOpaqueImpl() [2/3]

OptimizerOptionsOpaqueImpl ( bool reduceFp32ToFp16,
bool debug,
bool reduceFp32ToBf16,
bool importEnabled,
ModelOptions modelOptions = {},
bool exportEnabled = false,
bool debugToFile = false )
inlineexplicit

Definition at line 328 of file Network.hpp.

329 {},
330 bool exportEnabled = false, bool debugToFile = false)
331 : m_ReduceFp32ToFp16(reduceFp32ToFp16)
332 , m_Debug(debug)
333 , m_DebugToFile(debugToFile)
334 , m_ReduceFp32ToBf16(reduceFp32ToBf16)
335 , m_shapeInferenceMethod(armnn::ShapeInferenceMethod::ValidateOnly)
336 , m_ImportEnabled(importEnabled)
337 , m_ModelOptions(modelOptions)
338 , m_ProfilingEnabled(false)
339 , m_ExportEnabled(exportEnabled)
340 , m_AllowExpandedDims(false)
341 {
342 }
ShapeInferenceMethod
The ShapeInferenceMethod modify how the output shapes are treated.
Definition Types.hpp:237

References armnn::debug.

◆ OptimizerOptionsOpaqueImpl() [3/3]

OptimizerOptionsOpaqueImpl ( bool reduceFp32ToFp16,
bool debug,
bool reduceFp32ToBf16,
ShapeInferenceMethod shapeInferenceMethod,
bool importEnabled,
ModelOptions modelOptions,
bool exportEnabled,
bool debugToFile,
bool allowExpandedDims )
inlineexplicit

Definition at line 344 of file Network.hpp.

348 : m_ReduceFp32ToFp16(reduceFp32ToFp16)
349 , m_Debug(debug)
350 , m_DebugToFile(debugToFile)
351 , m_ReduceFp32ToBf16(reduceFp32ToBf16)
352 , m_shapeInferenceMethod(shapeInferenceMethod)
353 , m_ImportEnabled(importEnabled)
354 , m_ModelOptions(modelOptions)
355 , m_ProfilingEnabled(false)
356 , m_ExportEnabled(exportEnabled)
357 , m_AllowExpandedDims(allowExpandedDims)
358 {
359 }

References armnn::debug, m_AllowExpandedDims, m_Debug, m_DebugToFile, m_ExportEnabled, m_ImportEnabled, m_ModelOptions, m_ProfilingEnabled, m_ReduceFp32ToBf16, m_ReduceFp32ToFp16, and m_shapeInferenceMethod.

Member Data Documentation

◆ m_AllowExpandedDims

bool m_AllowExpandedDims = false

When calculating tensor sizes, dimensions of size == 1 will be ignored.

Definition at line 396 of file Network.hpp.

Referenced by OptimizerOptionsOpaqueImpl(), and OptimizerOptionsOpaqueImpl().

◆ m_Debug

bool m_Debug = false

Add debug data for easier troubleshooting.

Definition at line 371 of file Network.hpp.

Referenced by OptimizerOptionsOpaqueImpl(), and OptimizerOptionsOpaqueImpl().

◆ m_DebugToFile

bool m_DebugToFile = false

Pass debug data to separate output files for easier troubleshooting.

Definition at line 374 of file Network.hpp.

Referenced by OptimizerOptionsOpaqueImpl(), and OptimizerOptionsOpaqueImpl().

◆ m_ExportEnabled

bool m_ExportEnabled = false

Enable Export.

Definition at line 393 of file Network.hpp.

Referenced by OptimizerOptionsOpaqueImpl(), and OptimizerOptionsOpaqueImpl().

◆ m_ImportEnabled

bool m_ImportEnabled = false

Enable Import.

Definition at line 384 of file Network.hpp.

Referenced by OptimizerOptionsOpaqueImpl(), and OptimizerOptionsOpaqueImpl().

◆ m_ModelOptions

ModelOptions m_ModelOptions

Enable Model Options.

Definition at line 387 of file Network.hpp.

Referenced by OptimizerOptionsOpaqueImpl(), and OptimizerOptionsOpaqueImpl().

◆ m_ProfilingEnabled

bool m_ProfilingEnabled = false

Enable profiling dump of the optimizer phase.

Definition at line 390 of file Network.hpp.

Referenced by OptimizerOptionsOpaqueImpl(), and OptimizerOptionsOpaqueImpl().

◆ m_ReduceFp32ToBf16

bool m_ReduceFp32ToBf16 = false

@Note This feature has been replaced by enabling Fast Math in compute library backend options.

This is currently a placeholder option

Definition at line 378 of file Network.hpp.

Referenced by OptimizerOptionsOpaqueImpl(), and OptimizerOptionsOpaqueImpl().

◆ m_ReduceFp32ToFp16

bool m_ReduceFp32ToFp16 = false

Reduces all Fp32 operators in the model to Fp16 for faster processing.

If the first preferred backend does not have Fp16 support, this option will be disabled. If the value of converted Fp16 is infinity, round to the closest finite Fp16 value. @Note This feature works best if all operators of the model are in Fp32. ArmNN will add conversion layers between layers that weren't in Fp32 in the first place or if the operator is not supported in Fp16. The overhead of these conversions can lead to a slower overall performance if too many conversions are required.

Definition at line 368 of file Network.hpp.

Referenced by OptimizerOptionsOpaqueImpl(), and OptimizerOptionsOpaqueImpl().

◆ m_shapeInferenceMethod

Infer output size when not available.

Definition at line 381 of file Network.hpp.

Referenced by OptimizerOptionsOpaqueImpl(), and OptimizerOptionsOpaqueImpl().


The documentation for this struct was generated from the following file: