Khronos OpenVX™

OpenVX™ is an open, royalty-free standard for cross platform acceleration of computer vision applications. OpenVX enables performance and power-optimized computer vision processing, especially important in embedded and real-time use cases such as face, body and gesture tracking, smart video surveillance, advanced driver assistance systems (ADAS), object and scene reconstruction, augmented reality, visual inspection, robotics and more.

• Khronos OpenVX API offers a set of optimized primitives for low-level image processing, computer vision, and neural net operators. The API provides a simple method to write optimized code that is portable across multiple hardware vendors and platforms.

• OpenVX allows for resource and execution abstractions, which enable hardware vendors to optimize their implementation for their platform. Performance portability across CPUs, GPUs, and special-function hardware are one of the design goals of the OpenVX specification.

• OpenVX is used to build, verify, and coordinate computer vision and neural network graph executions. The graph abstraction enables OpenVX implementation to optimize execution for the underlying hardware. Using optimized OpenVX conformant implementation, software developers can spend more time on algorithmic innovations without worrying about the performance and portability of their applications.

• The standard defines graph conventions and execution semantics to address the needs of the developers. The advantage of the graphical interface is the ability of the underlying conformant implementation to optimize the whole graph pipeline instead of specific functions.

• OpenVX specification also defines the VXU or the immediate function library. VXU operators allow developers to use all the OpenVX operators as a directly callable C function without creating a graph first.

• Applications built using the VXU library do not benefit from the optimizations enabled by graph execution. The VXU library can be the simplest way to use OpenVX and is the first step in porting existing vision applications.

AMD OpenVX™

• AMD OpenVX™ is a highly optimized conformant open-source implementation of the Khronos OpenVX Version 1.3 computer vision specification. It allows for rapid prototyping as well as fast execution on a wide range of computer hardware, including small embedded AMD64 CPUs and large workstation discrete GPUs.

AMD OpenVX™ - Vision Feature Set Conformant Implementation

The Vision Conformance Feature Set includes all the functions and objects in the Base Feature Set, plus the vision data objects and vision functions.

The Base Feature Set

The purpose is to define a minimal subset of OpenVX features that enable the construction and execution of OpenVX graphs, but it does not contain any specific vision-processing operations.

Basic Framework Objects

vx_reference	vx_context	vx_graph	vx_kernel
vx_node	vx_parameter	vx_meta_format	vx_delay

Note: Details about Framework Objects

The Vision Conformance Feature Set

To provide a basic set of vision processing functions. This set of functions is roughly equivalent to the set of functions available in version 1.1 of the OpenVX specification. In addition to the framework objects included in the Base Feature Set, the Vision Conformance Feature Set includes a set of data objects that the Vision functions operate upon and produce.

Vision Conformance Data Objects

vx_array	vx_convolution	vx_distribution	vx_image
vx_lut	vx_matrix	vx_pyramid	vx_remap
vx_scalar	vx_threshold	vx_object_array

NOTE: Details about Data Objects

Vision Conformance Functions

AbsDiff	Add	And	Box3x3	CannyEdgeDetector	ChannelCombine
ChannelExtract	ColorConvert	ConvertDepth	Convolve	Dilate3x3	EqualizeHist
Erode3x3	FastCorners	Gaussian3x3	GaussianPyramid	HarrisCorners	HalfScaleGaussian
Histogram	IntegralImage	LaplacianPyramid	LaplacianReconstruct	Magnitude	MeanStdDev
Median3x3	MinMaxLoc	Multiply	NonLinearFilter	Not	OpticalFlowPyrLK
Or	Phase	Remap	ScaleImage	Sobel3x3	Subtract
TableLookup	Threshold	WarpAffine	WarpPerspective	WeightedAverage	Xor

Note: Details about Functions

AMD OpenVX™ - Features

• The code is highly optimized for both x86 CPU and OpenCL/HIP for GPU
• Supported hardware spans the range from low power embedded APUs, laptops, desktops, and workstation graphics
• Supports Windows , Linux , and macOS
• Includes a “graph optimizer” that looks at the entire processing pipeline and removes/replaces/merges functions to improve performance and minimize bandwidth at runtime
• Scripting support with RunVX allows for rapid prototyping, without re-compiling at production performance levels

NOTE: The amd_openvx project consists of the following components: AMD OpenVX™ Library

NOTE: The OpenVX framework provides a mechanism to add new vision functions to OpenVX by 3rd party vendors. Look into amd_openvx_extensions for additional OpenVX modules and utilities.

AMD OpenVX™ - Extensions

• vx_loomsl: Radeon LOOM stitching library for live 360-degree video applications
• vx_nn: OpenVX neural network module that was built on top of MIOpen
• vx_opencv: OpenVX module that implemented a mechanism to access OpenCV functionality as OpenVX kernels
• vx_rpp: OpenVX extension providing an interface to some of the ROCm Performance Primitives (RPP) functions. This extension is used to enable rocAL to perform image augmentation.
• vx_winml: OpenVX module that implemented a mechanism to access Windows Machine Learning(WinML) functionality as OpenVX kernels

Pre-requisites

• CPU: AMD64
• GPU: AMD Radeon™ Graphics [optional]
  • Windows: install the latest drivers and OpenCL SDK download
  • Linux: install ROCm
• APU: AMD Radeon™ Mobile/Embedded [optional]

Build Instructions

Build this project to generate AMD OpenVX™ library

• Refer to openvx/include/VX for Khronos OpenVX standard header files.
• Refer to openvx/include/vx_ext_amd.h for vendor extensions in AMD OpenVX™ library

Build using Visual Studio

• Install OpenCV with/without contrib download for RunVX tool to support camera capture and image display (optional)
  • OpenCV_DIR environment variable should point to OpenCV/build folder
• Use amd_openvx/amd_openvx.sln to build for x64 platform
• If AMD GPU (or OpenCL) is not available, set build flag ENABLE_OPENCL=0in openvx/openvx.vcxproj and runvx/runvx.vcxproj

Note: AMD GPU HIP backend is not supported on Windows

Build using CMake

• Install CMake 3.10 or later
• Use CMake to configure and generate Makefile

NOTE: OpenVX and the OpenVX logo are trademarks of the Khronos Group Inc.