mv_deploy

This project has the source code for MIVIsionX model compiler in mv_compile.cpp

mv_deploy consists of a model-compiler and necessary header/.cpp files which are required to run inference for a specific NeuralNet model

The “mv_compile” will be built as part of MIVisionX package installer To build and application using mv_compile, the user can use the deployment api from mv_deploy.h. The entire use of the mv_compile and deployment is shown in mv_objdetectsample The sample demonstrates the use of mv_compile utility to do video decoding and inference.

Prerequisites

• Ubuntu 20.04/22.04 or CentOS 7/8
• ROCm supported hardware
  • AMD Radeon GPU or APU required
• ROCm
• Build & Install MIVisionX
  • MIVisionX installs model compiler at /opt/rocm/libexec/mivisionx
  • mv_compile installs at /opt/rocm/bin and mvdeploy_api.h installs at /opt/rocm/include/mivisionx

Usage

The mv_compile utility generates deployment library, header files, and .cpp files required to run inference for the specified model.

• Usage:

  mv_compile   
         --model 	        <model_name: name of the trained model with path> 		[required]
         --install_folder   <install_folder:  the location for compiled model> 		[required]
         --input_dims 	<input_dims: n,c,h,w - batch size, channels, height, width> 	[required]
         --backend 	        <backend: name of the backend for compilation> 	  		[optional - default:OpenVX_Rocm_GPU]
         --fuse_cba 	<fuse_cba: enable or disable Convolution_bias_activation fuse mode (0/1)> [optional - default: 0]
         --quant_mode       <quant_mode: fp32/fp16 - quantization_mode for the model: if enabled the model and weights would be converted [optional -default: fp32]
  

• Sample Usage:
• Caffe

  ./mv_compile --model models/model.caffemodel --install_folder install_folder --input_dims 1,3,224,224
  

ONNX

./mv_compile --model models/model.onnx --install_folder install_folder --input_dims 1,3,224,224

NNEF

./mv_compile --model models/model.nnef --install_folder install_folder --input_dims 1,3,224,224

License

This project is licensed under the MIT License - see the LICENSE.md file for details

Author

Rajy Rawther - mivisionx.support@amd.com