GitXplorerGitXplorer
a

trex-example

public
0 stars
0 forks
0 issues

Commits

List of commits on branch main.
Verified
7c5f27214248eb0d33a56d90a37b69c0a1b66827

Update README.md

aatinfinity committed a year ago
Unverified
a4522ec6da8cba018e88932076091c7ed63b8628

fixed README

aatinfinity committed a year ago
Unverified
abc95795359741933d3fc41b850a3706fae28d10

fixed typo

aatinfinity committed a year ago
Unverified
df6e281facd3adf881329dc4d45de4b3692a21d1

Initial commit

aatinfinity committed a year ago
Verified
e816adf5088956067e8b2b2bc5bab0bd09c9a13f

Initial commit

aatinfinity committed a year ago

README

The README file for this repository.

trex-example

Introduction

This is an example of TensorRT and TREx.

  • TensorRT
    • Build engine
    • Profiling
  • TREx
    • Visualization

I checked on the following environment.

  • reComputer J4012(Jetson Orin NX 16GB)
  • JetPack 5.1.2
  • TensorRT 8.5.2
  • TREx 0.1.6

Create ONNX model

I created model/model_bn.onnx. This model was generated using the following steps.
https://github.com/NVIDIA-AI-IOT/jetson_dla_tutorial

Build

Please build engine by TensorRT.

trtexec --verbose --profilingVerbosity=detailed --buildOnly --memPoolSize=workspace:8192MiB --onnx=model/model_bn.onnx --saveEngine=model_bn.onnx.engine --int8 --useDLACore=0 --allowGPUFallback > model_bn.onnx.engine.build.log

Please generate metadata of building.

python3 script/generate_build_metadata.py

Profile

Please profile by TensorRT.

trtexec --verbose --noDataTransfers --separateProfileRun --useSpinWait --profilingVerbosity=detailed --loadEngine=model_bn.onnx.engine --exportTimes=model_bn.onnx.engine.timing.json --exportProfile=model_bn.onnx.engine.profile.json --exportLayerInfo=model_bn.onnx.engine.graph.json --timingCacheFile=timing.cache > model_bn.onnx.engine.profile.log

Please generate metadata of profiling.

python3 script/generate_profiling_metadata.py

Visualization by TREx

I provided an example notebook(trex_example.ipynb) for visualization.

Reference