[executorch][nvidia][tensorrt][24/n] Add power and unary converters with model improvements

[shoumikhin]

Stack from ghstack (oldest at bottom):

• [executorch][nvidia][tensorrt][25/n] Share CUDA stream across TRT delegates #17936
• -> [executorch][nvidia][tensorrt][24/n] Add power and unary converters with model improvements #17935
• [executorch][nvidia][tensorrt][23/n] Add benchmark infrastructure #17934
• [executorch][nvidia][tensorrt][22/n] Add correctness tests #17933
• [executorch][nvidia][tensorrt][21/n] Add comparison and slice converters #17932
• [executorch][nvidia][tensorrt][20/n] Add bmm converter #17931
• [executorch][nvidia][tensorrt][19/n] Add SDPA converter #17930
• [executorch][nvidia][tensorrt][18/n] Add layer_norm and pixel_shuffle converters #17929
• [executorch][nvidia][tensorrt][17/n] Add embedding, expand, upsample converters #17928
• [executorch][nvidia][tensorrt][16/n] Enable MobileNetV3 model support #17927
• [executorch][nvidia][tensorrt][15/n] Add linear model support with addmm and permute_copy converters #17926
• [executorch][nvidia][tensorrt][14/n] Add additional converters (mul, sub, div, mm, relu) #17925
• [executorch][nvidia][tensorrt][13/n] Add examples, C++ runner and CI workflow #17924
• [executorch][nvidia][tensorrt][12/n] Add C++ runtime infrastructure #17923
• [executorch][nvidia][tensorrt][11/n] Complete preprocess integration with serialization #17922
• [executorch][nvidia][tensorrt][10/n] Add blob serialization format with I/O metadata #17921
• [executorch][nvidia][tensorrt][9/n] Implement preprocess basic implementation #17920
• [executorch][nvidia][tensorrt][8/n] Add TensorRTCompileSpec dataclass #17919
• [executorch][nvidia][tensorrt][7/n] Add converter utils and add converter #17918
• [executorch][nvidia][tensorrt][6/n] Add converter registry infrastructure #17917
• [executorch][nvidia][tensorrt][5/n] Integrate partitioner #17916
• [executorch][nvidia][tensorrt][4/n] Add operator support base class #17915
• [executorch][nvidia][tensorrt][3/n] Add TensorRT partitioner stub #17914
• [executorch][nvidia][tensorrt][2/n] Add TensorRT backend stub #17913
• [executorch][nvidia][tensorrt][1/n] Add directory structure and initialization #17912

Add converters for power and unary operations to support additional model architectures.

Differential Revision: D93275058

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/17935

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 49 New Failures, 1 Unrelated Failure

As of commit e8ec287 with merge base 01d21fa ():

NEW FAILURES - The following jobs have failed:

• Lint / lintrunner-mypy (gh)
  >>> Lint for install_utils.py:
• pull / test-coreml-bc-macos (macos-m1-stable) / macos-job (gh)
  Can't find 'action.yml', 'action.yaml' or 'Dockerfile' under '/Users/ec2-user/runner/_work/executorch/executorch/test-infra/.github/actions/check-disk-space'. Did you forget to run actions/checkout before running your local action?
• pull / unittest / macos / macos-job (gh)
  Can't find 'action.yml', 'action.yaml' or 'Dockerfile' under '/Users/ec2-user/runner/_work/executorch/executorch/test-infra/.github/actions/check-disk-space'. Did you forget to run actions/checkout before running your local action?
• pull / unittest-buck / macos / macos-job (gh)
  Can't find 'action.yml', 'action.yaml' or 'Dockerfile' under '/Users/ec2-user/runner/_work/executorch/executorch/test-infra/.github/actions/check-disk-space'. Did you forget to run actions/checkout before running your local action?
• pull / unittest-editable / macos / macos-job (gh)
  Can't find 'action.yml', 'action.yaml' or 'Dockerfile' under '/Users/ec2-user/runner/_work/executorch/executorch/test-infra/.github/actions/check-disk-space'. Did you forget to run actions/checkout before running your local action?
• Test Metal Backend / export-model-metal-artifact (nvidia, parakeet-tdt, non-quantized) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• Test Metal Backend / export-model-metal-artifact (openai, whisper-small, quantized-int4-metal) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• Test TensorRT Backend / check-all-tensorrt-tests (gh)
  ERROR: TensorRT build test failed!
• Test TensorRT Backend / test-export / linux-job (gh)
  RuntimeError: Command docker exec -t 11a73c46f54a817d1592ffccd9a79b55f5d4f82bc40aec1bdee530d50486e440 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (add_mul) / linux-job (gh)
  RuntimeError: Command docker exec -t 2332cff6a17ea7e5614a482123ba2424ccf5a396a4eecbe6871e5d764d383d98 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (add) / linux-job (gh)
  RuntimeError: Command docker exec -t 42a0a387f2ed4187abb58485d757b32ebe8dfccc73546b78d83d6d3050649887 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (conv1d) / linux-job (gh)
  RuntimeError: Command docker exec -t c048fd582113b46a7440b71f59e44ac94c77a7be2f2976c461d2236a3b0ee1fc /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (dl3) / linux-job (gh)
  RuntimeError: Command docker exec -t 13c57ab99e0e0bf11cd0d826f21abb2dba9c1d50e5dfe54d172d64e32685639b /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (edsr) / linux-job (gh)
  RuntimeError: Command docker exec -t 502ca091e64fab3e61880ff35a938e17aa8b6bd21e55641f2cee22491dae2921 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (efficient_sam) / linux-job (gh)
  RuntimeError: Command docker exec -t 4d1959c180ff96ec679f6c5e7ea047b80a33fcf50334c5404cbf4f8261e97f06 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (emformer_join) / linux-job (gh)
  RuntimeError: Command docker exec -t 2611c337f79e73376d66862c1ff8e56a4afb998e60096513ef5e894134981e75 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (emformer_transcribe) / linux-job (gh)
  RuntimeError: Command docker exec -t 64a524d0e79c5e86e9b82c146ba1ba8015c2b2b1c46519c48387563ac07a78a5 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (ic3) / linux-job (gh)
  RuntimeError: Command docker exec -t e161dfdace3b698217d5b40703380e2684d4253bbe444b3c0019ff11d41fe31e /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (ic4) / linux-job (gh)
  RuntimeError: Command docker exec -t 1d802999e49d832833f56c6ebc7e8336e107ba02ef09c64d5884527f61530262 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (linear) / linux-job (gh)
  RuntimeError: Command docker exec -t 912f98547aeac7d65ceaddafb4c4399fc061b353edb77cc00876addaba62ea0e /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (mul) / linux-job (gh)
  RuntimeError: Command docker exec -t 16d44ff8335ff37f340feb68c3a8e8bb4ee29d25dbfe78b5c9f10ebdb693daa7 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (mv2) / linux-job (gh)
  RuntimeError: Command docker exec -t 241c4a7f61ede45d104766b33f4025a6e141c30803e33bfed55d607c3f49feaf /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (mv3) / linux-job (gh)
  RuntimeError: Command docker exec -t 102175fee15f2a3bba00c57ddc226b30a29b6f0b2de92b127931f170bc7efd94 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (resnet18) / linux-job (gh)
  RuntimeError: Command docker exec -t 60ae54bc43708419cde27856e53c4970a737a9ae77ff589dc4df070b40a72ae9 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (resnet50) / linux-job (gh)
  RuntimeError: Command docker exec -t da52e58ba105560278d82af361d35bbbe8747df5892747e70c40cf92430f89fc /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (sdpa) / linux-job (gh)
  RuntimeError: Command docker exec -t 2d941322086736741569d7336ce2f7c52402d371148730d8df102b707eb70b8e /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (softmax) / linux-job (gh)
  RuntimeError: Command docker exec -t b028ff502a5d859e2f0c3c7d500041de376ed997389ed5b5cd04ece3360ef22b /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-cpp (w2l) / linux-job (gh)
  RuntimeError: Command docker exec -t f8fe8ab0502af6c375209f0c02336037858d215c557ce7498c670703bbcdb56a /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (add_mul) / linux-job (gh)
  RuntimeError: Command docker exec -t c788fcfa068b1e899da66498457ab8a3c19976f7c168eac3687b1050a0031465 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (add) / linux-job (gh)
  RuntimeError: Command docker exec -t 9bc2dc000a2f97a39162f52d6d10c25e64f5e7a4089759084911e5e1524ec6eb /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (conv1d) / linux-job (gh)
  RuntimeError: Command docker exec -t c75d3fff743b284de617d700396e5b566036de593f415d95de405d6174748e92 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (dl3) / linux-job (gh)
  RuntimeError: Command docker exec -t 5e64d51591b0277840d47b99b9841c5942438fe2a2974c01153fd50c15700db0 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (edsr) / linux-job (gh)
  RuntimeError: Command docker exec -t 1563526f73e1058a68cb790aa15dae6fe5a2af00fd98b57a1cae2c0691a1cbcf /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (efficient_sam) / linux-job (gh)
  RuntimeError: Command docker exec -t 3ced1214c9ce9bc4889f103f606c11ba0daa7c1b3d80472bbedca1f79a8b9f0a /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (emformer_join) / linux-job (gh)
  RuntimeError: Command docker exec -t b9ac85ee021487caf59bc5a3bfe066901cf9eba175b03e8c9b6ab7524469af20 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (emformer_transcribe) / linux-job (gh)
  RuntimeError: Command docker exec -t 941de75cb909664ff41bea8264c1dae9ec6abf227f471f1e68f309ef043463ee /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (ic3) / linux-job (gh)
  RuntimeError: Command docker exec -t b8ef5307745521cb18f9128f90a44769e0995ae9d45e51ba0a11d1e867cb0a41 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (ic4) / linux-job (gh)
  RuntimeError: Command docker exec -t d16f0b0a2edc5c8b77b193f8863d31ad9564cc13542e675ff32595a0268e2ce6 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (linear) / linux-job (gh)
  RuntimeError: Command docker exec -t 447e838a80ae0694ebab7862a188c26ee43e375ac58228455e366c7d304d6b1b /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (mul) / linux-job (gh)
  RuntimeError: Command docker exec -t be3bf7e961c40dfd7c8a47fbbc096a693992c4383660268ca3e8c462df606840 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (mv2) / linux-job (gh)
  RuntimeError: Command docker exec -t 083092185e73121aaea5155d5b5793cf869de4226cdf40696f8ba644a9f7a93c /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (mv3) / linux-job (gh)
  RuntimeError: Command docker exec -t ce860e34f78ffc98a00ab94bc3aa16ed86b5e7d37e75b8cf24c3a9013fd46488 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (resnet18) / linux-job (gh)
  RuntimeError: Command docker exec -t 9a4252aeae3c2fa6d2fe748a89635738ed2554d044952d908eaf91686472f933 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (resnet50) / linux-job (gh)
  RuntimeError: Command docker exec -t a79b731239e0c633973648f07cae4c7c88957d6a8e38c12edc476d776da677a4 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (sdpa) / linux-job (gh)
  RuntimeError: Command docker exec -t 80a981f8deed164fafca28db90da1c484ff78f1421c19396e73bb404a0a797ee /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (softmax) / linux-job (gh)
  RuntimeError: Command docker exec -t 459746418a8b0d35819db9ddbc55a029b5335d5ea77941d577309d88f41f1188 /exec failed with exit code 1
• Test TensorRT Backend / test-models-tensorrt-python (w2l) / linux-job (gh)
  RuntimeError: Command docker exec -t 0c15592d65502a7a0edd925b51bb17b1fdd76f86552beca7f670153b2de942bc /exec failed with exit code 1
• Test TensorRT Backend / test-tensorrt-build / linux-job (gh)
  RuntimeError: Command docker exec -t 9629d70152f86ae60d09554d402bdf4d9e57ce6e91a5b64e7ae4611603b53861 /exec failed with exit code 1
• Test TensorRT Backend / unittest-tensorrt / linux-job (gh)
  RuntimeError: Command docker exec -t af193fbbbe5051631cc0684a0163f07c8a669c15f136b8f56e43b15072392eb6 /exec failed with exit code 1

FLAKY - The following job failed but was likely due to flakiness present on trunk:

• pull / test-static-llama-qnn-linux (stories_260k_bc) / linux-job (gh) (matched linux rule in flaky-rules.json)
  The process '/usr/bin/git' failed with exit code 128

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.