[Dependency] Bump onnxruntime from 1.3.0 to 1.12.0 in /.setup/pip

[dependabot]

Bumps onnxruntime from 1.3.0 to 1.12.0.

Release notes

Sourced from onnxruntime's releases.

ONNX Runtime v1.12.0

Announcements

• For Execution Provider maintainers/owners: the lightweight compile API is now the default compiler API for all Execution Providers (this was previously only available for the mobile build). If you have an EP using the legacy compiler API, please migrate to the lightweight compile API as soon as possible. The legacy API will be deprecated in next release (ORT 1.13).
• netstandard1.1 support is being deprecated in this release and will be removed in the next ORT 1.13 release

Key Updates

General

• ONNX spec support
  • onnx opset 17
  • onnx-ml opset 3 (TreeEnsemble update)
• BeamSearch operator for encoder-decoder transformers models
• Support for invoking individual ops without the need to create a separate graph
  • For use with custom op development to reuse ORT code
• Support for feeding external initializers (for large models) as byte arrays for model inferencing
• Build switch to disable usage of abseil library to remove dependency

Packages

• Python 3.10 support
• Mac M1 support in Python and Java packages
• .NET 6/MAUI support in Nuget C# package
  • Additional target frameworks: net6.0, net6.0-android, net6.0-ios, net6.0-macos
  • NOTE: netstandard1.1 support is being deprecated in this release and will be removed in the 1.13 release
• onnxruntime-openvino package available on Pypi (from Intel)

Performance and Quantization

• Improved C++ APIs that now utilize RAII for better memory management
• Operator performance optimizations, including GatherElements
• Memory optimizations to support compute-intensive real-time inferencing scenarios (e.g. audio inferencing scenarios)
  • CPU usage savings for infrequent inference requests by reducing thread spinning
  • Memory usage reduction through use of containers from the abseil library, especially inlined vectors used to store tensor shapes and inlined hash maps
• New quantized kernels for weight symmetry to improve performance on ARM64 little core (GEMM and Conv)
• Specialized kernel to improve performance of quantized Resize by up to 2x speedup
• Improved the thread job partition for QLinearConv, demonstrating up to ~20% perf gain for certain models
• Quantization tool: improved ONNX shape inference for large models

Execution Providers

• TensorRT EP
  • TensorRT 8.4 support
  • Provide option to share execution context memory between TensorRT subgraphs
  • Workaround long CI test time caused by frequent initialization/de-initialization of TensorRT builder
  • Improve subgraph partitioning and consolidate TensorRT subgraphs when possible
  • Refactor engine cache serialization/deserialization logic
  • Miscellaneous bug fixes and performance improvements
• OpenVINO EP
  • Pre-Built ONNXRuntime binaries with OpenVINO now available on pypi: onnxruntime-openvino
  • Performance optimizations of existing supported models
  • New runtime configuration option ‘enable_dynamic_shapes’ added to enable dynamic shapes for each iteration
  • ORTModule included as part of OVEP Python Package to enable Torch ORT Inference
• DirectML EP
  • Updated to DirectML 1.9

... (truncated)

Commits

• f466364 add release note url (#12259)
• 0d4f0f8 Cherry for release 1.12.0 final (#12218)
• 62226d0 Cherry-pick tagged commits to 1.12.0 release candidate (#12097)
• 64f95d4 Update DML 1.9 Nuget package to fix WindowsAI nuget pipeline build issue (#11...
• 3b1224d Add .net6 support to the C# nuget package. (#11908)
• 8c8a781 fix: handle setBindingDimensions return value in TensorRT EP (#11929)
• 5646410 Enable Pad test cases with initializer inputs only when building NNAPI EP on ...
• 61a74f2 Mohsin/enable dynamic shapes (#11867)
• b20daed Update Linux Multi GPU TensorRT pipeline to TensorRT 8.4 (#11923)
• 859ef27 apply zcode changes to the beam search op (#11880)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

The following labels could not be found: dependencies.

[dependabot]

Superseded by #575.