[Dependency] Bump onnxruntime from 1.3.0 to 1.12.1 in /.setup/pip

[dependabot]

Bumps onnxruntime from 1.3.0 to 1.12.1.

Release notes

Sourced from onnxruntime's releases.

ONNX Runtime v1.12.1

This patch addresses packaging issues and bug fixes on top of v1.12.0.

• Java package: MacOS M1 support folder structure fix
• Android package: enable optimizations
• GPU (TensorRT provider): bug fixes
• DirectML: package fix
• WinML: bug fixes

See #12418 for full list of specific fixes included

ONNX Runtime v1.12.0

Announcements

• For Execution Provider maintainers/owners: the lightweight compile API is now the default compiler API for all Execution Providers (this was previously only available for the mobile build). If you have an EP using the legacy compiler API, please migrate to the lightweight compile API as soon as possible. The legacy API will be deprecated in next release (ORT 1.13).
• netstandard1.1 support is being deprecated in this release and will be removed in the next ORT 1.13 release

Key Updates

General

• ONNX spec support
  • onnx opset 17
  • onnx-ml opset 3 (TreeEnsemble update)
• BeamSearch operator for encoder-decoder transformers models
• Support for invoking individual ops without the need to create a separate graph
  • For use with custom op development to reuse ORT code
• Support for feeding external initializers (for large models) as byte arrays for model inferencing
• Build switch to disable usage of abseil library to remove dependency

Packages

• Python 3.10 support
• Mac M1 support in Python and Java packages
• .NET 6/MAUI support in Nuget C# package
  • Additional target frameworks: net6.0, net6.0-android, net6.0-ios, net6.0-macos
  • NOTE: netstandard1.1 support is being deprecated in this release and will be removed in the 1.13 release
• onnxruntime-openvino package available on Pypi (from Intel)

Performance and Quantization

• Improved C++ APIs that now utilize RAII for better memory management
• Operator performance optimizations, including GatherElements
• Memory optimizations to support compute-intensive real-time inferencing scenarios (e.g. audio inferencing scenarios)
  • CPU usage savings for infrequent inference requests by reducing thread spinning
  • Memory usage reduction through use of containers from the abseil library, especially inlined vectors used to store tensor shapes and inlined hash maps
• New quantized kernels for weight symmetry to improve performance on ARM64 little core (GEMM and Conv)
• Specialized kernel to improve performance of quantized Resize by up to 2x speedup
• Improved the thread job partition for QLinearConv, demonstrating up to ~20% perf gain for certain models
• Quantization tool: improved ONNX shape inference for large models

Execution Providers

• TensorRT EP
  • TensorRT 8.4 support
  • Provide option to share execution context memory between TensorRT subgraphs

... (truncated)

Commits

• 7048164 Cherry picks for 1.12.1 (#12418)
• dd8e292 update version to 1.12.1
• f466364 add release note url (#12259)
• 0d4f0f8 Cherry for release 1.12.0 final (#12218)
• 62226d0 Cherry-pick tagged commits to 1.12.0 release candidate (#12097)
• 64f95d4 Update DML 1.9 Nuget package to fix WindowsAI nuget pipeline build issue (#11...
• 3b1224d Add .net6 support to the C# nuget package. (#11908)
• 8c8a781 fix: handle setBindingDimensions return value in TensorRT EP (#11929)
• 5646410 Enable Pad test cases with initializer inputs only when building NNAPI EP on ...
• 61a74f2 Mohsin/enable dynamic shapes (#11867)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

The following labels could not be found: dependencies.

[codecov-commenter]

Codecov Report

Merging #575 (166cccb) into master (cf9b6ce) will decrease coverage by 0.25%.
The diff coverage is 19.37%.

@@             Coverage Diff              @@
##             master     #575      +/-   ##
============================================
- Coverage     22.19%   21.94%   -0.26%     
- Complexity     7398     7713     +315     
============================================
  Files           196      208      +12     
  Lines         24092    25135    +1043     
  Branches         36       66      +30     
============================================
+ Hits           5348     5515     +167     
- Misses        18708    19556     +848     
- Partials         36       64      +28     

Flag	Coverage Δ
autograder	20.28% <81.30%> (+3.77%)	⬆️
js	28.74% <ø> (-16.45%)	⬇️
migrator	99.20% <ø> (+<0.01%)	⬆️
php	20.09% <14.30%> (-0.37%)	⬇️
python_submitty_utils	71.65% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

[dependabot]

Superseded by #687.