-
Notifications
You must be signed in to change notification settings - Fork 1
Expand file tree
/
Copy pathpytorch.html
More file actions
200 lines (189 loc) · 12.7 KB
/
pytorch.html
File metadata and controls
200 lines (189 loc) · 12.7 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
<!DOCTYPE html>
<html lang="en">
<head>
<script async src="https://www.googletagmanager.com/gtag/js?id=UA-156955408-1"></script>
<script>
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'UA-156955408-1');
</script>
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
<title>ONNX Runtime | PyTorch</title>
<link rel="icon" href="./images/ONNXRuntime-Favicon.png" type="image/gif" sizes="16x16">
<link rel="stylesheet" href="css/fonts.css">
<link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/4.3.1/css/bootstrap.min.css">
<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/font-awesome/4.7.0/css/font-awesome.min.css">
<link rel="stylesheet" href="css/custom.css">
<link rel="stylesheet" href="css/responsive.css">
</head>
<body>
<a class="skip-main" href="#skipMain">Skip to main content</a>
<div class="main-wrapper">
<div class="top-banner-bg">
<header class="fixed-top header-content">
<nav class="navbar navbar-expand-md navbar-custom" aria-label="Main menu">
<a id="ONNXLogo" class="navbar-brand" href="./index.html">
<img src="images/svg/ONNX-Runtime-logo.svg" class="d-inline-block align-top onnx-logo" alt="ONNX Runtime Home" />
</a>
<button class="navbar-toggler p-0" type="button" data-toggle="collapse" data-target="#navbarNav" aria-controls="navbarNav" aria-expanded="false" aria-label="Toggle navigation">
<span class="navbar-toggler-icon"></span>
</button>
<div class="collapse navbar-collapse border-md-top mt-md-0 mt-2" id="navbarNav">
<div class="mr-auto"></div>
<div class="my-md-2 mb-0 mt-2 my-lg-0 pl-3 pl-md-0">
<ul class="navbar-nav navbar-nav mr-auto text-uppercase" id="navigation">
<li class="nav-item">
<a class="nav-link pr-3" href="./index.html#getStartedTable">Get Started</a>
</li>
<li class="nav-item">
<a class="nav-link pr-3" href="./docs">Docs</a>
</li>
<li class="nav-item">
<a class="nav-link pr-3" target="_blank" href="https://cloudblogs.microsoft.com/opensource/tag/onnx">News</a>
</li>
<li class="nav-item">
<a class="nav-link pr-3" href="./community.html">Community</a>
</li>
<li class="nav-item">
<a class="nav-link pr-3" href="./about.html">About</a>
</li>
<li class="nav-item">
<a class="nav-link" target="_blank" href="http://github.com/microsoft/onnxruntime">GitHub</a>
</li>
</ul>
</div>
</div>
</nav>
</header>
<div role="main" id="skipMain" tabindex="-1">
<div class="container px-md-4 px-lg-5 pt-5 mx-auto text-center">
<h1 class="pt-3 pb-3 pt-md-5 pb-lg-3 px-md-4 px-lg-5 mt-5 mb-0">PyTorch + ONNX Runtime = Production</h1>
</div>
<div class="outer-container mx-auto">
<section class="py-md-5 pt-5 pb-4 blue-title-columns">
<div class="container-fluid">
<div class="row equalHeight">
<div class="col-12 col-md-4 mb-2 mb-md-0">
<div class="row">
<div class="col-2 col-md-3 col-xl-2">
<div class="icon-container">
<img src="images/svg/icon-2.svg" alt="" />
</div>
</div>
<div class="col-10 col-sm-9 col-xl-10 pl-sm-0 pl-md-3 pl-lg-0 pl-xl-3">
<h2 class="mr-xl-5 blue-text">Deploy anywhere</h2>
<p class="mr-xl-5 mb-md-0">Run PyTorch models on cloud, desktop, mobile, IoT, and even in the browser
</p>
</div>
</div>
</div>
<div class="col-12 col-md-4 mb-2 mb-md-0">
<div class="row">
<div class="col-2 col-md-3 col-xl-2">
<div class="icon-container">
<img src="images/svg/icon-4.svg" alt="" />
</div>
</div>
<div class="col-10 col-sm-9 col-xl-10 pl-sm-0 pl-md-3 pl-lg-0 pl-xl-3">
<h2 class="mr-xl-5 blue-text">Boost performance</h2>
<p class="mr-xl-5 mb-md-0">Accelerate PyTorch models to improve user experience and reduce costs
</p>
</div>
</div>
</div>
<div class="col-12 col-md-4 mb-2 mb-md-0">
<div class="row">
<div class="col-2 col-md-3 col-xl-2">
<div class="icon-container">
<img src="images/svg/icon-3.svg" alt="" />
</div>
</div>
<div class="col-10 col-sm-9 col-xl-10 pl-sm-0 pl-md-3 pl-lg-0 pl-xl-3">
<h2 class="mr-xl-5 blue-text">Improve time to market</h2>
<p class="mr-xl-5 mb-md-0">Used by Microsoft and many others for their production PyTorch workloads
</p>
</div>
</div>
</div>
</div>
</div>
<div class="pt-1 pb-1 pt-md-3 pb-lg-3 px-5 mt-5 mb-0 alert alert-dark alert-dismissible fade show" role="alert">
Please help us improve ONNX Runtime by participating in our <a href="https://ncv.microsoft.com/UySXuzobM9">customer survey.</a>
<button type="button" class="close" data-dismiss="alert" aria-label="Close">
<span aria-hidden="true">×</span>
</button>
</div>
</section>
<section class="pb-4 pt-4 blue-title-columns">
<div class="container-fluid">
<div class="row pb-4 pb-md-5">
<div class="col-12 col-md-6 order-md-2 mb-4 mb-md-0 text-center pr-10">
<img src="./images/pytorch-builtin.png" class="img-fluid">
</div>
<div class="col-12 col-md-6 pr-5">
<h2>Native support in PyTorch</h2>
<p>PyTorch includes support for ONNX through the <a href="https://pytorch.org/docs/stable/onnx.html" target="_blank" class="link">torch.onnx</a> APIs to simplify exporting your PyTorch model to the portable ONNX format.
The ONNX Runtime team maintains these exporter APIs to ensure a high level of compatibility with PyTorch models.
</p>
<p><a href="https://onnxruntime.ai/docs/tutorials/accelerate-pytorch/pytorch.html#convert-model-to-onnx" class="link">Get your PyTorch models ready for optimized deployment >></a></p>
</div>
</div>
<div class="row pb-4 pb-md-5">
<div class="col-12 col-md-6 mb-4 mb-md-0 text-center pr-10">
<img src="./images/python-free.png" class="img-fluid">
</div>
<div class="col-12 col-md-6 pr-5">
<h2>Python not required</h2>
<p>Training PyTorch models requires Python but that can be a significant obstacle to deploying PyTorch models to many production environments, especially Android and iOS mobile devices.
ONNX Runtime is designed for production and provides APIs in C/C++, C#, Java, and Objective-C, helping create a bridge from your PyTorch training environment to a successful PyTorch production deployment.
</p>
<p><a href="https://onnxruntime.ai/docs/api/" class="link">See ONNX Runtime's many Python-free APIs >></a></p>
</div>
</div>
<div class="row">
<div class="col-12 col-md-6 order-md-2 mb-4 mb-md-0 text-center pr-10">
<img src="./images/performance.png" class="img-fluid">
</div>
<div class="col-12 col-md-6 pr-5">
<h2>Lower latency, higher throughput</h2>
<p>Better performance can help improve your user experience and lower your operating costs.
A wide range of models from computer vision (ResNet, MobileNet, Inception, YOLO, super resolution, etc) to speech and NLP (BERT, RoBERTa, GPT-2, T5, etc) can benefit from ONNX Runtime's optimized performance.
The ONNX Runtime team regularly benchmarks and optimizes top models for performance.
ONNX Runtime also integrates with top hardware accelerator libraries like TensorRT and OpenVINO so you can get the best performance on the hardware available while using the same common APIs across all your target platforms.
</p>
<p><a href="https://cloudblogs.microsoft.com/opensource/tag/onnx" target="_blank" class="link">Check the latest on performance enhancements >></a></p>
</div>
</div>
<div class="row pt-4 pt-md-5">
<div class="col-12 col-md-6 mb-4 mb-md-0 text-center pr-10">
<img src="./images/agility.png" class="img-fluid">
</div>
<div class="col-12 col-md-6 pr-5">
<h2>Get innovations into production faster</h2>
<p>Development agility is a key factor in overall costs.
ONNX Runtime was built on the experience of taking PyTorch models to production in high scale services like Microsoft Office, Bing, and Azure. It used to take weeks and months to take a model from R&D to production.
With ONNX Runtime, models can be ready to be deployed at scale in hours or days.
</p>
<p><a href="community.html" class="link">See what ONNX Runtime users are saying >></a></p>
</div>
</div>
</div>
</section>
</div>
</div>
</div>
</div>
<!-- Partial footer.html Start-->
<div w3-include-html="footer.html"></div>
<!-- Partial footer.html End-->
<a id="back-to-top" href="JavaScript:void(0);" class="btn btn-lg back-to-top" role="button" aria-label="Back to top"><span class="fa fa-angle-up"></span></a>
<script src="https://www.w3schools.com/lib/w3.js"></script>
<script>w3.includeHTML();</script>
<script src="https://code.jquery.com/jquery-3.4.1.min.js"></script>
<script src="https://maxcdn.bootstrapcdn.com/bootstrap/4.3.1/js/bootstrap.min.js"></script>
<script src="./js/custom.js"></script>
</body>
</html>