https://www.infinitescript.com/tags/pytorch/Recent content in PyTorch on Infinite ScriptHugoen-usWed, 28 Mar 2018 12:30:58 +0000https://www.infinitescript.com/2018/03/build-pytorch-extensions-with-cuda-and-cffi/Wed, 28 Mar 2018 12:30:58 +0000https://www.infinitescript.com/2018/03/build-pytorch-extensions-with-cuda-and-cffi/<blockquote> <p><strong>Deprecated warning</strong>: PyTorch 1.0+ replaced the old TH/THC tensor backend with ATen, and the <code>torch.utils.ffi</code> toolchain described here was removed along the way. If you target PyTorch 1.0 or newer, write your extensions with <code>torch.utils.cpp_extension</code> instead, see <a href="https://github.com/hzxie/GRNet/tree/master/extensions">this GitHub repository</a> for a working example. The article below documents the older CFFI-based approach and is kept for reference.</p> </blockquote> <p>Python is one of the most popular languages for deep learning, but as an interpreted language it is slow at tight numerical loops. Most of the time this does not matter, because the heavy lifting happens inside libraries written in C and CUDA. It starts to matter the moment you need an operation that the framework does not provide out of the box.</p>