Angestrom
news · Reddit r/MachineLearning

Kuma: compiling PyTorch models into self-contained WebGPU executables [P]

<!-- SC_OFF --><div class="md"><p>I've been experimenting with a compiler/runtime project that I'm not entirely sure is a good idea, so I'd love some feedback from people who've worked on deployment systems.</p> <p>The idea is to compile an exported PyTorch model into a self-contained package that contains:</p> <ul> <li>graph</li> <li>binary weights</li> <li>backend kernels (currently WGSL)</li> <li>runtime metadata</li> </ul> <p>A lightweight runtime loads that package and executes it directly

Want the primary source?View original →