Updates on Pytorch

Every AI story we track on Pytorch: 25 stories so far, each summarized in our own words and linked to the publisher that reported it.

Pulled from 125 sources

This week

Machine Learning4 min read

Does Your Model Run on AWS Trainium? Look It Up

Hugging Face
Machine Learning3 min read

Google has joined Amazon in attacking Nvidia’s stronghold with AI app developers

Covered by 5 sources
Machine Learning9 min read

Profiling TorchNeuron (Part 1): System-level profiling on AWS Trainium.

Hugging Face
Machine Learning14 min read

Beyond the KV cache: Training and serving i14’s Laplace 3B linear attention model on AWS Trainium2 with native PyTorch

AWS Blog
Chips & Compute4 min read

Nvidia’s rivals have built their own AI chips and now want to make the software switch easier

ET AI (The Economic Times)
Machine Learning4 min read

Amazon is taking its biggest shot at Nvidia yet with new TorchNeuron dev tool

Covered by 2 sources
Machine Learning6 min read

Hugging Face ❤️ TorchTPU: TPUs, Natively

Hugging Face
Machine Learning8 min read

New course teaches how AI models run on modern accelerators

IBM Research
Machine Learning7 min read

TorchNeuron: running HF models on AWS Trainium is easier than ever

Hugging Face

This month

Machine Learning15 min read

Fault tolerant distributed training on Amazon EKS using NVRx

AWS Blog

Simplify and support your TorchServe workloads using Ray Serve Deep Learning Containers

AWS Blog
Machine Learning9 min read

Pathway’s brain-inspired architecture development on Amazon SageMaker HyperPod

AWS Blog
Machine Learning3 min read

Google's HEIR Aims to Make Homomorphic-Encrypted Inference a One-Click Capability

InfoQ (AI, ML & Data)
Machine Learning8 min read

Making Knowledge Distillation Cheap Enough to Run at Scale

Hugging Face
Machine Learning5 min read

Cursor Open-Sources Mixture-of-Kittens (MoK): A Deterministic MoE Training Megakernel for GB300 NVL72 Racks

MarkTechPost
Chips & Compute3 min read

A startup says the AI bottleneck isn’t compute. It’s memory, and it ditched the GPU to prove it.

The Next Web
Machine Learning4 min read

NVIDIA AI Releases Molt: A PyTorch-Native Agentic Reinforcement Learning Framework

MarkTechPost

5 Books That Will Deepen Your Understanding of Large Language Models

KDnuggets
Dev6 min read

Solving poker in custom WebGPU kernels

Hacker News

5 Must-Read Resources for Mastering Small Language Models

KDnuggets
Machine Learning16 min read

Build an explainable next-best-product recommendation system for banking on AWS

AWS Blog
Dev20 min read

Profiling in PyTorch (Part 3): Attention is all you profile

Hugging Face

Profiling in PyTorch (Part 2): From nn.Linear to a Fused MLP

Hugging Face

Profiling in PyTorch (Part 1): A Beginner's Guide to torch.profiler

Hugging Face
That's everything we have on Pytorch right now