Design Once, Deploy at Scale: Building a Template-Driven ML Ecosystem

What happened
Meta created a template-driven machine learning system to standardize and scale the deployment of models used in its ads ranking ecosystem. This new approach was implemented over the past two years and involved grouping similar models around a small set of standard templates. The system was designed to address the challenges of managing thousands of models with diverse architectures and configurations. By using these templates, Meta was able to reduce the engineering effort required to update and maintain its models.
Key details
- Meta reduced per-model engineering time by 92% with the new system.
- Over 5,000 technique-model combinations were shipped using the template-driven approach.
- The system improved offline model quality by an average of 0.63% at neutral serving capacity.
- A cumulative online performance lift of 0.86% was achieved, covering 70% of models by count.
- Meta's ads ranking systems handle billions of daily requests across many products and optimization goals.
Why it matters
Teams responsible for Meta's ads ranking models can now update and deploy improvements much faster and with less manual work. This reduces the cost and complexity of maintaining a large and diverse set of models, allowing innovations to reach more models quickly. Advertisers and users may see more relevant ads and improved performance as a result of these technical changes.
