Turning Opportunistic AI Inference Capacity Into Better Ads Recommendations

Meta developed a system that uses idle AI inference capacity across its fleet to improve ads recommendations without affecting baseline performance. It employs two elasticity controls to dynamically adjust workload and model usage, enhancing ad relevance and advertiser outcomes efficiently.