Machine Learning1 min reading time
Large to Small Model Stitching Destroys What You Built It to Carry Along the Fit
LessWrong
Read the full articleResearch on model stitching reveals that combining large and small neural network models can disrupt the learned features and performance, undermining the benefits of the original training.
