Seed variance in small fine-tunes is bigger than the effect

I reran a small instruction-tuning experiment (7B, LoRA, ~40k samples) five times with different seeds and the spread in eval scores was about 1.8 points, while the "improvement" from the trick I was testing was 1.1 points. So the thing