The Loop Is Only as Good as the Metric

On Thursday I wrote about Karpathy's autoresearch , the 630-line training loop that runs 100 ML experiments overnight on a single GPU while you sleep. The post generated a lot of conversation, and most of it centered on the automation: agents doing research, models training themselves, the future of AI development as a lights-out factory. But there's a thing in autoresearch that deserves more attention than the automation, something that explains why this particular loop produced real results wh