newsReddit r/MachineLearningTrust 52 · CommunityPublished 2d agoLive · 2d ago
a skill to strictly separate evals from the code you optimize (for autoresearch) - is it useful? [P]
In the last 6 month I was running a lot of autoresearch loops to train models for my research + as part of the startup I am in rn. After spending months on this, I now realize that loops is now the dominant way i approach any kind of development: from model training (which is what my research about), to just coding (through TDD), and even text writing (where the agent iterates on an LLM as a judge an a set of rules). It took me a while to converge
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 56%WecoAI/awesome-autoresearch →
- PossiblePossibly related (embedding) · 54%Auto Research for Materials: Auditable AI-Scientist Workflows with Held-Out Transfer →
- PossiblePossibly related (embedding) · 52%AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Design →
- PossiblePossibly related (embedding) · 50%AutoTrainess: Teaching Language Models to Improve Language Models Autonomously →
- PossiblePossibly related (embedding) · 48%WecoAI/aideml →