Bag of words, have mercy on us
Published: (December 7, 2025 at 05:31 PM EST)
1 min read
Source: Hacker News
Related posts
Read more »I Built a Brazilian Portuguese LLM from Scratch - Here's What I Learned
!Cover image for I Built a Brazilian Portuguese LLM from Scratch - Here's What I Learnedhttps://media2.dev.to/dynamic/image/width=1000,height=420,fit=cover,grav...
[Paper] Revisiting the Scaling Properties of Downstream Metrics in Large Language Model Training
While scaling laws for Large Language Models (LLMs) traditionally focus on proxy metrics like pretraining loss, predicting downstream task performance has been ...
[Paper] Toward Faithful Retrieval-Augmented Generation with Sparse Autoencoders
Retrieval-Augmented Generation (RAG) improves the factuality of large language models (LLMs) by grounding outputs in retrieved evidence, but faithfulness failur...
[Paper] Do Depth-Grown Models Overcome the Curse of Depth? An In-Depth Analysis
Gradually growing the depth of Transformers during training can not only reduce training cost but also lead to improved reasoning performance, as shown by MIDAS...