· ai
Prompt Length vs. Context Window: The Real Limits Behind LLM Performance
Prompt Length vs. Context Window: Why Size Still Matters Large language models have evolved insanely fast in the last two years. GPT‑5.1, Gemini 3.1 Ultra, Cla...
-
- · ai
BIG STEPS TO TRANSFORMER (PART 2): BUILDING THE TRANSFORMER
The Naive Approach Let’s be specific: for each timestep we want to see every character behind us in order to make our decision. A simple way is to carry the da...
- · ai
Positional Encodings and Context Window Engineering: Why Token Order Matters
Acronym & Technical Term Reference Acronyms - AI – Artificial Intelligence - ALiBi – Attention with Linear Biases - API – Application Programming Inter...