Archive - Towards AI Newsletter

#117:Do OpenAI's o1 Models Unlock a Full "Moore's Law" Feedback Loop for LLM Inference Tokens?

Also, DataGemma, Pixtral 12B, Reader-LM, Mini-Omni, MemoRAG, and more!

Sep 17 •

TAI #116; Rise of the Protein Foundation Model; Comparing AlphaProteo, Chai-1, HelixFold3, and AlphaFold-3.

Also, Claude Enterprise, Replit Agents, SSI Raise, Deepseek 2.5, and more!

Sep 10 •

#115: LLM Adoption Taking Off? OpenAI API Use Up 2x in 5 Weeks, LLama at 350m Downloads.

Also, Cohere's Command R, new Qwen2 models, HelixFold3, OpenAI Strawberry news, and more!

Sep 3 •

August 2024

#114: Two Paths to Small LMs? Synthetic Data (Phi 3.5) vs Pruning & Distillation (Llama-3.1-Minitron)

Also; Jamba 1.5, DisTrO, StormCast, Late Chunking & Cursor funding round.

Aug 27 •

#113; Sakana's AI Scientist - Are LLM Agents Ready To Assist AI Research?

Also, Xai's Grok-2, Claude context caching, Imagen 3, Tree Attention, and more!

Aug 20 •

TAI #112; Agent Capabilities Advancing; METR Eval and Inference Compute Scaling

Also, Qwen 2 Math, LG EXAONE, Structured Outputs, Gemini Flash 1.5 fine-tuning.

Aug 13 •

Louis-François Bouchard

TAI #111; What Does Deepseek's 10x Cheaper Reused LLM Input Tokens Unlock?

Also; Inference costs outpacing Moore's law, Gemini Pro 1.5 tops LMSYS, Character AI acqui-hire, Gemma 2, FLUX.1, Zamba2.

Aug 6 •

Louis-François Bouchard

July 2024

TAI #110; Llama 3.1’s scaling laws vs 100k+ H100 clusters?

Also Mistral Large 2 123B, AlphaProof Olympiad, SearchGPT, GPT4o 64k output, SAM 2

Jul 30 •

Louis-François Bouchard

#109: Cost and Capability Leaders Switching Places With GPT-4o Mini and LLama 3.1?

Also, xAI's 100k cluster, Apple's DCLM-7B, Mistral NeMo 12B, a closing internet, and more.

Jul 23

#108: Conflicting Developments in the AI Regulation Debate

Also, FlashAttention-3, imminent new LLMs, OpenAI's "Strawberry" project, CRAG, MambaVision, and more!

Jul 16

#107:What do enterprise customers need from LLMs?

Salesforce’s xLAM-1B, SenseTimes’s SenseNova 5o, Nvidia's RankRAG, Phi-3 Update, Moshi, SummaHay!

Jul 9

TAI #106: Gemma 2 and new LLM benchmarks

Open LLM Leaderboard v2, CharXiv, CriticGPT, ESM3 protein model, Meta LLM Compiler, and more.

Jul 2

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts