29
Points
40
Comments
maxloh
Author

Top Comments

pandoroJul 23
All frontier models have been trained without any regards for IP protection laws. I don't see how anyone can argue in good faith that distillation is not fair game and does not ultimately "benefit humanity™"
causalJul 23
So this shows distance relative to other models, but I don't have a good sense for what these numbers say in absolute terms.

K3-to-Fable is blue at 0.42. Is 0.42 meaningful, or did we set 0.4 as the lower bound because it makes 0.42 look significant?

Sol-to-Fable is 0.69. It's dark yellow, making this look VERY different from 0.42. But is it? What do these numbers mean in absolute terms?

throwa356262Jul 23
This data sort of disqualifies itself: unless Moonshot has a time machine, K3 should be more similar to Opus 4.5-4.8 than Fable 5.

Keep in mind, Anthropic started limiting access and introduced anti-distillation measures around 4.5-4.6 (?). So the majority of distillation should have happened on earlier models.

Maybe a better explanation is that they have access to the same training datasets? Which if private can again raise questions about theft, but on a very different level.

kingstnapJul 23
Keep in mind if you ask Claude what model it is in Chinese it says its Deepseek or Qwen or Kimi.

So who's training on who's outputs?

https://news.ycombinator.com/item?id=48990086

https://x.com/stevibe/status/2026227392076018101

josh-paulJul 23
This looks to be more behavior based, not logit based? What is the actual claim?
isoprophlexJul 23
Stolen data was stolen. Oh no! Anyway.
codelionJul 23
How do you do cross entropy analysis for Claude without logits?
great_psyJul 23
Shouldn’t we expect a convergence as models become more powerful ?

There is an optimal answer to any question. Something that maximizes utility and minimizes tokens.

Visit the Original Link

Read the full content on typebulb.com

Source
typebulb.com
Author
maxloh
Posted
July 23, 2026 at 03:05 PM


More Top Stories

nealstephenson.substack.com Jul 23
Writing by hand is good for your brain
356150 commentsby dwwoelfel
Details
haqr.eu Jul 23
Software rendering in 500 lines of bare C++
12323 commentsby mpweiher
Details
politico.com Jul 23
Startup founders urge U.S. government not to shut off Chinese open weight AI
307306 commentsby theanonymousone
Details
stephenfollows.com Jul 23
What happened to TheNumbers.com
361 commentsby nickthegreek
Details
eso.org Jul 23
Astronomers may have found the first exomoon
13552 commentsby MarcoDewey
Details
learnopengl.com Jul 23
Learn OpenGL, extensive tutorial resource for learning Modern OpenGL
7637 commentsby ibobev
Details
👋 Need help with code?