DeepSeek has been the most used model on open router by far, only temporarily overtaken by ox alpha when it was free, so it's the most representative experience
> Why not use actual frontier models, and you know do some real research, before writing a blog post?
Seems like they've already done more research than you. Their results not matching your expectations does not indicate a lack of research. If you feel they missed something, why don't you go spend your own money on whatever frontier model you want and go publish a post with your own conclusions.
What expectations do I have? They used one AI model and then wrote a blog post as if they have an informed opinion. It has no credibility whatsoever, why would I listen to anyone's opinion who hasn't done proper research.
It's like playing one video game and then claiming all video games are boring and have bad gameplay and stories.
It is funny that only real research on productivity gains from AI shows at best very minimal gains, but AI bros will always tell you "no no no, you have used wrong model, try a different one, there are more of them, you have to try, trust me" and call that a "research".
Ah yes I'm an AI bro because I said the author must do thorough testing before coming to a conclusion about LLM's.
Looking forward to the authors next blog post on how after driving one car they find that all cars are slow and uncomfortable. Then the follow up after trying one phone and that all phones have bad cameras and battery life.
No you cannot get a static analysis tool to guarantee 97% of zig code was safe. Well, you can - the tool is called the borrow checker.
Do you know what's infinitely cheaper and faster than an LLM running nightly reviews of all of the code and infact mathematically provable that the code (and any new code) is memory safe? It's called the borrow checker.
it seems like a reasonable enterprise to intercept the data dependency graph from the zig compiler and subject it to analysis to prove memory safety parameters:
Why not use actual frontier models, and you know do some real research, before writing a blog post?