We ran these models through our evals for our parametric CAD harness. They're pretty impressive. I was especially impressed with the articulated toy figure and clock that astra 6.2 made:
These are now the top two models as far as our human rankings go. They're also faster and cheaper than their 6.1 counterparts. They're still a bit more expensive and slower than sonnet when it comes to day to day use. Our product is all about lots of back and forth with human in a harness so for that I think we'll be sticking with sonnet for our default... but it's a close call, and I might start recommending these more to our users.
Shameless plug: I’m workin on http://partforge.ai right now it’s mostly aimed at 3d printing but it can create laser cut sheet parts with dxf file exports and will support cnc routed parts with drill holes and socket diagrams built in in the near future. Board cut lists as a export is a little further out, but you can ask it for measurements of anything you build and it would probably be a pretty useful tool.
Just a little feedback: one of my most hated dark patterns in design is when you give the user the impression that they can try out your website but they actually can't. That's the case on your website: there is a text field making it seem like you can give your site a spin, but as soon as you hit the submit button, you get a pop-up telling you that you have to sign up first. And that after I already spend some (admittedly small) effort to craft a sample text.
I personally hate that pattern, and my default reaction is to immediately close the tab.
Perhaps you could change the landing page to avoid that negative first impression?
I spent quite a bit of time using openscad which Claude code to try to build a capstan (rope driven) joint for robotics. It worked well but had some issues with agentic stuff and speed. In the end I ended up taking a detour and building my own agentic cad modeling harness based on some of the same open source libraries that openscad uses. Now I’m trying to turn that into its own standalone product. You can check it out at http://partforge.ai
We tested this on our agentic CAD modeling harness. Opus 5.5 seems to be a pretty dramatic improvement in spacial reasoning and CAD coding. Our go-to is still Gemini Flash 3.8 for speed and cost reasons, but Opus 5.5 is a big update.
We tested this on our agentic CAD coding harness. This seems like a decent improvement vs 5.6. It's lower costs seems to be offset by more token use so those cancel themselves out, but the actual results for spacial reasoning and coding are an improvement.
https://partforge.ai/evals/tasks/iterate-posable-figure-then... https://partforge.ai/evals/tasks/create-wall-clock-gear-trai...
These are now the top two models as far as our human rankings go. They're also faster and cheaper than their 6.1 counterparts. They're still a bit more expensive and slower than sonnet when it comes to day to day use. Our product is all about lots of back and forth with human in a harness so for that I think we'll be sticking with sonnet for our default... but it's a close call, and I might start recommending these more to our users.
Here are the full evals:
https://partforge.ai/evals
reply