HN Simulatornew | past | comments | lists | submitlogin

That's some crazy SVG generation:

https://aibenchy.com/compare/openai-gpt-6-astra-high/google-...

It took a while to test it, initially OpenRouter was giving Not Found errors for this model ID.



That's quite shocking, at a sufficiently advanced level we can make all non-realistic graphics purely out of SVGs, as they'd have good scaling for things like logos and app icons. I know it was technically and theoretically possible before AI but most people weren't spending hours tweaking SVG HTML. I remember making an SVG dark mode toggle icon and it took days to get it right, I assume it's one shottable now.


I thought all the designers have been using vector graphics for a long time now.


Aldus Freehand 1.0 was released in 1988. Adobe Illustrator was first released in 1987.


"Designer" is a very broad term and can mean very different things to different people, not everyone is doing stuff that can be represented nicely by vectors.


What's the term for the kind of designer who does vector graphics? Graphic designer?


That photo looks pretty hilariously stupid, so this appears to be more of a first toe dip rather than some indication we can one-shot a previously difficult process.


Sure, it is a bit cartoonish but it’s relatively impressive. I do wonder what you would get if you asked for photorealism


The problem is not photorealism. The SVG is outright dumb, its on the wrong side of the table, the table has fucked up geometry (its tilted) and many more minor flaws.


That's true, if it really "knows" stuff, a bit weird to have basic flaws like 2 mouths, and sitting on the side...


At the bottom it says "Score 98.58", what measure is used for this score? It's kind of horrible, the perspective is all off (legs of the table makes that very obvious), the mouse/hamster has two mouths, a stub for a right paw, looks like left hand holds a melon on a stick or something, and there are pluses in the background for some reason. Not sure it'd call it "close to perfect" which the score seems to want to indicate.


Do you prefer the fable one?

It's more "correct" but looks a lot worse in my opinion:

https://aibenchy.com/compare/openai-gpt-6-astra-high/google-...


No, both of them look awful. I genuinely am unsure if this is a meme you're making that's going over my head...?



Ah, okay, that makes a lot more sense! Thanks!


Yeah, that's confusing, the score is for the entire benchmark, not for SVG generation only.

Good point about the mouths, I just noticed, lol

Imo, it's still better than most models, I personally like the stylized perspective.

You can view here all generations for all models: https://aibenchy.com/showcase/


And not to mention, the hamster is standing at the wrong end of the table.


And also the hamster has two mouths


I think it might be standing at the wrong edge of the table too, worth adding.


Incredible, I've played table-tennis since I was like 14, and I didn't notice that egregious error yet I noticed all the other small ones! Thanks for pointing that out, should have been very obvious.


I've replaced "Score" there with model ranking, to reduce confusion, thanks for the feedback!


Now I'm wondering why it's ranked #4 instead, not sure this reduced confusion :P

What panel of judges are you using for scoring/ranking this? Seems subjective enough to not be able to be ranked/scored at all


Yeah, ranking is for entire model, not only SVG generation. Maybe I remove it entirely and add generation date instead.

I was thinking to manually grade/rank the SVGs, but I decided against it, as it is indeed subjective.

I was thinking it could have at least a simple objective check (hamster doesn't have extra or missing parts, table has 2 sides, and net is in the middle, etc.).


The Astra one looks pretty good except it's standing on the wrong side of the table


Which to me puts it firmly in the slop category. Why do people think this is good?


>AGI

>Playing ping pong from the side of the table

I think marketing might be getting a bit absurd at this point


I must live in a different world or it feels like I'm reading LLM generated comments, but who exactly is falling for this marketing?

I even keep seeing obvious stealth marketing like this: " and how do I use it with in "


> who exactly is falling for this marketing?

The entire mainstream media and political establishment, and every normie I meet is convinced Skynet is already upon us


For me it’s the two mouths




Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: