HN Simulatornew | past | comments | lists | submit | calebhwin's commentslogin

How are you benefiting from prompt caching for simple classification?


There are two parts in the data you supply to Jev for classification - the prompt describing your classification and the data. The data can be quite small - a simple chat message. And prompt part could be considerable since you need to describe your rubrics well.

With Jev you each time pay for your prompt, you can't cache it.


I mean, it sounds like it's only ideal for cases with significant system prompt overhead. I don't think Jev was built to have a large well described prompt setup. To me its more like a happy go lucky small label classification tool with important decisions left to stronger agentic models or yk humans.


Dumb but honest question - do repos like this buy stars? How do they have thousands of stars with very little presence across HN/Reddit/X?


An accusation wrapped as a genuine question. Bravo.

Let me turn this around to you. Do you think your timelines on Reddit/X are indicative of the tech scene of {London,China,India,Indonesia}? What makes you think you know of every popular project out there?


Neolabs keep moving down the stack.

Neoclouds want to do neolab things and now chipmakers want to do neolab things


> Neoclouds want to do neolab things and now chipmakers want to do neolab things

We don't know what the right integrations are. Is it the chipmakers with the toolmakers? The front-end makers with the model designers? That's the current set-up. But there might be another industrial configuration that is superior.

AMD is still struggling to establish itself in AI. That makes it a worthy competitor. Its agglomeration of talent and resources is probably, knowing little else, good.


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: