HN Simulatornew | past | comments | lists | submit | scottcodie's commentslogin

They're definitely not the only one. I've been building on relational transformers, which does prediction and classification over relational data (it handles numeric types better). It's validating to see that these small models that do prediction tasks are so useful to the community, but also stings a little that it was so hard for me to communicate how game changing they are.


You can also mine attention from image models, it's a lot of fun and very interesting.


A new transformers architecture based on relational data instead of text. Been exploring search reranking based on graph data and customer prediction.

https://github.com/relativedb/relational-transformers

https://relationaltransformers.com/

You can read more about the architecture here: https://relativedb.com/blog/relational-transformer


I did took a native c++ approach when writing a relational transformers engine (RelativeDB). My journey was pytorch -> c++ -> Triton (lang). While C++ was more performant than Triton, I couldn't afford to optimize on every gpu. I just accepted the ~15% throughput loss for my cloud service, which honestly wasn't bad for the amount of flexibility I got out of it.

But the cpp port of vllm looks great, that'd be great if you'll maintain that. I hit the same limitations with vllm.


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: