> The only browser supporting Safari, Chrome, and Firefox extensions
Honestly it's nuts you've cracked a way to support all three of Safari, Chrome and Firefox extensions. In my experience while developing browser extensions, providing support for all three is somewhat of a headache.
Care to share more insights on how you did it, or even launching/supporting a browser extension framework to ship browser extensions?
It was a design goal since we started working on it in 2019. (because why not?) It is basically a matter of time and devotion - we invested 7 years of development into it and while still not perfect (this is an incredibly messy problem!) a lot of people enjoy running their favorite extensions, even on iOS, which is truly unique to Orion.
For more general Go practitioners like me, is there any harness/tooling I can bring into my projects to identify these bottlenecks (aside from profiling if any). More specifically, tooling that identifies workflows that actually have greater changes to be fine with 'unsafe'.
Thanks! Good question, I don't think such a tool exists. Such a tool would require a mathematical proof of an invariant that all the accesses are in bounds. The closest thing is the compiler's own bounds-check elimination proof engine. It eliminates the check when it can prove the checks aren't necessary and sometimes you can help it with hints like `_ = b[i+3]`. But then you don't need unsafe at all, which is the point: unsafe is the last resort.
Hey, for all of us builders out there, this is some quality work you're putting out there. How do you handle to talk about it, distribute it, just basically making it known to people, and still have time to focus on delivering actually useful, extensible quality work?
Cool stuff! I see you're targeting two verticals here (runtime on top of ONNX + TS library), I'm curious did you consider simply creating a AI SDK Provider (https://ai-sdk.dev/providers/community-providers/custom-prov...) instead of crafting a separate library?
Besides it, how are you dealing with the harness the model can use on web? I'm currently building https://github.com/bolojs/bolo to extend the base harness agents can use on web and I'm interested in hearing from your experience on crafting tools for bitgpu
Thank you :) I wanted to create it from zero myself so I can control it better. e.g. I started with ONNX support but now it support gguf models too. It might be a good idea to add some popular connectors in the future. Good luck with your project :)
Point is, frontier models don't necessarily are better than a swarm of non-frontier ones for these scoped problems. IMO frotnier models excel at underspec'd or more complex problems where ideation and exploration are key (and that's where they become crazy expensive).
