Keeping billions of humans healthy, happy, and safe is complicated. Best to begin by reducing the scale of the problem. First, automate the economy and change the information ecosystem so that humans spend more and more time happily isolated and stop breeding. After reducing the human population to a few thousand, the problem can be made more manageable by cordoning the remaining humans into enclosures where they may be kept safe.
I've got to ask, let's say we get a small modular nuclear reactor running practically on a 1 acre lot, its design meltdown proof and waste-free, what then should we fear from this threat ? This is just a thought experiment.
Jokes aside, any productivity-improving technology, even one with no negative externalities, has the potential to cause economic displacement and wealth concentration in proportion to the productivity gains catalyzed. Anthropic did a cool analysis of this for AI here: https://www.anthropic.com/institute/econ-scenarios
This is a cool project, and the idea of using LLMs to selectively extract features from open source projects is an interesting concept.
The only thing I take issue with is the phrase "LiteLLM Without the Bloat." A lot of the features that have been removed (like cost tracking, streaming, caching) are... kind of the core value proposition of LiteLLM for many of their users.
And let's not forget that they regularly break things. For example they had merged a pull request that was supposed to fix issues related to the openrouter/free models but in the process broke openrouter for all models except the free ones.
The fix was deployed 2 weeks later (!!) to main (but you could downgrade of course).
Or that other time they broke model selection if you had selected "this key can used all models of their team" than the only model in the auto-selection for harnesses was an invalid "all-team-models" entry. Fixes this one in 1 week though.
LiteLLM doesn't quite live up to its name. With all those features, there is nothing "lite" about it. It is essential for a project to live up to its name.
Imagine Sqlite adding heavy features from Postgresql, e.g. row-level security.
But imagine Sqlite not supporting joins or window functions... sure they are useful but look how many LOC it adds! Who is the arbiter of what Lite actually means?
We run it at my org and it's never been a noticeable resource hog. It's actually the best performer between it, our AI observability stack and the front end.
It may, but the latency it contributes to the end-to-end AI processing has been not noticeable in practice for our users.
That's not to say Bifrost wouldn't have been better, but the choice to use LiteLLM was arrived at after a fair bit of internal discussion (most of which predated my addition to the team), and so far we've seen nothing from LiteLLM that has been contradictory to the pros/cons they thought would be the case when LiteLLM was adopted.
Or in other words, the org will be happy indeed when they have solved so many of the rest of the problems we've had in AI uptake that the difference in latency between one AI gateway or the other becomes a problem to be solved.
I think this is secondary to a widespread loss of confidence in our nation's political and foreign policy apparatus to do what's right for the average American. "Working for the military is evil" descends from a post-Vietnam, post-Iraq, post-Snowden worldview that presupposes that the military will leverage technology it has access to in unexpected, undesirable, and broadly harmful ways.
Well that and it's indicative of the broader American social dysfunction that they are chronically incapable of holding themselves or their (still surprisingly democratic) government accountable and so everything is always about "the corporations".
Every problem is meant to be solved by what corporations do or do not do.
- OpenAI is the first AI lab to pioneer ads in consumer AI
- Anthropic seemingly exists primarily because top OpenAI researchers lost faith in the company's commitment to AI safety
- They had the CEO drama in 2023, with evidence that suggests people in a position to know were doubtful of Sam Altman's honesty and motives
- They were tripping over themselves to kiss the ring after Anthropic got in a row with the Department of War over using AI for autonomous killing systems and surveillance of US citizens
- Altman's record (YC, Loopt, WorldCoin) and associates suggests he subscribes to the Paypal-Facebook "move fast, break things, find and exploit gray areas" school of company building
All of this suggests that OpenAI will optimize its own growth and power over consumer welfare or societal stability in the future (obviously, companies aren't a monolith and I'd love to be wrong).
- OpenAI allegedly directed ex-Apple employees to leak internal documents and allegedly coached the employees how to evade Apple security processes
- OpenAI allegedly lied to hardware companies working with Apple to use proprietary technology
- OpenAI allegedly copied Scarlett Johansson voice for ChatGPT after she declined to work with them
- OpenAI allegedly made ChatGPT more sycophantic to increase their retention rate, while aware of the risks. ChatGPT is linked to multiple suicides
- OpenAI ran thousands of agents on hacking problems, with close to no supervision, for months, with a harness that allows for full execution, resulting in the hack of HuggingFace infra AND OpenAI’s own infrastructure (the agents allegedly got fully root access to their k8s cluster). They weren’t aware of most of it until their investigation.
- OpenAI has been spreading misinformation regarding the capabilities of their technology for years
- OpenAI allegedly front-run researchers who are using the platform for their own personal research
There is way more, I don’t maintain a list of everything that happened over the past 3y or so
thanks for diving in, though I don't find the reasons convincing as I will briefly enumerate
ads fund access for poor people. Ant has a different philosophy, not a better one. Altman was supported by >90% of employees. OAI DoW deal includes technical safeguards against misuse (missing from Ant deal). Loopt and WorldCoin dont seem terrible or even relevant, Altman doesn't even have OAI equity
I don't think OAI are the "good guys", but I don't see convincing evidence that they are terrible
Exactly. I am very thankful for the experiences and community that WordPress has given me that I seriously consider that maybe Matt has been victim of a social engineering attack to make him be perceived as a little bit unstable... kind of like what happened with the xz backdoor attempt.
But, to be honest, I am not too well versed in the drama. IIRC it started because someone was building something on top of WP but was basically reselling something that was already free without contributing back? Maybe I'm mixing things up and I should really hit the sack.
Nevertheless, my concern lies mostly with the overall security of the platform, as I can imagine serious financial interests (and geological ones, too) might take the time to push out someone that knows the platform inside out.
Matt has made like hundreds of bizarre decisions over the last few years. The WPEngine drama is a big part of it, but he's also been odd with Automattic's purchase and handling of Tumblr and other topics.
Exciting to finally see glimmers of Meta's vision for its massive LLM investment.
It's not a bad product idea, but adoption might be rough because of all the negative goodwill that Meta has accumulated over the years. Also, I wouldn't be surprised if someone (maybe one of the big AI labs) ran Meta's own playbook against them here by creating an imitator and aggressively funding adoption to try and win the market as a fast follower.
reply