Have you tried... reading the article? Under the big headline that says "Limitations", in particular

> Hopefully this will send in place a party-shutdown procedure

Let's save democracy by abolishing democracy!

Heh. Abolishing parties who vow to destroy it is anything but that.

The limiting factor on a party’s ability to operate should be public support, not political permission. This is basic Democracy. If not, you’re giving those in power the authority to decide which political views are allowed to exist. That's Authoritarianism.

If a party expressed anti-democratic goals, protecting them by the social compact of democracy is stupid.

Look how well that idea worked out in Turkey. Authoritarian movements use democracy like a train and get off when they get power

The power to determine which political groups can exist is itself anti-Democratic. People can debate if the AfD is anti-Democratic or not but if they are not allowed to exist, then the government is already anti-Democratic.

Not very shocking that OpenAI wants you to use tokens

Gemini offers indefinite cache on API, but you pay per hour.

AFAIK, there's no evidence that Alibaba won't keep releasing more open source models. Before 3.8 there was speculation they wouldn't release the weights, but they finally did - Although I guess the largest model wasn't multi modal.

And Minmax is set to release their latest flash model on October 23rd.

So not sure where you're getting this from, unless I misunderstood something

I have this idea that the big labs internally have much more capable models which are prohibitively expensive to run though, and the competition is mainly around getting the price down by releasing models that are quantized/otherwise made more efficient at the cost of a lot of performance.

30GB a month isn't too terrible? I guess it depends - for example my provider includes 10TB egress per month, so 30gb would be negligible if it's static content. I'm not sure what others do, but I often click on the links that the agents pull up as sources so the websites do get more discoverable.

What really sucks is e.g. Gemini that pulls images without being able to go to the source (unless it changed recently.)

Edit: I didn't read "logs"

The issue is that a dynamic site that can serve the traffic that generates 10MB of logs a week might be very performant on the smallest and cheapest of virtual servers, but one that generated a GB daily might find itself very slow and sometimes crashing because of load depending on spikes, unless they opt for a server with more resources, for more money.

Any answer to that along the lines of "do something more complex" or "optimize your site for load" to be able to deal with the rampant bad behavior of multi-billion dollar companies is unpalatable to most.

In other way I must use LLM to fix issue created by LLM in the first place

If you think your only tool is a hammer, everything indeed starts to look like a nail.

This is one of those things that might be best solved through policy and law. There probably will be some changes to policy and law to help, eventually. That stuff usually takes a while, and that's always been a problem for those suffering in the interim.

1GB of logs, not content

Average log size is about 300 bytes. 1GB of logs per day is approximately 40 requests per second average.

Not every request is meant to be served below 500ms and this is server which supposed to be called couple of times a minute not milliseconds

We started with caching but this created a new kind of problems of its own (veterans know what circus of man eating from outside out clowns this create) but client was mad manual refresh is causing "freezes" in the system.

So we ban LLM and problem solved until client starts asking why ChatGPT, Claude, whatever he prefer can't access data and release him/her from pain of using brain

I'm not sure just skipping the scraping by providing your data directly for harvesting is the solution

You sure? HuggingFace should be happy they got their leaked keys reported at pretty much zero cost and no real adversarial breach.

I'm not sure at all, it's pure conjecture. But they actively exploited a zero-day, leaked private repo data to public repos, modified private code, and rooted private machines. It was far from just reporting leaked keys.

And the others have been pretty muted: the online forums they spammed, etc.

I recommend just setting up a podman container, LLM can do it for you.

Basically Podman is a more secure version of Docker.

I would keep stuff like secret keys outside the container and sign/push commits manually.