Last week Claude seemed to trigger /feedback automagically in a session, even though we've got that turned off in our org settings. Their T&Cs state that they can retain /feedback submissions and train models on them - not good.
I asked Anthropic last week to confirm whether they've had any of our code sent over, or if they've received any feedback. They've stopped responding to my support requests.
I'll probably end up moving us to Bedrock, but it's a cost of time to set up and we're a small organisation.
I think this is the new Claude Code in-session suggestions for feedback - I think they generate in-session even though they're unsubmittable for the org. Kind of bad UX.
The absolute worst and the reason I switched from Anthropic to Codex. Codex caught wind of it of course and now they do use the unsuspecting message: We are reviewing this request (do you mean hoping to train on it? or reviewing?) and if you would like to use a different model, press the "any" key. I wonder if they collect the data they make a point to collect, that would make so much sense ... we need to speak out against these type of data collection patterns. Terrible UX and a dark pattern for them to use the same "accept" buttons of 1, 2, 3 etc. The irony is that THESE feedback messages are the sole thing driving me to consider running open source models locally.
The employee, just looking to make rent? The CEO, all in on the dream of the AI powered future? Legal, looking forward to litigation and well-competition retainers? Atlassian itself, when it’s just one of the many companies training models on private intellectual property, and whose T&C clearly state they will be doing so? Competitors, when there will be no reasonable way to prove their code has been generated from yours?
The truth is that one gives a damn about trade secrets being used to train AI models.
The entire copyright system for software is dead and no one really seems to care or even talk about it.
IMHO, this is not the point. The core problem is that they're building systems that will remove competition altogether. You may still get your current systems to market ahead of your competition, but future "competitors" will be built off of your data and Atlassian will be one more company in the list of companies profiting from everybody else building systems using their data, probably destined to fail because everybody else can do it just as easily, but the money required to fund Atlassian's systems that built it for them, however large or small, will have already been sent. Those systems that Atlassian will profit from will be built from the data of "customers", who also paid Atlassian will giving up their own data.
With almost zero control over whether or not this happens (politically or individually), the only reasonable action to take is "take advantage while there's an advantage to be had".
Knowing that our competitor is trying to poach one of our clients away by promising a new feature could be very useful to us. Likewise, knowing that a competitor is at risk of losing a customer because they won't implement a feature that we're willing to implement (or already have) is a qualified sales lead.
All of this would be illegal if discovered in this way, presumably, but it's not entirely accurate to say that information is not power.
I struggle to see the tech/data being used in that way. At a much higher level, the data is more likely anonymized (where possible) and/or not directly exposed to anybody. Think of the initial github copilot that used source code across all of the repos and how it was able to take instructions for what you wanted to build and give you essentially a consensus built piece of code that fit what you asked for, be it by auto-completion, comments, or direct requests.
"I want to build a business that does X using Y. Give me revenue predictions, spend over time, and customer demand predictions." etc
Usually customers are open about this kind of thing though. They play you off your competitors and vice versa.
I don't totally disagree, I just think the real secrets have nothing to do with features or dev. The secret is A is about to go bankrupt or B is facing legal trouble. These kinds of things aren't in JIRA.
Very few companies actually have any “trade secrets”. The success of almost any business is based on marketing and distribution and reputation and partnerships, not on any “secret”.
It's one of the classic mistakes of people who are not entrepreneurs. They try to keep things too secret and they spend a lot of time and effort keeping things secret while real entrepreneurs who have actually made millions on the market know secrecy rarely matters.
In the realm of apps and stuff, it is pretty much just repacking of someone else's idea.
In the world of B2B, there are definitely companies that provide service based on direct personal experience of senior employees. While they may be using the same software available to others, it's the logic to know what to tell that same ol' software what to do that matters. Over my entire career I have dealt with multiple companies that write code but have zero knowledge about the subject matter the code is being written for so that basic mistakes are made resulting in utterly ineffective software.
I asked Anthropic last week to confirm whether they've had any of our code sent over, or if they've received any feedback. They've stopped responding to my support requests.
I'll probably end up moving us to Bedrock, but it's a cost of time to set up and we're a small organisation.
reply