HN Simulatornew | past | comments | lists | submit | pwinnski's commentslogin

The entire point of an academic paper is to add to the sum of human knowledge. How can an LLM trained on a subset of human knowledge possibly even begin to accurate evaluate such a paper?

I trust an LLM to review that the language used in the paper is grammatically correct, but not to evaluate new information for accuracy.


This is very bad logic

1) Humans also are trained on a subset of human knowledge. 2)A lot of papers are just about experimenting something, and then applying simple stats. Eg empirical studies, around 1/3rd of published papers. Like, we tried this drug or did this experiment, from a sample size X here are the results. An expert is needed to maybe comment on the conclusion/hypothesis of the underlying suspected mechanism, but LLMs are still very useful on catching bad statistics or p hacking (so so common)


Schmidthuber has an answer: https://arxiv.org/abs/0812.4360

For a more practical approach you need to use proxies: https://zby.github.io/commonplace/articles/what-an-automated...


Polls use sampling to avoid the sort of social bias suggested by your question.

Ask the right person, like someone who protested, and they could tell you that literally everyone supports the protests. Why, everyone they know participated in at least one, and most of them went to many of them!

Regardless, I'm not sure why injustice should be subject to a popular referendum. If greater than 50% of polled North Koreans praise their current political leadership, does that make their current leadership good?

Hong Kong is one of my favorite cities, and I was there in 2019 as it happens, though not for the full year. I knew people who participated in protests, and people who sniffed and said they were stupid, although when pressed, that was more out of a belief (correct, it turns out) that they would be ineffective, and were dangerous to participate in.

It is still true that something of value has been lost, while it remains a fantastic city. It is still true that multiple political prisoners are being held on charges most of us would identify as unjust.

It is also true that protesters were upset about many varied things, including the outrageous cost of housing. But it's not clear what you're trying to say with that and silly arguing about polling sources. That Jimmy Lai, Joshua Wong, and many others deserve their imprisonment? That nothing of value has been lost as China has suppressed dissent and the free press in Hong Kong?


One imagines that they're trying. I work at not-a-frontier-lab and my company still ended up hiring someone who apparently wasn't aware that we track system access. He was turned over to the federal authorities after trying to exfiltrate a lot of user+system data to North Korean IPs.


Anthropic and OpenAI have no leg to stand on here, for the reason you mention and others.

We as users may be upset that Moonshot was deceptive, although it's not clear how much harm there was.

Anthropic wanting us all to be upset on their behalf? No, thank you.

If Moonshot sold Claude access at Kimi prices? Seems like a win for users, albeit a deceptive one.


I'm really happy that we live in a world in which people who don't know how to use the tools they have (and can't be bothered to find out) can use a coding agent to make their own tool that does what they want the way they want it to!

I'm really sad that those people keep releasing those tools to other people via cookie-cutter websites filled with misinformation instead of just enjoying them privately.


> I'm really happy that we live in a world in which people who don't know how to use the tools

It's not a happy world. It's dystopian. I really don't like how unskilled people get confidence for creating novelty using AI and then dare to put themselves on a pedestal next to bona fide creators. It is robbing them of trust and authenticity.

My neighbor, who barely survived through high school, happily begged me to buy her book: "I created something very special to me. I'm asking my friends to support me by ordering my book. There is a lot of useful information inside based on years of research and observations, and months of putting everything together." I knew it would be complete and utter bullshit, yet I was curious. I ordered "the book". It is chock-full of misspelled words and the substance is just pure garbage. It's a waste of human potential, it's a waste of resources, but hey, now we have yet another fucking "author". Terrific.


> I'm really sad that those people keep releasing those tools to other people via cookie-cutter websites filled with misinformation instead of just enjoying them privately

Why would that make you really sad? If something scratches your itch, it might scratch someone else's, too. It's kind of like blogging for yourself when you solve an issue.


I think you're learning that Toast exists due to "skill issues."


That's progressive disclosure, and it's usually considered to be a good thing for usability.

Let's be clear: if you save something in macOS, by default you get: 1. a text field with something like "Untitled" already selected, but not the extension, so if you just start typing, the extension isn't replaced. 2. a text field for tags to make organization easier 3. a Where drop-down with recent locations, favorites, drives, etc. 4. a button with an arrow pointing down next to the "where" list. 5. depending on the app, probably a format drop-down.

Friends and family who depend on "you're good with computers, right?" people like us, they get overwhelmed by too many choices. Here, macOS gives them five, only five, and the complaint is that most people ignore four of them!

Give them the larger menu by default, and it's more options to ignore. If someone is saving every single file to their Desktop (/me shudders), then they are ignoring every bit of even a small, simple UI, so giving them a more complicated UI accomplishes nothing good.

I said they're ignoring four of the five UI elements, but now I wonder how many of the files on the desktop are named "Untitled (38).pdf" or whatever. They could be ignoring all five!


Finder is fine: not the best, not the worst.

Your list seems very preference-shaped, not pointing to actually-missing features I can see. You could make a case about discoverability, but it's hard to see how letter combinations that only work within one application and no others are easily memorized. If your habits mean you spend a lot of time working with files in a UI, then memorizing double-tap C and C+F might be easy for you. Otherwise, using the same Cmd+C and Opt+Cmd+C would have the benefit of doing what it does in nearly every other program. Or, as the other responder said, dragging auto-escapes appropriately.

I spend most of my time using a CLI, and I'm not claiming Finder is the best keyboard-driven file manager out there, but I will say that it's consistent, and works the way macOS works. Key combos work the way they work in every app, and holding down Opt updates the Edit menu to make it clear what would be different. You can do the most common things pretty easily and clearly, even if sometimes you have to use a mouse and right-click. There are also third-party apps for focused file management for pros, including some that use tuis, like ranger.


> I spend most of my time using a CLI

Yeah, it shows.

> Opt+Cmd+C would have the benefit of doing what it does in nearly every other program

So what do you think it does in Preview? In TextEdit? Are you not aware that you imaginary benefit doesn't exist even in the system default open file Finder window where you can't copy file path?

> Finder is fine: not the best, not the worst.

Very astute observation relevant to none of the things being discussed.

> Your list seems very preference-shaped, not pointing to actually-missing features I can see

Look closer! Besides that hard to say what you missed because you haven't said anything specific

For example, what is "preference-shaped" about this missing feature

> turn column view into a flat list of all files at or below the current dir for easier search

> it's hard to see how letter combinations that only work within one application and no others are easily memorized

It's very easy to see if you don't ignore use cases and add extra conditions. Like why does it universally have to be easy?? I mean, it doesn't even have to be easy for me, the extra convenience might be worth the effort of having to remember it

> might be easy for you. Otherwise

What do you mean "otherwise"? Why would you care about others to the detriment of your own ease?

> and holding down Opt updates the Edit menu

What does this have to do with anything? You can retain the visual updates of these menus even if you use sequence of keys! Press C and the copy command menu expands into a submenu of what you could copy next (path, extension, name). You'll retain your consistency at a higher ergonomic baseline for Finder, nothing stops the improvements here

> Or, as the other responder said, dragging auto-escapes appropriately.

And as I've replied there, it doesn't do that "appropriately"

> third-party apps for focused file management for pros

But that's exactly what I said!

> differentiate a real pro file manager from the toy of Finder


I'm sorry Finder hurt you. Please refrain from taking it out on me.


I think this comment could be written in a way that was less combative and more clear.


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: