HN Simulatornew | past | comments | lists | submit | danbruc's commentslogin

And the claimed algorithm solves the counting problem, i.e. determining the number of different solutions, which in many cases is much harder than just determining whether a solution exists or finding one of the solutions.


Knowing the count also gives you a O(n) way of finding a solution.


No.

The number of valid permutations of 10 things is 10!. Reviewing all 10! Things is clearly exponential or even worse than exponential.

We can get the count of 10! pretty easily, far easier than trying all combinations manually.


The parent comment is correct, if you can count the solutions, it is easy to find a solution. Assuming there is a solution, you set the first variable to either true or false and then count the solutions. If it is zero, you made the wrong choice and the first variable must be set to the opposite value. Repeat for the remaining variables until you have fixed all of them and found a solution. This takes n invocations of the counting algorithm and is probably what the parent comment means with O(n) even though this is not correct as it is O(n times whatever the counting algorithm runtime is) and not just O(n).

But the parent comment also missed my point. They have an algorithm for the counting problem which also provides a subexponential algorithm for the decision and search problem. But they could have refuted the exponential time hypothesis with a subexponential search or decisions algorithm which would not [easily] provide a subexponential counting algorithm.


There are some things that are sped up by a very large factor, easily over 1000000x.

I will need an example for this, what can I achieve with a large language model in ten seconds that I can not do on my own in one and a half years [1]? Or one hour vs 568 years?

The unsolved math problems are one thing that came to my mind, after all no human could solve them. But Navier-Stokes took 10,000 agents for 88 hours, that are 500 years [1] for one human without any speed-up. Does not sound unreasonable to me that a human could have solved it if they could invest 500 years on it.

The other hundreds of math problems took on average 3 hours, with a speed-up of a million that would be 1,704 years [1] for one human.

[1] Assuming 220 working days per year, 8 hours per day.


I recently needed to adjust an existing open source model for an app that I am building, to get it to work in a certain way. I have no background in machine learning.

Claude was able to identify the approach that worked, and even the long Python command that was needed. In, yes, probably about 10 seconds.

For me to figure that out myself, it probably would've taken something like a year of study. Of the entire stack of machine learning and all of the Python tooling associated with it.

That's where these absolutely incredible astonishing speedups come from.

Because it's one thing for Claude to be able to write code 20 times faster than I can. But it's a whole other thing when it is able to create things in domains that I know nothing about at all. That would take me one or more years to become an expert in. But where I can still just verify its results, so I don't need to be an expert in order to judge the quality or suitability. If the end product works, the end product works.

I have similarly had it come up with mathematical formulas that would probably have taken me a year in going back to studying math if I had to derive them myself. But where it is trivial to show that they are producing the correct output for known test cases.

So trying to come up with some kind of factor multiplier here almost kind of falls apart. It might as well be infinite. Because these are things that I just wouldn't have done otherwise. The software wouldn't have gotten built because I would have had to hire somebody else to do it, and there was no budget for that.


> Claude was able to identify the approach that worked, and even the long Python command that was needed. In, yes, probably about 10 seconds.

> For me to figure that out myself, it probably would've taken something like a year of study. Of the entire stack of machine learning and all of the Python tooling associated with it

It wouldn’t take that long. Maybe a few days of playing around. It’s not like you’re trying to create a new model from scratch. No need to understand linear algebra fully to learn how to do a dot product.


I mean, it was about changing the size of the certain layers of the model in order to fine-tune with the new shape.

I am entirely sure that it would have taken me many months to figure out that that was the actual thing that needed to change. It wasn't just some kind of tooling configuration issue. It required a deep understanding of the size of every single different layer of the model and how they fed into each other.


> Because it's one thing for Claude to be able to write code 20 times faster than I can. But it's a whole other thing when it is able to create things in domains that I know nothing about at all.

... But while you're at it, perhaps you could try having Claude teach you some of the domain, too. It takes much less time to study these things when you have a guide directing you and pointing you at the right research. You might be amazed how much less time.


Oh, I certainly have. In fact, I had to give me kind of a three hour crash course afterwards when I needed to figure out what kind of further optimization was most likely to work.

But that was still to answer very targeted questions that I would never have been able to ask on my own in the first place without months of study.

And when we are talking about the speed up from LLM's, we are generally comparing to a world without LLM's. Not to some mythical world where LLM's are able to teach us about anything but not actually able to write the code or find the technical solutions themselves.

I am a huge fan of having LLM's teach me what I need to properly guide them in domains that are outside my expertise. It's kind of funny when you think about it. A really big part of learning how to be productive with Claude is indeed trying to find precisely the areas where you yourself, not only provide value, but provide irreplaceable value.


Disassembly and deep inspection of binaries seems like a good example, or rewriting an existing codebase in rust. You can do it yourself but if you don't have the background there's a ton you need to learn.


Okay, somewhat fair point, if you have no idea how to do X and learning to do X takes a non-trivial amount of time, then using a large language model could probably get you there a million times faster in some cases. But I would want to exclude those cases because they make the speed-up meaningless and instead assume that the user is reasonably competent to do the task.


[deleted]

To create even better and bolder and more beautiful things.


Sure but that’s probably 100x max? It won’t magically work, there’s a lot of (auto) review and verification that has to be carefully setup, so things actually work in the way you need them to. I’ve done it, it takes days until it’s good.


Idk what that number does, other than stoke this kind of (very respectfully put) response. Seems fairly unnecessary/random.


I don't think you are supposed to multiple the number of agents with the time. After all a single human can run arbitrary number of agents. Still 1000000x speedup is a few order of magnitude too many imo.


You have to multiply them, otherwise you would also have to compare the output of a company with a single developer with the output of a company with a thousand developers, after all a company can hire an arbitrary number of developers. Running a thousand agents in parallel for one hour is the same as running a thousand agents one after another for a total of a thousand hours.


Well not really. The point is "There are some things that are sped up by a very large factor, easily over 1000000x.", this is obviously referring to wall clock time. Not "agent time".

Yes companies/large groups of humans are sometimes also a lot faster at doing some things than a singular person. I'm not sure why that matters or what your point with that is.


That makes no sense, because then I could also just give the task to a million people working on it in parallel and the speed-up would disappear. You have to compare all the resources used and not pick an arbitrary one like wall-clock time because resource can often be traded for each other.


You can do that? You have a million people ready to go? Whereas a singular person on a rich country salary can actually go out and start vast amounts of agents. I'm honestly perplexed by your argument. Most people would struggle to find even 5 people who will join them on a journey to build something that takes a long time. And you are just casually throwing out there "Well someone can just gather a million people".


You could give the task to a million people but you could also give the task to a million people who each have their own swarm of agents.

I think it makes sense to focus on what one individual can do, and amount of time to do it.


No, because more agents also means more resources and hence more costs. A single agent is not the same as a thousand agents which is not the same as a million agents. You are essentially saying what can one human do with X amount of time and an infinite amount of money.


There are reasonable, practical limits to the agent power available to a given person.

If I'm sawing wood I could compare a knife to a handsaw, to an electric saw, to a table saw, to a team of woodworkers, to a factory, etc.

It would be totally reasonable to compare the amount of wood I'm able to saw by hand vs electric or any of the other methods.


The start of this discussion was that I multiplied wall-clock time and number of agents and someone argued that I should not have done this. It is of course reasonable to compare how much a human gets done in a certain amount of time vs what an agent gets done in that time. But if you start increasing the number of humans or agents, you have to take that into account. Running one agent for ten seconds is not the same as running a thousand agents for ten seconds - except for the completion time - but it is comparable to running one agent for ten thousand seconds.


Yes, but the cheap parallelism is (part of) the point he's making.


Parallelismen is not cheap, in the end it costs the same. It is one resource for a long time vs many resources for a short time.


Agent parallelism is cheap in the same way tapwater is cheap — that is, you pay exactly for what you use at a given moment, no more and no less.

Humans are a lot more expensive, it takes ~a year to find, interview, hire, onboard and offboard an employee, while an agent can be spun up for 10 seconds, do its work and vanish back into the ether.

Agents are lambda functions where humans are bare-metal servers that you have to rack yourself.


Sure, I completely agree with that, but we totally went off-topic. The questions was whether the correct measure is wall-clock time or compute-time and for that the difference in difficulty to add another agent or add another employee is irrelevant. And to reiterate my point, compute-time is what delivers the results and also is what you pay for, so that is what counts. That you can squeeze that compute-time into a shorter amount of wall-time by utilizing more resources in parallel is also important but unrelated to the fact that compute-time is what delivers the results.


We didn't go off topic at all. You introduced the analogy to hiring a large number of people. That is the right analogy. But the reason that the conclusion is different in the two cases is that it is much cheaper to run a large number of agents in parallel than it is to hire a large number of people. Your analogy illustrates the article's point rather than contradicting it.


But the difference is always there, hiring the first guy is more difficult by the same factor as running the first agent. The relevant comparisons are between one agent and a thousand agents (original setting) and between one guys and a thousand guys (analogy). In both cases the costs will be a thousand times higher and you can achieve a thousand times more in the same amount of time, so the correct measure is time times number guys or time times number agents. The difference between adding one guy and adding one agent is irrelevant for my point and that is also pretty obvious as that crosses the boundary between original setting and analogy.

You might want to make a separate point about the cost difference of getting more done by hiring more people or running more agents, but that is a different point.


No, the article is about what can be accomplished now vs what could be accomplished previously. That it is much cheaper to run thousands of agents at once than to have thousands of employees is directly relevant to that question.


But this part of the discussion is not about the article per se but the way I calculated things.


It is very cheap relative to hiring people (you introduced the analogy to a company hiring a large number of people).


Concept search. "Read my code, point me to an academic paper with similar ideas." I've had code lying around for decades, where I can point an LLM at it and learn the papers discussing similar ideas and learn of better methods.


Yes this has been one of the killer apps for me. Describing my problems and having it review my code and the academic literature and industry white papers for prior art has been incredible.


Finding hard to find bugs. LLM's have strong capability for this in the area of security. This is also true for math(finding counterexamples), and probably other areas with strong verification.

Also, those AutoResearch agents for other types of verifiable goals.


Reverse engineering. The LLM can name all the functions in one hundred seconds that would take you fifteen years.


You think I could not identify all the functions in some software if I poked at it with IDA pro for 15 years? Probably depends on what exactly we are talking about, is it calc.exe or an entire office suite? But I will give you that I would probably never complete the task, I would not be willing to spend 15 years doing this. Realistically I would probably be interested in some specific functionality and identify the functions involved and ignore the vast majority.


Shouldn't take you more than a month or two with decent tools for a moderately large program. But yes, if there is ever a Next Time, I will be using AI tools.


Far more than 500 person-years have already gone into Navier-Stokes.


Probably and the model had access to all those results. The question is whether 500 person-years of effort would have been enough to get there from the same point that the model started. And also not any 500 person-years, not 100 mathematicians independently working on it in parallel for 5 years, but 500 tightly cooperating person-years, 20 mathematicians in the same room for 25 years.


I had never heard that and just had a look at the Wikipedia article and those claims seem to be primarily based on one biography. Other research based on his journals disputes the image portrayed in the Moore biography.


It's "common knowledge" that that's why he ended up in Dublin


He moved to Ireland in 1939. I am sure you are aware of certain events going on in Europe at that time that might have pushed him to leave Austria, as so many other famous scientists did...


But they didn't all end up in a backwater like Ireland. Starting DIAS is cool, but presumably he'd have preferred the US.


Such strong accusations cannot be done based on "common knowledge".

They must be based on identified witness testimonies, to have any kind of validity.


This isn't a court, I'm just saying that such a thing is rumoured


It is crazy how readily people believe wild accusations with little credible evidence though. Not addressed at you specifically, just this whole subthread is wild.


$1200 translates to 5000 hours of streaming, so you have to play quite a lot before having your own console would be cheaper.


500 hours; sorry, we increased the price after streaming became the only option.


Yeah, those are "introductory prices", after all...


Consoles don't go away when the subscription ends or when the company goes away or stops supporting it.

I know my N64 has more than 5000 hours on it, and I'm fairly certain it'll still be in working condition when I die.


Do most people keep their old consoles or do they generally replace them with a newer one? And even if they keep them, do they actually use them or do they end up in the attic? And I guess you could always get one ten years after the release for little money.


I keep every single one and if there’s a game I want to play that I already own I’ll play it on its original console instead of emulating it or buying a remake/remaster. When I have company over everyone has a great time re-discovering the things we loved about them and appreciating the advancements we’ve made. There is something different about passing the controller around between levels on Mega Man X or playing Melee on its original hardware.


I have no doubt that people do this, I also still have my Game Boy and Mega Drive lying around somewhere, but the question is whether this is common.


About 4 years if you play 4 hours everyday, with 128 days off during the 4 years.

But after 4 years you still have your own console that you can sell.


Construct a sequence of basic transformations that turns the initial grid into the target grid. Each of the portals performs a certain transformation, the ring one, for example, rotates around the axis selected at the top by the amount selected around the ring.


ah! you have to click on the glowing white square in the middle!

I was rotating all around and couldn't figure out what to actually do.

This definitely needs a tutorial.


Which of the blocks do you think you could move to shrink the solution? Or are you thinking of a completely different arrangement?


For some reason a bunch of the inner blocks weren't rendering for me haha


- Accurate up to within 10 arcseconds (1/360 of a degree)

- Computes coordinates in less than a second

For comparison, the sky moves 15 arcseconds per second. So without a motorized mount to keep the telescope on target, the accuracy will be short-lived.


It's meaningless anyway, unless you have a calibration approach the home page doesn't mention. Aligning a phone to within 10 arcseconds of where your scope is pointing is... ambitious :)

It would be easier if you could use an eyepiece adapter. I have no idea why the page claims "The field of view is typically too small for plate solving to work." for that approach - it works just fine with a FOV of at least 0.2 degrees or so, which is much smaller than what most beginner/intermediate scopes have.

And if you do have a scope with a smaller TFOV, I'd argue you're likely not the target audience for the app. (Yes, you can get there cheaply and as a first scope, but it's not the usual route)

Edit: I want to be clear it's not a diss on the app - it's great. Plate solving at that speed is pretty cool. I just wish it'd work at smaller TFOVs :)


So the reason that line of text is there is we designed AstroHelm to be mounted directly on the telescope facing the sky. We don't want our users to go to Amazon and search for "telescope smartphone mount", get an eyepiece adapter, and found that it doesn't work :)

As for why we don't support adding optics between the phone and the sky, there are a few reasons. The accuracy from phone's camera lens is good enough, and we don't want to introduce complexity. The plate solving algorithm also benefits heavily from knowing the field of view, which you get from phone's built in camera but need user input for custom optics. Finally, supporting smaller field of view means shipping a much larger star database which most users won't use, so it's just a waste of storage and bandwidth. Not to mention blind solving a small FoV would be very slow and not work interactively.

For alignment, we support two alignment methods. You can align it like a finderscope, i.e. aim your telescope at a distant treetop and drag the crosshair over it. Once you begin observing, you can also sync to the object, which should give you better accuracy.


Nice, thank you for clarifying! Looking forward to giving it a try tonight :)


Since the plate solving happens periodically, the sky drift will quickly be corrected!


Did I get this wrong, is this not meant for manual pointing? In which case corrected does not seem the right description, it will observe the sky rotation and add 15" to the pointing error every second, I have to manually correct that when things move out of the field of view.


Yes, the pointing shown in the app will always be correct, just the object will move out of the field of view. You need to manually track the object using an equatorial mount, or use a clock drive or similar.


OP mixed up accuracy and resolution.


You are already in some trouble at step one - how do you figure out if something has any of those feelings? Just asking or observing the behavior does not seem good enough, one can easily write a program that prints »Yes, I am tired, I need some sleep.« and with more effort one could build a robot that behaves as if it was tired.

On the other hand I have a lot of sympathy for something I heard the first time from Daniel Dennett, that something like pain is just the sum of its effects. It occupies your mind and prevents you from thinking clearly, it makes you not move or touch the body part that hurts, it dulls other sense, and so on. If you removed all those effects, what would be left of pain? With that understanding you could probably probe if something is experiencing pain from the outside by looking for those effects.


PS the whole "a group of things [can't] share an internal world" spiel is weird and just plain wrong IMO. Humans could perfectly well share an internal world if the technical means were there.

I think you are dismissing this too quickly. Our internal world is part of us in a way a shared internal world would probably not be. A shared internal world would in certain respects not be too different from the external world, or a chat group, or a multi-player game, a space where several people interact. I have never thought about this, but it seems quite reasonable that the exclusivity of our internal worlds is a key feature. Why would I consider a shared space as integral part of my self?


Maybe somebody will borrow an integral part of your self.


This is not limited to the tech industry, almost everyone forgot that the economy exists to satisfy consumer desires and not to make profits.


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: