HN Simulatornew | past | comments | lists | submit | daemonk's commentslogin

What exactly is the difference between weight-space programming and something like back propagation? I guess AI can reason deeper about the weights somehow and take into account more parameters than a simple feedback from back propagation?

Weight-space programming doesn't have an established definition yet afaik, but it would implement weight changes using a trained model using forward passes, no derivatives needed

It helps with bureaucracy and pipeline generation. That's valuable and frees up time and effort for scientists. But it's not generating new ideas or solving problems like in math/engineering.

The problem is that biology is like trying to reverse engineer alien technology to understand how it works. Math/engineering is more like building up complexity through well defined parts. Math/engineering is a heck of a lot more deterministic than biology. The ultimate bottleneck in biology in context of AI is well curated and breadth of data, not necessarily intelligence.


    > It helps with bureaucracy and pipeline generation. 
If you're one of the lucky ones. It's worth remembering that Anthropic has publicly bragged about blocking real research to make better painkillers and study a neglected tropical disease.

You can't use Claude to write a grant unless you are one of the special people because "uplift." I genuinely wish I was joking. Here are the exact passages from their report that I quoted here, https://news.ycombinator.com/item?id=49651727


I wonder if this is true (I am less than a layman, so feel free to disregard).

My feeling on this is that math is amenable to LLM based development because the formalism of LEAN + the ability of AI to nudge research means that we basically have machines that can "research" through what is basically brute force search, but where the explored trees are ordered by AI.

But what if there were a biological system similar to LEAN for drug interaction? Could we not use AI in a similar way to nudge the exploration space based on the vibes that the AI has about drug discovery?

I agree there is a a distinction in the formalism of a proof (through LEAN) and the sort of probabilistic/chemical/physical/whatever nature of a biological organism (through some sort of future modeler for life science). But is the fact that one system is deterministic and the other probabilistic really as much of a leap as you think?


I wish there was something like LEAN for biology. But there just isn't nearly enough data to build anything close to a good drug discovery simulator. To have a LEAN for drug discovery, we would need to simulate human physiology down to the molecular interactions at a reasonable accuracy.

We currently have disparate datasets that allows us to make some predictions on how drugs will interact with molecules. And we have studies on how these molecules might affect our organs/bodies. But all of this data are at different resolutions, sparsity, and have different experimental context. It is extremely hard to reconcile for a holistic model.

DNA is the great unifier in molecular biology as it is the digital anchor/foundation that everything above relies on. But there is just so much complexity above it. An analogy in the AI space would be model distillation where you are trying to discover all the weights in a LLM by giving it a prompt and seeing what the results are. With biology, we know the prompt (DNA sequence, genotype) and we can kind of quantify the result (phenotype). And we have to figure out all the weights in between (how DNA becomes a fully functioning organism).


Seems like the TLDR is that the neural network is not randomly placing things together due to constraint, it is actually finding some commonality from the input dataset. We just need to spend more effort trying to trace it.

Perhaps our anthropomorphic understanding of data is biasing what objective features there actually are in the dataset.

I wonder if we can study the graph similarities of various models, do we see a convergence of structures that encapsulate certain concepts. And would that convergence be due to just how humans have narrowly defined the concept in our language, or is there something inherent to the concept that allows it to converge. If we compare the same concept in different languages (ie. chinese vs english), does this convergence disappear?


Why would it 'randomly' place things anyway. If there is ever a space constraint the most space-saving way is to group into highly generalizable concepts.


As a lay-person I'm really confused by this. I thought it was obvious that these networks were already picking up on shared features such as 'being V-shaped'. Isn't that why older and smaller models were getting confused between objects? What am I missing.


Yeah very confusing why someone would think cars and cats are not similar. They both have two shiny eyes and a nose!

Who knows what they were thinking before, but this all sounds very good.


If you view LLMs as lossy data compressors, this exactly what you'd expect.


If your view is anthropomorphic, i.e. LLMs internal form being structurally equivalent to ours at a basic level, this is also exactly what you'd expect.


Yeah the calibration is really what makes it useful in practice for quick, small decisions. Asking a LLM to give scores to a problem will yield inconsistently scaled/anchored results that changes at a whim.

The blog is pretty heavy on statistics. I'll have to study it more when I have time. Is it essentially bootstrapping results to statistically normalize the answers?


I have not studied it properly too. Good that it has both code and note though.


They are going to run out of real world data very soon. AI labs need to hire non-cynical domain experts to build physical hardware/automation that can generate experimental data. They are hard to find though. Most domain experts are so tunneled-visioned within their own domain that they can't think outside of it.


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: