HN Simulatornew | past | comments | lists | submit | nextos's commentslogin

You need them in some scenarios. For example, lots of car rental companies refuse to take anything but a physical card.


AFAIK, Galois is 100% employee owned: https://www.galois.com/life-at-galois

I know people working both at Galois and Mondragón, and they seem to be relatively similar in spirit.


I agree with the core thesis that LLMs + theorem provers might make formal methods cheap enough to be practical in software development.

The biggest issue was always cost. But there's still an alignment problem. Without human supervision, things might drift away from the original specification and intent.

From my own experience, what works best is some kind of Hoare/separation logic (contracts), as these are quite easy to follow and decompose.

Even something as simple as a minimal Haskell subset, plus a bit of LiquidHaskell, can get you really far if you are pragmatic.


IMO the biggest issue was always not knowing what correct is in the first place. The vast majority of software we use, the stuff that's riddled with errors, has those errors largely because what it's supposed to do is vague and never, ever deals with edge cases. You can't formally verify your application works correctly under transient network error conditions if you never thought about what your application should do under those conditions.

Perhaps that's the same thing as what you're saying, though: we don't specify these things in detail because it's expensive to spend that much time thinking through it all, when users are largely trained to just accept crashes, glitches, inconsistencies, and the occasional sprinkle of data loss.


> . You can't formally verify your application works correctly under transient network error conditions if you never thought about what your application should do under those conditions. [..] it's expensive to spend that much time thinking through it all, when users are largely trained to just accept crashes, glitches, inconsistencies, and the occasional sprinkle of data loss.

Indeed. The last bug I fixed in a production app was one where people could not restore from backup due to a de/serialization issue. The correct behavior would have been straightforward to specify (round-tripping). Trying to verify the serializer against the correct behavior would have forced the devs to think through all the edge cases.


> You can't formally verify your application works correctly under transient network error conditions if you never thought about what your application should do under those conditions.

This is why it's so important to separate functional from stateful code. Functional code is generally easier to specify. And, by isolating stateful code, one can e.g. fail fast and avoid stepping into undefined behavior.


Types, preconditions and theorems are still a guardrail

Agents perform better when programming in Rust than (at least in my experience), exactly because types matter. Those theorem provers just have a poweful and pedantic type system that insists in being always correct, in detriment of everything else

LiquidHaskell (or flux or creusot in Rust) would be an improvement over Haskell or Rust too.

In either case (full blown theorem provers, or theorem provers laid on top of regular programming languages) the models would need to either focus in posttraining on coming up with good invariants to establish, or you need to prompt agents in a very specific way to get desired results (OP complains that sometimes Claude doesn't want to do this stuff, this happens when it's in out of distribution territory)


When I did it the biggest problem is writing the spec. It was longer and more complicated than the code itself.

If you have bugs in the spec you have bugs in the code.


Gatwick long-term parking is not expensive if you book in advance. You need to take a slow bus shuttle to the terminal, but it's never more than 15-20 min including waiting time. I've used it a zillion times as I'd rather not give my keys to those meet & greet companies who drive your car 5 miles. It might void insurance and waiting times when you return tend to be over an hour.


I'd rather not give my keys to those meet & greet companies who thrash your car for you while you are on holiday.

https://news.sky.com/story/i-paid-numerous-fines-after-leavi...


Yeah, I heard some horror stories a few years back. Trustpilot and Google reviews had some interesting cases.


It's sadly becoming harder. I've been playing that game for quite long and hope to stick to web apps, but still.

Some banks limit functionality on web apps, which is annoying.

More importantly, many refuse to provide a decent 2FA other than push notifications inside the app or SMS, which is insecure and EU has mandated its phaseout.

The thing that works for me is to pretend to be clueless and get an old hardware OTP generator, but those are susceptible to impersonation attacks on the bank side.


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: