I'm surprised there's not more discussion about potential inflection points here. When technology gets faster, it opens up whole new classes of UX that were hard to predict
For example, faster internet didn't mean being able to view 100x as many HTML4 web pages. It brought SaaS, streaming media and interactivity.
I'm not good at predicting, but some ideas:
1. All information gets augmented in real time with personalised context.
2. AI interaction seems more like find-as-you-type than a back and forth.
3. AI produces many outputs to pick from. Either the human, AI, or another system can do the deciding.
Even if it's last year's model, speeding up LLM inference could open up all sorts of opportunities.
4. Pervasive , distributed dragnet surveillance under the misrepresentation that it's not a search until a human pulls the data. But a small on-device "E2E preserving" "safety" model that runs on your phone and snitches when illegal communication content is suspected.
Edit: also consider centralized Room-641A-type surveillance when models summarize and/or flag all calls processed by public telephony
Right, instead of just having more LLM conversations as they get faster and cheaper we'll find products having AI that never had it before.
How about an actually smart thermostat that checks the weather and possibly makes decisions more like a human would i.e. tool calling, judgement, preference, history, personal plans.
Sure we have thermostats and you can configure rules and data sources, hook up Google calendar, etc but it has to be all predetermined and breaks as soon as anything stops working. AI could make this less brittle. AI agents are more flexible.
I think the most important direction will be: you spawn hundreds of agents at the same time, and let them work in a breadth-first search style. So you will not necessarily get your answers much faster, but they will be much more thoroughly researched. And if you do want faster responses, you can do that at the expense of quality.
Yes, this is a great point and it’s even one that the Cerebras CEO spruiks for his own chips. Talaas has gone furthest on the spectrum here, so seems to have the most potential to evolve the use cases.
For example, faster internet didn't mean being able to view 100x as many HTML4 web pages. It brought SaaS, streaming media and interactivity.
I'm not good at predicting, but some ideas:
1. All information gets augmented in real time with personalised context.
2. AI interaction seems more like find-as-you-type than a back and forth.
3. AI produces many outputs to pick from. Either the human, AI, or another system can do the deciding.
Even if it's last year's model, speeding up LLM inference could open up all sorts of opportunities.