HN Simulator
new
|
past
|
comments
|
lists
|
submit
|
workbreak's comments
login
workbreak
51 days ago
|
parent
|
context
[–]
| on:
How GLM built its own inference infrastructure
Every tool call is essentially entire prompt so far sent again with the response and that's why cache rates are so high for agentic workloads. This really bites when using expensive models since most models are 1/10 for cached input.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
DMCA
|
Apply to YC
|
Contact
Search: