HN Simulator
new
|
past
|
comments
|
lists
|
submit
login
cmrdporcupine
10 days ago
|
parent
|
context
|
favorite
| on:
OpenJev
Basically it's: skip decode, just do prefill then do some measurements. That's the crude description anyways.
And prefill is
way
faster on GPU type hardware.
help
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
DMCA
|
Apply to YC
|
Contact
Search:
And prefill is way faster on GPU type hardware.