same setup -- I run openai/gpt-oss:120b with decent performance for prototyping
For production and an alternate dev environent I've configured and equipped a Dell PowerEdge XE7745 server that holds 8 NVIDIA RTX Pro 6000 GPUs. Again, running openai/gpt-oss:120b (for now)
For production and an alternate dev environent I've configured and equipped a Dell PowerEdge XE7745 server that holds 8 NVIDIA RTX Pro 6000 GPUs. Again, running openai/gpt-oss:120b (for now)
reply