FitMyLLM — Independent benchmarks for self-hosted AI
FitMyLLM — Independent benchmarks for self-hosted AI
www.fitmyllm.com
FitMyLLM — The data layer for self-hosted AI
Independent benchmarks for every model, GPU, and cloud provider. Measured, not estimated. 428 models, 1720 GPUs, multi-provider cloud comparisons.
cross-posted from: https://programming.dev/post/51407459
Check what can you use and at what rate of token per seconds would it be... It has examples of many models and quantization levels. Huge resource!