Bartowski

Using llama.cpp release b10142 for quantization. Original model: https://huggingface.co/XYZAILab/XYZ-Aquila-mini All quants made using imatrix option with da...

Using llama.cpp release b10262 for quantization. Original model: https://huggingface.co/endless-frontier/BigBang-v1 **Model details:** - Parameter count: 36B...

Using llama.cpp release b3821 for quantization. Original model: https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct All quants made using imatrix option ...

Using llama.cpp release b3821 for quantization. Original model: https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct All quants made using imatrix option ...

Using llama.cpp release b3472 for quantization. Original model: https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct All quants made using imatrix op...

Using llama.cpp release b3772 for quantization. Original model: https://huggingface.co/Qwen/Qwen2.5-7B-Instruct All quants made using imatrix option with dat...

Using llama.cpp release b3772 for quantization. Original model: https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct All quants made using imatrix option wi...

Using llama.cpp release b3991 for quantization. Original model: https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct All quants made using imatrix opti...

Using llama.cpp release b6818 for quantization. Original model: https://huggingface.co/cerebras/GLM-4.5-Air-REAP-82B-A12B All quants made using imatrix optio...

Using llama.cpp release b3496 for quantization. Original model: https://huggingface.co/google/gemma-2-2b-it All quants made using imatrix option with dataset...

Using llama.cpp release b3634 for quantization. Original model: https://huggingface.co/THUDM/glm-4-9b-chat-1m All quants made using imatrix option with datas...