LFM2.5-2.6B-GGUF
src="https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png" alt="Liquid AI" style="width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;" /> LFM2.5 is a new family of hybrid models designed for **on-device deployment**. It builds on the LFM2 architecture with extended pre-training and reinforcement learning. Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2.5-2.6B Example usage with [llama.cpp](https://github.com/ggml-org/llama.cpp): llama-cli -hf LiquidAI/LFM2.5-2.6B-GGUF --conversation \ --temp 0.1 --top-k 50 --repeat-penalty 1.1 The Quantization-Aware Distillation (QAD) checkpoint is available as [`LFM2.5-2.6B-QAD-Q4_0.gguf`](https://huggingface.co/LiquidAI/LFM2.5-2.6B-GGUF/blob/main/LFM2.5-2.6B-QAD-Q4_0.gguf). This is distinct from the post-training-quantized `LFM2.5-2.6B-Q4_0.gguf`; both use the GGUF Q4_0 format.
Open LFM2.5-2.6B-GGUF in AIniverse
Compare versions, read real ratings, save to your stack.
Open in App