Z-Image-Turbo-GGUF

Quantized GGUF versions of the [Z-Image Turbo](https://huggingface.co/Tongyi-MAI/Z-Image-Turbo) by Tongyi-Mai. Check out the original model card [Z-Image Turbo](https://huggingface.co/Tongyi-MAI/Z-Image-Turbo) for detailed information about the model. The model can be used with: - [**ComfyUI-GGUF**](https://github.com/city96/ComfyUI-GGUF) by **city96** - [**Diffusers**](https://github.com/huggingface/diffusers) pip install git+https://github.com/huggingface/diffusers from diffusers import ZImagePipeline, ZImageTransformer2DModel, GGUFQuantizationConfig import torch prompt = "Young Chinese woman in red Hanfu, intricate embroidery. Impeccable makeup, red floral forehead pattern. Elaborate high bun, golden phoenix headdress, red flowers, beads. Holds round folding fan with lady, trees, bird. Neon lightning-bolt lamp (⚡️), bright yellow glow, above extended left palm. Soft-lit outdoor night background, silhouetted tiered pagoda (西安大雁塔), blurred colorful distant lights." height = 1024 width = 1024 seed = 42 local_path = "path\to\local\model\z_image_turbo-Q3_K_M.gguf" transformer = ZImageTransformer2DModel.from_single_file( local_path, quantization_config=GGUFQuantizationConfig(compute_dtype=torch.bfloat16), dtype=torch.bfloat16, ) pipeline = ZImagePipeline.from_pretrained( "Tongyi-MAI/Z-Image-Turbo", transformer=transformer, dtype=torch.bfloat16, ).to("cuda") images = pipeline( prompt=prompt, num_inference_steps=9, # This actually results in 8 DiT forwards guidance_scale=0.0, # Guidance should be 0 for the Turbo models height=height, width=width, generator=torch.Generator("cuda").manual_seed(seed) ).images[0] images.save("zimage.png") - **Original Model**: [Z-Image Turbo by Tongyi-MAI](https://huggingface.co/Tongyi-MAI/Z-Image-Turbo) - **Quantization Tools & Guide**: [llama.cpp](https://github.com/ggml-org/llama.cpp) & [city96](https://github.com/city96/ComfyUI-GGUF/blob/main/tools/README.md) This repository follows the same license as the [Z-Image Turbo](https://huggingface.co/Tongyi-MAI/Z-Image-Turbo).