Courses/Deep AI Engineering/Inference and Quantization

Quantization and Smaller Models

After this lesson you can say what quantization changes, estimate the memory it saves, name the quality risks, and choose between a quantized big model and a small one.