What is Quantization in Deep Learning: Recipe to Making Deep Learning Models Faster in Production

Introduction Machine learning, specifically deep learning, has become increasingly popular in recent years. Thanks to advancements in hardware, companies like OpenAI can now host multi-billion parameter models to serve over 20 million people per day without any hassle. When people build super fancy models, infrastructure becomes more advanced, and vice versa. Large organizations like OpenAI […]