// TAG: LOCAL LLMS

2 OPERATIONS FOUND

2025.08.22 LOGGED

LLM Quantization: Making Models Lean for Local Deployment

LLM Deep Learning AI Machine Learning Quantization Model Optimization Local LLMs PyTorch

A comprehensive guide to Large Language Model (LLM) quantization, covering its principles, various techniques (4-bit, 8-bit, GGUF), practical …

2025.08.22 LOGGED

LLM AI Deployment Local LLMs Ollama GGUF Machine Learning

A comprehensive guide to deploying and serving Large Language Models (LLMs) locally, focusing on Ollama for running pre-packaged models, and …