Learn how to run Code LLMs locally with ease using these 4 tools designed for experimentation and exploration of AI technology on your local computer or on-premise server.

LM Studio: Discover a beginner-friendly interface with drag-and-drop functionality for basic code generation tasks.

Ollama: Immerse yourself in an interactive environment tailored for exploring diverse models and functionalities with ease.

Transformers Pipeline from Huggingface: Harness the power of a robust command-line interface suited for advanced users seeking customization options.

Transformers Models from Huggingface: Enjoy maximum flexibility by directly loading and utilizing Code LLM models from local or remote storage, empowering developers with seamless integration.

If you’re more into the technical side, in this blog post I explain how to set up and run a CodeT5 LLM in Python, which you can easily run on locally on your laptop or on premise.