Welcome to your LocalAI

The powerful FOSS alternative to OpenAI, Claude, and more

Installed Models

59 models ready to use

Llama-3.1-8B-Lexi-Uncensored_V2

Auto

Chat

Edit

animagine

diffusers

Edit

bert-embeddings icon

bert-embeddings

bert-embeddings

Edit

bunny-llama-3-8b-v

Auto

Chat

Edit

chatbot

Auto

Chat

Edit

chatbot2

Auto

Chat

Edit

claude

Auto

Chat

Edit

deepseek-r1-distill-llama-8b icon

deepseek-r1-distill-llama-8b

Auto

Chat

Edit

deepseek-r1-distill-llama-8b-bart

Auto

Chat

Edit

deepseek-r1-distill-qwen-14b icon

deepseek-r1-distill-qwen-14b

Auto

Chat

Edit

dolphin-2.9-llama3-8b icon

dolphin-2.9-llama3-8b

Auto

Chat

Edit

dolphin-2.9-llama3-8b:Q6_K

Auto

Chat

Edit

dolphin3.0-llama3.1-8b icon

dolphin3.0-llama3.1-8b

Auto

Chat

Edit

dolphin3.0-qwen2.5-3b icon

dolphin3.0-qwen2.5-3b

Auto

Chat

Edit

dreamshaper icon

dreamshaper

diffusers

Image

Edit

einstein-v6.1-llama3-8b icon

einstein-v6.1-llama3-8b

llama-cpp

Chat

Edit

flux.1dev-abliteratedv2 icon

flux.1dev-abliteratedv2

diffusers

Image

Edit

gemma-3-12b-it icon

gemma-3-12b-it

Auto

Chat

Edit

gemma-3-12b-it-qat icon

gemma-3-12b-it-qat

llama-cpp

Chat

Edit

gemma-3-4b-it icon

gemma-3-4b-it

Auto

Chat

Edit

gpt-3.5-turbo

llama

Chat

Edit

gpt-4

Auto

Chat

Edit

gpt-4-vision-preview

llama-cpp

Chat

Edit

gpt-4o

Auto

Chat

Edit

gpt-4o-mini

llama-cpp

Chat

Edit

gpt-oss-20b

llama-cpp

Chat

Edit

lexi-llama-3-8b-uncensored icon

lexi-llama-3-8b-uncensored

llama-cpp

Chat

Edit

llama-3-smaug-8b icon

llama-3-smaug-8b

Auto

Chat

Edit

llama3

Auto

Chat

Edit

llama3-8b-instruct

Auto

Chat

Edit

llava-1.6-mistral

llama-cpp

Chat

Edit

moondream2

llama-cpp

Chat

Edit

qwen3-14b

llama-cpp

Chat

Edit

qwen3-embedding-0.6b icon

qwen3-embedding-0.6b

Auto

Chat

Edit

qwen3-vl-30b-a3b-instruct

llama-cpp

Chat

Edit

sd-3.5-medium-ggml icon

sd-3.5-medium-ggml

stablediffusion-ggml

Image

Edit

stable-diffusion-3-medium icon

stable-diffusion-3-medium

diffusers

Image

Edit

voice-en-gb-vctk-medium

piper

TTS

Edit

voice-en-us-libritts-high

piper

TTS

Edit

whisper-1

whisper

Edit

Bunny-Llama-3-8B-Q4_K_M-mmproj.gguf

Auto Backend No Config

Configuration required for full functionality

DeepSeek-R1-Distill-Llama-8B-Q4_K_M.gguf

Auto Backend No Config

Configuration required for full functionality

DeepSeek-R1-Distill-Llama-8B-Q6_K_L.gguf

Auto Backend No Config

Configuration required for full functionality

Meta-Llama-3-8B-Instruct.Q4_0.gguf

Auto Backend No Config

Configuration required for full functionality

chatbot.gguf.OLD

Auto Backend No Config

Configuration required for full functionality

chatbot7b.gguf

Auto Backend No Config

Configuration required for full functionality

clip_g-Q4_0.gguf

Auto Backend No Config

Configuration required for full functionality

clip_l-Q4_0.gguf

Auto Backend No Config

Configuration required for full functionality

galatolo-Q4_K.gguf

Auto Backend No Config

Configuration required for full functionality

gemma-3-12b-it-mmproj-f16.gguf

Auto Backend No Config

Configuration required for full functionality

gemma-3-4b-it-mmproj-f16.gguf

Auto Backend No Config

Configuration required for full functionality

gemma-3-q4_0-mmproj-model-f16-12B.gguf

Auto Backend No Config

Configuration required for full functionality

gpt-4-vision-preview.yaml.bak

Auto Backend No Config

Configuration required for full functionality

gpt-4-vision-preview.yaml.llava1.6

Auto Backend No Config

Configuration required for full functionality

llama-2-7b-chat.Q4_K_M.gguf

Auto Backend No Config

Configuration required for full functionality

llama-3.2-1b-instruct-q4_k_m.gguf

Auto Backend No Config

Configuration required for full functionality

llava-v1.6-7b-mmproj-f16.gguf

Auto Backend No Config

Configuration required for full functionality

mmproj-model-f16-12B.gguf

Auto Backend No Config

Configuration required for full functionality

t5xxl-Q4_0.gguf

Auto Backend No Config

Configuration required for full functionality

Installed Backends

20 backends ready to use

cuda12-llama-cpp

cuda12-rerankers

cuda12-stablediffusion-ggml

cuda12-transformers

cuda12-vllm

cuda12-whisper

llama-cpp

local-store

localai@llama-cpp

localai@rerankers

localai@stablediffusion-ggml

localai@transformers

localai@vllm

localai@whisper

piper

rerankers

stablediffusion-ggml

transformers

vllm

whisper