LLM

There are so many large language models that you can run it locally, e.g. llama, mixtral.

llama.cpp

The most popular open source LLM framework that support run many LLM locally.

• https://github.com/ggerganov/llama.cpp/

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
make
./examples/chat-13B.sh

Before you …