LLM Archives - Jianqing's Blog

Build the LLM Agent with Google ADK and self deployed LLM Model

Here it shows how we build the LLM Agent with Google ADK(Agent Development Kit), and we integrate it with our own models.

Follow the quick start to setup the project

And the project structure will be like

 tree
.

…

There are so many large language models that you can run it locally, e.g. llama, mixtral.

The most popular open source LLM framework that support run many LLM locally.

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
make
./examples/chat-13B.sh

Before you …