Skip to content
Jianqing's Blog

Jianqing's Blog

Thoughts and Future

Menu

LLM

You are here: Home » LLM

Build the LLM Agent with Google ADK and self deployed LLM Model

Here it shows how we build the LLM Agent with Google ADK(Agent Development Kit), and we integrate it with our own models.

Follow the quick start to setup the project

  • https://google.github.io/adk-docs/get-started/quickstart/

And the project structure will be like

 tree
.
…
pengjianqing April 10, 2025April 10, 2025 Tech No Comments Read more

How to run LLM locally

There are so many large language models that you can run it locally, e.g. llama, mixtral.

llama.cpp

The most popular open source LLM framework that support run many LLM locally.

  • https://github.com/ggerganov/llama.cpp/
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
make
./examples/chat-13B.sh

Before you …

pengjianqing December 16, 2023December 31, 2023 Tech No Comments Read more

Recent Posts

  • 一个好好用的文字风格提示词生成器 April 12, 2025
  • Build the LLM Agent with Google ADK and self deployed LLM Model April 10, 2025
  • Leverage the browser-use agent to automate Web tasks. March 10, 2025
  • LLM AI tools February 14, 2025
  • How to create Cloudflare Tunnel for ollama January 22, 2025
  • Run DeepSeek R1 70b with ollama January 21, 2025
  • 2024年终总结 December 31, 2024
  • How to check the RSA p,q,N,phi_N,e,d November 29, 2024
  • Square and Multiply November 26, 2024
  • Install DSM 7.2 (DS 918+) on J3455(暴风二期) November 9, 2024
  • Cryptography-ECC October 28, 2024
  • hashcat September 8, 2024
  • nmap & Linux Process Analysis September 7, 2024
  • 如何把SAP AI Core 接入Cursor September 7, 2024
  • Heart bleed testing with nmap or msfconsole September 7, 2024
  • OpenWRT + OpenClash August 17, 2024
  • 群晖双网口OpenWRT软路由设置 July 4, 2024
  • Cloudflare转发公网IP非443端口 July 4, 2024
  • 群晖启用xiaogpt June 23, 2024
  • Fix syno storage management May 1, 2024
  • Cloudflare ddns update shell script April 27, 2024
  • Fine tune llama2 on Mac January 4, 2024
  • 2023年终总结 December 31, 2023
  • How to report the false positive for your domain December 30, 2023
  • How to run LLM locally December 16, 2023
  • Cryptography 1 December 14, 2023
  • Whisper.cpp Playground November 30, 2023
  • My server is flagged as hacked November 21, 2023
  • Nginx Proxy for OpenAI API July 27, 2023
  • conda May 8, 2023

Recent Comments

  • 2023年终总结 - Jianqing's Blog on 初遇黄山
  • 2023年终总结 - Jianqing's Blog on 2016年终总结
  • 2023年终总结 - Jianqing's Blog on 2010年度总结
  • 2023年终总结 - Jianqing's Blog on 2021年终总结
  • 2023年终总结 - Jianqing's Blog on 2015年终总结

Archives

Categories

Meta

  • Log in
  • Entries feed
  • Comments feed
  • WordPress.org

Tags

2013 2014 2015 2018 2019 AI Android App AppWidget Bash Browser ChatGPT Cryptography Database,Google DDos dokuwiki DSM EditText en_US.UTF-8 exec fcitx File find firefox Gentoo git github Google Kali Linux LLM NAS OpenAI ssl syno vps Webkit wordfence wordpress 十年 希望 年终总结 心情 浏览器 生活随笔
Copyright © 2025 Jianqing's Blog. All rights reserved. Theme Spacious by ThemeGrill. Powered by: WordPress.