git/gemma3-vllm-stack
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Initial production-ready Gemma 3 vLLM ROCm stack

Browse Source 
Co-Authored-By: Oz <oz-agent@warp.dev>
This commit is contained in:
Raghav
2026-04-18 22:53:38 +05:30
commit ef8537e923
18 changed files with 988 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
frontend/config/frontend.env.example Normal file
View File

@ -0,0 +1,5 @@
FRONTEND_PORT=3000
OPENAI_API_BASE_URL=http://gemma3-vllm:8000/v1
VLLM_API_KEY=YOUR_LOCAL_API_KEY_HERE
GEMMA_MODEL_ID=google/gemma-3-1b-it
OPEN_WEBUI_DATA_DIR=./frontend/data/open-webui