Installation
Quick Install
git clone https://github.com/Zyrabit-tech/zyrabit-SLM.git
cd zyrabit-SLM
chmod +x zyra.sh install.sh
./zyra.sh install
[!TIP] Do not run
./zyra.shwithsudo: Executing the script undersudocauses Docker to create root-owned volume files (chroma-data,db_data,.env) that block standard user access. If you encounter a Dockerpermission deniederror on Linux, configure non-root Docker access instead:sudo usermod -aG docker $USER && newgrp docker
The install command will:
- Detect your hardware (RAM, GPU, Apple Silicon Metal)
- Create
.envfromexample.envif it doesn't exist - Build Docker images for the API, Web UI, MCP, and ChromaDB
- Start all containers in local/dev mode with direct open ports
- Auto-discover local model weights (or pull a model based on available resources)
[!IMPORTANT] Requirements: Docker Desktop must be running. A local inference provider (Ollama) will be configured automatically.
System Requirements
| Component | Minimum | Recommended |
|---|---|---|
| RAM | 8 GB | 16+ GB |
| Disk | 10 GB free | 20+ GB free |
| Docker | Docker Desktop or Engine | Latest stable |
| OS | macOS, Linux, WSL2 | macOS (Apple Silicon) or Linux (NVIDIA GPU) |
Verify Installation
After zyra.sh install completes:
./zyra.sh verify
Then open the Web UI at http://localhost:8080.
Test the API directly:
curl http://localhost:8080/v1/health
Next Steps
For a detailed walkthrough including environment setup, uv toolchain installation, and production deployment, see the Quickstart Fundamentals guide.