I use it with GitHub - mitsuhiko/pi-ds4: Run deepseek4 locally on metal right from within Pi · GitHub, which allows me to call GitHub - antirez/ds4: DeepSeek 4 Flash local inference engine for Metal and CUDA · GitHub directly from within pi, without having to start a separate server.
Running Cohere North Mini 1.0
uv tool install git+http://github.com/Blaizzy/mlx-vlm
uv run mlx_vlm.server --model CohereLabs/North-Mini-Code-1.0
Add this following line to ~/.pi/agent/models.json under providers key:
"mlx-lm": {
"baseUrl": "http://localhost:8080/v1",
"api": "openai-completions",
"apiKey": "none",
"models": [
{
"id": "CohereLabs/North-Mini-Code-1.0"
}
]
},Pi will use the above server running on port :8080:
pi --provider mlx-vlm --model CohereLabs/North-Mini-Code-1.0
The above will download the weights.