Pi Coding Agent.

I use it with GitHub - mitsuhiko/pi-ds4: Run deepseek4 locally on metal right from within Pi · GitHub, which allows me to call GitHub - antirez/ds4: DeepSeek 4 Flash local inference engine for Metal and CUDA · GitHub directly from within pi, without having to start a separate server.

Running Cohere North Mini 1.0

via

uv tool install git+http://github.com/Blaizzy/mlx-vlm
uv run mlx_vlm.server --model CohereLabs/North-Mini-Code-1.0

Add this following line to ~/.pi/agent/models.json under providers key:

"mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "CohereLabs/North-Mini-Code-1.0"
        }
      ]
    },

Pi will use the above server running on port :8080:

pi --provider mlx-vlm --model CohereLabs/North-Mini-Code-1.0

The above will download the weights.