Use LM Studio in Kilo Code

Steps

1. 1
   Step 1.

   Download and install LM Studio, download a model (GGUF), then start the local server from the "Local Server" tab (icon <->): select the model and click "Start Server".

2. 2
   Step 2.

   In Kilo Code, open Settings (gear icon) and go to the Providers tab to add LM Studio. No API key is needed. You can configure the base URL if LM Studio runs on a different host or port. The extension stores this in your kilo.json config file.

3. 3
   Step 3.

   If the model you loaded doesn't appear in the Kilo model picker, register it as a custom model in your config file. The model key must match the model identifier LM Studio serves.

   JSON

   Copy

   {
     "model": "lmstudio/my-custom-model",
     "provider": {
       "lmstudio": {
         "models": {
           "my-custom-model": {
             "name": "My Custom Model",
           },
         },
       },
     },
   }

4. 4
   Step 4.

   If the display name differs from the API identifier, use the id field to set the API-facing name separately.

   JSON

   Copy

   {
     "provider": {
       "lmstudio": {
         "models": {
           "my-llama": {
             "id": "meta-llama-3.1-8b-instruct",
             "name": "Llama 3.1 8B (Local)",
           },
         },
       },
     },
   }