Setting up LMStudio

Set up LMStudio on your computer

1. Go to: https://lmstudio.ai/
2. Download the Windows or the Linux version - whichever you need.
3. Run LmStudio

You'll need a model or two. Depending on your computer, you may want a small or a large. You can search HuggingFace from within LmStudio using the 'Discover' tab.

Small models

Models like FuseChat Kunoichi are very good. Mixtral is still a popular 7B option.

Medium models

If you can run it (RTX 4080+), try Command.R

---

Ultimately, when it comes to models, it's just whatever you prefer. Some are better than others.

Set up server

Setting up the server in LmStudio is easy.

1. Click into the "Developer tab"
2. Make sure you load a model from the drop down.
3. Click "Start Server"

You can learn/mess about with the settings for sampling etc.. but ultimately LmStudio does the hard work for you. CRL will superseed your sampling options.

---

LmStudio is the only local option that will be available in CRL.