Arrange your fashions
If you first run LM Studio, the very first thing you’ll wish to do is ready up a number of fashions. A sidebar button opens a curated search panel, the place you’ll be able to seek for fashions by identify or creator, and even filter based mostly on whether or not the mannequin suits inside the obtainable reminiscence in your present system. Every mannequin has an outline of its parameter dimension, common activity kind, and whether or not it’s skilled for software use. For this evaluation, I downloaded three totally different fashions:
Downloads and mannequin administration are all tracked inside the applying, so that you don’t need to guide wrangle mannequin information such as you would with ComfyUI.
The mannequin choice interface for LM Studio. The mannequin record is curated by LM Studio’s creators, however the person can manually set up fashions outdoors this interface by putting them within the app’s mannequin listing.
Foundry
Conversing with an LLM
To have a dialog with an LLM, you select which one to load into reminiscence from the selector on the high of the window. You can even finetune the controls for utilizing the mannequin—e.g., if you wish to try to load the complete mannequin into reminiscence, what number of CPU threads to dedicate to serving predictions, what number of layers of the mannequin to dump to the GPU, and so forth. The defaults are usually high-quality, although.
