Give a model access to your own documents.
Your files are chunked, embedded and stored in a local vector index. At query time the passages that actually matter are retrieved and placed in the prompt, so the model answers from your material instead of its training data — and can cite which document it used.
Use when
- +The model needs facts it was never trained on
- +Source material changes and must stay editable
- +Answers need to be traceable back to a document
Not for
- −Changing tone, structure or response format
- −Teaching a task the model has never seen performed
ChunkingEmbeddingsVector searchRetrieval-augmented generation
Teach a model a behaviour, format or domain style.
A LoRA or QLoRA adapter is trained on your instruction dataset. Instead of rewriting every weight, a small low-rank matrix is learned alongside the frozen base — which is why a 14B model can be customised on a single consumer GPU in an afternoon.
Use when
- +The model must answer in a consistent structure every time
- +You need a tone or house style it will not hold through prompting
- +You have several hundred or more good input/output pairs
Not for
- −Installing facts that change — retrain cost is real
- −Fixing behaviour you have not yet tried to prompt for
SFTLoRAQLoRAGradient checkpointing
Make a model fit, and make it fast.
Quantization trades a measurable amount of quality for a large amount of memory. Performance mode sizes each option against your actual hardware, converts to the format your runtime wants, and shows what the trade costs before you commit to it.
Use when
- +The model you want does not fit in your VRAM
- +Generation is too slow to be usable interactively
- +You are packaging a model for a specific machine
Not for
- −Recovering capability the base model never had
GGUF quantizationk-quantsFormat conversionKV cache sizing
Nothing leaves the machine.
Every stage — parsing, embedding, training, inference — runs against local compute. ModelLM labels each operation local or cloud before it runs, and Private mode refuses to start any operation that would send your content off the machine.
Use when
- +The material is confidential, regulated or under NDA
- +You work somewhere that forbids third-party AI APIs
- +You want a hard guarantee rather than a policy promise
Not for
- −Workloads that genuinely need more compute than you own
Local inferenceOn-device embeddingsNo outbound telemetry
Give a local model tools and let it act.
Tool definitions are exposed to the model, calls are parsed from its output and executed under an explicit permission policy. The hard part is not the loop — it is picking a base model whose tool-call formatting is reliable enough to build on.
Use when
- +The model needs to read files, query a database or call an API
- +A task takes several steps and a decision between them
- +You want automation that runs against private systems
Not for
- −Anything where a wrong action is expensive and unattended
Function callingTool schemasExecution sandboxPermission policy
Build a local coding assistant.
Code models are selected on fill-in-the-middle support, repository-scale context and latency rather than general chat quality. Coding mode biases the catalogue toward those properties and configures the project for editor integration.
Use when
- +You want completion and review without sending source to a vendor
- +Your codebase uses internal patterns a general model has never seen
- +Latency matters more than the last few points of benchmark score
Not for
- −General-purpose assistants — a chat model will serve you better
Fill-in-the-middleRepository contextCode-specific tokenizers
Shape voice, format and refusal behaviour.
A system prompt plus, where it earns its keep, a small style adapter. Personality mode starts with prompting because that is almost always where the answer is, and only escalates to training when prompting demonstrably fails to hold.
Use when
- +Responses need a consistent voice across a team
- +You need a fixed output template every single time
- +Default assistant hedging gets in the way
Not for
- −Adding knowledge or capability — style is not substance
System promptsStyle adaptersResponse templates
Combine themModes stack.
Selecting several modes on one project changes which pipeline stages exist, what the advisor weighs, and what gets built. A private company agent is four modes at once.
Pick your modes →