mudler's LocalAI [bot]
40d35c0385
docs: onboarding overhaul, dedup, and error docs ( #7711 ) ( #10895 )
...
* docs: fix CPU image tag (latest, not latest-cpu)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: use canonical localai/localai registry in models guide
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: replace dead llama-stable backend with llama-cpp
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: correct mitm-proxy intercept config and redaction tier
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: fix text-to-audio endpoint and broken notice block
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: fix VAD example, stale FAQ, broken link, CLI list, whats-new dump
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: render advanced/reference section indexes (consolidate _index)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: remove duplicate getting-started build/kubernetes pages
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: fold container image reference into installation/containers
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: remove stale advanced fine-tuning page (superseded by features/fine-tuning)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: fold distribution/longcat/sound pages into their parents
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: make getting-started index accurate and complete
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: carry one concrete model through the getting-started path
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: add end-to-end 'build your first agent' walkthrough
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: add runtime errors reference; consolidate troubleshooting from FAQ
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: add agent actions catalog
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: agent-scoped MCP, skills walkthrough, agentic disambiguation
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: add concrete gallery install lines to media feature pages
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: merge installation into getting-started (URLs preserved via aliases)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: add Operations section; move operator pages and P2P API reference
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: journey-ordered top nav and grouped feature sections
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: add docs-with-code process gate (PR template + agent instructions)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* docs: remove em/en dashes from documentation prose
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Co-authored-by: Ettore Di Giacinto <mudler@localai.io >
2026-07-17 22:08:20 +02:00
Ettore Di Giacinto
a28ab18987
feat(vllm): Allow to set quantization ( #1094 )
...
This particularly useful to set AWQ
**Description**
Follow up of #1015
**Notes for Reviewers**
**[Signed
commits](../CONTRIBUTING.md#signing-off-on-commits-developer-certificate-of-origin)**
- [ ] Yes, I signed my commits.
<!--
Thank you for contributing to LocalAI!
Contributing Conventions:
1. Include descriptive PR titles with [<component-name>] prepended.
2. Build and test your changes before submitting a PR.
3. Sign your commits
By following the community's contribution conventions upfront, the
review process will
be accelerated and your PR merged more quickly.
-->
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-09-22 15:52:38 +02:00
