From f1ff707b97bcc0496ed703787d5495140fb8fcbd Mon Sep 17 00:00:00 2001 From: mudler-agent Date: Fri, 23 Oct 2026 01:00:07 +0200 Subject: [PATCH] feat(addons): list and install backends from a library (#12816) * feat(addons): add the add-on runtime, navigation and first-party add-ons Add the add-on runtime to LocalAI: manifests, the host operation broker, admin gating by account role, the add-on UI bundle builder and the SDK for add-on pages. Move the navigation to Chat, Models, Add-ons and Settings, with pinned add-ons in the sidebar and an Add-ons drawer. Ship the first-party add-ons (voice, face, fine-tuning, quantization) as packages for linux/amd64, linux/arm64 and darwin/arm64. Intel macOS (darwin/amd64) is enabled in the platform files. Squashed from the review branch. The tree is unchanged; the pre-squash history is kept on a local backup branch. Signed-off-by: Ettore Di Giacinto * fix(gosec): tighten file modes and annotate false positives Write job state, configs and imported models with mode 0600, clean the paths that are read from disk, and mark the route tables, the header name and the retry jitter as reviewed false positives. Assisted-by: Claude Code:claude-sonnet-5-5 gosec Signed-off-by: Ettore Di Giacinto * fix(addons): keep API keys off recovery mutations and same-site cookies POST /api/addons/dispatch forwarded the recovery and update mutations to the owner for any administrator key, which skipped the browser-session rule of their own routes. Refuse those actions there. Also apply the same-origin rule to the legacy token cookie, not only the session cookie, because the global CSRF check lets same-site requests through. Do not fail the start of LocalAI when an add-on library cannot be refreshed; log it and keep the installed add-ons up. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * fix(addons): refuse a reinstall that would migrate retained data unbacked An upgrade takes a verified backup before the new package migrates the data. A reinstall over retained data has no running generation to stop, so the new package would migrate it without one. Refuse a reinstall whose data format differs from the retained one. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * fix(addons): release the manager lock while a release is fetched Submit held the state lock across the catalog lookup and the package download, so the apps list and status reads stalled for the whole install. Serialize Submit and Reconcile with their own lock and drop the state lock around the fetch only. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * fix(addons): kill an add-on only after three missed health probes One slow 100 ms probe killed a busy add-on and dropped the work it was serving. Require three misses in a row. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(ui): move settings under the operate hub The Operate hub already has Settings as a tab, so the sidebar no longer shows a separate Settings entry. The /app/settings route stays, and the hub tab still reaches it. The navigation test now expects Chat, Models and Add-ons as the primary items. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * fix(addons): accept same-host browser requests that carry no fetch metadata Browsers do not send Sec-Fetch-* headers over plain HTTP on an address that is not localhost, so every add-on request from a LAN address was refused as cross-site. Keep refusing a Sec-Fetch-Site value other than same-origin. When the header is absent, accept the request only if its Origin, or failing that its Referer, names the same host and port as the request. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * fix(ui): show the server's reason when an add-on request is refused A 403 or 400 answer showed a generic message and hid the reason in the response body, so a refusal by the browser guard could not be told from a missing permission. Show error.message from the body as the server sent it, and keep the generic text when the body has none. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * feat(addons): run the add-on owner in the normal binary The owner was only enabled when an embedding host set the add-on config, so a normal run answered every add-on request as unavailable. Add --addons-enabled (default true) and --addons-ownership-mode (default named-user, or local-owner; anything else stops startup). The node is its own owner: state lives under the data path, and the carrier uses loopback keys made at each start and kept in memory. --addons-enabled=false turns the owner off completely. Named-user mode needs the account database. With authentication off the owner stays off and a warning says how to use local-owner. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * fix(addons): keep the loopback owner address stable across restarts The single-node loopback transport took a new ephemeral port at each start. The owner stores its address in its identity file and refuses to start when the address differs, so every start after the first failed with "invalid addon owner configuration". Choose the port once, keep it in the add-on state root (loopback-port, mode 0600) and reuse it. If the port is taken at a later start, stop with an error that names the port and --addons-enabled=false, because another port would break the identity check. The keys and certificate stay in memory. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(addons): let add-on pages keep the host modules they were written against A page written for the web UI imports React, the router, i18next and a few shared components. The add-on builder refuses a bundle that holds a host file, so moving such a page into an add-on meant rewriting it. Add a compat mode to the shared builder. It answers those imports from a directory of stand-ins that read the SDK, bundles the dynamic import of the page code into the one output file, and collects the style sheets the page imports. A relative import that is not in the add-on's own source resolves to the file at the same path under the compat directory. Widen the SDK for these pages, without a version change: more host components (spinner, modal, lightbox, model picker) and hooks (models, resources, voice profiles, operations, MCP client), a style on icons, the icon names the pages draw, sdk.navigation.openApp to open a page of the app (only addresses under /app, and the way back as the only state) and sdk.portal. The shell passes the query string to the page. The stand-ins cover the router (the tab in the path, the model in the query), the translator over the host locale files, the core API calls through sdk.core.fetch, and byte copies of the pure helpers, with tests that keep the copies equal to the originals. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * feat(addons): ship Studio and Talk as add-ons instead of built-in pages Studio and Talk were compiled into the web bundle and always listed in the Add-ons drawer. They are add-ons now, like Voice, Face, fine-tuning and quantization: a person installs and removes them, the drawer lists them only while they are installed, and they are packaged the same way. Move the pages, their components, hooks and helpers into addons/studio and addons/talk. Each has a manifest, a UI bundle, a release platform matrix and a catalog template, and is built by the compat mode of the shared builder. The core API stays where it is: the pages call it with the signed-in person's session. The history keeps its browser storage keys. The unit tests of the moved helpers move with them. In the core, drop the two pages, the Create group of the sidebar (Chat joins Home and Models in the old layout), the built-in catalog entries (the catalog is empty) and the talk locale namespace. The old addresses (/app/studio, /app/talk and the generator links) redirect to the add-on pages, with the model as ?model=. The Home /studio command is offered only while the Studio add-on is installed and opens it. The release workflow and its tests now list seven add-ons. Assisted-by: Claude Code:claude-sonnet-5-5 go node Signed-off-by: Ettore Di Giacinto * test(ui): run the Studio and Talk specs against the add-on bundles The pages are add-ons now, so a spec that draws one installs the real built bundle first: the apps list names it and its module and style sheet are served from the build output, the way the add-on owner serves them. studio-addon.js holds that helper, and the Studio and Talk fixtures call it. Update the specs for the new addresses (/app/addons/studio/studio, the model as ?model=), the session permission the add-on route needs, the legacy redirects, the Home /studio command that appears only while the add-on is installed, and the sidebar without a Create group. Add specs for the add-ons themselves: every tab draws with no script error, the shell titles the page once, the old addresses say so when the add-on is not installed, a button of the page reaches a core page with the way back, and the drawer lists both only after they are installed. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * fix(ui): centre the icon of a built-in tile in its icon box The drawer drew the icon of a built-in tile (Studio's palette was one) in a bare 40px box. Only the placeholder box was laid out as a centred grid with the 20px size, so the real icon sat in the top-left corner at the size of the page text. Give the built-in tile the same classes as the placeholder box, and check in a browser that the icon is centred. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * docs(addons): describe Studio and Talk as add-ons Replace the built-in list (now empty) with the Studio and Talk add-on sections, the new targets of the old links, the Home command, and the seven packaged add-ons. Describe the SDK additions the pages use: components, hooks, icons, openApp and portal. Say on the Studio page that it is installed from the drawer. Assisted-by: Claude Code:claude-sonnet-5-5 Signed-off-by: Ettore Di Giacinto * test(ui): click the shell title in the Studio slash-key spec The add-on shell titles the page, and the Studio overview no longer draws a second title, but the generator tabs keep theirs, so a bare h1 locator matched two elements. Click the first, which is the shell's. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * fix(addons): read the loopback port file through os.Root The persisted port file was read with a path built from the add-on root, which gosec reports as a file inclusion through a variable. Open it through os.Root so the name cannot leave the root, even by a symbolic link, and require a regular file with no group or other access. A looser file now fails closed instead of being trusted. Assisted-by: Claude Code:claude-sonnet-5-5 Signed-off-by: Ettore Di Giacinto * test(ui): expect Settings under the Operate hub, not the sidebar Settings moved out of the sidebar into the Operate hub. The navigation spec still expected a sidebar link. Assert that the sidebar has no Settings entry, and that the Operate hub opens Settings as a tab. Assisted-by: Claude Code:claude-sonnet-5-5 playwright Signed-off-by: Ettore Di Giacinto * test(ui): drop Settings from the 404 places Settings is a tab of the Operate hub and not a destination of its own, so the 404 page does not list it. Assert that it is absent. Assisted-by: Claude Code:claude-sonnet-5-5 playwright Signed-off-by: Ettore Di Giacinto * test(ui): drive the media history and TTS specs through the Studio add-on The image, video, sound and speech generators are pages of the Studio add-on now, and the old addresses redirect to it. Install the add-on with the Studio fixtures, open its pages and use its compose card, so the specs run against the page that exists. Assisted-by: Claude Code:claude-sonnet-5-5 playwright Signed-off-by: Ettore Di Giacinto * test(ui): count the first-run steps, not every list item The recommended models are a list inside the second step, so counting all list items read 3 only while the models were still loading. Count the step elements, which does not depend on the load order. Assisted-by: Claude Code:claude-sonnet-5-5 playwright Signed-off-by: Ettore Di Giacinto * test(ui): fail the node refresh by state, not by call count The spec served the list to the first request and failed the rest. The first request is not always the one from the page, so the page could get the failure first and show no list. Serve the list until the page shows it, then fail the refreshes. Assisted-by: Claude Code:claude-sonnet-5-5 playwright Signed-off-by: Ettore Di Giacinto * feat(addons): default to local-owner when auth is off A server without authentication has no accounts, so named-user left the add-on owner off. Resolve the unset mode in one place: local-owner when authentication is off, named-user when it is on. A flag or environment value still wins, and an unknown value is still refused. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(addons): register an official add-on library by default Add gallery/addons/index.yaml, a YAML index of the four first-party add-ons (fine-tuning, quantization, voice, face) in the library format. The entries come from addonpkg catalog over locally built linux/amd64 packages, so the digests pin those images. On the first start, when the owner has no sources.json, register the raw GitHub URL of that index on master as the "official" library and write the file. The file is then the record: a library the admin removes stays removed, and an existing file is never changed. --addons-official-library=false skips the default. Assisted-by: Claude Code:claude-sonnet-5-5 go node Signed-off-by: Ettore Di Giacinto * docs(addons): document the ownership default and the official library Assisted-by: Claude Code:claude-sonnet-5-5 Signed-off-by: Ettore Di Giacinto * feat(addons): list Studio and Talk in the first-party index Add the Studio and Talk entries to gallery/addons/index.yaml next to the four existing ones. They come from addonpkg catalog over locally built linux/amd64 packages, so the digests pin those images. Assisted-by: Claude Code:claude-sonnet-5-5 go node Signed-off-by: Ettore Di Giacinto * test(addons): expect Studio and Talk in the official index The official index now lists six add-ons. Update the test that decodes it so it accepts Studio and Talk. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(addons): add a real icon to each first-party add-on Each icon is a 256 by 256 PNG: a rounded square in one colour of the UI kit palette with a white outline glyph from the kit sprite. Fine-tuning uses sliders, quantization layers, voice waveform, face user, studio palette, talk phone and tables database. They were rendered with headless Chrome from the sprite paths. Assisted-by: Claude Code:claude-sonnet-5-5 chrome Signed-off-by: Ettore Di Giacinto * feat(addons): ship a committed icon.png instead of the generated square The shared UI builder and the Tables builder copy ui/icon.png from the add-on source tree to the package unchanged when the file exists. They write the generated placeholder only when it does not. Add a fixture with an icon and a test for both cases. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * feat(addons): list the tables add-on in the first-party index Add the Tables entry to gallery/addons/index.yaml next to the six existing ones. It comes from addonpkg catalog over a locally built linux/amd64 package, so the digest pins that image. The official index test now expects seven add-ons. Assisted-by: Claude Code:claude-sonnet-5-5 go node Signed-off-by: Ettore Di Giacinto * feat(addons): make the Voice add-on one page with tabs The Voice add-on had four pages: recognition, library, create and speech, and the drawer listed two of them. It now has one page, "voice", and one drawer entry. Recognition, Library, Text to speech and From a recording are tabs of that page, drawn with the same tab strip the recognition page already used. The tab is the first path segment (voice/library), as in the Studio add-on, and the form that adds a voice is a view of the Library tab (voice/library/new). The old page names stay declared in the manifest. Each one redirects to its tab and keeps the query string, so saved links still open. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * feat(ui): send the old voice routes to the Voice tabs /app/voice, /app/voice-library and /app/voice-library/new now open the matching tab of the Voice add-on page while the add-on is installed and running, and the core pages otherwise. The moved-page helper compares the first segment of the target with the declared pages, so a target can name a tab. The docs and the navigation spec list the new addresses. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * test(addons): cover the Voice tabs and the old page redirects The add-on unit tests render the tabs instead of the four pages. The Playwright spec checks the tab strip, the address of each tab, the missing Library tab for a member, and that the old page addresses of the add-on redirect to their tab with the query string kept. The migration table test follows the new targets. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * fix(studio): keep the model menu inside a narrow screen The Home model picker sizes its menu from the viewport, and assumes the picker sits at the page gutter. In the Studio composer card the field is further in, so on a 390px screen the menu of the Sound expansion picker ended 7px past the right edge. Size the menu from the field it opens under instead. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * test(ui): build the add-on bundles once for the whole run Each worker built the Studio and Talk bundles into the same dist directory, and the build empties that directory first. A worker that started, or restarted after a failure, removed the files another worker was serving, so a Studio spec saw "the style sheet of the add-on could not be loaded". Build once in a global setup before the workers start. A run without the setup still builds per worker. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * test(ui): register the worker when the add-node spec says so The mocked roster added the worker on the third read of /api/nodes. The shell and the page both read it, and which one asks first depends on load, so the page could take the new worker as part of the roster it opened with and never show it as found. The worker now joins after the page shows it is listening. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * test(ui): hold the gallery answer until the skeleton is seen The spec delayed the answer by a fixed 800 ms and then looked for the skeleton. The assertion polls at growing intervals, so on a slow machine it could step over that window. The answer now waits until the skeleton has been seen, and the spec then checks that the skeleton goes away. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * test(ui): give the PDF tag the time the other PDF specs have pdf.js and its worker load on first use. The other specs in this file wait up to ten seconds for the result of that load. The first one waited five, and missed the tag on a busy machine. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * test(ui): build the Face and Fine-tuning bundles in the global setup The navigation spec serves the built Fine-tuning bundle, but nothing built it, so two specs failed on a fresh checkout when the dist folder was missing. The spec also built the Face bundle in a hook that every worker runs, and a build rewrites the folder the other workers serve. The global setup now builds Studio, Talk, Face and Fine-tuning once, before the workers start. The spec builds the two bundles itself only when it runs without the global setup. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * test(ui): fix the Home answers in the stale pin spec The spec asserts that the page shows no alert. The Home page raises its own alert when the model list fails or a staging operation has failed, and both answers come from the shared test server. A slow reply or a failed install left there counted as an alert about the pin. The spec now fixes both answers, so the alert count tells only about the pin. The assertions are unchanged. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * test(ui): read the server address in the add-node spec from the page The spec expected the register address to carry port 8089, so it failed on any other port. It now expects the origin the page was opened from. Assisted-by: Claude Code:claude-sonnet-5-5 node Signed-off-by: Ettore Di Giacinto * test(addons): give the navigation routes spec its own catalog No page is built in today, so the catalog is empty and the three specs that expect the studio and talk entries failed on the list and on the pin seed. They passed only while Studio and Talk were built in. The spec now sets a catalog of two ungated entries for each example and restores the old one afterwards. The assertions are unchanged. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * fix(cli): report a failed write of the MLX hostfile The tunnel callback ignored the error of os.WriteFile and set the hostfile variable even when the file was not written. It now logs the error and leaves the variable alone. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * test(addons): discard the close error of the held listener errcheck flags the deferred Close of the listener that keeps the port busy. The test has no use for that error, so the defer drops it explicitly. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * test(addons): move the add-on tool tests to Ginkgo The fine-tuning, quantization and add-on host library tests used t.Errorf, t.Fatal and t.Run, which the forbidigo rule rejects. They now use Describe, It and Gomega, with a suite bootstrap in each package. The cases and the assertions are the same. The tables in the host client and the tool schema tests keep one entry per case. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * test(addons): move the host operation tests to Ginkgo The hostops tests used the testing package calls that forbidigo rejects. They now run as Ginkgo specs under one suite bootstrap. Every check and every per-operation case is kept. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * test(addons): move the pin store tests to Ginkgo The pin service, file store, sweep and shared store contract tests used the testing package calls that forbidigo rejects. The store contract is now a function that registers its specs for each store, so the file store, the memory-only store and the database store run the same cases. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * test(addons): move the remaining add-on tests to Ginkgo The built-in catalog, tool arguments, loopback carrier, host operation contract, packaging, application, config, CLI and endpoint tests used the testing package calls that forbidigo rejects. They now run as Ginkgo specs. The endpoint tests also drop the unchecked Close errors that errcheck reports when the auth tag is on. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * test(ui): wait for the targeted Reinstall button before the install click The "generic deletion blocks targeted install at confirmation" spec dispatches a popstate to set the target node, then clicks Reinstall with a script click. The click can run before the targeted page has rendered or while the button is still disabled, so no install request is sent and the poll on the install count times out. It failed 1 run in 10 with two workers and on every retry in CI. The spec now waits for the button to be enabled first. The assertions are unchanged. Assisted-by: Claude Code:claude-sonnet-5-5 playwright Signed-off-by: Ettore Di Giacinto * chore(addons): refresh the voice package digest in the first-party index The Voice add-on became one page with tabs and got a new icon, so the digest in gallery/addons/index.yaml no longer matched the build. Render the entry again with addonpkg catalog over a locally built linux/amd64 package; the main page is now voice. The other entries are unchanged. Assisted-by: Claude Code:claude-sonnet-5-5 go node Signed-off-by: Ettore Di Giacinto * test(ui): wait for the target node's Reinstall button after the popstate The "generic deletion blocks targeted install at confirmation" spec dispatches a popstate to set the target node, then waits for a button named Reinstall and clicks it. Until React renders the targeted page, the page still draws the generic Reinstall button. It is enabled and has the same name, so the wait passed on it, the click started a global install, and no node install request was sent. The poll on the install count timed out with the confirm dialog still open. With the CPU throttled to 8x, the spec failed on 20 of 20 runs, and the button it clicked had the title "Reinstall". The spec now waits for the button titled "Reinstall on ". With the throttle it passes 30 of 30 runs. The assertions are unchanged. Assisted-by: Claude Code:claude-sonnet-5-5 playwright Signed-off-by: Ettore Di Giacinto * test(ui): give the Studio hand-off spec a budget for the cold bundle load The "a result made through a hand-off records which result it came from" spec opens the Studio add-on straight from an address, twice. Each is a cold load: the page shows "Loading" until the add-on module has run, and the next assertion had the default five seconds. The load takes about two seconds on an idle run and seven to ten under CPU load, so the spec failed on a loaded machine with the hand-off note not yet drawn. With the CPU throttled to 6x and eight busy loops running, it failed on 21 of 30 runs. The first assertion after each load now waits up to 20 seconds, and the spec then passed 30 of 30 under the same load. The assertions are unchanged. Assisted-by: Claude Code:claude-sonnet-5-5 playwright Signed-off-by: Ettore Di Giacinto * fix(addons): carry the identity page styles in the Face add-on The Face page is drawn with the shared identity views, but its style sheet held only the clip and error rules. The page, card, model list, known-faces table, enrol sheet and distance scale classes had no rules. They looked right only when the host had already loaded the style sheet of its own Faces page, which a visit through the add-on drawer does not do. Opened that way, the cards had no gap, the model list showed bullets, and the install buttons ran into the names. The Face sheet now holds the same identity rules as the core sheet, so the page looks the same whichever way it is opened. Assisted-by: Claude Code:claude-sonnet-5-5 playwright Signed-off-by: Ettore Di Giacinto * fix(addons): scope the narrow-screen identity rules of the Voice add-on The rules for narrow screens (single-column pairs, smaller tool padding, compact rank rows) were copied into the Voice style sheet without their media query, so they applied at every width. They now sit in a max-width 720px query, and the reduced-motion rule in its own query, as in the core sheet. Assisted-by: Claude Code:claude-sonnet-5-5 playwright Signed-off-by: Ettore Di Giacinto * fix(addons): drop the repeated title from the Voice and Face pages The add-on shell already titles the page, so the recognition pages showed the name twice: "Voice" above "Voices", "Face" above "Faces". Keep the supporting line and the model picker, as the Studio page does, and remove the unused title strings. Assisted-by: Claude Code:claude-sonnet-5-5 node playwright Signed-off-by: Ettore Di Giacinto * feat(ui): replace the Pinned sidebar section with an Apps entry The sidebar no longer lists pinned add-ons. It shows one Apps entry that opens the add-ons drawer, with a Show all link below it that opens the same drawer. Pins are used from the drawer, where a pinned tile keeps its pin and move buttons. The server pins API is unchanged. Remove the PinnedNav component and its locale title, rename the items.addons label to Apps, and update the e2e specs and the add-ons documentation to match. Assisted-by: Claude Code:claude-sonnet-5-5 playwright Signed-off-by: Ettore Di Giacinto * test(addons): assert the single shell title on the Voice and Face pages The add-on shell now shows the one title, "Voice" or "Face", and the page no longer repeats it. The tests still looked for the h1 "Voices" and "Faces". Assert that the add-on page has exactly one h1 and that it is the shell title. The core pages keep their own "Voices" and "Faces" titles. Assisted-by: Claude Code:claude-sonnet-5-5 playwright Signed-off-by: Ettore Di Giacinto * fix(addons): drop the repeated title from the Voice Library and Text to speech pages The add-on shell already titles the page "Voice", so these two tabs showed a second heading below it ("Speech voices", "Speak text"). Keep the supporting line, as the Studio and recognition pages do, and remove the unused title strings. The e2e spec now checks that each tab has exactly one h1, the shell title. Assisted-by: Claude Code:claude-sonnet-5-5 node playwright Signed-off-by: Ettore Di Giacinto * feat(ui): list pinned apps under Apps in the sidebar A pinned app now shows as an indented child of the Apps entry, with its icon and title, in pin order. Show all stays the last child. The pins come from GET /api/addons/pins through the navigation context, and the apps from the add-on registry, which the drawer feeds on every list read, so the links follow the drawer. A pin without an installed app is not drawn, nothing extra shows when no app is pinned, and the children are hidden when the sidebar is collapsed to the rail. Assisted-by: Claude Code:claude-sonnet-5-5 node playwright Signed-off-by: Ettore Di Giacinto * docs(addons): say that pinned apps are listed under Apps in the sidebar The sidebar lists the pinned apps between Apps and Show all, in pin order. The pins section and the navigation section said that pins do not appear in the sidebar. Assisted-by: Claude Code:claude-sonnet-5-5 Signed-off-by: Ettore Di Giacinto * fix(ui): remove the Show all link under Apps in the sidebar The link repeated the Apps entry, which opens the same drawer, and looked redundant when no app was pinned. Apps is now the only add-on entry; pinned apps still list under it in pin order. The link, its locale key and the style comment are gone, and the e2e spec and the add-ons docs now say that Apps is the only entry. Assisted-by: Claude Code:claude-sonnet-5-5 node playwright Signed-off-by: Ettore Di Giacinto * feat(ui): show a first-run card on Apps when nothing is installed An administrator who opens Apps with no add-on installed now sees a short card with three steps: choose a library, browse and install, start the add-on. Its button opens the Browse tab. The card is hidden once an add-on is installed and for anyone who cannot install. Assisted-by: Claude Code:claude-sonnet-5-5 node playwright Signed-off-by: Ettore Di Giacinto * fix(ui): hide the pinned apps in the icon rail When the window is narrower than 1024 px the sidebar shrinks to the icon rail by CSS alone, without the collapsed class. The pinned app links were still drawn there, with the indent meant for the full sidebar, so their icons sat to the right of the rail and were cut off. Hide the pinned app links in both rail states. The Apps entry keeps its centred icon. The e2e spec checks that the rail shows no pinned app and that every icon is centred at 1280 px collapsed and at 1000 px. Assisted-by: Claude Code:claude-sonnet-5-5 node playwright Signed-off-by: Ettore Di Giacinto * test(ui): stop the backend redirect test racing the installed list The test reads the redirected URL right after the path changes. The Backends page then loads the installed list and drops a selected backend that is not installed, so the backend parameter was sometimes already gone when the test read it. The mock server has no llama-cpp, and about 15 of 40 repeated runs failed on the backend assertion. The redirect itself was correct, including show_all. Serve the selected backend in the installed list, so the page keeps the selection and the assertions stay as strict as before. Assisted-by: Claude Code:claude-sonnet-5-5 node playwright Signed-off-by: Ettore Di Giacinto * fix(addons): accept a same-host Referer or Origin for human confirmation Browsers send no Sec-Fetch-* headers over plain HTTP on an address that is not localhost, so creating a resource from a LAN address failed with "Creating a resource requires your own browser session". When Sec-Fetch-Site is present it must still be same-origin with an empty destination, as before. When it is absent, Origin or, failing that, Referer must name the request host and port. A destination or mode that is present must still be the expected one. This matches the rule in BrowserProtection. The credential, token cookie, API key and tool-context checks are unchanged. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * fix(ui): keep hub entries off the Apps route in the sidebar The Build hub still owned /app/addons through its legacy Add-ons tab, so the sidebar lit both Apps and Build on the Apps page. A tab whose gate is closed now owns no route when the sidebar asks, so only the Apps entry is active there. The hubs keep their own routes, and the legacy navigation still gives /app/addons to the Build hub. Assisted-by: Claude Code:claude-sonnet-5-5 node playwright Signed-off-by: Ettore Di Giacinto * feat(ui): label the pin control on app tiles and in the detail view The pin was a small icon-only button and hard to find. Each app tile now shows a button reading Pin, or Pinned with a filled pin, and the detail view has the same control in its header. Both toggle the same stored pin. The Apps grid lists pinned apps first, in pin order, then the others. The sidebar list and the server pins API are unchanged. Assisted-by: Claude Code:claude-sonnet-5-5 node playwright Signed-off-by: Ettore Di Giacinto * test(addons): check the Voice From a recording tab has one title The Library and Text to speech tabs already assert that the add-on shell title is the only h1. Do the same for the From a recording tab, so a heading added there later fails the navigation spec. Assisted-by: Claude Code:claude-sonnet-5-5 node playwright Signed-off-by: Ettore Di Giacinto * fix(ui): stop the add-on shell drawing a title over add-on pages The app decides what its page shows. The shell drew the add-on name as a header above every add-on page, so an add-on could not choose its own title. The shell now draws no header on a live, loading or frozen add-on page; each add-on titles its own pages. The unavailable and missing-page states keep the name, because no add-on page is drawn there. The runtime and shell specs now check that the shell adds no page title. Assisted-by: Claude Code:claude-sonnet-5-5 node playwright Signed-off-by: Ettore Di Giacinto * fix(addons): let each add-on draw its own page title The shell no longer titles add-on pages, so each add-on draws one h1 per page. Voice titles its tabs "Voices" (Recognition and From a recording), "Speech voices" (Library) and "Speak text" (Text to speech); "Add a speech voice" already had its own. Face draws "Faces", Studio "Studio" and Talk "Talk". Tables promotes the database list and database name from h2 to h1. Fine-tuning and Quantization already drew a title. The add-on unit tests and the navigation and Studio specs now assert exactly one h1 per page, with the page's own title. Assisted-by: Claude Code:claude-sonnet-5-5 node playwright Signed-off-by: Ettore Di Giacinto * feat(addons): add a kind to library entries and read unknown kinds tolerantly A library entry now has an optional kind: addon (the default when it is absent), backend or model. Every index written before kinds existed stays valid and its entries are add-ons. A reader keeps the entries of the kinds it knows and skips the others without reading their fields, so a newer kind never makes an older host refuse the whole index. The refresh result and the library state report how many entries were skipped and of which kinds, and the refresh logs a warning. A kind that is not a plain kind name still makes the index malformed. Search lists add-ons unless the caller asks for a kind, and Resolve returns add-ons only, so an add-on install cannot be pointed at a backend image. A library policy may name the signer with an anchored identityRegex instead of an exact identity, so builds from master and from tags both verify. An add-on install refuses a policy that carries one. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(backends): install a backend from a library entry A library can now list backends. An entry of kind backend names the image of the backend gallery by digest, and POST /backends/library/install installs it on the local node. The gallery stays the source of truth and its install path is the one used: the library resolves the entry, takes the signature policy from the library, pins the image by digest and calls the same install as the gallery. Installing a name that came from a gallery, another library or by hand is refused and changes nothing. The signature policy of a backend library names the signer with an anchored identityRegex, so images signed by the merge workflow on master and on tags both verify. A pattern that is not anchored is refused. An install is bounded by a size limit per kind: add-ons keep 512 MiB and a backend image defaults to 8 GiB, set with --addons-backend-max-bytes. The limit reads the manifest after the signature check and before any layer is fetched. The metadata of an installed backend records the library it came from. scripts/backends/cmd/backendcatalog renders entries from backend/index.yaml and pins them against the registry. The pilot is the CPU build of local-store, in gallery/backends/index.yaml. The library is registered on the first start only with --addons-backend-library, which is off by default. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(ui): show the kind of library entries and install backends from them The Browse tab lists the entries of every kind this host reads and marks each one as an add-on or a backend. A backend installs through the backend route and not through the add-on lifecycle: the confirmation says that the backend gallery is not changed and that a backend runs native code, and a refusal of the host, such as a name installed from another origin, is shown with its own reason. The details give the kind, the alias and the signer pattern. The library editor can name the signer with a pattern. Without this a save would drop the pattern of a backend library. The Libraries tab reports the entries a refresh skipped because their kind is not read. Assisted-by: Claude Code:claude-sonnet-5-5 node playwright Signed-off-by: Ettore Di Giacinto * docs(addons): describe backends in the library Document the entry kinds, how a reader skips a kind it does not know, the backend entry format, the signer identity pattern, the install route, the size limit of each kind, the pilot library and the command that renders it. The backend page links to it. Assisted-by: Claude Code:claude-sonnet-5-5 Signed-off-by: Ettore Di Giacinto * feat(mcp): install a backend from a library entry The backend library route installs a backend from an add-on library entry, and the admin REST surface and the MCP catalog must stay in step. Add the install_library_backend tool with an in-process and an HTTP client, the route map entry, the safety-rule listing and a skill recipe. Listing library entries stays on the add-on routes, which the assistant does not expose, so no list tool is added. Assisted-by: Claude Code:claude-sonnet-5-5 Signed-off-by: Ettore Di Giacinto * fix(ui): carry the add-on library keys in every locale The add-on library and backend library strings existed only in English, so the other locales had no value for them. Add the missing keys of the addons namespace to de, es, id, it, ko, pt-BR and zh-CN. The values are the English text until a translation is contributed. Assisted-by: Claude Code:claude-sonnet-5-5 Signed-off-by: Ettore Di Giacinto * feat(backends): report the steps of a library install as a job A backend install from a library ran inside the request and showed nothing until it ended. It is now a job of the gallery service, the kind the backend gallery installs use. The request answers with the job ID and GET /backends/jobs/{id} reports the step as the phase of the job: resolving, verifying, size, fetching and writing, with the byte progress of the fetch. A job that fails keeps the phase of the step that failed and gives the reason. A second install of the same name is refused while one runs. The downloader and the gallery install report their stages through an optional hook, so the steps are the real ones and not a guess. The Browse tab lists the steps of the entry being installed, marks the one that failed, and omits the signature step for a library that does not require one. The library installer also gets Updates and a route that lists the installed library backends with a newer build in their library, for the next change. Assisted-by: Claude Code:claude-sonnet-5-5 node playwright Signed-off-by: Ettore Di Giacinto * feat(ui): mark library backends and offer their updates on the Backends page A backend installed from a library now shows the library ID next to its name and, in the detail, the library and the digest that metadata.json pinned. Gallery backends look and behave as before, and the gallery reinstall is not offered for a library backend, because the gallery does not list it. When the cached index of the library lists another build in the channel of the installed version, the row says "Update available" and offers an Update button. The button starts the same install as the Browse tab, and the detail shows its steps. Nothing is upgraded on its own. The check says nothing when the library no longer lists the installed version and has several channels, instead of guessing one. Assisted-by: Claude Code:claude-sonnet-5-5 node playwright Signed-off-by: Ettore Di Giacinto * fix(mcp): match the library installer to the progress type The MCP install of a library backend was written against the earlier Install signature. The job-based install now takes a Progress value, so the application did not build. The MCP interface drops its unused status callback and the application adapts the installer to it. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(gallery): add the model library entry shape and its reader A model library entry is the shared library envelope (kind, id, name, version, description, license, urls, tags, icon, channel, policy, schemaVersion) plus a model body: url, backend, size, files, configFile, overrides, variants and promptTemplates. The envelope lives in the catalog package so the other kinds can move to it. A gallery entry converts to a library entry and back to the same gallery entry. Floats are written so they read back as floats, and an empty variants list stays distinct from an absent one, because both occur in the real index. The reader is strict: unknown fields, duplicate ids, a second document and a flow-style list are refused. An entry of another kind is skipped and reported, as in the add-on reader. The gallery index stays the default and is not changed. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(gallery): render the model library from the model gallery scripts/models/cmd/modelcatalog reads gallery/index.yaml with the same structs the host reads it with, converts every entry to a library entry and back, and fails if any entry does not come back equal. It writes gallery/models/index.yaml and the golden files for the tests. The output is deterministic, and the gallery is only read. The golden files are a digest pair for every entry (the gallery entry and the library entry made from it) and a readable gallery and library pair for each kind of entry: plain, with variants, with an empty variants list, with a config file, with a size, with a backend, with floats in the overrides, without a url, without files and with a multiline description. All 2212 entries of the index round trip. The gallery struct does not read a few keys (last_checked, parameters and four stray capitalised keys); the host drops them when it loads the index, so the library does not carry them, and the command reports them. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(gallery): add --model-index-source to read the model library --model-index-source selects the file the host reads the models of the official gallery from: gallery (the default) or library. With library the gallery named localai reads the model library, from --model-library-url or the file in the repository, and keeps its configured name and URL on every entry. A gallery the owner added keeps its own index, and add-on and backend galleries never take this path. A library that cannot be fetched or read is an error and not a fall back to the gallery, so the setting is never silent. The tests round trip every entry of the real gallery index, compare it with the golden files, check the rendered library file reads and agrees with itself, and cover the strict reader, the kinds it skips, prompt templates, number types, empty lists and the setting. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(backends): upgrade library backends with the auto-upgrade switch The upgrade checker now installs the newer build of a library backend when auto_upgrade_backends is on, on the same check that upgrades the gallery backends. With the switch off nothing is installed and the Update button stays manual. The switch is read on every check, so a change in the runtime settings applies at the next one. There is no second toggle. The tests cover both states and a host without a library. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(cli): add local-ai library to manage library sources local-ai library has list, add, remove, enable and disable. It works on the source store the server reads (addons/sources.json under the data path), so it also works with the server stopped. A source has a kind (addon, backend or model); the store records whether it is a shipped default, and removing a default leaves a tombstone so it does not come back at the next start. The shipped model and backend gallery indexes are default sources next to the official add-on library. Defaults are added at every start when they have no record yet, and an existing file that holds no default is left alone as before. The --model-index-source and --model-library-url flags are removed: a model library is added as a model source, and the gallery entry says it is a library. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(addons): let a source of your own win an entry over a default When two enabled sources list the same entry (same kind and id), the source the user added wins over a shipped default, and the default is ignored for that entry. When two sources the user added list it, search and resolve are refused with an error that names the entry and both sources, and nothing is picked silently. Among shipped defaults nothing changes. The tests cover a user source over a default, a tie between two user sources, a default ignored once a user source wins, and the case where disabling a source ends the conflict. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(cli): map the gallery flags to library sources at startup --galleries and --backend-galleries keep loading the same JSON. At startup each entry they name also becomes a source the user owns, of kind model or backend, so local-ai library list shows it. The mapping is additive: an entry whose kind and URL is already a source (a shipped default, one added with the CLI, or one mapped at an earlier start) is not added twice, and a derived id never collides with another source. The sources then decide which galleries the server reads: a gallery whose source is disabled or removed is left out, and a model library or gallery added with local-ai library add is added. A list set by the flags still replaces the shipped defaults. If the store cannot be opened, the galleries stay as the flags set them. The autoload switches are not touched. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * refactor(library): use id for every kind and seed the default libraries The backend entries of the library used addonId while the model entries use id. Release now has the field ID, written as id for every kind. ReadIndex reads addonId as a legacy alias for one release, for add-ons and backends, and refuses an entry that holds both names. The backend index and the catalog generator write id. The shipped libraries are default sources. The pilot backend library is now on by default, like the official add-on library, and the model library is a new default model source, official-models. The server reads it next to the localai gallery. A source the user removed stays removed, and a source the user adds is added to the defaults. The model catalog header held a backtick that ended its raw string, so the generator did not build. The header no longer has it. Assisted-by: Claude Code:claude-sonnet-5-5 go node playwright Signed-off-by: Ettore Di Giacinto * feat(library): choose the default model source by build A build read both the localai gallery and the official-models library by default, so every model was listed twice. Now a build reads one of them. library.ModelSource names it: "library" or "gallery". The model source that is not chosen is still shipped, as a disabled default, and local-ai library enable turns it on. The value is a Go variable set at link time with -ldflags, because the same source tree makes both kinds of build and a constant would need a commit to change. It is "library" in the source, so a build from master, go build and go test read the library. Only the exact value "gallery" selects the gallery, so a mistyped value cannot leave a build without a model source. The Makefile sets it from LOCALAI_MODEL_SOURCE. When that is not set, a commit that carries a tag gets "gallery" and any other commit gets "library". .goreleaser.yaml passes the same variable and defaults to "gallery". The release workflow sets it to "library" on a tag, which is the cutover. A default source is seeded once, so a data directory that an earlier build seeded keeps its enabled flags. Switch it with local-ai library enable and disable. Tests assert the master default, the tagged default before the cutover and after it, and that a mistyped value reads the library. The model library header now says that CI checks it and when a build reads it. Assisted-by: Claude Code:claude-sonnet-5-5 go node Signed-off-by: Ettore Di Giacinto * ci(library): check the model library and cut over on tag No workflow checked gallery/models/index.yaml, so it could go stale when gallery/index.yaml changed. A new workflow, model-library.yml, runs on pull requests and on master when the gallery, the library, the generator or core/gallery change. It runs the generator tests and the library shape tests (the file decodes, it has the library shape, every real entry round trips), then renders the library again from gallery/index.yaml and fails on any difference with git diff --exit-code. The error message gives the command that fixes it. release.yaml gets the cutover. On a tag, a step sets LOCALAI_MODEL_SOURCE=library before GoReleaser runs, and .goreleaser.yaml links it into the binary. Without that step a tagged build reads the gallery. The step is the one place to remove when the gallery is retired. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(library): make the model library the source of the gallery The library, gallery/models/index.yaml, was rendered from the gallery. Now it is the source and models are edited there. modelcatalog reads the library and writes gallery/index.yaml, a generated copy that stays only so releases before the cutover keep working. The gallery file is written in the shape the host reads: the same field order, floats such as 1.0 keep their form, and an empty variants list stays apart from an absent one. The command converts every library entry to a gallery entry and back, loads its own output the way the host does, and fails when an entry comes back different. The gallery copy drops what the library cannot carry: last_checked, parameters and four capitalised keys (Base Model, Context Length, License, Training Data). The gallery struct has no field for any of them, so the host ignored them on load. Every run lists these keys and how often the file being replaced still had each. Loading the old and the new gallery with the host structs gives equal entries for all 2212 models. The tests that read the library and the golden files follow in the next commit. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * ci(library): check the library and that the gallery is its copy The model-library workflow assumed the gallery was the source. It now checks the library file, the new source. The library decodes, every entry has the library shape, every entry converts to a gallery entry and back, and the gallery reader loads the generated gallery and sees the same names, file uris and digests. The workflow then generates gallery/index.yaml again and fails on any diff with git diff --exit-code. The message says the file is generated, not to edit it by hand, and gives the command that regenerates it. The tests in core/gallery read the library file now. The round trip runs library to gallery and back on all 2212 real entries, a new test compares the checked-in gallery with the generated copy so go test finds a hand edit too, and the golden digests and samples are written from the library. The version of an entry is no longer compared with a digest of its content, since an edit to the library does not change it. The docs say the library is the source, the gallery file is a generated copy for releases before the cutover, and edits go to the library. The agent guide for adding models says the same. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(library): add admin routes for library sources and an official libraries switch The library sources of the add-on, backend and model kinds had a CLI but no HTTP routes. Add them for administrators, on the same store and the same functions as `local-ai library`, so the two cannot drift: GET /api/library/sources POST /api/library/sources POST /api/library/sources/{id}/enable POST /api/library/sources/{id}/disable DELETE /api/library/sources/{id} The list carries kind, default, removed (a tombstone), suspended and the conflict message of a source that clashes with another one. A change to a model or backend source applies to the running server. A deleted source drops its gallery by address; a removed default keeps its record. Add the runtime setting official_libraries (default on), with the flag --official-libraries. When it is off, every shipped default source of the three kinds is suspended: it is not read, stays in the store marked default, and comes back when the setting is on again. Sources the user added are not affected. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(ui): list library sources of all three kinds in the Libraries tab The Libraries tab of the Add-ons page now lists the sources of the add-on, backend and model kinds from the new library routes. It has a kind filter with counts, a Default badge, the state of each source (enabled, disabled, removed, or off while the official libraries are off), turn on and off, a Restore button for a removed default, and the conflict message next to a source that clashes. Adding a source takes a kind and, for backends and models, an index format. Settings gets the toggle "Use official libraries" for the official_libraries setting. Add unit tests for the list and the kind filter, and a Playwright spec that runs on a fresh test server started with --library-sources (its own config, port 8097): it lists the three kinds, adds a model source, disables and removes a default, checks the conflict message and the official libraries toggle. Assisted-by: Claude Code:claude-sonnet-5-5 javascript Signed-off-by: Ettore Di Giacinto * feat(library): extend the backend body to carry what the gallery carries The backend library entry only held an image and its digest. The backend gallery holds more that matters at install and in the UI, so the library could not replace it. Add the missing fields to the backend kind and keep the strict reader. New fields, all refused on an add-on entry: - mirrors: ordered fallback images of the same backend, each oci://. The install pins them with the digest of the artifact. - capabilities: a map from a host capability to a backend id. An entry with capabilities and no artifact is a meta backend. It has no digest, os or arch, is listed for every platform, and installing it installs the backend its capability names, in the same library and channel. - license, urls, tags: display metadata, bounded and checked as text. - icon: an https URL. The add-on ui.icon stays a path in the package. The host never fetches the icon. - mutable: the artifact is a moving tag, such as a development image. The entry has no digest. The install resolves the tag to a digest, verifies that image and records the digest it installed. - schemaVersion: the envelope version. A higher one is refused. The index bounds grow to 8 MiB and 4000 entries, because the backend library lists every image for every platform. Release now holds lists, so the add-on staging compares it with Equal instead of ==. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(library): render the backend library from the whole backend gallery Add the conversion between a gallery backend and its library entries in core/gallery, and make scripts/backends/cmd/backendcatalog build the library from the gallery and the gallery from the library. The library now holds all 1093 gallery entries as 1088 backends, because five names appear twice in the gallery with the same content and are folded. That is 934 concrete backends and 154 meta backends, written as 1240 entries: a backend built for several platforms has one entry for each, with the digest of that platform image. - 539 release entries are pinned by the digest the registry serves for the platform. - 543 development entries (master-* tags) keep their tag and are mutable. The install pins them. - 4 release entries are not pinned, because the registry has no image for them: cpu-qdrant-store, metal-qdrant-store, cpu-gemxcpp and vulkan-gemxcpp. They are marked mutable and no digest is invented. Render them again with --repin once the images exist. The generator can import a gallery once, pin the release images again, and write the gallery file from the library without the network. Before it writes it converts every backend to the library and back and fails if one does not come back equal. A policy is no longer written on each entry, because the host takes the policy of the library source. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * test(library): check that every backend gallery entry round trips Prove that the backend library can replace the backend gallery. The golden input is the real backend gallery from before the library became the source: 1093 entries, kept under core/gallery/testdata/backend_library with the pins the library holds and the digest of each generated entry. TestBackendLibraryRoundTripsEveryRealGalleryEntry converts each entry to library entries, writes them as an index, reads them as a host does, validates them and converts them back. It asserts that all 1093 entries come back equal on every field the gallery reader uses, and logs the count. The five names that appear twice in the gallery have the same content, so the twin is checked against the first one and folded. The other tests check the library file in the repository: every entry passes the host checks, every backend round trips, every meta backend names concrete backends the library has, a development entry keeps its master-* tag and has no digest, and the golden digests still match. Unit tests cover each field, the fields the library cannot carry, which are refused rather than dropped, and entries of one backend that disagree. An entry with no artifact, digest, os or arch no longer writes them as empty strings, so a meta backend and a mutable entry stay short. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * feat(library): make the backend library the source of the backend gallery Flip the source the way the model library did. The backend library, gallery/backends/index.yaml, is where backends are edited. The backend gallery, backend/index.yaml, is now generated from it by scripts/backends/cmd/backendcatalog and stays only so releases before the cutover keep working. It no longer has anchors or hand-written order, and it holds 1088 backends: the five names that were listed twice with the same content are folded. Which source a build reads is set at build time, like the model source: - core/library.BackendSource is "library" or "gallery". Only the exact value "gallery" selects the gallery, so a mistyped value cannot leave a build with no backend source. - A build from master reads the library. The Makefile reads the gallery for a commit that carries a tag (LOCALAI_BACKEND_SOURCE), and GoReleaser defaults to the gallery. - A step in release.yaml sets LOCALAI_BACKEND_SOURCE=library, so a tagged build cuts over by itself. - Both sources are shipped and one is enabled. With --addons-backend-library=false every build reads the gallery. The server hands the shipped backend library to the gallery reader as a library, so the Backends page lists it and installs from it the way it did from the gallery. A backend library the user adds stays with the add-on catalog. The shipped library is now a backend source, not an add-on one. The new workflow backend-library.yml runs the tests, regenerates backend/index.yaml and fails on a diff. It never reads the registry. backendcatalog --add merges backends written in the gallery shape into the library, so adding a backend does not mean writing platform entries by hand; the agent guide says so. Assisted-by: Claude Code:claude-sonnet-5-5 go Signed-off-by: Ettore Di Giacinto * docs(library): describe the backend library as the source of the backends Rewrite the backends and add-ons pages for the backend library. The library file is the source of truth and the backend gallery is a generated copy that is never edited by hand. - backends.md: the library and the generated gallery, which source a build reads (master, tagged before the cutover, tagged after it), the --addons-backend-library switch, how to add a backend and generate the gallery, and what CI checks. - addons.md: the full backend entry with the new fields (mirrors, capabilities, license, urls, tags, icon URL, mutable, schemaVersion), meta backends, development images pinned at install, and the backend library section in place of the pilot one. - compatibility-table.md: point to the library as the source. Assisted-by: Claude Code:claude-sonnet-5-5 Signed-off-by: Ettore Di Giacinto * feat(library): mirrors on library sources, editable through the API Library sources carry an optional list of mirrors. The mirrors go into the gallery entries the server reads, and a source can be edited with PUT /api/library/sources/:id. The mirror forms accepted are http(s), github:, oci:// and file://, at most eight per source. Sources saved before this change load without mirrors. Assisted-by: Claude:claude-haiku-5-5 [Claude Code] Signed-off-by: Ettore Di Giacinto * feat(ui): library chips on the model and backend pages The model and backend pages manage their own library sources. Filter chips above the list narrow it to one library, and a panel adds, edits, turns on or off, refreshes and removes sources of that kind. The add-on Libraries tab lists add-on sources only. Settings shows the model and backend galleries as a read-only view of the library sources, with their mirrors. Mirrors are edited in the panel. Assisted-by: Claude:claude-haiku-5-5 [Claude Code] Signed-off-by: Ettore Di Giacinto * feat(ui): show the library chips when a kind has one library The chips were hidden until a page had two libraries, so a single library had no visible filter. The row now shows whenever a page has a library. Assisted-by: Claude:claude-haiku-5-5 [Claude Code] Signed-off-by: Ettore Di Giacinto * docs(gallery): state the mirror rule and the cutover for the old index The library no longer has no mirrors: a source can list them, so the note now says that the shipped official-models library has none. The mirror section says that clearing a source's mirrors waits for a restart. The cutover section says the old gallery file is removed in the cutover release. Assisted-by: Claude:claude-haiku-5-5 [Claude Code] Signed-off-by: Ettore Di Giacinto * fix(gosec): tighten the modes the catalog generators write The generators wrote generated files and sample folders with 0644 and 0755. The generated index copies are tracked by git, which keeps only the executable bit, so the tracked files do not change. Local copies get 0600 and 0750. The library path read in mergeLibrary is the operator's own argument, so that read is annotated. Assisted-by: Claude:claude-haiku-5-5 [Claude Code] Signed-off-by: Ettore Di Giacinto --------- Signed-off-by: Ettore Di Giacinto Co-authored-by: Ettore Di Giacinto --- .agents/adding-backends.md | 32 +- .agents/adding-gallery-models.md | 6 +- .agents/localai-assistant-mcp.md | 6 + .github/workflows/backend-library.yml | 85 + .github/workflows/model-library.yml | 69 + .github/workflows/release.yaml | 12 + .goreleaser.yaml | 6 + AGENTS.md | 2 +- Makefile | 13 + backend/index.yaml | 31043 ++++- core/application/application.go | 39 +- core/application/library_sources.go | 77 + core/application/library_sources_test.go | 74 + core/application/startup.go | 8 + core/application/upgrade_checker.go | 45 + .../upgrade_checker_library_test.go | 44 + core/cli/cli.go | 1 + core/cli/library.go | 168 + core/cli/library_test.go | 166 + core/cli/run.go | 12 + core/cli/run_addons_test.go | 2 + core/config/application_config.go | 19 + core/config/application_config_test.go | 26 + core/config/gallery.go | 7 +- core/config/runtime_settings.go | 1 + core/config/runtime_settings_registry.go | 4 + core/gallery/backend_index_source.go | 59 + core/gallery/backend_library.go | 404 + .../gallery/backend_library_generated_test.go | 165 + core/gallery/backend_library_test.go | 548 + core/gallery/backend_types.go | 17 + core/gallery/backends.go | 11 + core/gallery/gallery.go | 21 + core/gallery/model_index_source.go | 88 + core/gallery/model_library.go | 515 + core/gallery/model_library_digest.go | 28 + core/gallery/model_library_test.go | 549 + core/gallery/models.go | 4 +- .../testdata/backend_library/digests.tsv | 1090 + .../backend_library/gallery-before.yaml | 7488 ++ .../gallery/testdata/backend_library/pins.tsv | 1088 + .../samples/development.gallery.yaml | 32 + .../samples/development.library.yaml | 40 + .../samples/meta-development.gallery.yaml | 37 + .../samples/meta-development.library.yaml | 42 + .../backend_library/samples/meta.gallery.yaml | 30 + .../backend_library/samples/meta.library.yaml | 35 + .../samples/multi-platform.gallery.yaml | 32 + .../samples/multi-platform.library.yaml | 80 + .../multiline-description.gallery.yaml | 28 + .../multiline-description.library.yaml | 33 + .../samples/no-description.gallery.yaml | 7 + .../samples/no-description.library.yaml | 12 + .../samples/no-icon.gallery.yaml | 32 + .../samples/no-icon.library.yaml | 40 + .../samples/no-mirrors.gallery.yaml | 28 + .../samples/no-mirrors.library.yaml | 36 + .../samples/release.gallery.yaml | 23 + .../samples/release.library.yaml | 31 + .../testdata/model_library/digests.tsv | 2214 + .../samples/backend.gallery.yaml | 44 + .../samples/backend.library.yaml | 52 + .../samples/config-file.gallery.yaml | 31 + .../samples/config-file.library.yaml | 39 + .../samples/empty-variants.gallery.yaml | 56 + .../samples/empty-variants.library.yaml | 64 + .../samples/float-override.gallery.yaml | 48 + .../samples/float-override.library.yaml | 56 + .../multiline-description.gallery.yaml | 38 + .../multiline-description.library.yaml | 46 + .../samples/no-files.gallery.yaml | 34 + .../samples/no-files.library.yaml | 42 + .../model_library/samples/no-url.gallery.yaml | 28 + .../model_library/samples/no-url.library.yaml | 36 + .../model_library/samples/plain.gallery.yaml | 38 + .../model_library/samples/plain.library.yaml | 46 + .../model_library/samples/size.gallery.yaml | 21 + .../model_library/samples/size.library.yaml | 29 + .../samples/variants.gallery.yaml | 40 + .../samples/variants.library.yaml | 48 + core/http/endpoints/addons/catalogui_test.go | 17 + core/http/endpoints/addons/gateway.go | 2 +- .../endpoints/localai/api_instructions.go | 1 + .../localai/api_instructions_test.go | 3 +- .../http/endpoints/localai/backend_library.go | 190 + .../endpoints/localai/backend_library_test.go | 193 + .../http/endpoints/localai/library_sources.go | 277 + .../endpoints/localai/library_sources_test.go | 258 + core/http/endpoints/localai/settings.go | 6 + .../e2e/addons-backend-library.spec.js | 228 + core/http/react-ui/e2e/addons-fixtures.js | 33 +- core/http/react-ui/e2e/addons-gallery.spec.js | 6 +- .../http/react-ui/e2e/library-sources.spec.js | 196 + core/http/react-ui/e2e/settings-fixtures.js | 2 +- core/http/react-ui/e2e/settings-page.spec.js | 16 +- core/http/react-ui/playwright.config.js | 5 +- .../react-ui/playwright.library.config.js | 22 + .../react-ui/public/locales/de/addons.json | 64 +- .../react-ui/public/locales/en/addons.json | 101 +- .../react-ui/public/locales/en/models.json | 1 + .../react-ui/public/locales/en/operate.json | 11 +- .../react-ui/public/locales/es/addons.json | 64 +- .../react-ui/public/locales/id/addons.json | 64 +- .../react-ui/public/locales/it/addons.json | 64 +- .../react-ui/public/locales/ko/addons.json | 64 +- .../react-ui/public/locales/pt-BR/addons.json | 64 +- .../react-ui/public/locales/zh-CN/addons.json | 64 +- .../src/components/addons/AddonBits.jsx | 23 + .../src/components/addons/BrowseView.jsx | 62 +- .../src/components/addons/LibrariesView.jsx | 2 +- .../react-ui/src/components/addons/addons.css | 13 + .../src/components/addons/installSteps.js | 27 + .../src/components/catalog/CatalogView.jsx | 4 +- .../src/components/catalog/KindLibraries.jsx | 68 + .../src/components/catalog/SourcesView.jsx | 172 +- .../src/components/catalog/catalogState.js | 114 +- .../src/components/operate/BackendsTable.jsx | 10 +- .../settings/LibrarySourcesField.jsx | 48 + .../src/components/settings/SettingField.jsx | 4 + core/http/react-ui/src/pages/Backends.jsx | 86 +- core/http/react-ui/src/pages/Models.jsx | 10 +- core/http/react-ui/src/pages/operate.css | 2 + core/http/react-ui/src/utils/addonsApi.js | 99 +- core/http/react-ui/src/utils/backendRows.js | 21 +- .../http/react-ui/src/utils/settingsSchema.js | 12 +- core/http/react-ui/tests/unit/addons.test.mjs | 121 +- .../react-ui/tests/unit/libsources.test.mjs | 140 + core/http/routes/localai.go | 18 + core/library/cutover_test.go | 107 + core/library/info.go | 81 + core/library/info_test.go | 172 + core/library/library.go | 212 + core/library/library_test.go | 599 + core/library/startup.go | 191 + core/services/addons/backendlib/install.go | 240 + .../addons/backendlib/install_fields_test.go | 158 + .../addons/backendlib/install_test.go | 310 + core/services/addons/backendlib/updates.go | 113 + core/services/addons/catalog/backend_entry.go | 164 + .../addons/catalog/backend_entry_test.go | 311 + core/services/addons/catalog/catalog.go | 139 +- core/services/addons/catalog/catalog_test.go | 11 +- core/services/addons/catalog/conflict.go | 100 + core/services/addons/catalog/conflict_test.go | 159 + core/services/addons/catalog/envelope.go | 39 + core/services/addons/catalog/index.go | 75 +- .../addons/catalog/index_yaml_test.go | 6 +- core/services/addons/catalog/kind.go | 108 + core/services/addons/catalog/kind_test.go | 202 + core/services/addons/catalog/official.go | 45 + .../addons/catalog/official_switch_test.go | 93 + core/services/addons/catalog/official_test.go | 6 +- core/services/addons/catalog/sources.go | 344 +- core/services/addons/catalog/sources_test.go | 9 +- core/services/addons/catalog/store.go | 235 + core/services/addons/catalog/store_test.go | 105 + core/services/addons/gateway/carrier.go | 2 +- core/services/addons/gateway/management.go | 11 +- core/services/addons/packages/install.go | 9 +- core/services/addons/packages/install_test.go | 13 + .../addons/runtime_integration_test.go | 3 + docs/content/features/addons.md | 299 +- docs/content/features/backends.md | 39 +- docs/content/features/model-gallery.md | 39 +- docs/content/features/runtime-settings.md | 4 +- docs/content/reference/cli-reference.md | 16 + docs/content/reference/compatibility-table.md | 2 +- gallery/backends/index.yaml | 43109 +++++++ gallery/index.yaml | 49692 ++++---- gallery/models/index.yaml | 94743 ++++++++++++++++ pkg/downloader/uri.go | 67 + pkg/mcp/localaitools/client.go | 3 + pkg/mcp/localaitools/coverage_test.go | 45 +- pkg/mcp/localaitools/dto.go | 15 + pkg/mcp/localaitools/fakes_test.go | 87 +- pkg/mcp/localaitools/httpapi/client.go | 13 + pkg/mcp/localaitools/httpapi/client_test.go | 19 + pkg/mcp/localaitools/httpapi/routes.go | 49 +- pkg/mcp/localaitools/inproc/client.go | 25 + pkg/mcp/localaitools/prompts/10_safety.md | 2 +- pkg/mcp/localaitools/prompts/20_tools.md | 1 + .../prompts/skills/install_library_backend.md | 7 + pkg/mcp/localaitools/server_test.go | 4 + pkg/mcp/localaitools/tools.go | 42 +- pkg/mcp/localaitools/tools_backends.go | 14 + scripts/backends/cmd/backendcatalog/main.go | 662 + .../backends/cmd/backendcatalog/main_test.go | 439 + .../cmd/backendcatalog/workflow_test.go | 76 + scripts/models/cmd/modelcatalog/main.go | 343 + scripts/models/cmd/modelcatalog/main_test.go | 170 + swagger/docs.go | 365 +- swagger/swagger.json | 365 +- swagger/swagger.yaml | 286 +- tests/e2e-ui/main.go | 12 + 194 files changed, 216969 insertions(+), 29219 deletions(-) create mode 100644 .github/workflows/backend-library.yml create mode 100644 .github/workflows/model-library.yml create mode 100644 core/application/library_sources.go create mode 100644 core/application/library_sources_test.go create mode 100644 core/application/upgrade_checker_library_test.go create mode 100644 core/cli/library.go create mode 100644 core/cli/library_test.go create mode 100644 core/gallery/backend_index_source.go create mode 100644 core/gallery/backend_library.go create mode 100644 core/gallery/backend_library_generated_test.go create mode 100644 core/gallery/backend_library_test.go create mode 100644 core/gallery/model_index_source.go create mode 100644 core/gallery/model_library.go create mode 100644 core/gallery/model_library_digest.go create mode 100644 core/gallery/model_library_test.go create mode 100644 core/gallery/testdata/backend_library/digests.tsv create mode 100644 core/gallery/testdata/backend_library/gallery-before.yaml create mode 100644 core/gallery/testdata/backend_library/pins.tsv create mode 100644 core/gallery/testdata/backend_library/samples/development.gallery.yaml create mode 100644 core/gallery/testdata/backend_library/samples/development.library.yaml create mode 100644 core/gallery/testdata/backend_library/samples/meta-development.gallery.yaml create mode 100644 core/gallery/testdata/backend_library/samples/meta-development.library.yaml create mode 100644 core/gallery/testdata/backend_library/samples/meta.gallery.yaml create mode 100644 core/gallery/testdata/backend_library/samples/meta.library.yaml create mode 100644 core/gallery/testdata/backend_library/samples/multi-platform.gallery.yaml create mode 100644 core/gallery/testdata/backend_library/samples/multi-platform.library.yaml create mode 100644 core/gallery/testdata/backend_library/samples/multiline-description.gallery.yaml create mode 100644 core/gallery/testdata/backend_library/samples/multiline-description.library.yaml create mode 100644 core/gallery/testdata/backend_library/samples/no-description.gallery.yaml create mode 100644 core/gallery/testdata/backend_library/samples/no-description.library.yaml create mode 100644 core/gallery/testdata/backend_library/samples/no-icon.gallery.yaml create mode 100644 core/gallery/testdata/backend_library/samples/no-icon.library.yaml create mode 100644 core/gallery/testdata/backend_library/samples/no-mirrors.gallery.yaml create mode 100644 core/gallery/testdata/backend_library/samples/no-mirrors.library.yaml create mode 100644 core/gallery/testdata/backend_library/samples/release.gallery.yaml create mode 100644 core/gallery/testdata/backend_library/samples/release.library.yaml create mode 100644 core/gallery/testdata/model_library/digests.tsv create mode 100644 core/gallery/testdata/model_library/samples/backend.gallery.yaml create mode 100644 core/gallery/testdata/model_library/samples/backend.library.yaml create mode 100644 core/gallery/testdata/model_library/samples/config-file.gallery.yaml create mode 100644 core/gallery/testdata/model_library/samples/config-file.library.yaml create mode 100644 core/gallery/testdata/model_library/samples/empty-variants.gallery.yaml create mode 100644 core/gallery/testdata/model_library/samples/empty-variants.library.yaml create mode 100644 core/gallery/testdata/model_library/samples/float-override.gallery.yaml create mode 100644 core/gallery/testdata/model_library/samples/float-override.library.yaml create mode 100644 core/gallery/testdata/model_library/samples/multiline-description.gallery.yaml create mode 100644 core/gallery/testdata/model_library/samples/multiline-description.library.yaml create mode 100644 core/gallery/testdata/model_library/samples/no-files.gallery.yaml create mode 100644 core/gallery/testdata/model_library/samples/no-files.library.yaml create mode 100644 core/gallery/testdata/model_library/samples/no-url.gallery.yaml create mode 100644 core/gallery/testdata/model_library/samples/no-url.library.yaml create mode 100644 core/gallery/testdata/model_library/samples/plain.gallery.yaml create mode 100644 core/gallery/testdata/model_library/samples/plain.library.yaml create mode 100644 core/gallery/testdata/model_library/samples/size.gallery.yaml create mode 100644 core/gallery/testdata/model_library/samples/size.library.yaml create mode 100644 core/gallery/testdata/model_library/samples/variants.gallery.yaml create mode 100644 core/gallery/testdata/model_library/samples/variants.library.yaml create mode 100644 core/http/endpoints/localai/backend_library.go create mode 100644 core/http/endpoints/localai/backend_library_test.go create mode 100644 core/http/endpoints/localai/library_sources.go create mode 100644 core/http/endpoints/localai/library_sources_test.go create mode 100644 core/http/react-ui/e2e/addons-backend-library.spec.js create mode 100644 core/http/react-ui/e2e/library-sources.spec.js create mode 100644 core/http/react-ui/playwright.library.config.js create mode 100644 core/http/react-ui/src/components/addons/installSteps.js create mode 100644 core/http/react-ui/src/components/catalog/KindLibraries.jsx create mode 100644 core/http/react-ui/src/components/settings/LibrarySourcesField.jsx create mode 100644 core/http/react-ui/tests/unit/libsources.test.mjs create mode 100644 core/library/cutover_test.go create mode 100644 core/library/info.go create mode 100644 core/library/info_test.go create mode 100644 core/library/library.go create mode 100644 core/library/library_test.go create mode 100644 core/library/startup.go create mode 100644 core/services/addons/backendlib/install.go create mode 100644 core/services/addons/backendlib/install_fields_test.go create mode 100644 core/services/addons/backendlib/install_test.go create mode 100644 core/services/addons/backendlib/updates.go create mode 100644 core/services/addons/catalog/backend_entry.go create mode 100644 core/services/addons/catalog/backend_entry_test.go create mode 100644 core/services/addons/catalog/conflict.go create mode 100644 core/services/addons/catalog/conflict_test.go create mode 100644 core/services/addons/catalog/envelope.go create mode 100644 core/services/addons/catalog/kind.go create mode 100644 core/services/addons/catalog/kind_test.go create mode 100644 core/services/addons/catalog/official_switch_test.go create mode 100644 core/services/addons/catalog/store.go create mode 100644 core/services/addons/catalog/store_test.go create mode 100644 gallery/backends/index.yaml create mode 100644 gallery/models/index.yaml create mode 100644 pkg/mcp/localaitools/prompts/skills/install_library_backend.md create mode 100644 scripts/backends/cmd/backendcatalog/main.go create mode 100644 scripts/backends/cmd/backendcatalog/main_test.go create mode 100644 scripts/backends/cmd/backendcatalog/workflow_test.go create mode 100644 scripts/models/cmd/modelcatalog/main.go create mode 100644 scripts/models/cmd/modelcatalog/main_test.go diff --git a/.agents/adding-backends.md b/.agents/adding-backends.md index a7880a17b..2a4343d98 100644 --- a/.agents/adding-backends.md +++ b/.agents/adding-backends.md @@ -32,7 +32,7 @@ For Rust backends, you'll typically need (see `backend/rust/kokoros/` as a refer The build matrix is data-only YAML at `.github/backend-matrix.yml` (not inside `backend.yml` itself). `backend.yml` (master push) and `backend_pr.yml` (PR) load it via `scripts/changed-backends.js`, which also handles per-file path filtering so only touched backends rebuild on PRs and master pushes alike. Add build matrix entries to `.github/backend-matrix.yml` for each platform/GPU type you want to support. Look at similar backends for reference — `chatterbox`/`faster-whisper` for Python, `piper`/`silero-vad` for Go, `kokoros` for Rust. -**Without an entry here no image is ever built or pushed, and the gallery entry in `backend/index.yaml` will point at a tag that does not exist.** The `dockerfile:` field must point at `./backend/Dockerfile.` matching the language bucket from step 1 (e.g. `Dockerfile.python`, `Dockerfile.golang`, `Dockerfile.rust`). The `tag-suffix` must match the `uri:` in the corresponding `backend/index.yaml` image entry exactly. +**Without an entry here no image is ever built or pushed, and the library entry in `gallery/backends/index.yaml` will point at a tag that does not exist.** The `dockerfile:` field must point at `./backend/Dockerfile.` matching the language bucket from step 1 (e.g. `Dockerfile.python`, `Dockerfile.golang`, `Dockerfile.rust`). The `tag-suffix` must match the `uri:` of the entry you give to `backendcatalog --add` (step 3) exactly. **Path-filter registration — REQUIRED for any new dockerfile suffix.** This is the single most common omission, because it has no effect on the PR that adds the backend (when no prior path filter could catch it anyway) — it only breaks the *next* PR that touches your backend's directory, which then gets zero CI jobs and looks broken for unrelated reasons. Edit `scripts/lib/backend-filter.mjs:inferBackendPath` and add a branch BEFORE the more-generic suffixes: @@ -116,21 +116,32 @@ Entries whose `dockerfile` is `./backend/Dockerfile.{llama-cpp,ik-llama-cpp,turb Wiring a backend into `includeDarwin:` is more than the matrix entry: 1. **`includeDarwin:` entry** — `tag-suffix: "-metal-darwin-arm64-"`, `build-type: "metal"`, `lang: "go"` for go+ggml backends; omit `build-type` for the bespoke C++ ones (llama-cpp / ds4 / privacy-filter). Match an existing entry of the same shape. -2. **`backend/index.yaml`** — add `metal:` to the backend's `capabilities` map (main and `-development`) and concrete `metal-` / `metal--development` image entries pointing at the `-metal-darwin-arm64-` images. +2. **The backend library** (step 3) — add `metal:` to the backend's `capabilities` map (main and `-development`) and concrete `metal-` / `metal--development` image entries pointing at the `-metal-darwin-arm64-` images. 3. **C/C++ backends only** — add an `inferBackendPathDarwin` case in `scripts/lib/backend-filter.mjs` returning `backend/cpp//` (the generic fallthrough assumes `backend//`, which is wrong for a C++ source tree driven with `lang: go`), and give `run.sh` a Darwin branch that exports `DYLD_LIBRARY_PATH` instead of `LD_LIBRARY_PATH`. If the build is bespoke (single `grpc-server` + dylib bundling), model it on `scripts/build/ds4-darwin.sh` and add a `backends/-darwin` make target plus a gated step in `.github/workflows/backend_build_darwin.yml`. 4. **C++ proto gotcha** — if the backend compiles the generated gRPC/protobuf in a separate CMake target (e.g. `hw_grpc_proto`), that target must link `protobuf::libprotobuf` + `gRPC::grpc++` so the Homebrew include dirs propagate; otherwise macOS fails with `google/protobuf/runtime_version.h not found` (Linux hides this because apt headers sit in `/usr/include`). The CI path filter only builds a backend on a PR when a file under its directory changes, so a darwin-only YAML edit builds nothing — touch a file under `backend///` (a one-line comment is enough) in the same PR. -## 3. Add Backend Metadata to `backend/index.yaml` +## 3. Add Backend Metadata to the Backend Library -**Step 3a: Add Meta Definition** +`gallery/backends/index.yaml` is the **backend library** and the source of truth for the backends. `backend/index.yaml` is the backend gallery: a **generated copy** that stays only so releases before the library cutover keep working. **Never edit `backend/index.yaml`**; CI (`.github/workflows/backend-library.yml`) fails when it differs from the generated copy. -Add a YAML anchor definition in the `## metas` section (around line 2-300). Look for similar backends to use as a template such as `diffusers` or `chatterbox` +You do not write library entries by hand. A library entry is one backend image for one platform, pinned by a digest, so a backend with ten variants has dozens of them. Write the backend the way the gallery shaped it, in a scratch file, and let `scripts/backends/cmd/backendcatalog` convert it. Put the scratch file under `assets/work/` or the system temp directory, not in the repository. -**Step 3b: Add Image Entries** +**Step 3a: Write the entries in gallery shape** -Add image entries at the end of the file, following the pattern of similar backends such as `diffusers` or `chatterbox`. Include both `latest` (production) and `master` (development) tags. +Use a YAML anchor for the meta definition and `<<: *anchor` for the image entries, as in the old `backend/index.yaml` (a similar backend such as `diffusers` or `chatterbox` is in `core/gallery/testdata/backend_library/gallery-before.yaml`, which keeps the whole gallery as it was before the library). A meta backend has `capabilities` and no `uri`. An image entry has `uri` (no `oci://` prefix), `mirrors` and, if you keep them, the same `capabilities`. Include both `latest-` (production) and `master-` (development) tags, and name the development entries `-development`. + +**Step 3b: Merge them into the library** + +```bash +go run ./scripts/backends/cmd/backendcatalog --add my-backend.yaml --library gallery/backends/index.yaml +go run ./scripts/backends/cmd/backendcatalog --library gallery/backends/index.yaml --out backend/index.yaml +``` + +The first command converts the entries, pins every `latest-` image that is already in the registry to the digest of each platform, and merges the result into the library. Entries of other backends are not touched. An image that is not published yet (the usual case for a new backend, because CI builds it after the merge) is written unpinned and `mutable: true`: it installs by its tag, and a maintainer pins it with `--repin` once the image exists. A `master-` image is always `mutable`; the install pins it. The second command regenerates `backend/index.yaml`. Commit both files. + +To change a backend that is already there, put its new entries in the scratch file and run `--add` again: the entries of that backend are replaced where they stand. To pin every `latest-` image again after a release, run `go run ./scripts/backends/cmd/backendcatalog --library gallery/backends/index.yaml --repin`; this is the only mode that reads the registry, and a digest is never edited by hand. **Note on integrity:** OCI backends installed from a gallery whose `verification:` block is set are verified against a keyless-cosign policy before extraction; tarball/HTTP backends use the optional `sha256:` field. New backends do not need any extra YAML — the gallery-level `verification:` block covers every entry. See [.agents/backend-signing.md](backend-signing.md) for the producer-side CI step. @@ -308,10 +319,9 @@ After adding a new backend, verify: - [ ] Backend directory structure is complete with all necessary files - [ ] Build configurations added to `.github/backend-matrix.yml` for all desired platforms (per-arch entries with `platform-tag` for multi-arch; `builder-base-image` for llama-cpp / ik-llama-cpp / turboquant) -- [ ] **OS coverage considered**: added to `includeDarwin:` (macOS/Apple Silicon) if the backend can build there — with the `backend/index.yaml` `metal:` capability + `metal-` image entries, a `run.sh` Darwin/DYLD branch and `inferBackendPathDarwin` case (in `scripts/lib/backend-filter.mjs`) for C++ backends — or the PR explains why an OS is unsupported. Do not ship Linux-only by default. -- [ ] Meta definition added to `backend/index.yaml` in the `## metas` section -- [ ] Image entries added to `backend/index.yaml` for all build variants (latest + development) -- [ ] Tag suffixes match between workflow file and index.yaml +- [ ] **OS coverage considered**: added to `includeDarwin:` (macOS/Apple Silicon) if the backend can build there — with the `metal:` capability in the backend library + `metal-` image entries, a `run.sh` Darwin/DYLD branch and `inferBackendPathDarwin` case (in `scripts/lib/backend-filter.mjs`) for C++ backends — or the PR explains why an OS is unsupported. Do not ship Linux-only by default. +- [ ] Meta definition and image entries added to the backend library with `backendcatalog --add`, for all build variants (latest + development), and `backend/index.yaml` regenerated (never edited by hand) +- [ ] Tag suffixes match between the workflow file and the library entries - [ ] Makefile updated with all 6 required changes (`.NOTPARALLEL`, `prepare-test-extra`, `test-extra`, backend definition, docker-build target eval, `docker-build-backends`) - [ ] No YAML syntax errors (check with linter) - [ ] No Makefile syntax errors (check with linter) diff --git a/.agents/adding-gallery-models.md b/.agents/adding-gallery-models.md index 51221608f..a8350ae8b 100644 --- a/.agents/adding-gallery-models.md +++ b/.agents/adding-gallery-models.md @@ -4,7 +4,9 @@ When adding a GGUF model from HuggingFace to the LocalAI model gallery, follow t ## Gallery file -All models are defined in `gallery/index.yaml`. Find the appropriate section (embedding models near other embeddings, chat models near similar chat models) and add a new entry. +The source of the models is the library file, `gallery/models/index.yaml`. Edit it there, in the library entry shape (header plus a `model:` body; see `docs/content/features/model-gallery.md`). `gallery/index.yaml` is a generated copy for releases before the cutover and is never edited by hand: after an edit run `go run ./scripts/models/cmd/modelcatalog --library gallery/models/index.yaml --out gallery/index.yaml` and commit both files. CI fails when the copy differs. The examples below use the gallery field names (`files`, `overrides`, `config_file`); in the library they sit under `model:`, with `config_file` written as `configFile`. + +Find the appropriate section (embedding models near other embeddings, chat models near similar chat models) and add a new entry. ## Getting the SHA256 @@ -207,7 +209,7 @@ Look at existing `.yaml` files in `gallery/` to find the right prompt template f 1. **Find the GGUF file** on HuggingFace — note exact filename (case-sensitive) 2. **Get the SHA256** using the `curl -sI` + `x-linked-etag` method above 3. **Choose the right template** config from `gallery/` based on model architecture -4. **Add the entry** to `gallery/index.yaml` near similar models +4. **Add the entry** to `gallery/models/index.yaml` near similar models, then regenerate `gallery/index.yaml` 5. **Set `embeddings: true`** if it's an embedding model 6. **Include both URLs** — the original model page and the GGUF repo 7. **Write a description** — mention model size, capabilities, and quantization type diff --git a/.agents/localai-assistant-mcp.md b/.agents/localai-assistant-mcp.md index deeb02837..dcf5650bf 100644 --- a/.agents/localai-assistant-mcp.md +++ b/.agents/localai-assistant-mcp.md @@ -116,6 +116,12 @@ example Tables) follow a different, code-enforced rule, documented in `tools.Consumers` (`core/services/addons/tools/consumers.go`) as route or reject. The matrix test scans the sources and fails for an unclassified file. +One backend route sits outside the add-on surface: `POST /backends/library/install` +installs a backend (not an add-on) from a library entry. It is exposed as the +`install_library_backend` tool and is a plain admin mutation under safety +rule 1. Listing library entries stays on `/api/addons` and has no assistant +tool, for the reason above. + Do not rewrite the unrelated assistant tools to match this rule. ## Distributed mode diff --git a/.github/workflows/backend-library.yml b/.github/workflows/backend-library.yml new file mode 100644 index 000000000..3c1df520a --- /dev/null +++ b/.github/workflows/backend-library.yml @@ -0,0 +1,85 @@ +name: 'backend library' + +# gallery/backends/index.yaml is the backend library and the source of the +# backends: edits go there. backend/index.yaml is a generated copy of it, kept +# only so releases before the cutover keep working; +# scripts/backends/cmd/backendcatalog writes it and it is never edited by hand. +# This workflow fails when the library does not decode, an entry does not have +# the library shape or does not round trip, the gallery reader does not load +# the generated gallery, or backend/index.yaml differs from the generated copy. +# It never reads the image registry: digests are pinned by hand-run +# backendcatalog --repin, not by CI. + +on: + pull_request: + paths: + - 'backend/index.yaml' + - 'gallery/backends/**' + - 'scripts/backends/**' + - 'core/gallery/**' + - 'core/library/**' + - 'core/services/addons/catalog/**' + - 'core/services/addons/backendlib/**' + - '.github/workflows/backend-library.yml' + push: + branches: [master] + paths: + - 'backend/index.yaml' + - 'gallery/backends/**' + - 'scripts/backends/**' + - 'core/gallery/**' + - 'core/library/**' + - 'core/services/addons/catalog/**' + - 'core/services/addons/backendlib/**' + - '.github/workflows/backend-library.yml' + +permissions: + contents: read + +concurrency: + group: backend-library-${{ github.event.pull_request.number || github.sha }} + cancel-in-progress: ${{ github.event_name == 'pull_request' }} + +jobs: + backend-library: + name: 'Check the backend library' + runs-on: ubuntu-latest + steps: + - uses: actions/checkout@v7 + with: + persist-credentials: false + - uses: actions/setup-go@v6 + with: + go-version-file: go.mod + - name: Generate the gRPC stubs the Go packages import + # The stubs are not in the tree. Same pinned tools as the test workflow. + run: | + curl -L -s https://github.com/protocolbuffers/protobuf/releases/download/v26.1/protoc-26.1-linux-x86_64.zip -o protoc.zip + sudo unzip -j -d /usr/local/bin protoc.zip bin/protoc + rm protoc.zip + go install google.golang.org/protobuf/cmd/protoc-gen-go@v1.34.2 + go install google.golang.org/grpc/cmd/protoc-gen-go-grpc@1958fcbe2ca8bd93af633f11e97d44e567e945af + PATH="$PATH:$HOME/go/bin" make protogen-go + - name: Test the library, the generator and the gallery copy + # The library decodes and every entry has the library shape and passes + # the checks a host applies. The generator is deterministic. Every real + # gallery entry round trips through the library and back, a meta + # backend names backends the library has, and the gallery reader loads + # the generated gallery and sees the same backends as the library. + run: | + go test ./scripts/backends/... + go test ./core/services/addons/catalog/... ./core/services/addons/backendlib/... + go test ./core/gallery -run 'TestBackendLibrary|TestRealBackendLibrary|TestCheckedInBackendGalleryIsTheGeneratedCopy|TestLibraryGalleryReadsTheBackendLibrary|TestBackendRoundTrip|TestBackendsFromLibrary|TestToGalleryBackend|TestEncodeBackendGallery' -v + - name: Check that the gallery copy is the generated copy of the library + run: | + go run ./scripts/backends/cmd/backendcatalog --library gallery/backends/index.yaml --out backend/index.yaml + if ! git diff --exit-code -- backend/index.yaml; then + echo "::error file=backend/index.yaml::backend/index.yaml is generated from gallery/backends/index.yaml and must not be edited by hand. Edit the library file, then regenerate: go run ./scripts/backends/cmd/backendcatalog --library gallery/backends/index.yaml --out backend/index.yaml" + exit 1 + fi + - name: Report the release entries that are not pinned + # A release image the registry had no image for when the library was + # rendered is marked mutable and has no digest. It installs, but it is + # not pinned. List them so a release does not ship them unnoticed. + run: | + go test ./core/gallery -run TestRealBackendLibraryHasTheLibraryShape -v | grep -E 'not pinned' | sed 's/^ *//; s/^/::warning::/' || true diff --git a/.github/workflows/model-library.yml b/.github/workflows/model-library.yml new file mode 100644 index 000000000..753083fe2 --- /dev/null +++ b/.github/workflows/model-library.yml @@ -0,0 +1,69 @@ +name: 'model library' + +# gallery/models/index.yaml is the model library and the source of the models: +# edits go there. gallery/index.yaml is a generated copy of it, kept only so +# releases before the cutover keep working; scripts/models/cmd/modelcatalog +# writes it and it is never edited by hand. This workflow fails when the +# library does not decode, an entry does not have the library shape or does +# not round trip, the gallery reader does not load the generated gallery, or +# gallery/index.yaml differs from the generated copy. + +on: + pull_request: + paths: + - 'gallery/index.yaml' + - 'gallery/models/**' + - 'scripts/models/**' + - 'core/gallery/**' + - '.github/workflows/model-library.yml' + push: + branches: [master] + paths: + - 'gallery/index.yaml' + - 'gallery/models/**' + - 'scripts/models/**' + - 'core/gallery/**' + - '.github/workflows/model-library.yml' + +permissions: + contents: read + +concurrency: + group: model-library-${{ github.event.pull_request.number || github.sha }} + cancel-in-progress: ${{ github.event_name == 'pull_request' }} + +jobs: + model-library: + name: 'Check the model library' + runs-on: ubuntu-latest + steps: + - uses: actions/checkout@v7 + with: + persist-credentials: false + - uses: actions/setup-go@v6 + with: + go-version-file: go.mod + - name: Generate the gRPC stubs the Go packages import + # The stubs are not in the tree. Same pinned tools as the test workflow. + run: | + curl -L -s https://github.com/protocolbuffers/protobuf/releases/download/v26.1/protoc-26.1-linux-x86_64.zip -o protoc.zip + sudo unzip -j -d /usr/local/bin protoc.zip bin/protoc + rm protoc.zip + go install google.golang.org/protobuf/cmd/protoc-gen-go@v1.34.2 + go install google.golang.org/grpc/cmd/protoc-gen-go-grpc@1958fcbe2ca8bd93af633f11e97d44e567e945af + PATH="$PATH:$HOME/go/bin" make protogen-go + - name: Test the library, the generator and the gallery copy + # The library decodes and every entry has the library shape. The + # generator is deterministic. Every real entry round trips through the + # generator to a gallery entry and back, and the gallery reader loads + # the generated gallery and sees the same names, uris and digests. + run: | + go test ./scripts/models/... + go test ./core/gallery -run 'TestModelLibrary|TestRealModelLibraryHasTheLibraryShape|TestGeneratedGalleryLoadsWithTheSameEntries|TestCheckedInGalleryIsTheGeneratedCopy|TestDecodeModelIndex' + - name: Check that the gallery copy is the generated copy of the library + run: | + go run ./scripts/models/cmd/modelcatalog --library gallery/models/index.yaml --out gallery/index.yaml + if ! git diff --exit-code -- gallery/index.yaml; then + echo "::error file=gallery/index.yaml::gallery/index.yaml is generated from gallery/models/index.yaml and must not be edited by hand. Edit the library file, then regenerate: go run ./scripts/models/cmd/modelcatalog --library gallery/models/index.yaml --out gallery/index.yaml" + exit 1 + fi diff --git a/.github/workflows/release.yaml b/.github/workflows/release.yaml index a7d0517f9..2a9dd59d0 100644 --- a/.github/workflows/release.yaml +++ b/.github/workflows/release.yaml @@ -17,6 +17,18 @@ jobs: uses: actions/setup-go@v5 with: go-version-file: go.mod + # The cutover. A tagged build reads the model gallery (localai) by default + # until this step runs; from here the tagged build reads the model library + # (official-models, gallery/models/index.yaml) and not the gallery. + # .goreleaser.yaml passes the value to the binary with -ldflags. + - name: Cut the default model source over to the library + run: echo "LOCALAI_MODEL_SOURCE=library" >> "$GITHUB_ENV" + # The same cutover for the backends: until this step runs, a tagged build + # reads the backend gallery (localai-backends, backend/index.yaml, which + # is generated from the backend library). From here it reads the backend + # library (official-backends, gallery/backends/index.yaml). + - name: Cut the default backend source over to the library + run: echo "LOCALAI_BACKEND_SOURCE=library" >> "$GITHUB_ENV" - name: Run GoReleaser uses: goreleaser/goreleaser-action@v7 with: diff --git a/.goreleaser.yaml b/.goreleaser.yaml index 88d6e9ecd..4300f4db8 100644 --- a/.goreleaser.yaml +++ b/.goreleaser.yaml @@ -17,6 +17,12 @@ builds: - -s -w - -X "github.com/mudler/LocalAI/internal.Version={{ .Tag }}" - -X "github.com/mudler/LocalAI/internal.Commit={{ .FullCommit }}" + # A tagged build reads the gallery until the release workflow sets + # LOCALAI_MODEL_SOURCE=library (the cutover step in release.yaml). + - -X "github.com/mudler/LocalAI/core/library.ModelSource={{ envOrDefault "LOCALAI_MODEL_SOURCE" "gallery" }}" + # The same for the backends: a tagged build reads the backend gallery + # until the release workflow sets LOCALAI_BACKEND_SOURCE=library. + - -X "github.com/mudler/LocalAI/core/library.BackendSource={{ envOrDefault "LOCALAI_BACKEND_SOURCE" "gallery" }}" goos: - linux - darwin diff --git a/AGENTS.md b/AGENTS.md index c34df87dd..c566a5af2 100644 --- a/AGENTS.md +++ b/AGENTS.md @@ -48,7 +48,7 @@ LocalAI follows the Linux kernel project's [guidelines for AI coding assistants] - **Admin endpoints → MCP tool**: every admin endpoint that an admin would manage conversationally (install/list/edit/toggle/upgrade) MUST also be exposed as an MCP tool in `pkg/mcp/localaitools/`. The LocalAI Assistant chat modality and the standalone `local-ai mcp-server` consume that package; drift between REST and MCP is a real risk. Read [.agents/localai-assistant-mcp.md](.agents/localai-assistant-mcp.md) — the `TestToolHTTPRouteMappingComplete` test fails until you wire the new tool and update the route map. - **Releases ship with a post and clips**: a release is not done at the tag. It needs labelled PRs, `RELEASE_NOTES_vX.Y.Z.md`, a blog post under `website/content/blog/`, and a short demo clip in `website/static/media/` for each notable feature. See [.agents/preparing-a-release.md](.agents/preparing-a-release.md). - **Build**: Inspect `Makefile` and `.github/workflows/` — ask the user before running long builds -- **Backend OS coverage**: a new backend must target every OS it can build for, not just Linux. `.github/backend-matrix.yml` has two matrices — `include:` (Linux) and `includeDarwin:` (macOS / Apple Silicon). Most C/C++/GGML and many Python backends build on Darwin too — wire the `includeDarwin` entry + `backend/index.yaml` `metal:` entries, or say in the PR why an OS is unsupported. See the darwin checklist in [.agents/adding-backends.md](.agents/adding-backends.md). +- **Backend OS coverage**: a new backend must target every OS it can build for, not just Linux. `.github/backend-matrix.yml` has two matrices — `include:` (Linux) and `includeDarwin:` (macOS / Apple Silicon). Most C/C++/GGML and many Python backends build on Darwin too — wire the `includeDarwin` entry + the `metal:` entries of the backend library (`gallery/backends/index.yaml`, added with `backendcatalog --add`; `backend/index.yaml` is generated, never edited), or say in the PR why an OS is unsupported. See the darwin checklist in [.agents/adding-backends.md](.agents/adding-backends.md). - **Gallery variant ranking**: a gallery entry can declare `variants` (alternative builds of the same weights), and LocalAI ranks the ones a host can run by engine preference first, size second. A new backend that should be preferred on some hardware must be listed in `engineNamePreferenceRules` in `pkg/system/capabilities.go`; the sibling `backendBuildTagPreferenceRules` speaks build tags rather than engine names, and using the wrong table matches nothing without erroring. See [.agents/adding-backends.md](.agents/adding-backends.md). - **UI**: The active UI is the React app in `core/http/react-ui/`. The older Alpine.js/HTML UI in `core/http/static/` is pending deprecation — all new UI work goes in the React UI - **Distributed-aware state**: any feature that keeps runtime state (maps, caches, pins, schedulers, background loops) must choose shared (syncstate), single-runner (advisorylock), stateless, or documented per-instance behaviour for multi-frontend clusters. See [.agents/distributed-state.md](.agents/distributed-state.md). diff --git a/Makefile b/Makefile index 85f47c85f..8739e1dac 100644 --- a/Makefile +++ b/Makefile @@ -45,6 +45,19 @@ LAUNCHER_APP_VERSION?=$(shell v=$$(echo "$(VERSION)" | sed -E 's/^v//; s/[+-].*$ LD_FLAGS?=-s -w override LD_FLAGS += -X "github.com/mudler/LocalAI/internal.Version=$(VERSION)" override LD_FLAGS += -X "github.com/mudler/LocalAI/internal.Commit=$(shell git rev-parse HEAD)" +# The model source the binary reads by default: "library" (the model library) or +# "gallery" (the gallery named localai). A build from master reads the library. +# A build of a commit that carries a tag reads the gallery until the release +# workflow cuts over by setting LOCALAI_MODEL_SOURCE=library (see release.yaml). +LOCALAI_MODEL_SOURCE?=$(shell git describe --exact-match --tags >/dev/null 2>&1 && echo gallery || echo library) +override LD_FLAGS += -X "github.com/mudler/LocalAI/core/library.ModelSource=$(LOCALAI_MODEL_SOURCE)" +# The backend source follows the same rule: "library" (the backend library, +# gallery/backends/index.yaml) or "gallery" (the gallery named localai-backends, +# backend/index.yaml, which is generated from the library). A build from master +# reads the library; a build of a commit that carries a tag reads the gallery +# until the release workflow cuts over with LOCALAI_BACKEND_SOURCE=library. +LOCALAI_BACKEND_SOURCE?=$(shell git describe --exact-match --tags >/dev/null 2>&1 && echo gallery || echo library) +override LD_FLAGS += -X "github.com/mudler/LocalAI/core/library.BackendSource=$(LOCALAI_BACKEND_SOURCE)" OPTIONAL_TARGETS?= diff --git a/backend/index.yaml b/backend/index.yaml index d9e75c73c..1bf606e65 100644 --- a/backend/index.yaml +++ b/backend/index.yaml @@ -1,8 +1,11 @@ ---- -## metas -- &llamacpp - name: "llama-cpp" - alias: "llama-cpp" +# Backend gallery: a GENERATED copy of the backend library, +# gallery/backends/index.yaml. The library is the source of truth; edit it, not +# this file. This file is written by scripts/backends/cmd/backendcatalog and +# stays only so releases before the cutover keep working. CI fails when it +# differs from the generated copy: +# go run ./scripts/backends/cmd/backendcatalog --library gallery/backends/index.yaml --out backend/index.yaml +- name: llama-cpp + alias: llama-cpp license: mit icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png description: | @@ -20,20 +23,19 @@ - CUDA - HIP capabilities: - default: "cpu-llama-cpp" - nvidia: "cuda12-llama-cpp" - intel: "intel-sycl-f16-llama-cpp" - amd: "rocm-llama-cpp" - metal: "metal-llama-cpp" - vulkan: "vulkan-llama-cpp" - nvidia-l4t: "nvidia-l4t-arm64-llama-cpp" - nvidia-cuda-13: "cuda13-llama-cpp" - nvidia-cuda-12: "cuda12-llama-cpp" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-llama-cpp" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-llama-cpp" -- &ikllamacpp - name: "ik-llama-cpp" - alias: "ik-llama-cpp" + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp +- name: ik-llama-cpp + alias: ik-llama-cpp license: mit description: | Fork of llama.cpp optimized for CPU performance by ikawrakow @@ -44,10 +46,9 @@ - LLM - CPU capabilities: - default: "cpu-ik-llama-cpp" -- &turboquant - name: "turboquant" - alias: "turboquant" + default: cpu-ik-llama-cpp +- name: turboquant + alias: turboquant license: mit description: | Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. @@ -64,19 +65,18 @@ - turboquant - kv-cache capabilities: - default: "cpu-turboquant" - nvidia: "cuda12-turboquant" - intel: "intel-sycl-f16-turboquant" - amd: "rocm-turboquant" - vulkan: "vulkan-turboquant" - nvidia-l4t: "nvidia-l4t-arm64-turboquant" - nvidia-cuda-13: "cuda13-turboquant" - nvidia-cuda-12: "cuda12-turboquant" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-turboquant" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-turboquant" -- &bonsai - name: "bonsai" - alias: "bonsai" + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant +- name: bonsai + alias: bonsai license: apache-2.0 description: | Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) @@ -98,19 +98,18 @@ - 1-bit - ternary capabilities: - default: "cpu-bonsai" - nvidia: "cuda12-bonsai" - intel: "intel-sycl-f16-bonsai" - amd: "rocm-bonsai" - vulkan: "vulkan-bonsai" - nvidia-l4t: "nvidia-l4t-arm64-bonsai" - nvidia-cuda-13: "cuda13-bonsai" - nvidia-cuda-12: "cuda12-bonsai" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-bonsai" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-bonsai" -- &ds4 - name: "ds4" - alias: "ds4" + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai +- name: ds4 + alias: ds4 license: mit description: | antirez/ds4 - DeepSeek V4 Flash inference engine. Single-model, @@ -125,15 +124,14 @@ - CUDA - Metal capabilities: - default: "cpu-ds4" - nvidia: "cuda13-ds4" - nvidia-cuda-13: "cuda13-ds4" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-ds4" - metal: "metal-ds4" - metal-darwin-arm64: "metal-ds4" -- &audiocpp - name: "audio-cpp" - alias: "audio-cpp" + default: cpu-ds4 + metal: metal-ds4 + metal-darwin-arm64: metal-ds4 + nvidia: cuda13-ds4 + nvidia-cuda-13: cuda13-ds4 + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ds4 +- name: audio-cpp + alias: audio-cpp license: apache-2.0 description: | 0xShug0/audio.cpp - a ggml audio inference framework covering text to @@ -152,22 +150,16 @@ - CUDA - HIP - Metal - # No vulkan key: the vulkan image would carry a Vulkan loader with no Mesa ICD - # (see the audio-cpp block in .github/backend-matrix.yml). Pointing a - # capability at a tag CI never builds hands the user a pull failure; leaving it - # out lets SystemState.Capability() fall through to `default` and the CPU - # image. capabilities: - default: "cpu-audio-cpp" - nvidia: "cuda12-audio-cpp" - nvidia-cuda-12: "cuda12-audio-cpp" - nvidia-cuda-13: "cuda13-audio-cpp" - amd: "rocm-audio-cpp" - metal: "metal-audio-cpp" - metal-darwin-arm64: "metal-audio-cpp" -- &whispercpp - name: "whisper" - alias: "whisper" + amd: rocm-audio-cpp + default: cpu-audio-cpp + metal: metal-audio-cpp + metal-darwin-arm64: metal-audio-cpp + nvidia: cuda12-audio-cpp + nvidia-cuda-12: cuda12-audio-cpp + nvidia-cuda-13: cuda13-audio-cpp +- name: whisper + alias: whisper license: mit icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg description: | @@ -181,20 +173,19 @@ - CUDA - HIP capabilities: - default: "cpu-whisper" - nvidia: "cuda12-whisper" - intel: "intel-sycl-f16-whisper" - metal: "metal-whisper" - amd: "rocm-whisper" - vulkan: "vulkan-whisper" - nvidia-l4t: "nvidia-l4t-arm64-whisper" - nvidia-cuda-13: "cuda13-whisper" - nvidia-cuda-12: "cuda12-whisper" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-whisper" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-whisper" -- &vllm-cpp - name: "vllm-cpp" - alias: "vllm-cpp" + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper +- name: vllm-cpp + alias: vllm-cpp license: apache-2.0 description: | ALPHA development builds. Try it, but llama-cpp stays the recommendation for @@ -223,26 +214,52 @@ - CUDA - metal capabilities: - default: "cpu-vllm-cpp" - nvidia: "cuda13-vllm-cpp" - metal: "metal-vllm-cpp" - vulkan: "vulkan-vllm-cpp" - nvidia-cuda-13: "cuda13-vllm-cpp" - nvidia-l4t: "nvidia-l4t-arm64-vllm-cpp" - nvidia-l4t-cuda-13: "nvidia-l4t-arm64-vllm-cpp" -- !!merge <<: *vllm-cpp - name: "vllm-cpp-development" + default: cpu-vllm-cpp + metal: metal-vllm-cpp + nvidia: cuda13-vllm-cpp + nvidia-cuda-13: cuda13-vllm-cpp + nvidia-l4t: nvidia-l4t-arm64-vllm-cpp + nvidia-l4t-cuda-13: nvidia-l4t-arm64-vllm-cpp + vulkan: vulkan-vllm-cpp +- name: vllm-cpp-development + alias: vllm-cpp + license: apache-2.0 + description: | + ALPHA development builds. Try it, but llama-cpp stays the recommendation for + production use. + + vllm.cpp is an Apache-2.0 C++20 inference engine maintained by the LocalAI team, + developed in its own repository and usable without LocalAI. It began as a port of + vLLM and keeps vLLM as its reference implementation, checking output against it and + benchmarking against it, while growing a featureset of its own. It implements vLLM's + V1 architecture (paged KV cache, continuous batching, prefix caching, scheduler, + sampler) on a portable tensor runtime with no Python, PyTorch or ggml at inference + time. It loads GGUF as well as Hugging Face safetensors, supports structured output + (JSON schema / regex / choice / GBNF grammar) enforced in-engine, ships speculative + decoding and KV offload, and runs on CPU, NVIDIA CUDA (Blackwell-family), Apple + Metal and Vulkan. + + The project is expected to be renamed as it diverges further from vLLM; the new + name is still to be decided. + urls: + - https://github.com/mudler/vllm.cpp + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - metal capabilities: - default: "cpu-vllm-cpp-development" - nvidia: "cuda13-vllm-cpp-development" - metal: "metal-vllm-cpp-development" - vulkan: "vulkan-vllm-cpp-development" - nvidia-cuda-13: "cuda13-vllm-cpp-development" - nvidia-l4t: "nvidia-l4t-arm64-vllm-cpp-development" - nvidia-l4t-cuda-13: "nvidia-l4t-arm64-vllm-cpp-development" -- &crispasr - name: "crispasr" - alias: "crispasr" + default: cpu-vllm-cpp-development + metal: metal-vllm-cpp-development + nvidia: cuda13-vllm-cpp-development + nvidia-cuda-13: cuda13-vllm-cpp-development + nvidia-l4t: nvidia-l4t-arm64-vllm-cpp-development + nvidia-l4t-cuda-13: nvidia-l4t-arm64-vllm-cpp-development + vulkan: vulkan-vllm-cpp-development +- name: crispasr + alias: crispasr license: mit icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg description: | @@ -256,20 +273,19 @@ - CUDA - HIP capabilities: - default: "cpu-crispasr" - nvidia: "cuda12-crispasr" - intel: "intel-sycl-f16-crispasr" - metal: "metal-crispasr" - amd: "rocm-crispasr" - vulkan: "vulkan-crispasr" - nvidia-l4t: "nvidia-l4t-arm64-crispasr" - nvidia-cuda-13: "cuda13-crispasr" - nvidia-cuda-12: "cuda12-crispasr" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-crispasr" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-crispasr" -- ¶keetcpp - name: "parakeet-cpp" - alias: "parakeet-cpp" + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr +- name: parakeet-cpp + alias: parakeet-cpp license: mit icon: https://avatars.githubusercontent.com/u/95302084 description: | @@ -285,20 +301,19 @@ - CUDA - HIP capabilities: - default: "cpu-parakeet-cpp" - nvidia: "cuda12-parakeet-cpp" - intel: "intel-sycl-f16-parakeet-cpp" - metal: "metal-parakeet-cpp" - amd: "rocm-parakeet-cpp" - vulkan: "vulkan-parakeet-cpp" - nvidia-l4t: "nvidia-l4t-arm64-parakeet-cpp" - nvidia-cuda-13: "cuda13-parakeet-cpp" - nvidia-cuda-12: "cuda12-parakeet-cpp" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-parakeet-cpp" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-parakeet-cpp" -- &nemospeechcpp - name: "nemo-speech-cpp" - alias: "nemo-speech-cpp" + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp +- name: nemo-speech-cpp + alias: nemo-speech-cpp license: apache-2.0 icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 description: | @@ -321,33 +336,18 @@ - GPU - CUDA - Metal - # No amd and no intel key on purpose: upstream NeMo-Speech.cpp has no ROCm/HIP - # and no SYCL backend, so there is nothing to point those at. A host reporting - # either capability falls through to "default" (SystemState.Capability) and - # gets the CPU build, which is the honest answer rather than a broken tag. - # - # Listing only nvidia-l4t would be a silent downgrade: a Jetson that reports a - # CUDA-refined capability would miss the map and fall back to the CPU build. - # - # The two nvidia-l4t-cuda-* keys point at DIFFERENT images on purpose. The - # JetPack r36.4.0 base links ggml against CUDA 12, so serving it to a host that - # reports nvidia-l4t-cuda-13 would fail at dlopen on a missing libcudart.so.12. - # That is worse than no key at all, since a missing key falls back to a working - # CPU build. Hence the separate cuda13 L4T image, as parakeet-cpp and - # moss-transcribe-cpp both do. capabilities: - default: "cpu-nemo-speech-cpp" - nvidia: "cuda12-nemo-speech-cpp" - metal: "metal-nemo-speech-cpp" - vulkan: "vulkan-nemo-speech-cpp" - nvidia-l4t: "nvidia-l4t-arm64-nemo-speech-cpp" - nvidia-cuda-13: "cuda13-nemo-speech-cpp" - nvidia-cuda-12: "cuda12-nemo-speech-cpp" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-nemo-speech-cpp" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-nemo-speech-cpp" -- &mosstranscribecpp - name: "moss-transcribe-cpp" - alias: "moss-transcribe-cpp" + default: cpu-nemo-speech-cpp + metal: metal-nemo-speech-cpp + nvidia: cuda12-nemo-speech-cpp + nvidia-cuda-12: cuda12-nemo-speech-cpp + nvidia-cuda-13: cuda13-nemo-speech-cpp + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + vulkan: vulkan-nemo-speech-cpp +- name: moss-transcribe-cpp + alias: moss-transcribe-cpp license: mit icon: https://avatars.githubusercontent.com/u/95302084 description: | @@ -363,20 +363,19 @@ - CUDA - HIP capabilities: - default: "cpu-moss-transcribe-cpp" - nvidia: "cuda12-moss-transcribe-cpp" - intel: "intel-sycl-f16-moss-transcribe-cpp" - metal: "metal-moss-transcribe-cpp" - amd: "rocm-moss-transcribe-cpp" - vulkan: "vulkan-moss-transcribe-cpp" - nvidia-l4t: "nvidia-l4t-arm64-moss-transcribe-cpp" - nvidia-cuda-13: "cuda13-moss-transcribe-cpp" - nvidia-cuda-12: "cuda12-moss-transcribe-cpp" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-moss-transcribe-cpp" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-moss-transcribe-cpp" -- &ced - name: "ced" - alias: "ced" + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp +- name: ced + alias: ced license: mit icon: https://avatars.githubusercontent.com/u/95302084 description: | @@ -394,20 +393,19 @@ - CUDA - HIP capabilities: - default: "cpu-ced" - nvidia: "cuda12-ced" - intel: "intel-sycl-f16-ced" - metal: "metal-ced" - amd: "rocm-ced" - vulkan: "vulkan-ced" - nvidia-l4t: "nvidia-l4t-arm64-ced" - nvidia-cuda-13: "cuda13-ced" - nvidia-cuda-12: "cuda12-ced" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-ced" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-ced" -- &voicedetect - name: "voice-detect" - alias: "voice-detect" + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced +- name: voice-detect + alias: voice-detect license: mit icon: https://avatars.githubusercontent.com/u/95302084 description: | @@ -430,20 +428,19 @@ - CUDA - HIP capabilities: - default: "cpu-voice-detect" - nvidia: "cuda12-voice-detect" - intel: "intel-sycl-f16-voice-detect" - metal: "metal-voice-detect" - amd: "rocm-voice-detect" - vulkan: "vulkan-voice-detect" - nvidia-l4t: "nvidia-l4t-arm64-voice-detect" - nvidia-cuda-13: "cuda13-voice-detect" - nvidia-cuda-12: "cuda12-voice-detect" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-voice-detect" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-voice-detect" -- &facedetect - name: "face-detect" - alias: "face-detect" + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect +- name: face-detect + alias: face-detect license: mit icon: https://avatars.githubusercontent.com/u/95302084 description: | @@ -466,20 +463,19 @@ - CUDA - HIP capabilities: - default: "cpu-face-detect" - nvidia: "cuda12-face-detect" - intel: "intel-sycl-f16-face-detect" - metal: "metal-face-detect" - amd: "rocm-face-detect" - vulkan: "vulkan-face-detect" - nvidia-l4t: "nvidia-l4t-arm64-face-detect" - nvidia-cuda-13: "cuda13-face-detect" - nvidia-cuda-12: "cuda12-face-detect" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-face-detect" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-face-detect" -- &voxtral - name: "voxtral" - alias: "voxtral" + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect +- name: voxtral + alias: voxtral license: mit description: | Voxtral Realtime 4B Pure C speech-to-text inference engine @@ -490,15 +486,14 @@ - CPU - Metal capabilities: - default: "cpu-voxtral" - metal-darwin-arm64: "metal-voxtral" -- &stablediffusionggml - name: "stablediffusion-ggml" - alias: "stablediffusion-ggml" + default: cpu-voxtral + metal-darwin-arm64: metal-voxtral +- name: stablediffusion-ggml + alias: stablediffusion-ggml license: mit icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png description: | - Stable Diffusion and Flux in pure C/C++ + Stable Diffusion and Flux in pure C/C++ urls: - https://github.com/leejet/stable-diffusion.cpp tags: @@ -509,61 +504,66 @@ - CUDA - HIP capabilities: - default: "cpu-stablediffusion-ggml" - nvidia: "cuda12-stablediffusion-ggml" - intel: "intel-sycl-f16-stablediffusion-ggml" - amd: "rocm-stablediffusion-ggml" - vulkan: "vulkan-stablediffusion-ggml" - nvidia-l4t: "nvidia-l4t-arm64-stablediffusion-ggml" - metal: "metal-stablediffusion-ggml" - nvidia-cuda-13: "cuda13-stablediffusion-ggml" - nvidia-cuda-12: "cuda12-stablediffusion-ggml" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-stablediffusion-ggml" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-stablediffusion-ggml" -- &kimodocpp - name: "kimodocpp" - alias: "kimodocpp" + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml +- name: kimodocpp + alias: kimodocpp license: apache-2.0 description: | kimodo.cpp text-to-motion: animated skeleton GLB on CPU and Vulkan. Apple Silicon uses the CPU runtime. urls: - https://github.com/localai-org/kimodo.cpp - tags: [3d-animation, text-to-motion, CPU, Vulkan] + tags: + - 3d-animation + - text-to-motion + - CPU + - Vulkan capabilities: - default: "cpu-kimodocpp" - vulkan: "vulkan-kimodocpp" - nvidia: "vulkan-kimodocpp" - nvidia-cuda-12: "vulkan-kimodocpp" - nvidia-cuda-13: "vulkan-kimodocpp" - amd: "vulkan-kimodocpp" - intel: "vulkan-kimodocpp" - metal: "cpu-darwin-arm64-kimodocpp" -- &gemxcpp - name: "gemxcpp" - alias: "gemxcpp" + amd: vulkan-kimodocpp + default: cpu-kimodocpp + intel: vulkan-kimodocpp + metal: cpu-darwin-arm64-kimodocpp + nvidia: vulkan-kimodocpp + nvidia-cuda-12: vulkan-kimodocpp + nvidia-cuda-13: vulkan-kimodocpp + vulkan: vulkan-kimodocpp +- name: gemxcpp + alias: gemxcpp license: apache-2.0 description: | gem-x.cpp live human motion: SOMA and SMPL pose streams on CPU and Vulkan. Apple Silicon uses the CPU runtime. urls: - https://github.com/localai-org/gem-x.cpp - tags: [motion, pose-estimation, CPU, Vulkan] + tags: + - motion + - pose-estimation + - CPU + - Vulkan capabilities: - default: "cpu-gemxcpp" - vulkan: "vulkan-gemxcpp" - nvidia: "vulkan-gemxcpp" - nvidia-cuda-12: "vulkan-gemxcpp" - nvidia-cuda-13: "vulkan-gemxcpp" - amd: "vulkan-gemxcpp" - intel: "vulkan-gemxcpp" - metal: "cpu-darwin-arm64-gemxcpp" -- &trellis2cpp - name: "trellis2cpp" - alias: "trellis2cpp" + amd: vulkan-gemxcpp + default: cpu-gemxcpp + intel: vulkan-gemxcpp + metal: cpu-darwin-arm64-gemxcpp + nvidia: vulkan-gemxcpp + nvidia-cuda-12: vulkan-gemxcpp + nvidia-cuda-13: vulkan-gemxcpp + vulkan: vulkan-gemxcpp +- name: trellis2cpp + alias: trellis2cpp license: mit description: | - TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml urls: - https://github.com/localai-org/trellis2cpp - https://github.com/microsoft/TRELLIS.2 @@ -575,18 +575,17 @@ - CUDA - Metal capabilities: - default: "cpu-trellis2cpp" - nvidia: "cuda12-trellis2cpp" - vulkan: "vulkan-trellis2cpp" - nvidia-l4t: "nvidia-l4t-arm64-trellis2cpp" - metal: "metal-trellis2cpp" - nvidia-cuda-13: "cuda13-trellis2cpp" - nvidia-cuda-12: "cuda12-trellis2cpp" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-trellis2cpp" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-trellis2cpp" -- &rfdetr - name: "rfdetr" - alias: "rfdetr" + default: cpu-trellis2cpp + metal: metal-trellis2cpp + nvidia: cuda12-trellis2cpp + nvidia-cuda-12: cuda12-trellis2cpp + nvidia-cuda-13: cuda13-trellis2cpp + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp + vulkan: vulkan-trellis2cpp +- name: rfdetr + alias: rfdetr license: apache-2.0 icon: https://avatars.githubusercontent.com/u/53104118?s=200&v=4 description: | @@ -601,25 +600,17 @@ - gpu - cpu capabilities: - nvidia: "cuda12-rfdetr" - intel: "intel-rfdetr" - #amd: "rocm-rfdetr" - nvidia-l4t: "nvidia-l4t-arm64-rfdetr" - metal: "metal-rfdetr" - default: "cpu-rfdetr" - nvidia-cuda-13: "cuda13-rfdetr" - nvidia-cuda-12: "cuda12-rfdetr" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-rfdetr" -- &insightface - name: "insightface" - alias: "insightface" - # Upstream insightface library is MIT. The pretrained model packs - # (buffalo_l, buffalo_s, antelopev2) are released for NON-COMMERCIAL - # research use only. The backend image also pre-bakes OpenCV Zoo - # YuNet + SFace (Apache 2.0) for commercial use. Pick the engine - # via model-gallery entries (insightface-buffalo-l / insightface-opencv - # / insightface-buffalo-s) or set `options` in your model YAML. - license: "mixed" + default: cpu-rfdetr + intel: intel-rfdetr + metal: metal-rfdetr + nvidia: cuda12-rfdetr + nvidia-cuda-12: cuda12-rfdetr + nvidia-cuda-13: cuda13-rfdetr + nvidia-l4t: nvidia-l4t-arm64-rfdetr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr +- name: insightface + alias: insightface + license: mixed description: | Face recognition backend powered by `insightface` (ONNX Runtime). Provides face verification (/v1/face/verify), face analysis @@ -644,12 +635,11 @@ - gpu - cpu capabilities: - default: "cpu-insightface" - nvidia: "cuda12-insightface" - nvidia-cuda-12: "cuda12-insightface" -- &sam3cpp - name: "sam3-cpp" - alias: "sam3-cpp" + default: cpu-insightface + nvidia: cuda12-insightface + nvidia-cuda-12: cuda12-insightface +- name: sam3-cpp + alias: sam3-cpp license: mit description: | Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. @@ -663,19 +653,18 @@ - gpu - cpu capabilities: - default: "cpu-sam3-cpp" - nvidia: "cuda12-sam3-cpp" - nvidia-cuda-12: "cuda12-sam3-cpp" - nvidia-cuda-13: "cuda13-sam3-cpp" - nvidia-l4t: "nvidia-l4t-arm64-sam3-cpp" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-sam3-cpp" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-sam3-cpp" - intel: "intel-sycl-f32-sam3-cpp" - vulkan: "vulkan-sam3-cpp" - metal: "metal-sam3-cpp" -- &rfdetrcpp - name: "rfdetr-cpp" - alias: "rfdetr-cpp" + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp +- name: rfdetr-cpp + alias: rfdetr-cpp license: apache-2.0 description: | Native RF-DETR object detection and instance segmentation in C/C++ @@ -692,19 +681,18 @@ - gpu - cpu capabilities: - default: "cpu-rfdetr-cpp" - nvidia: "cuda12-rfdetr-cpp" - nvidia-cuda-12: "cuda12-rfdetr-cpp" - nvidia-cuda-13: "cuda13-rfdetr-cpp" - nvidia-l4t: "nvidia-l4t-arm64-rfdetr-cpp" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-rfdetr-cpp" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-rfdetr-cpp" - intel: "intel-sycl-f32-rfdetr-cpp" - vulkan: "vulkan-rfdetr-cpp" - metal: "metal-rfdetr-cpp" -- &locateanything - name: "locate-anything" - alias: "locate-anything" + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp +- name: locate-anything + alias: locate-anything license: apache-2.0 description: | Open-vocabulary object detection and visual grounding (NVIDIA @@ -722,122 +710,623 @@ - gpu - cpu capabilities: - default: "cpu-locate-anything-cpp" - nvidia: "cuda12-locate-anything-cpp" - nvidia-cuda-12: "cuda12-locate-anything-cpp" - nvidia-cuda-13: "cuda13-locate-anything-cpp" - nvidia-l4t: "nvidia-l4t-arm64-locate-anything-cpp" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-locate-anything-cpp" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-locate-anything-cpp" - intel: "intel-sycl-f32-locate-anything-cpp" - vulkan: "vulkan-locate-anything-cpp" - metal: "metal-locate-anything-cpp" -- !!merge <<: *locateanything - name: "locate-anything-development" + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp +- name: locate-anything-development + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu capabilities: - default: "cpu-locate-anything-cpp-development" - nvidia: "cuda12-locate-anything-cpp-development" - nvidia-cuda-12: "cuda12-locate-anything-cpp-development" - nvidia-cuda-13: "cuda13-locate-anything-cpp-development" - nvidia-l4t: "nvidia-l4t-arm64-locate-anything-cpp-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-locate-anything-cpp-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-locate-anything-cpp-development" - intel: "intel-sycl-f32-locate-anything-cpp-development" - vulkan: "vulkan-locate-anything-cpp-development" - metal: "metal-locate-anything-cpp-development" -- !!merge <<: *locateanything - name: "cpu-locate-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-locate-anything-cpp" + default: cpu-locate-anything-cpp-development + intel: intel-sycl-f32-locate-anything-cpp-development + metal: metal-locate-anything-cpp-development + nvidia: cuda12-locate-anything-cpp-development + nvidia-cuda-12: cuda12-locate-anything-cpp-development + nvidia-cuda-13: cuda13-locate-anything-cpp-development + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp-development + vulkan: vulkan-locate-anything-cpp-development +- name: cpu-locate-anything-cpp + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-locate-anything-cpp mirrors: - localai/localai-backends:latest-cpu-locate-anything-cpp -- !!merge <<: *locateanything - name: "cpu-locate-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-locate-anything-cpp" +- name: cpu-locate-anything-cpp-development + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-locate-anything-cpp mirrors: - localai/localai-backends:master-cpu-locate-anything-cpp -- !!merge <<: *locateanything - name: "metal-locate-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-locate-anything-cpp" +- name: metal-locate-anything-cpp + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-locate-anything-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-locate-anything-cpp -- !!merge <<: *locateanything - name: "metal-locate-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-locate-anything-cpp" +- name: metal-locate-anything-cpp-development + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-locate-anything-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-locate-anything-cpp -- !!merge <<: *locateanything - name: "cuda12-locate-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-locate-anything-cpp" +- name: cuda12-locate-anything-cpp + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-locate-anything-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-locate-anything-cpp -- !!merge <<: *locateanything - name: "cuda12-locate-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-locate-anything-cpp" +- name: cuda12-locate-anything-cpp-development + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-locate-anything-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-locate-anything-cpp -- !!merge <<: *locateanything - name: "cuda13-locate-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-locate-anything-cpp" +- name: cuda13-locate-anything-cpp + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-locate-anything-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-locate-anything-cpp -- !!merge <<: *locateanything - name: "cuda13-locate-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-locate-anything-cpp" +- name: cuda13-locate-anything-cpp-development + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-locate-anything-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-locate-anything-cpp -- !!merge <<: *locateanything - name: "nvidia-l4t-arm64-locate-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-locate-anything-cpp" +- name: nvidia-l4t-arm64-locate-anything-cpp + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-locate-anything-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-locate-anything-cpp -- !!merge <<: *locateanything - name: "nvidia-l4t-arm64-locate-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-locate-anything-cpp" +- name: nvidia-l4t-arm64-locate-anything-cpp-development + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-locate-anything-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-locate-anything-cpp -- !!merge <<: *locateanything - name: "cuda13-nvidia-l4t-arm64-locate-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-locate-anything-cpp" +- name: cuda13-nvidia-l4t-arm64-locate-anything-cpp + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-locate-anything-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-locate-anything-cpp -- !!merge <<: *locateanything - name: "cuda13-nvidia-l4t-arm64-locate-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-locate-anything-cpp" +- name: cuda13-nvidia-l4t-arm64-locate-anything-cpp-development + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-locate-anything-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-locate-anything-cpp -- !!merge <<: *locateanything - name: "intel-sycl-f32-locate-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-locate-anything-cpp" +- name: intel-sycl-f32-locate-anything-cpp + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-locate-anything-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-locate-anything-cpp -- !!merge <<: *locateanything - name: "intel-sycl-f32-locate-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-locate-anything-cpp" +- name: intel-sycl-f32-locate-anything-cpp-development + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-locate-anything-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-locate-anything-cpp -- !!merge <<: *locateanything - name: "intel-sycl-f16-locate-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-locate-anything-cpp" +- name: intel-sycl-f16-locate-anything-cpp + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-locate-anything-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-locate-anything-cpp -- !!merge <<: *locateanything - name: "intel-sycl-f16-locate-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-locate-anything-cpp" +- name: intel-sycl-f16-locate-anything-cpp-development + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-locate-anything-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-locate-anything-cpp -- !!merge <<: *locateanything - name: "vulkan-locate-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-locate-anything-cpp" +- name: vulkan-locate-anything-cpp + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-locate-anything-cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-locate-anything-cpp -- !!merge <<: *locateanything - name: "vulkan-locate-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-locate-anything-cpp" +- name: vulkan-locate-anything-cpp-development + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-locate-anything-cpp mirrors: - localai/localai-backends:master-gpu-vulkan-locate-anything-cpp -- &depthanything - name: "depth-anything" - alias: "depth-anything" +- name: depth-anything + alias: depth-anything license: apache-2.0 description: | Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ @@ -854,133 +1343,605 @@ - gpu - cpu capabilities: - default: "cpu-depth-anything-cpp" - nvidia: "cuda12-depth-anything-cpp" - nvidia-cuda-12: "cuda12-depth-anything-cpp" - nvidia-cuda-13: "cuda13-depth-anything-cpp" - nvidia-l4t: "nvidia-l4t-arm64-depth-anything-cpp" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-depth-anything-cpp" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-depth-anything-cpp" - intel: "intel-sycl-f32-depth-anything-cpp" - vulkan: "vulkan-depth-anything-cpp" - metal: "metal-depth-anything-cpp" -- !!merge <<: *depthanything - name: "depth-anything-development" + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp +- name: depth-anything-development + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu capabilities: - default: "cpu-depth-anything-cpp-development" - nvidia: "cuda12-depth-anything-cpp-development" - nvidia-cuda-12: "cuda12-depth-anything-cpp-development" - nvidia-cuda-13: "cuda13-depth-anything-cpp-development" - nvidia-l4t: "nvidia-l4t-arm64-depth-anything-cpp-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-depth-anything-cpp-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-depth-anything-cpp-development" - intel: "intel-sycl-f32-depth-anything-cpp-development" - vulkan: "vulkan-depth-anything-cpp-development" - metal: "metal-depth-anything-cpp-development" -- !!merge <<: *depthanything - name: "cpu-depth-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-depth-anything-cpp" + default: cpu-depth-anything-cpp-development + intel: intel-sycl-f32-depth-anything-cpp-development + metal: metal-depth-anything-cpp-development + nvidia: cuda12-depth-anything-cpp-development + nvidia-cuda-12: cuda12-depth-anything-cpp-development + nvidia-cuda-13: cuda13-depth-anything-cpp-development + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp-development + vulkan: vulkan-depth-anything-cpp-development +- name: cpu-depth-anything-cpp + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-depth-anything-cpp mirrors: - localai/localai-backends:latest-cpu-depth-anything-cpp -- !!merge <<: *depthanything - name: "cpu-depth-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-depth-anything-cpp" +- name: cpu-depth-anything-cpp-development + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-depth-anything-cpp mirrors: - localai/localai-backends:master-cpu-depth-anything-cpp -- !!merge <<: *depthanything - name: "metal-depth-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-depth-anything-cpp" +- name: metal-depth-anything-cpp + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-depth-anything-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-depth-anything-cpp -- !!merge <<: *depthanything - name: "metal-depth-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-depth-anything-cpp" +- name: metal-depth-anything-cpp-development + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-depth-anything-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-depth-anything-cpp -- !!merge <<: *depthanything - name: "cuda12-depth-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-depth-anything-cpp" +- name: cuda12-depth-anything-cpp + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-depth-anything-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-depth-anything-cpp -- !!merge <<: *depthanything - name: "cuda12-depth-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-depth-anything-cpp" +- name: cuda12-depth-anything-cpp-development + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-depth-anything-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-depth-anything-cpp -- !!merge <<: *depthanything - name: "cuda13-depth-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-depth-anything-cpp" +- name: cuda13-depth-anything-cpp + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-depth-anything-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-depth-anything-cpp -- !!merge <<: *depthanything - name: "cuda13-depth-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-depth-anything-cpp" +- name: cuda13-depth-anything-cpp-development + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-depth-anything-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-depth-anything-cpp -- !!merge <<: *depthanything - name: "nvidia-l4t-arm64-depth-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-depth-anything-cpp" +- name: nvidia-l4t-arm64-depth-anything-cpp + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-depth-anything-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-depth-anything-cpp -- !!merge <<: *depthanything - name: "nvidia-l4t-arm64-depth-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-depth-anything-cpp" +- name: nvidia-l4t-arm64-depth-anything-cpp-development + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-depth-anything-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-depth-anything-cpp -- !!merge <<: *depthanything - name: "cuda13-nvidia-l4t-arm64-depth-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-depth-anything-cpp" +- name: cuda13-nvidia-l4t-arm64-depth-anything-cpp + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-depth-anything-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-depth-anything-cpp -- !!merge <<: *depthanything - name: "cuda13-nvidia-l4t-arm64-depth-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-depth-anything-cpp" +- name: cuda13-nvidia-l4t-arm64-depth-anything-cpp-development + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-depth-anything-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-depth-anything-cpp -- !!merge <<: *depthanything - name: "intel-sycl-f32-depth-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-depth-anything-cpp" +- name: intel-sycl-f32-depth-anything-cpp + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-depth-anything-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-depth-anything-cpp -- !!merge <<: *depthanything - name: "intel-sycl-f32-depth-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-depth-anything-cpp" +- name: intel-sycl-f32-depth-anything-cpp-development + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-depth-anything-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-depth-anything-cpp -- !!merge <<: *depthanything - name: "intel-sycl-f16-depth-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-depth-anything-cpp" +- name: intel-sycl-f16-depth-anything-cpp + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-depth-anything-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-depth-anything-cpp -- !!merge <<: *depthanything - name: "intel-sycl-f16-depth-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-depth-anything-cpp" +- name: intel-sycl-f16-depth-anything-cpp-development + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-depth-anything-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-depth-anything-cpp -- !!merge <<: *depthanything - name: "vulkan-depth-anything-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-depth-anything-cpp" +- name: vulkan-depth-anything-cpp + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-depth-anything-cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-depth-anything-cpp -- !!merge <<: *depthanything - name: "vulkan-depth-anything-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-depth-anything-cpp" +- name: vulkan-depth-anything-cpp-development + alias: depth-anything + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: cpu-depth-anything-cpp + intel: intel-sycl-f32-depth-anything-cpp + metal: metal-depth-anything-cpp + nvidia: cuda12-depth-anything-cpp + nvidia-cuda-12: cuda12-depth-anything-cpp + nvidia-cuda-13: cuda13-depth-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-depth-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-depth-anything-cpp + vulkan: vulkan-depth-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-depth-anything-cpp mirrors: - localai/localai-backends:master-gpu-vulkan-depth-anything-cpp -- &vllm - name: "vllm" +- name: vllm + alias: vllm license: apache-2.0 - urls: - - https://github.com/vllm-project/vllm - tags: - - text-to-text - - multimodal - - GPTQ - - AWQ - - AutoRound - - INT4 - - INT8 - - FP8 icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png description: | vLLM is a fast and easy-to-use library for LLM inference and serving. @@ -994,24 +1955,29 @@ Optimized CUDA kernels, including integration with FlashAttention and FlashInfer Speculative decoding Chunked prefill - alias: "vllm" - capabilities: - nvidia: "cuda12-vllm" - amd: "rocm-vllm" - intel: "intel-vllm" - nvidia-cuda-12: "cuda12-vllm" - nvidia-cuda-13: "cuda13-vllm" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-vllm" - cpu: "cpu-vllm" - metal: "metal-vllm" -- &sglang - name: "sglang" - license: apache-2.0 urls: - - https://github.com/sgl-project/sglang + - https://github.com/vllm-project/vllm tags: - text-to-text - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + capabilities: + amd: rocm-vllm + cpu: cpu-vllm + intel: intel-vllm + metal: metal-vllm + nvidia: cuda12-vllm + nvidia-cuda-12: cuda12-vllm + nvidia-cuda-13: cuda13-vllm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm +- name: sglang + alias: sglang + license: apache-2.0 icon: https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png description: | SGLang is a fast serving framework for large language models and vision language models. @@ -1019,18 +1985,28 @@ decoding) and the frontend language to make interaction with models faster and more controllable. Features include fast backend runtime, flexible frontend language, extensive model support, and an active community. - alias: "sglang" + urls: + - https://github.com/sgl-project/sglang + tags: + - text-to-text + - multimodal capabilities: - nvidia: "cuda12-sglang" - amd: "rocm-sglang" - intel: "intel-sglang" - nvidia-cuda-12: "cuda12-sglang" - nvidia-cuda-13: "cuda13-sglang" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-sglang" - cpu: "cpu-sglang" -- &vllm-omni - name: "vllm-omni" + amd: rocm-sglang + cpu: cpu-sglang + intel: intel-sglang + nvidia: cuda12-sglang + nvidia-cuda-12: cuda12-sglang + nvidia-cuda-13: cuda13-sglang + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sglang +- name: vllm-omni + alias: vllm-omni license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM-Omni is a unified interface for multimodal generation with vLLM. + It supports image generation (text-to-image, image editing), video generation + (text-to-video, image-to-video), text generation with multimodal inputs, and + text-to-speech generation. Only supports NVIDIA (CUDA) and ROCm platforms. urls: - https://github.com/vllm-project/vllm-omni tags: @@ -1042,23 +2018,21 @@ - TTS - multimodal - LLM - icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png - description: | - vLLM-Omni is a unified interface for multimodal generation with vLLM. - It supports image generation (text-to-image, image editing), video generation - (text-to-video, image-to-video), text generation with multimodal inputs, and - text-to-speech generation. Only supports NVIDIA (CUDA) and ROCm platforms. - alias: "vllm-omni" capabilities: - nvidia: "cuda12-vllm-omni" - amd: "rocm-vllm-omni" - nvidia-cuda-12: "cuda12-vllm-omni" - nvidia-cuda-13: "cuda13-vllm-omni" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-vllm-omni" -- &longcat-video - name: "longcat-video" - alias: "longcat-video" + amd: rocm-vllm-omni + nvidia: cuda12-vllm-omni + nvidia-cuda-12: cuda12-vllm-omni + nvidia-cuda-13: cuda13-vllm-omni + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm-omni +- name: longcat-video + alias: longcat-video license: mit + icon: https://raw.githubusercontent.com/meituan-longcat/LongCat-Video/main/assets/longcat-video_logo.svg + description: | + LongCat-Video generation for text, image, and audio-conditioned avatars. + Supports LongCat-Video and LongCat-Video-Avatar-1.5, including multi-segment + talking-head continuation and an SDPA path for NVIDIA Blackwell ARM64 systems. + Requires Linux with an NVIDIA CUDA GPU; CPU, ROCm, and macOS are unsupported. urls: - https://github.com/meituan-longcat/LongCat-Video tags: @@ -1068,61 +2042,52 @@ - avatar-generation - video-generation - CUDA - icon: https://raw.githubusercontent.com/meituan-longcat/LongCat-Video/main/assets/longcat-video_logo.svg - description: | - LongCat-Video generation for text, image, and audio-conditioned avatars. - Supports LongCat-Video and LongCat-Video-Avatar-1.5, including multi-segment - talking-head continuation and an SDPA path for NVIDIA Blackwell ARM64 systems. - Requires Linux with an NVIDIA CUDA GPU; CPU, ROCm, and macOS are unsupported. capabilities: - nvidia: "cuda12-longcat-video" - nvidia-cuda-12: "cuda12-longcat-video" - nvidia-cuda-13: "cuda13-longcat-video" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-longcat-video" -- &mlx - name: "mlx" + nvidia: cuda12-longcat-video + nvidia-cuda-12: cuda12-longcat-video + nvidia-cuda-13: cuda13-longcat-video + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-longcat-video +- name: mlx + license: MIT icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run LLMs with MLX urls: - https://github.com/ml-explore/mlx-lm - license: MIT - description: | - Run LLMs with MLX tags: - text-to-text - LLM - MLX capabilities: - default: "cpu-mlx" - nvidia: "cuda12-mlx" - metal: "metal-mlx" - nvidia-cuda-12: "cuda12-mlx" - nvidia-cuda-13: "cuda13-mlx" - nvidia-l4t: "nvidia-l4t-mlx" - nvidia-l4t-cuda-12: "nvidia-l4t-mlx" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx" -- &mlx-video - name: "mlx-video" + default: cpu-mlx + metal: metal-mlx + nvidia: cuda12-mlx + nvidia-cuda-12: cuda12-mlx + nvidia-cuda-13: cuda13-mlx + nvidia-l4t: nvidia-l4t-mlx + nvidia-l4t-cuda-12: nvidia-l4t-mlx + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx +- name: mlx-video + license: MIT icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Generate videos with LTX-2 and converted Wan2.1/Wan2.2 checkpoints using + MLX on Apple Silicon. urls: - https://github.com/Blaizzy/mlx-video - license: MIT - description: | - Generate videos with LTX-2 and converted Wan2.1/Wan2.2 checkpoints using - MLX on Apple Silicon. tags: - text-to-video - image-to-video - MLX capabilities: - metal: "metal-mlx-video" -- &mlx-vlm - name: "mlx-vlm" + metal: metal-mlx-video +- name: mlx-vlm + license: MIT icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Vision-Language Models with MLX urls: - https://github.com/Blaizzy/mlx-vlm - license: MIT - description: | - Run Vision-Language Models with MLX tags: - text-to-text - multimodal @@ -1130,22 +2095,21 @@ - LLM - MLX capabilities: - default: "cpu-mlx-vlm" - nvidia: "cuda12-mlx-vlm" - metal: "metal-mlx-vlm" - nvidia-cuda-12: "cuda12-mlx-vlm" - nvidia-cuda-13: "cuda13-mlx-vlm" - nvidia-l4t: "nvidia-l4t-mlx-vlm" - nvidia-l4t-cuda-12: "nvidia-l4t-mlx-vlm" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx-vlm" -- &mlx-audio - name: "mlx-audio" + default: cpu-mlx-vlm + metal: metal-mlx-vlm + nvidia: cuda12-mlx-vlm + nvidia-cuda-12: cuda12-mlx-vlm + nvidia-cuda-13: cuda13-mlx-vlm + nvidia-l4t: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-12: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-vlm +- name: mlx-audio + license: MIT icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Audio Models with MLX urls: - https://github.com/Blaizzy/mlx-audio - license: MIT - description: | - Run Audio Models with MLX tags: - audio-to-text - audio-generation @@ -1153,47 +2117,44 @@ - LLM - MLX capabilities: - default: "cpu-mlx-audio" - nvidia: "cuda12-mlx-audio" - metal: "metal-mlx-audio" - nvidia-cuda-12: "cuda12-mlx-audio" - nvidia-cuda-13: "cuda13-mlx-audio" - nvidia-l4t: "nvidia-l4t-mlx-audio" - nvidia-l4t-cuda-12: "nvidia-l4t-mlx-audio" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx-audio" -- &mlx-distributed - name: "mlx-distributed" + default: cpu-mlx-audio + metal: metal-mlx-audio + nvidia: cuda12-mlx-audio + nvidia-cuda-12: cuda12-mlx-audio + nvidia-cuda-13: cuda13-mlx-audio + nvidia-l4t: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-12: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-audio +- name: mlx-distributed + license: MIT icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run distributed LLM inference with MLX across multiple Apple Silicon Macs urls: - https://github.com/ml-explore/mlx-lm - license: MIT - description: | - Run distributed LLM inference with MLX across multiple Apple Silicon Macs tags: - text-to-text - LLM - MLX - distributed capabilities: - default: "cpu-mlx-distributed" - nvidia: "cuda12-mlx-distributed" - metal: "metal-mlx-distributed" - nvidia-cuda-12: "cuda12-mlx-distributed" - nvidia-cuda-13: "cuda13-mlx-distributed" - nvidia-l4t: "nvidia-l4t-mlx-distributed" - nvidia-l4t-cuda-12: "nvidia-l4t-mlx-distributed" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx-distributed" -- &rerankers - name: "rerankers" - alias: "rerankers" + default: cpu-mlx-distributed + metal: metal-mlx-distributed + nvidia: cuda12-mlx-distributed + nvidia-cuda-12: cuda12-mlx-distributed + nvidia-cuda-13: cuda13-mlx-distributed + nvidia-l4t: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-12: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-distributed +- name: rerankers + alias: rerankers capabilities: - nvidia: "cuda12-rerankers" - intel: "intel-rerankers" - amd: "rocm-rerankers" - metal: "metal-rerankers" -- &tinygrad - name: "tinygrad" - alias: "tinygrad" + amd: rocm-rerankers + intel: intel-rerankers + metal: metal-rerankers + nvidia: cuda12-rerankers +- name: tinygrad + alias: tinygrad license: MIT description: | tinygrad is a minimalist deep-learning framework with zero runtime @@ -1209,9 +2170,6 @@ CUDA / ROCm / Metal when the host driver is visible. urls: - https://github.com/tinygrad/tinygrad - uri: "quay.io/go-skynet/local-ai-backends:latest-tinygrad" - mirrors: - - localai/localai-backends:latest-tinygrad tags: - text-to-text - LLM @@ -1219,11 +2177,13 @@ - image-generation - transcription - multimodal -- &transformers - name: "transformers" - icon: https://avatars.githubusercontent.com/u/25720743?s=200&v=4 - alias: "transformers" + uri: quay.io/go-skynet/local-ai-backends:latest-tinygrad + mirrors: + - localai/localai-backends:latest-tinygrad +- name: transformers + alias: transformers license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/25720743?s=200&v=4 description: | Transformers acts as the model-definition framework for state-of-the-art machine learning models in text, computer vision, audio, video, and multimodal model, for both inference and training. It centralizes the model definition so that this definition is agreed upon across the ecosystem. transformers is the pivot across frameworks: if a model definition is supported, it will be compatible with the majority of training frameworks (Axolotl, Unsloth, DeepSpeed, FSDP, PyTorch-Lightning, ...), inference engines (vLLM, SGLang, TGI, ...), and adjacent modeling libraries (llama.cpp, mlx, ...) which leverage the model definition from transformers. @@ -1233,17 +2193,17 @@ - text-to-text - multimodal capabilities: - nvidia: "cuda12-transformers" - intel: "intel-transformers" - amd: "rocm-transformers" - metal: "metal-transformers" - nvidia-cuda-13: "cuda13-transformers" - nvidia-cuda-12: "cuda12-transformers" -- &diffusers - name: "diffusers" + amd: rocm-transformers + intel: intel-transformers + metal: metal-transformers + nvidia: cuda12-transformers + nvidia-cuda-12: cuda12-transformers + nvidia-cuda-13: cuda13-transformers +- name: diffusers + alias: diffusers + license: apache-2.0 icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg - description: | - 🤗 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, 🤗 Diffusers is a modular toolbox that supports both. + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" urls: - https://github.com/huggingface/diffusers tags: @@ -1251,21 +2211,19 @@ - video-generation - sound-generation - diffusion-models - license: apache-2.0 - alias: "diffusers" capabilities: - nvidia: "cuda12-diffusers" - intel: "intel-diffusers" - amd: "rocm-diffusers" - nvidia-l4t: "nvidia-l4t-diffusers" - metal: "metal-diffusers" - default: "cpu-diffusers" - nvidia-cuda-13: "cuda13-diffusers" - nvidia-cuda-12: "cuda12-diffusers" - nvidia-l4t-cuda-12: "nvidia-l4t-diffusers" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-diffusers" -- &ace-step - name: "ace-step" + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers +- name: ace-step + alias: ace-step description: | ACE-Step 1.5 is an open-source music generation model. It supports simple mode (natural language description) and advanced mode (caption, lyrics, think, bpm, keyscale, etc.). Uses in-process acestep (LLMHandler for metadata, DiT for audio). urls: @@ -1273,27 +2231,33 @@ tags: - music-generation - sound-generation - alias: "ace-step" capabilities: - nvidia: "cuda12-ace-step" - intel: "intel-ace-step" - amd: "rocm-ace-step" - metal: "metal-ace-step" - default: "cpu-ace-step" - nvidia-cuda-13: "cuda13-ace-step" - nvidia-cuda-12: "cuda12-ace-step" -- !!merge <<: *ace-step - name: "ace-step-development" + amd: rocm-ace-step + default: cpu-ace-step + intel: intel-ace-step + metal: metal-ace-step + nvidia: cuda12-ace-step + nvidia-cuda-12: cuda12-ace-step + nvidia-cuda-13: cuda13-ace-step +- name: ace-step-development + alias: ace-step + description: | + ACE-Step 1.5 is an open-source music generation model. It supports simple mode (natural language description) and advanced mode (caption, lyrics, think, bpm, keyscale, etc.). Uses in-process acestep (LLMHandler for metadata, DiT for audio). + urls: + - https://github.com/ace-step/ACE-Step-1.5 + tags: + - music-generation + - sound-generation capabilities: - nvidia: "cuda12-ace-step-development" - intel: "intel-ace-step-development" - amd: "rocm-ace-step-development" - metal: "metal-ace-step-development" - default: "cpu-ace-step-development" - nvidia-cuda-13: "cuda13-ace-step-development" - nvidia-cuda-12: "cuda12-ace-step-development" -- &acestepcpp - name: "acestep-cpp" + amd: rocm-ace-step-development + default: cpu-ace-step-development + intel: intel-ace-step-development + metal: metal-ace-step-development + nvidia: cuda12-ace-step-development + nvidia-cuda-12: cuda12-ace-step-development + nvidia-cuda-13: cuda13-ace-step-development +- name: acestep-cpp + alias: acestep-cpp description: | ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). @@ -1302,21 +2266,20 @@ tags: - music-generation - sound-generation - alias: "acestep-cpp" capabilities: - default: "cpu-acestep-cpp" - nvidia: "cuda12-acestep-cpp" - nvidia-cuda-13: "cuda13-acestep-cpp" - nvidia-cuda-12: "cuda12-acestep-cpp" - intel: "intel-sycl-f16-acestep-cpp" - metal: "metal-acestep-cpp" - amd: "rocm-acestep-cpp" - vulkan: "vulkan-acestep-cpp" - nvidia-l4t: "nvidia-l4t-arm64-acestep-cpp" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-acestep-cpp" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-acestep-cpp" -- &qwen3ttscpp - name: "qwen3-tts-cpp" + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp +- name: qwen3-tts-cpp + alias: qwen3-tts-cpp description: | Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech with streaming output, named speakers, voice design, and zero-shot voice @@ -1329,21 +2292,20 @@ - tts - voice-cloning - streaming - alias: "qwen3-tts-cpp" capabilities: - default: "cpu-qwen3-tts-cpp" - nvidia: "cuda12-qwen3-tts-cpp" - nvidia-cuda-13: "cuda13-qwen3-tts-cpp" - nvidia-cuda-12: "cuda12-qwen3-tts-cpp" - intel: "intel-sycl-f16-qwen3-tts-cpp" - metal: "metal-qwen3-tts-cpp" - amd: "rocm-qwen3-tts-cpp" - vulkan: "vulkan-qwen3-tts-cpp" - nvidia-l4t: "nvidia-l4t-arm64-qwen3-tts-cpp" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-qwen3-tts-cpp" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-qwen3-tts-cpp" -- &mossttscpp - name: "moss-tts-cpp" + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp +- name: moss-tts-cpp + alias: moss-tts-cpp description: | MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local @@ -1357,35 +2319,47 @@ - text-to-speech - tts - voice-cloning - alias: "moss-tts-cpp" capabilities: - default: "cpu-moss-tts-cpp" - nvidia: "cuda12-moss-tts-cpp" - nvidia-cuda-13: "cuda13-moss-tts-cpp" - nvidia-cuda-12: "cuda12-moss-tts-cpp" - intel: "intel-sycl-f16-moss-tts-cpp" - metal: "metal-moss-tts-cpp" - amd: "rocm-moss-tts-cpp" - vulkan: "vulkan-moss-tts-cpp" - nvidia-l4t: "nvidia-l4t-arm64-moss-tts-cpp" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-moss-tts-cpp" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-moss-tts-cpp" -- !!merge <<: *mossttscpp - name: "moss-tts-cpp-development" + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp +- name: moss-tts-cpp-development + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning capabilities: - default: "cpu-moss-tts-cpp-development" - nvidia: "cuda12-moss-tts-cpp-development" - nvidia-cuda-13: "cuda13-moss-tts-cpp-development" - nvidia-cuda-12: "cuda12-moss-tts-cpp-development" - intel: "intel-sycl-f16-moss-tts-cpp-development" - metal: "metal-moss-tts-cpp-development" - amd: "rocm-moss-tts-cpp-development" - vulkan: "vulkan-moss-tts-cpp-development" - nvidia-l4t: "nvidia-l4t-arm64-moss-tts-cpp-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-moss-tts-cpp-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-moss-tts-cpp-development" -- &magpiettscpp - name: "magpie-tts-cpp" + amd: rocm-moss-tts-cpp-development + default: cpu-moss-tts-cpp-development + intel: intel-sycl-f16-moss-tts-cpp-development + metal: metal-moss-tts-cpp-development + nvidia: cuda12-moss-tts-cpp-development + nvidia-cuda-12: cuda12-moss-tts-cpp-development + nvidia-cuda-13: cuda13-moss-tts-cpp-development + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp-development + vulkan: vulkan-moss-tts-cpp-development +- name: magpie-tts-cpp + alias: magpie-tts-cpp description: | Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + @@ -1399,35 +2373,47 @@ tags: - text-to-speech - tts - alias: "magpie-tts-cpp" capabilities: - default: "cpu-magpie-tts-cpp" - nvidia: "cuda12-magpie-tts-cpp" - nvidia-cuda-13: "cuda13-magpie-tts-cpp" - nvidia-cuda-12: "cuda12-magpie-tts-cpp" - intel: "intel-sycl-f16-magpie-tts-cpp" - metal: "metal-magpie-tts-cpp" - amd: "rocm-magpie-tts-cpp" - vulkan: "vulkan-magpie-tts-cpp" - nvidia-l4t: "nvidia-l4t-arm64-magpie-tts-cpp" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-magpie-tts-cpp" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-magpie-tts-cpp" -- !!merge <<: *magpiettscpp - name: "magpie-tts-cpp-development" + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp +- name: magpie-tts-cpp-development + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts capabilities: - default: "cpu-magpie-tts-cpp-development" - nvidia: "cuda12-magpie-tts-cpp-development" - nvidia-cuda-13: "cuda13-magpie-tts-cpp-development" - nvidia-cuda-12: "cuda12-magpie-tts-cpp-development" - intel: "intel-sycl-f16-magpie-tts-cpp-development" - metal: "metal-magpie-tts-cpp-development" - amd: "rocm-magpie-tts-cpp-development" - vulkan: "vulkan-magpie-tts-cpp-development" - nvidia-l4t: "nvidia-l4t-arm64-magpie-tts-cpp-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-magpie-tts-cpp-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-magpie-tts-cpp-development" -- &omnivoicecpp - name: "omnivoice-cpp" + amd: rocm-magpie-tts-cpp-development + default: cpu-magpie-tts-cpp-development + intel: intel-sycl-f16-magpie-tts-cpp-development + metal: metal-magpie-tts-cpp-development + nvidia: cuda12-magpie-tts-cpp-development + nvidia-cuda-12: cuda12-magpie-tts-cpp-development + nvidia-cuda-13: cuda13-magpie-tts-cpp-development + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp-development + vulkan: vulkan-magpie-tts-cpp-development +- name: omnivoice-cpp + alias: omnivoice-cpp description: | OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning (reference audio + transcript) and voice design (attribute keywords: gender, @@ -1440,21 +2426,20 @@ - tts - voice-cloning - voice-design - alias: "omnivoice-cpp" capabilities: - default: "cpu-omnivoice-cpp" - nvidia: "cuda12-omnivoice-cpp" - nvidia-cuda-13: "cuda13-omnivoice-cpp" - nvidia-cuda-12: "cuda12-omnivoice-cpp" - intel: "intel-sycl-f16-omnivoice-cpp" - metal: "metal-omnivoice-cpp" - amd: "rocm-omnivoice-cpp" - vulkan: "vulkan-omnivoice-cpp" - nvidia-l4t: "nvidia-l4t-arm64-omnivoice-cpp" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-omnivoice-cpp" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-omnivoice-cpp" -- &vibevoicecpp - name: "vibevoice-cpp" + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp +- name: vibevoice-cpp + alias: vibevoice-cpp description: | vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with @@ -1468,21 +2453,21 @@ - asr - voice-cloning - diarization - alias: "vibevoice-cpp" capabilities: - default: "cpu-vibevoice-cpp" - nvidia: "cuda12-vibevoice-cpp" - nvidia-cuda-13: "cuda13-vibevoice-cpp" - nvidia-cuda-12: "cuda12-vibevoice-cpp" - intel: "intel-sycl-f16-vibevoice-cpp" - metal: "metal-vibevoice-cpp" - amd: "rocm-vibevoice-cpp" - vulkan: "vulkan-vibevoice-cpp" - nvidia-l4t: "nvidia-l4t-arm64-vibevoice-cpp" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-vibevoice-cpp" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-vibevoice-cpp" -- &localvqecpp - name: "localvqe" + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp +- name: localvqe + alias: localvqe + license: apache2 description: | LocalVQE C++ backend using GGML — joint acoustic echo cancellation, noise suppression, and dereverberation (DeepVQE-style architecture). 16 kHz mono @@ -1496,28 +2481,21 @@ - acoustic-echo-cancellation - noise-suppression - dereverberation - license: apache2 - alias: "localvqe" - # Upstream LocalVQE only supports CPU and Vulkan; no CUDA/ROCm/SYCL/Metal - # builds. GPU-class hardware that exposes a Vulkan ICD (NVIDIA, AMD, Intel - # discrete + iGPU, Tegra) routes to the Vulkan image; everything else - # falls back to the CPU build, which is already ~9× realtime on a desktop. capabilities: - default: "cpu-localvqe" - nvidia: "vulkan-localvqe" - nvidia-cuda-12: "vulkan-localvqe" - nvidia-cuda-13: "vulkan-localvqe" - intel: "vulkan-localvqe" - amd: "vulkan-localvqe" - vulkan: "vulkan-localvqe" - nvidia-l4t: "vulkan-localvqe" - nvidia-l4t-cuda-12: "vulkan-localvqe" - nvidia-l4t-cuda-13: "vulkan-localvqe" - # Apple Silicon: CPU build (LocalVQE has no Metal path); still arm64-native. - metal: "metal-localvqe" -- &privacyfilter - name: "privacy-filter" - alias: "privacy-filter" + amd: vulkan-localvqe + default: cpu-localvqe + intel: vulkan-localvqe + metal: metal-localvqe + nvidia: vulkan-localvqe + nvidia-cuda-12: vulkan-localvqe + nvidia-cuda-13: vulkan-localvqe + nvidia-l4t: vulkan-localvqe + nvidia-l4t-cuda-12: vulkan-localvqe + nvidia-l4t-cuda-13: vulkan-localvqe + vulkan: vulkan-localvqe +- name: privacy-filter + alias: privacy-filter + license: apache-2.0 icon: https://cdn-avatars.huggingface.co/v1/production/uploads/5fd5e18a90b6dc4633f6d292/QPiv8pt4JNxr0FdGnpFef.png description: | Standalone GGML engine (privacy-filter.cpp) for the OpenMed privacy-filter @@ -1535,24 +2513,17 @@ - privacy - CPU - GPU - license: apache-2.0 - # Builds: CPU (amd64+arm64 manifest), Vulkan (amd64) and CUDA 13 (amd64). - # Only a host that actually reports CUDA 13 gets the CUDA image (it bundles - # the CUDA 13 runtime and needs a recent driver); every other GPU — including - # NVIDIA without a CUDA-13 toolkit, AMD and Intel — routes to the Vulkan - # image, which only needs a Vulkan ICD. Everything else (incl. arm64/Jetson, - # where Vulkan/CUDA images are a future add) falls back to the CPU build, - # already fast for this ~50M-active-param model. capabilities: - default: "cpu-privacy-filter" - nvidia: "vulkan-privacy-filter" - nvidia-cuda-12: "vulkan-privacy-filter" - nvidia-cuda-13: "cuda13-privacy-filter" - amd: "vulkan-privacy-filter" - intel: "vulkan-privacy-filter" - vulkan: "vulkan-privacy-filter" - metal: "metal-privacy-filter" -- &faster-whisper + amd: vulkan-privacy-filter + default: cpu-privacy-filter + intel: vulkan-privacy-filter + metal: metal-privacy-filter + nvidia: vulkan-privacy-filter + nvidia-cuda-12: vulkan-privacy-filter + nvidia-cuda-13: cuda13-privacy-filter + vulkan: vulkan-privacy-filter +- name: faster-whisper + license: MIT icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 description: | faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. @@ -1562,19 +2533,19 @@ tags: - speech-to-text - Whisper - license: MIT - name: "faster-whisper" capabilities: - default: "cpu-faster-whisper" - nvidia: "cuda12-faster-whisper" - intel: "intel-faster-whisper" - amd: "rocm-faster-whisper" - metal: "metal-faster-whisper" - nvidia-cuda-13: "cuda13-faster-whisper" - nvidia-cuda-12: "cuda12-faster-whisper" - nvidia-l4t: "nvidia-l4t-arm64-faster-whisper" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-faster-whisper" -- &whisper-medusa + amd: rocm-faster-whisper + default: cpu-faster-whisper + intel: intel-faster-whisper + metal: metal-faster-whisper + nvidia: cuda12-faster-whisper + nvidia-cuda-12: cuda12-faster-whisper + nvidia-cuda-13: cuda13-faster-whisper + nvidia-l4t: nvidia-l4t-arm64-faster-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-faster-whisper +- name: whisper-medusa + alias: whisper-medusa + license: MIT description: | Whisper-Medusa accelerates Whisper transcription by predicting multiple tokens per decoding step. The upstream checkpoints use custom Transformers generation code and accept audio clips up to 30 seconds. @@ -1586,14 +2557,13 @@ - transcription - Whisper - Medusa - license: MIT - name: "whisper-medusa" - alias: "whisper-medusa" capabilities: - default: "cpu-whisper-medusa" - nvidia: "cuda12-whisper-medusa" - nvidia-cuda-12: "cuda12-whisper-medusa" -- &moonshine + default: cpu-whisper-medusa + nvidia: cuda12-whisper-medusa + nvidia-cuda-12: cuda12-whisper-medusa +- name: moonshine + alias: moonshine + license: MIT description: | Moonshine is a fast, accurate, and efficient speech-to-text transcription model using ONNX Runtime. It provides real-time transcription capabilities with support for multiple model sizes and GPU acceleration. @@ -1603,16 +2573,15 @@ - speech-to-text - transcription - ONNX - license: MIT - name: "moonshine" - alias: "moonshine" capabilities: - nvidia: "cuda12-moonshine" - metal: "metal-moonshine" - default: "cpu-moonshine" - nvidia-cuda-13: "cuda13-moonshine" - nvidia-cuda-12: "cuda12-moonshine" -- &whisperx + default: cpu-moonshine + metal: metal-moonshine + nvidia: cuda12-moonshine + nvidia-cuda-12: cuda12-moonshine + nvidia-cuda-13: cuda13-moonshine +- name: whisperx + alias: whisperx + license: BSD-4-Clause description: | WhisperX provides fast automatic speech recognition with word-level timestamps, speaker diarization, and forced alignment. Built on faster-whisper and pyannote-audio for high-accuracy transcription @@ -1623,18 +2592,17 @@ - speech-to-text - diarization - whisperx - license: BSD-4-Clause - name: "whisperx" - alias: "whisperx" capabilities: - nvidia: "cuda12-whisperx" - metal: "metal-whisperx" - default: "cpu-whisperx" - nvidia-cuda-13: "cuda13-whisperx" - nvidia-cuda-12: "cuda12-whisperx" - nvidia-l4t: "nvidia-l4t-arm64-whisperx" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-whisperx" -- &kokoro + default: cpu-whisperx + metal: metal-whisperx + nvidia: cuda12-whisperx + nvidia-cuda-12: cuda12-whisperx + nvidia-cuda-13: cuda13-whisperx + nvidia-l4t: nvidia-l4t-arm64-whisperx + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisperx +- name: kokoro + alias: kokoro + license: apache-2.0 icon: https://avatars.githubusercontent.com/u/166769057?v=4 description: | Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. @@ -1645,20 +2613,19 @@ - text-to-speech - TTS - LLM - license: apache-2.0 - alias: "kokoro" - name: "kokoro" capabilities: - default: "cpu-kokoro" - nvidia: "cuda12-kokoro" - intel: "intel-kokoro" - amd: "rocm-kokoro" - nvidia-l4t: "nvidia-l4t-kokoro" - metal: "metal-kokoro" - nvidia-cuda-13: "cuda13-kokoro" - nvidia-cuda-12: "cuda12-kokoro" - nvidia-l4t-cuda-12: "nvidia-l4t-kokoro" -- &kokoros + amd: rocm-kokoro + default: cpu-kokoro + intel: intel-kokoro + metal: metal-kokoro + nvidia: cuda12-kokoro + nvidia-cuda-12: cuda12-kokoro + nvidia-cuda-13: cuda13-kokoro + nvidia-l4t: nvidia-l4t-kokoro + nvidia-l4t-cuda-12: nvidia-l4t-kokoro +- name: kokoros + alias: kokoros + license: apache-2.0 icon: https://avatars.githubusercontent.com/u/166769057?v=4 description: | Kokoros is a pure Rust TTS backend using the Kokoro ONNX model (82M parameters). @@ -1673,104 +2640,93 @@ - TTS - Rust - ONNX - license: apache-2.0 - alias: "kokoros" - name: "kokoros" capabilities: - default: "cpu-kokoros" -- &coqui + default: cpu-kokoros +- name: coqui + alias: coqui + license: mpl-2.0 + icon: https://avatars.githubusercontent.com/u/1338804?s=200&v=4 + description: "\U0001F438 Coqui TTS is a library for advanced Text-to-Speech generation.\n\n\U0001F680 Pretrained models in +1100 languages.\n\n\U0001F6E0️ Tools for training new models and fine-tuning existing models in any language.\n\n\U0001F4DA Utilities for dataset analysis and curation.\n" urls: - https://github.com/idiap/coqui-ai-TTS - description: | - 🐸 Coqui TTS is a library for advanced Text-to-Speech generation. - - 🚀 Pretrained models in +1100 languages. - - 🛠️ Tools for training new models and fine-tuning existing models in any language. - - 📚 Utilities for dataset analysis and curation. tags: - text-to-speech - TTS - license: mpl-2.0 - name: "coqui" - alias: "coqui" capabilities: - nvidia: "cuda12-coqui" - intel: "intel-coqui" - amd: "rocm-coqui" - metal: "metal-coqui" - nvidia-cuda-12: "cuda12-coqui" - icon: https://avatars.githubusercontent.com/u/1338804?s=200&v=4 -- &outetts - urls: - - https://github.com/OuteAI/outetts + amd: rocm-coqui + intel: intel-coqui + metal: metal-coqui + nvidia: cuda12-coqui + nvidia-cuda-12: cuda12-coqui +- name: outetts + alias: outetts + license: apache-2.0 description: | OuteTTS is an open-weight text-to-speech model from OuteAI (OuteAI/OuteTTS-0.3-1B). Supports custom speaker voices via audio path or default speakers. + urls: + - https://github.com/OuteAI/outetts tags: - text-to-speech - TTS - license: apache-2.0 - name: "outetts" - alias: "outetts" capabilities: - default: "cpu-outetts" - nvidia-cuda-12: "cuda12-outetts" -- &chatterbox - urls: - - https://github.com/resemble-ai/chatterbox + default: cpu-outetts + nvidia-cuda-12: cuda12-outetts +- name: chatterbox + alias: chatterbox + license: MIT + icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 description: | Resemble AI's first production-grade open source TTS model. Licensed under MIT, Chatterbox has been benchmarked against leading closed-source systems like ElevenLabs, and is consistently preferred in side-by-side evaluations. Whether you're working on memes, videos, games, or AI agents, Chatterbox brings your content to life. It's also the first open source TTS model to support emotion exaggeration control, a powerful feature that makes your voices stand out. + urls: + - https://github.com/resemble-ai/chatterbox tags: - text-to-speech - TTS - license: MIT - icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 - name: "chatterbox" - alias: "chatterbox" capabilities: - nvidia: "cuda12-chatterbox" - metal: "metal-chatterbox" - default: "cpu-chatterbox" - nvidia-l4t: "nvidia-l4t-arm64-chatterbox" - nvidia-cuda-13: "cuda13-chatterbox" - nvidia-cuda-12: "cuda12-chatterbox" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-chatterbox" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-chatterbox" -- &vibevoice - urls: - - https://github.com/microsoft/VibeVoice + default: cpu-chatterbox + metal: metal-chatterbox + nvidia: cuda12-chatterbox + nvidia-cuda-12: cuda12-chatterbox + nvidia-cuda-13: cuda13-chatterbox + nvidia-l4t: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-12: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-chatterbox +- name: vibevoice + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 description: | VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice tags: - text-to-speech - TTS - license: mit - name: "vibevoice" - alias: "vibevoice" capabilities: - nvidia: "cuda12-vibevoice" - intel: "intel-vibevoice" - amd: "rocm-vibevoice" - nvidia-l4t: "nvidia-l4t-vibevoice" - metal: "metal-vibevoice" - default: "cpu-vibevoice" - nvidia-cuda-13: "cuda13-vibevoice" - nvidia-cuda-12: "cuda12-vibevoice" - nvidia-l4t-cuda-12: "nvidia-l4t-vibevoice" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-vibevoice" - icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 -- &liquid-audio - urls: - - https://github.com/Liquid4All/liquid-audio - - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice +- name: liquid-audio + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png description: | LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the upstream `liquid-audio` package; supports fine-tuning via LocalAI's /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B tags: - speech-to-speech - any-to-any @@ -1779,5267 +2735,24590 @@ - TTS - ASR - realtime - license: LFM-Open-License-v1.0 - name: "liquid-audio" - alias: "liquid-audio" capabilities: - nvidia: "cuda12-liquid-audio" - intel: "intel-liquid-audio" - amd: "rocm-liquid-audio" - default: "cpu-liquid-audio" - nvidia-cuda-13: "cuda13-liquid-audio" - nvidia-cuda-12: "cuda12-liquid-audio" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-liquid-audio" - metal: "metal-liquid-audio" - icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png -- &qwen-tts - urls: - - https://github.com/QwenLM/Qwen3-TTS + amd: rocm-liquid-audio + default: cpu-liquid-audio + intel: intel-liquid-audio + metal: metal-liquid-audio + nvidia: cuda12-liquid-audio + nvidia-cuda-12: cuda12-liquid-audio + nvidia-cuda-13: cuda13-liquid-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio +- name: qwen-tts + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png description: | Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS tags: - text-to-speech - TTS - license: apache-2.0 - name: "qwen-tts" - alias: "qwen-tts" capabilities: - nvidia: "cuda12-qwen-tts" - intel: "intel-qwen-tts" - amd: "rocm-qwen-tts" - nvidia-l4t: "nvidia-l4t-qwen-tts" - metal: "metal-qwen-tts" - default: "cpu-qwen-tts" - nvidia-cuda-13: "cuda13-qwen-tts" - nvidia-cuda-12: "cuda12-qwen-tts" - nvidia-l4t-cuda-12: "nvidia-l4t-qwen-tts" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-qwen-tts" - icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png -- &fish-speech - urls: - - https://github.com/fishaudio/fish-speech + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts +- name: fish-speech + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 description: | Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech tags: - text-to-speech - TTS - voice-cloning - license: apache-2.0 - name: "fish-speech" - alias: "fish-speech" capabilities: - nvidia: "cuda12-fish-speech" - intel: "intel-fish-speech" - amd: "rocm-fish-speech" - nvidia-l4t: "nvidia-l4t-fish-speech" - default: "cpu-fish-speech" - nvidia-cuda-13: "cuda13-fish-speech" - nvidia-cuda-12: "cuda12-fish-speech" - nvidia-l4t-cuda-12: "nvidia-l4t-fish-speech" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-fish-speech" - icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 -- &faster-qwen3-tts + amd: rocm-fish-speech + default: cpu-fish-speech + intel: intel-fish-speech + nvidia: cuda12-fish-speech + nvidia-cuda-12: cuda12-fish-speech + nvidia-cuda-13: cuda13-fish-speech + nvidia-l4t: nvidia-l4t-fish-speech + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech +- name: faster-qwen3-tts + alias: faster-qwen3-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Real-time Qwen3-TTS inference using CUDA graph capture. Voice clone only; requires NVIDIA GPU with CUDA. urls: - https://github.com/andimarafioti/faster-qwen3-tts - https://pypi.org/project/faster-qwen3-tts/ - description: | - Real-time Qwen3-TTS inference using CUDA graph capture. Voice clone only; requires NVIDIA GPU with CUDA. tags: - text-to-speech - TTS - voice-clone - license: apache-2.0 - name: "faster-qwen3-tts" - alias: "faster-qwen3-tts" capabilities: - nvidia: "cuda12-faster-qwen3-tts" - default: "cuda12-faster-qwen3-tts" - nvidia-cuda-13: "cuda13-faster-qwen3-tts" - nvidia-cuda-12: "cuda12-faster-qwen3-tts" - nvidia-l4t: "nvidia-l4t-faster-qwen3-tts" - nvidia-l4t-cuda-12: "nvidia-l4t-faster-qwen3-tts" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-faster-qwen3-tts" - icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png -- &funasr - urls: - - https://github.com/modelscope/FunASR + default: cuda12-faster-qwen3-tts + nvidia: cuda12-faster-qwen3-tts + nvidia-cuda-12: cuda12-faster-qwen3-tts + nvidia-cuda-13: cuda13-faster-qwen3-tts + nvidia-l4t: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-12: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-faster-qwen3-tts +- name: funasr + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 description: | FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR tags: - speech-recognition - ASR - multilingual - license: mit - name: "funasr" - alias: "funasr" capabilities: - nvidia: "cuda12-funasr" - intel: "intel-funasr" - amd: "rocm-funasr" - metal: "metal-funasr" - default: "cpu-funasr" - nvidia-cuda-13: "cuda13-funasr" - nvidia-cuda-12: "cuda12-funasr" - nvidia-l4t: "nvidia-l4t-funasr" - nvidia-l4t-cuda-12: "nvidia-l4t-funasr" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-funasr" - icon: https://avatars.githubusercontent.com/u/109454077 -- &qwen-asr - urls: - - https://github.com/QwenLM/Qwen3-ASR + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr +- name: qwen-asr + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png description: | Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR tags: - speech-recognition - ASR - license: apache-2.0 - name: "qwen-asr" - alias: "qwen-asr" capabilities: - nvidia: "cuda12-qwen-asr" - intel: "intel-qwen-asr" - amd: "rocm-qwen-asr" - nvidia-l4t: "nvidia-l4t-qwen-asr" - metal: "metal-qwen-asr" - default: "cpu-qwen-asr" - nvidia-cuda-13: "cuda13-qwen-asr" - nvidia-cuda-12: "cuda12-qwen-asr" - nvidia-l4t-cuda-12: "nvidia-l4t-qwen-asr" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-qwen-asr" - icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png -- &nemo - urls: - - https://github.com/NVIDIA/NeMo + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr +- name: nemo + alias: nemo + license: apache-2.0 + icon: https://www.nvidia.com/favicon.ico description: | NVIDIA NEMO Toolkit for ASR provides state-of-the-art automatic speech recognition models including Parakeet models for various languages and use cases. + urls: + - https://github.com/NVIDIA/NeMo tags: - speech-recognition - ASR - NVIDIA - license: apache-2.0 - name: "nemo" - alias: "nemo" capabilities: - nvidia: "cuda12-nemo" - intel: "intel-nemo" - amd: "rocm-nemo" - metal: "metal-nemo" - default: "cpu-nemo" - nvidia-cuda-13: "cuda13-nemo" - nvidia-cuda-12: "cuda12-nemo" - icon: https://www.nvidia.com/favicon.ico -- &voxcpm - urls: - - https://github.com/ModelBest/VoxCPM + amd: rocm-nemo + default: cpu-nemo + intel: intel-nemo + metal: metal-nemo + nvidia: cuda12-nemo + nvidia-cuda-12: cuda12-nemo + nvidia-cuda-13: cuda13-nemo +- name: voxcpm + alias: voxcpm + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 description: | VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech. + urls: + - https://github.com/ModelBest/VoxCPM tags: - text-to-speech - TTS - license: mit - name: "voxcpm" - alias: "voxcpm" capabilities: - nvidia: "cuda12-voxcpm" - intel: "intel-voxcpm" - amd: "rocm-voxcpm" - metal: "metal-voxcpm" - default: "cpu-voxcpm" - nvidia-cuda-13: "cuda13-voxcpm" - nvidia-cuda-12: "cuda12-voxcpm" - icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 -- &pocket-tts - urls: - - https://github.com/kyutai-labs/pocket-tts + amd: rocm-voxcpm + default: cpu-voxcpm + intel: intel-voxcpm + metal: metal-voxcpm + nvidia: cuda12-voxcpm + nvidia-cuda-12: cuda12-voxcpm + nvidia-cuda-13: cuda13-voxcpm +- name: pocket-tts + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 description: | Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts tags: - text-to-speech - TTS - license: mit - name: "pocket-tts" - alias: "pocket-tts" capabilities: - nvidia: "cuda12-pocket-tts" - intel: "intel-pocket-tts" - amd: "rocm-pocket-tts" - nvidia-l4t: "nvidia-l4t-pocket-tts" - metal: "metal-pocket-tts" - default: "cpu-pocket-tts" - nvidia-cuda-13: "cuda13-pocket-tts" - nvidia-cuda-12: "cuda12-pocket-tts" - nvidia-l4t-cuda-12: "nvidia-l4t-pocket-tts" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-pocket-tts" - icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 -- &piper - name: "piper" + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts +- name: piper + license: MIT icon: https://github.com/OHF-Voice/piper1-gpl/raw/main/etc/logo.png + description: | + A fast, local neural text to speech system urls: - https://github.com/rhasspy/piper - https://github.com/mudler/go-piper - license: MIT - description: | - A fast, local neural text to speech system tags: - text-to-speech - TTS capabilities: - default: "cpu-piper" - metal: "metal-piper" -- &opus - name: "opus" - alias: "opus" - capabilities: - default: "cpu-opus" - metal: "metal-opus" - urls: - - https://opus-codec.org/ + default: cpu-piper + metal: metal-piper +- name: opus + alias: opus license: BSD-3-Clause description: | Opus audio codec backend for encoding and decoding audio. Required for WebRTC transport in the Realtime API. + urls: + - https://opus-codec.org/ tags: - audio-codec - opus - WebRTC - realtime -- !!merge <<: *opus - name: "opus-development" capabilities: - default: "cpu-opus-development" - metal: "metal-opus-development" -- &silero-vad - name: "silero-vad" - icon: https://user-images.githubusercontent.com/12515440/89997349-b3523080-dc94-11ea-9906-ca2e8bc50535.png + default: cpu-opus + metal: metal-opus +- name: opus-development + alias: opus + license: BSD-3-Clause + description: | + Opus audio codec backend for encoding and decoding audio. + Required for WebRTC transport in the Realtime API. urls: - - https://github.com/snakers4/silero-vad + - https://opus-codec.org/ + tags: + - audio-codec + - opus + - WebRTC + - realtime capabilities: - default: "cpu-silero-vad" - metal: "metal-silero-vad" + default: cpu-opus-development + metal: metal-opus-development +- name: silero-vad + icon: https://user-images.githubusercontent.com/12515440/89997349-b3523080-dc94-11ea-9906-ca2e8bc50535.png description: | Silero VAD: pre-trained enterprise-grade Voice Activity Detector. Silero VAD is a voice activity detection model that can be used to detect whether a given audio contains speech or not. + urls: + - https://github.com/snakers4/silero-vad tags: - voice-activity-detection - VAD - silero-vad - CPU -- &local-store - name: "local-store" - urls: - - https://github.com/mudler/LocalAI + capabilities: + default: cpu-silero-vad + metal: metal-silero-vad +- name: local-store + license: MIT description: | Local Store is a local-first, self-hosted, and open-source vector database. + urls: + - https://github.com/mudler/LocalAI tags: - vector-database - local-first - open-source - CPU - license: MIT capabilities: - default: "cpu-local-store" - metal: "metal-local-store" -- &cloud-proxy - name: "cloud-proxy" - alias: "cloud-proxy" - urls: - - https://github.com/mudler/LocalAI/tree/master/backend/go/cloud-proxy + default: cpu-local-store + metal: metal-local-store +- name: cloud-proxy + alias: cloud-proxy + license: MIT description: | Forward OpenAI-compatible and Anthropic chat requests to external providers. + urls: + - https://github.com/mudler/LocalAI/tree/master/backend/go/cloud-proxy tags: - text-to-text - cloud - proxy - CPU - license: MIT capabilities: - default: "cpu-cloud-proxy" - metal: "metal-cloud-proxy" -- &localai-proxy - name: "localai-proxy" - alias: "localai-proxy" - urls: - - https://github.com/mudler/LocalAI/tree/master/backend/go/localai-proxy + default: cpu-cloud-proxy + metal: metal-cloud-proxy +- name: localai-proxy + alias: localai-proxy + license: MIT description: | Serve a model from another LocalAI instance: text, embeddings, rerank, audio, image and video requests are forwarded to its REST API. + urls: + - https://github.com/mudler/LocalAI/tree/master/backend/go/localai-proxy tags: - text-to-text - proxy - CPU - license: MIT capabilities: - default: "cpu-localai-proxy" - metal: "metal-localai-proxy" -- &valkey-store - name: "valkey-store" - urls: - - https://github.com/mudler/LocalAI + default: cpu-localai-proxy + metal: metal-localai-proxy +- name: valkey-store + license: MIT description: | Valkey Store is a Valkey Search (FT.*) backed vector store for LocalAI. It persists vectors across restarts and supports opt-in HNSW indexing. Requires a reachable Valkey Search server (valkey/valkey-bundle). + urls: + - https://github.com/mudler/LocalAI tags: - vector-database - valkey - open-source - CPU - license: MIT capabilities: - default: "cpu-valkey-store" - metal: "metal-valkey-store" -- &qdrant-store - name: "qdrant-store" - urls: - - https://github.com/mudler/LocalAI - - https://github.com/qdrant/qdrant + default: cpu-valkey-store + metal: metal-valkey-store +- name: qdrant-store + license: MIT description: | Qdrant Store is a Qdrant-backed vector store for LocalAI. It persists vectors across restarts in HNSW-indexed collections and works with self-hosted Qdrant (single node or cluster) and Qdrant Cloud. Requires a reachable Qdrant server (gRPC port, 6334 by default). + urls: + - https://github.com/mudler/LocalAI + - https://github.com/qdrant/qdrant tags: - vector-database - qdrant - open-source - CPU - license: MIT capabilities: - default: "cpu-qdrant-store" - metal: "metal-qdrant-store" -- &kitten-tts - name: "kitten-tts" - urls: - - https://github.com/KittenML/KittenTTS + default: cpu-qdrant-store + metal: metal-qdrant-store +- name: kitten-tts + license: apache-2.0 description: | Kitten TTS is a text-to-speech model that can generate speech from text. + urls: + - https://github.com/KittenML/KittenTTS tags: - text-to-speech - TTS - license: apache-2.0 capabilities: - default: "cpu-kitten-tts" - metal: "metal-kitten-tts" -- &neutts - name: "neutts" - urls: - - https://github.com/neuphonic/neutts-air + default: cpu-kitten-tts + metal: metal-kitten-tts +- name: neutts + license: apache-2.0 description: | NeuTTS Air is the world’s first super-realistic, on-device, TTS speech language model with instant voice cloning. Built off a 0.5B LLM backbone, NeuTTS Air brings natural-sounding speech, real-time performance, built-in security and speaker cloning to your local device - unlocking a new category of embedded voice agents, assistants, toys, and compliance-safe apps. + urls: + - https://github.com/neuphonic/neutts-air tags: - text-to-speech - TTS - license: apache-2.0 capabilities: - default: "cpu-neutts" - nvidia: "cuda12-neutts" - amd: "rocm-neutts" - nvidia-cuda-12: "cuda12-neutts" -- &sherpa-onnx - name: "sherpa-onnx" - alias: "sherpa-onnx" - urls: - - https://k2-fsa.github.io/sherpa/onnx/ + amd: rocm-neutts + default: cpu-neutts + nvidia: cuda12-neutts + nvidia-cuda-12: cuda12-neutts +- name: sherpa-onnx + alias: sherpa-onnx description: | Sherpa-ONNX backend for text-to-speech (VITS, Matcha, Kokoro), speech-to-text (Whisper, Paraformer, SenseVoice, Omnilingual ASR CTC), and voice activity detection via ONNX Runtime. Supports multi-speaker voices, 1600+ language ASR, and GPU acceleration. + urls: + - https://k2-fsa.github.io/sherpa/onnx/ tags: - text-to-speech - TTS - speech-to-text - ASR capabilities: - default: "cpu-sherpa-onnx" - nvidia: "cuda12-sherpa-onnx" - nvidia-cuda-12: "cuda12-sherpa-onnx" - metal: "metal-sherpa-onnx" -- &supertonic - name: "supertonic" - alias: "supertonic" - urls: - - https://github.com/supertone-inc/supertonic + default: cpu-sherpa-onnx + metal: metal-sherpa-onnx + nvidia: cuda12-sherpa-onnx + nvidia-cuda-12: cuda12-sherpa-onnx +- name: supertonic + alias: supertonic description: | Supertonic backend: lightning-fast, on-device multilingual text-to-speech via ONNX Runtime. Runs Supertone's flow-matching TTS model (Supertone/supertonic-3), 44.1kHz output, 31 languages, multiple preset voice styles. No espeak-ng dependency. + urls: + - https://github.com/supertone-inc/supertonic tags: - text-to-speech - TTS capabilities: - default: "cpu-supertonic" - metal: "metal-supertonic" -- !!merge <<: *neutts - name: "neutts-development" + default: cpu-supertonic + metal: metal-supertonic +- name: neutts-development + license: apache-2.0 + description: | + NeuTTS Air is the world’s first super-realistic, on-device, TTS speech language model with instant voice cloning. Built off a 0.5B LLM backbone, NeuTTS Air brings natural-sounding speech, real-time performance, built-in security and speaker cloning to your local device - unlocking a new category of embedded voice agents, assistants, toys, and compliance-safe apps. + urls: + - https://github.com/neuphonic/neutts-air + tags: + - text-to-speech + - TTS capabilities: - default: "cpu-neutts-development" - nvidia: "cuda12-neutts-development" - amd: "rocm-neutts-development" - nvidia-cuda-12: "cuda12-neutts-development" -- !!merge <<: *llamacpp - name: "llama-cpp-development" + amd: rocm-neutts-development + default: cpu-neutts-development + nvidia: cuda12-neutts-development + nvidia-cuda-12: cuda12-neutts-development +- name: llama-cpp-development + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP capabilities: - default: "cpu-llama-cpp-development" - nvidia: "cuda12-llama-cpp-development" - intel: "intel-sycl-f16-llama-cpp-development" - amd: "rocm-llama-cpp-development" - metal: "metal-llama-cpp-development" - vulkan: "vulkan-llama-cpp-development" - nvidia-l4t: "nvidia-l4t-arm64-llama-cpp-development" - nvidia-cuda-13: "cuda13-llama-cpp-development" - nvidia-cuda-12: "cuda12-llama-cpp-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-llama-cpp-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-llama-cpp-development" -- !!merge <<: *ikllamacpp - name: "ik-llama-cpp-development" + amd: rocm-llama-cpp-development + default: cpu-llama-cpp-development + intel: intel-sycl-f16-llama-cpp-development + metal: metal-llama-cpp-development + nvidia: cuda12-llama-cpp-development + nvidia-cuda-12: cuda12-llama-cpp-development + nvidia-cuda-13: cuda13-llama-cpp-development + nvidia-l4t: nvidia-l4t-arm64-llama-cpp-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp-development + vulkan: vulkan-llama-cpp-development +- name: ik-llama-cpp-development + alias: ik-llama-cpp + license: mit + description: | + Fork of llama.cpp optimized for CPU performance by ikawrakow + urls: + - https://github.com/ikawrakow/ik_llama.cpp + tags: + - text-to-text + - LLM + - CPU capabilities: - default: "cpu-ik-llama-cpp-development" -- !!merge <<: *turboquant - name: "turboquant-development" + default: cpu-ik-llama-cpp-development +- name: turboquant-development + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache capabilities: - default: "cpu-turboquant-development" - nvidia: "cuda12-turboquant-development" - intel: "intel-sycl-f16-turboquant-development" - amd: "rocm-turboquant-development" - vulkan: "vulkan-turboquant-development" - nvidia-l4t: "nvidia-l4t-arm64-turboquant-development" - nvidia-cuda-13: "cuda13-turboquant-development" - nvidia-cuda-12: "cuda12-turboquant-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-turboquant-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-turboquant-development" -- !!merge <<: *bonsai - name: "bonsai-development" + amd: rocm-turboquant-development + default: cpu-turboquant-development + intel: intel-sycl-f16-turboquant-development + nvidia: cuda12-turboquant-development + nvidia-cuda-12: cuda12-turboquant-development + nvidia-cuda-13: cuda13-turboquant-development + nvidia-l4t: nvidia-l4t-arm64-turboquant-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant-development + vulkan: vulkan-turboquant-development +- name: bonsai-development + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary capabilities: - default: "cpu-bonsai-development" - nvidia: "cuda12-bonsai-development" - intel: "intel-sycl-f16-bonsai-development" - amd: "rocm-bonsai-development" - vulkan: "vulkan-bonsai-development" - nvidia-l4t: "nvidia-l4t-arm64-bonsai-development" - nvidia-cuda-13: "cuda13-bonsai-development" - nvidia-cuda-12: "cuda12-bonsai-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-bonsai-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-bonsai-development" -- !!merge <<: *ds4 - name: "ds4-development" + amd: rocm-bonsai-development + default: cpu-bonsai-development + intel: intel-sycl-f16-bonsai-development + nvidia: cuda12-bonsai-development + nvidia-cuda-12: cuda12-bonsai-development + nvidia-cuda-13: cuda13-bonsai-development + nvidia-l4t: nvidia-l4t-arm64-bonsai-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai-development + vulkan: vulkan-bonsai-development +- name: ds4-development + alias: ds4 + license: mit + description: | + antirez/ds4 - DeepSeek V4 Flash inference engine. Single-model, + optimized for Metal (Darwin) and CUDA (Linux). Requires the GGUFs + published at huggingface.co/antirez/deepseek-v4-gguf. + urls: + - https://github.com/antirez/ds4 + tags: + - text-to-text + - LLM + - CPU + - CUDA + - Metal capabilities: - default: "cpu-ds4-development" - nvidia: "cuda13-ds4-development" - nvidia-cuda-13: "cuda13-ds4-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-ds4-development" - metal: "metal-ds4-development" - metal-darwin-arm64: "metal-ds4-development" -- !!merge <<: *audiocpp - name: "audio-cpp-development" + default: cpu-ds4-development + metal: metal-ds4-development + metal-darwin-arm64: metal-ds4-development + nvidia: cuda13-ds4-development + nvidia-cuda-13: cuda13-ds4-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ds4-development +- name: audio-cpp-development + alias: audio-cpp + license: apache-2.0 + description: | + 0xShug0/audio.cpp - a ggml audio inference framework covering text to + speech, voice cloning, transcription, forced alignment, voice activity + detection, speaker diarization, source separation, voice conversion and + music generation, across 30+ model families. Consumes audio.cpp-native + GGUF packages from huggingface.co/audio-cpp/audio.cpp-gguf. + urls: + - https://github.com/0xShug0/audio.cpp + - https://huggingface.co/audio-cpp/audio.cpp-gguf + tags: + - TTS + - text-to-speech + - audio-transcription + - CPU + - CUDA + - HIP + - Metal capabilities: - default: "cpu-audio-cpp-development" - nvidia: "cuda12-audio-cpp-development" - nvidia-cuda-12: "cuda12-audio-cpp-development" - nvidia-cuda-13: "cuda13-audio-cpp-development" - amd: "rocm-audio-cpp-development" - metal: "metal-audio-cpp-development" - metal-darwin-arm64: "metal-audio-cpp-development" -- !!merge <<: *stablediffusionggml - name: "stablediffusion-ggml-development" + amd: rocm-audio-cpp-development + default: cpu-audio-cpp-development + metal: metal-audio-cpp-development + metal-darwin-arm64: metal-audio-cpp-development + nvidia: cuda12-audio-cpp-development + nvidia-cuda-12: cuda12-audio-cpp-development + nvidia-cuda-13: cuda13-audio-cpp-development +- name: stablediffusion-ggml-development + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP capabilities: - default: "cpu-stablediffusion-ggml-development" - nvidia: "cuda12-stablediffusion-ggml-development" - intel: "intel-sycl-f16-stablediffusion-ggml-development" - amd: "rocm-stablediffusion-ggml-development" - vulkan: "vulkan-stablediffusion-ggml-development" - nvidia-l4t: "nvidia-l4t-arm64-stablediffusion-ggml-development" - metal: "metal-stablediffusion-ggml-development" - nvidia-cuda-13: "cuda13-stablediffusion-ggml-development" - nvidia-cuda-12: "cuda12-stablediffusion-ggml-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-stablediffusion-ggml-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-stablediffusion-ggml-development" -- !!merge <<: *trellis2cpp - name: "trellis2cpp-development" + amd: rocm-stablediffusion-ggml-development + default: cpu-stablediffusion-ggml-development + intel: intel-sycl-f16-stablediffusion-ggml-development + metal: metal-stablediffusion-ggml-development + nvidia: cuda12-stablediffusion-ggml-development + nvidia-cuda-12: cuda12-stablediffusion-ggml-development + nvidia-cuda-13: cuda13-stablediffusion-ggml-development + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml-development + vulkan: vulkan-stablediffusion-ggml-development +- name: trellis2cpp-development + alias: trellis2cpp + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal capabilities: - default: "cpu-trellis2cpp-development" - nvidia: "cuda12-trellis2cpp-development" - vulkan: "vulkan-trellis2cpp-development" - nvidia-l4t: "nvidia-l4t-arm64-trellis2cpp-development" - metal: "metal-trellis2cpp-development" - nvidia-cuda-13: "cuda13-trellis2cpp-development" - nvidia-cuda-12: "cuda12-trellis2cpp-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-trellis2cpp-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-trellis2cpp-development" -- !!merge <<: *neutts - name: "cpu-neutts" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-neutts" + default: cpu-trellis2cpp-development + metal: metal-trellis2cpp-development + nvidia: cuda12-trellis2cpp-development + nvidia-cuda-12: cuda12-trellis2cpp-development + nvidia-cuda-13: cuda13-trellis2cpp-development + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp-development + vulkan: vulkan-trellis2cpp-development +- name: cpu-neutts + license: apache-2.0 + description: | + NeuTTS Air is the world’s first super-realistic, on-device, TTS speech language model with instant voice cloning. Built off a 0.5B LLM backbone, NeuTTS Air brings natural-sounding speech, real-time performance, built-in security and speaker cloning to your local device - unlocking a new category of embedded voice agents, assistants, toys, and compliance-safe apps. + urls: + - https://github.com/neuphonic/neutts-air + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-neutts + default: cpu-neutts + nvidia: cuda12-neutts + nvidia-cuda-12: cuda12-neutts + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-neutts mirrors: - localai/localai-backends:latest-cpu-neutts -- !!merge <<: *neutts - name: "cuda12-neutts" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-neutts" +- name: cuda12-neutts + license: apache-2.0 + description: | + NeuTTS Air is the world’s first super-realistic, on-device, TTS speech language model with instant voice cloning. Built off a 0.5B LLM backbone, NeuTTS Air brings natural-sounding speech, real-time performance, built-in security and speaker cloning to your local device - unlocking a new category of embedded voice agents, assistants, toys, and compliance-safe apps. + urls: + - https://github.com/neuphonic/neutts-air + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-neutts + default: cpu-neutts + nvidia: cuda12-neutts + nvidia-cuda-12: cuda12-neutts + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-neutts mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-neutts -- !!merge <<: *neutts - name: "rocm-neutts" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-neutts" +- name: rocm-neutts + license: apache-2.0 + description: | + NeuTTS Air is the world’s first super-realistic, on-device, TTS speech language model with instant voice cloning. Built off a 0.5B LLM backbone, NeuTTS Air brings natural-sounding speech, real-time performance, built-in security and speaker cloning to your local device - unlocking a new category of embedded voice agents, assistants, toys, and compliance-safe apps. + urls: + - https://github.com/neuphonic/neutts-air + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-neutts + default: cpu-neutts + nvidia: cuda12-neutts + nvidia-cuda-12: cuda12-neutts + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-neutts mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-neutts -- !!merge <<: *neutts - name: "cpu-neutts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-neutts" +- name: cpu-neutts-development + license: apache-2.0 + description: | + NeuTTS Air is the world’s first super-realistic, on-device, TTS speech language model with instant voice cloning. Built off a 0.5B LLM backbone, NeuTTS Air brings natural-sounding speech, real-time performance, built-in security and speaker cloning to your local device - unlocking a new category of embedded voice agents, assistants, toys, and compliance-safe apps. + urls: + - https://github.com/neuphonic/neutts-air + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-neutts + default: cpu-neutts + nvidia: cuda12-neutts + nvidia-cuda-12: cuda12-neutts + uri: quay.io/go-skynet/local-ai-backends:master-cpu-neutts mirrors: - localai/localai-backends:master-cpu-neutts -- !!merge <<: *neutts - name: "cuda12-neutts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-neutts" +- name: cuda12-neutts-development + license: apache-2.0 + description: | + NeuTTS Air is the world’s first super-realistic, on-device, TTS speech language model with instant voice cloning. Built off a 0.5B LLM backbone, NeuTTS Air brings natural-sounding speech, real-time performance, built-in security and speaker cloning to your local device - unlocking a new category of embedded voice agents, assistants, toys, and compliance-safe apps. + urls: + - https://github.com/neuphonic/neutts-air + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-neutts + default: cpu-neutts + nvidia: cuda12-neutts + nvidia-cuda-12: cuda12-neutts + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-neutts mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-neutts -- !!merge <<: *neutts - name: "rocm-neutts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-neutts" +- name: rocm-neutts-development + license: apache-2.0 + description: | + NeuTTS Air is the world’s first super-realistic, on-device, TTS speech language model with instant voice cloning. Built off a 0.5B LLM backbone, NeuTTS Air brings natural-sounding speech, real-time performance, built-in security and speaker cloning to your local device - unlocking a new category of embedded voice agents, assistants, toys, and compliance-safe apps. + urls: + - https://github.com/neuphonic/neutts-air + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-neutts + default: cpu-neutts + nvidia: cuda12-neutts + nvidia-cuda-12: cuda12-neutts + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-neutts mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-neutts -- !!merge <<: *mlx - name: "metal-mlx" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx" +- name: metal-mlx + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run LLMs with MLX + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + capabilities: + default: cpu-mlx + metal: metal-mlx + nvidia: cuda12-mlx + nvidia-cuda-12: cuda12-mlx + nvidia-cuda-13: cuda13-mlx + nvidia-l4t: nvidia-l4t-mlx + nvidia-l4t-cuda-12: nvidia-l4t-mlx + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx mirrors: - localai/localai-backends:latest-metal-darwin-arm64-mlx -- !!merge <<: *mlx-video - name: "metal-mlx-video" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx-video" +- name: metal-mlx-video + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Generate videos with LTX-2 and converted Wan2.1/Wan2.2 checkpoints using + MLX on Apple Silicon. + urls: + - https://github.com/Blaizzy/mlx-video + tags: + - text-to-video + - image-to-video + - MLX + capabilities: + metal: metal-mlx-video + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx-video mirrors: - localai/localai-backends:latest-metal-darwin-arm64-mlx-video -- !!merge <<: *mlx-video - name: "metal-mlx-video-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-mlx-video" +- name: metal-mlx-video-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Generate videos with LTX-2 and converted Wan2.1/Wan2.2 checkpoints using + MLX on Apple Silicon. + urls: + - https://github.com/Blaizzy/mlx-video + tags: + - text-to-video + - image-to-video + - MLX + capabilities: + metal: metal-mlx-video + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-mlx-video mirrors: - localai/localai-backends:master-metal-darwin-arm64-mlx-video -- !!merge <<: *mlx-video - name: "mlx-video-development" +- name: mlx-video-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Generate videos with LTX-2 and converted Wan2.1/Wan2.2 checkpoints using + MLX on Apple Silicon. + urls: + - https://github.com/Blaizzy/mlx-video + tags: + - text-to-video + - image-to-video + - MLX capabilities: - metal: "metal-mlx-video-development" -- !!merge <<: *mlx - name: "metal-mlx-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-mlx" + metal: metal-mlx-video-development +- name: metal-mlx-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run LLMs with MLX + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + capabilities: + default: cpu-mlx + metal: metal-mlx + nvidia: cuda12-mlx + nvidia-cuda-12: cuda12-mlx + nvidia-cuda-13: cuda13-mlx + nvidia-l4t: nvidia-l4t-mlx + nvidia-l4t-cuda-12: nvidia-l4t-mlx + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-mlx mirrors: - localai/localai-backends:master-metal-darwin-arm64-mlx -- !!merge <<: *mlx - name: "mlx-development" +- name: mlx-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run LLMs with MLX + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX capabilities: - default: "cpu-mlx-development" - nvidia: "cuda12-mlx-development" - metal: "metal-mlx-development" - nvidia-cuda-12: "cuda12-mlx-development" - nvidia-cuda-13: "cuda13-mlx-development" - nvidia-l4t: "nvidia-l4t-mlx-development" - nvidia-l4t-cuda-12: "nvidia-l4t-mlx-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx-development" -- !!merge <<: *mlx-vlm - name: "metal-mlx-vlm" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx-vlm" + default: cpu-mlx-development + metal: metal-mlx-development + nvidia: cuda12-mlx-development + nvidia-cuda-12: cuda12-mlx-development + nvidia-cuda-13: cuda13-mlx-development + nvidia-l4t: nvidia-l4t-mlx-development + nvidia-l4t-cuda-12: nvidia-l4t-mlx-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-development +- name: metal-mlx-vlm + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Vision-Language Models with MLX + urls: + - https://github.com/Blaizzy/mlx-vlm + tags: + - text-to-text + - multimodal + - vision-language + - LLM + - MLX + capabilities: + default: cpu-mlx-vlm + metal: metal-mlx-vlm + nvidia: cuda12-mlx-vlm + nvidia-cuda-12: cuda12-mlx-vlm + nvidia-cuda-13: cuda13-mlx-vlm + nvidia-l4t: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-12: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-vlm + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx-vlm mirrors: - localai/localai-backends:latest-metal-darwin-arm64-mlx-vlm -- !!merge <<: *mlx-vlm - name: "metal-mlx-vlm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-mlx-vlm" +- name: metal-mlx-vlm-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Vision-Language Models with MLX + urls: + - https://github.com/Blaizzy/mlx-vlm + tags: + - text-to-text + - multimodal + - vision-language + - LLM + - MLX + capabilities: + default: cpu-mlx-vlm + metal: metal-mlx-vlm + nvidia: cuda12-mlx-vlm + nvidia-cuda-12: cuda12-mlx-vlm + nvidia-cuda-13: cuda13-mlx-vlm + nvidia-l4t: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-12: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-vlm + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-mlx-vlm mirrors: - localai/localai-backends:master-metal-darwin-arm64-mlx-vlm -- !!merge <<: *mlx-vlm - name: "mlx-vlm-development" +- name: mlx-vlm-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Vision-Language Models with MLX + urls: + - https://github.com/Blaizzy/mlx-vlm + tags: + - text-to-text + - multimodal + - vision-language + - LLM + - MLX capabilities: - default: "cpu-mlx-vlm-development" - nvidia: "cuda12-mlx-vlm-development" - metal: "metal-mlx-vlm-development" - nvidia-cuda-12: "cuda12-mlx-vlm-development" - nvidia-cuda-13: "cuda13-mlx-vlm-development" - nvidia-l4t: "nvidia-l4t-mlx-vlm-development" - nvidia-l4t-cuda-12: "nvidia-l4t-mlx-vlm-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx-vlm-development" -- !!merge <<: *mlx-audio - name: "metal-mlx-audio" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx-audio" + default: cpu-mlx-vlm-development + metal: metal-mlx-vlm-development + nvidia: cuda12-mlx-vlm-development + nvidia-cuda-12: cuda12-mlx-vlm-development + nvidia-cuda-13: cuda13-mlx-vlm-development + nvidia-l4t: nvidia-l4t-mlx-vlm-development + nvidia-l4t-cuda-12: nvidia-l4t-mlx-vlm-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-vlm-development +- name: metal-mlx-audio + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Audio Models with MLX + urls: + - https://github.com/Blaizzy/mlx-audio + tags: + - audio-to-text + - audio-generation + - text-to-audio + - LLM + - MLX + capabilities: + default: cpu-mlx-audio + metal: metal-mlx-audio + nvidia: cuda12-mlx-audio + nvidia-cuda-12: cuda12-mlx-audio + nvidia-cuda-13: cuda13-mlx-audio + nvidia-l4t: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-12: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-audio + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx-audio mirrors: - localai/localai-backends:latest-metal-darwin-arm64-mlx-audio -- !!merge <<: *mlx-audio - name: "metal-mlx-audio-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-mlx-audio" +- name: metal-mlx-audio-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Audio Models with MLX + urls: + - https://github.com/Blaizzy/mlx-audio + tags: + - audio-to-text + - audio-generation + - text-to-audio + - LLM + - MLX + capabilities: + default: cpu-mlx-audio + metal: metal-mlx-audio + nvidia: cuda12-mlx-audio + nvidia-cuda-12: cuda12-mlx-audio + nvidia-cuda-13: cuda13-mlx-audio + nvidia-l4t: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-12: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-audio + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-mlx-audio mirrors: - localai/localai-backends:master-metal-darwin-arm64-mlx-audio -- !!merge <<: *mlx-audio - name: "mlx-audio-development" +- name: mlx-audio-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Audio Models with MLX + urls: + - https://github.com/Blaizzy/mlx-audio + tags: + - audio-to-text + - audio-generation + - text-to-audio + - LLM + - MLX capabilities: - default: "cpu-mlx-audio-development" - nvidia: "cuda12-mlx-audio-development" - metal: "metal-mlx-audio-development" - nvidia-cuda-12: "cuda12-mlx-audio-development" - nvidia-cuda-13: "cuda13-mlx-audio-development" - nvidia-l4t: "nvidia-l4t-mlx-audio-development" - nvidia-l4t-cuda-12: "nvidia-l4t-mlx-audio-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx-audio-development" -- !!merge <<: *mlx-distributed - name: "metal-mlx-distributed" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx-distributed" + default: cpu-mlx-audio-development + metal: metal-mlx-audio-development + nvidia: cuda12-mlx-audio-development + nvidia-cuda-12: cuda12-mlx-audio-development + nvidia-cuda-13: cuda13-mlx-audio-development + nvidia-l4t: nvidia-l4t-mlx-audio-development + nvidia-l4t-cuda-12: nvidia-l4t-mlx-audio-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-audio-development +- name: metal-mlx-distributed + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run distributed LLM inference with MLX across multiple Apple Silicon Macs + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + - distributed + capabilities: + default: cpu-mlx-distributed + metal: metal-mlx-distributed + nvidia: cuda12-mlx-distributed + nvidia-cuda-12: cuda12-mlx-distributed + nvidia-cuda-13: cuda13-mlx-distributed + nvidia-l4t: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-12: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-distributed + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx-distributed mirrors: - localai/localai-backends:latest-metal-darwin-arm64-mlx-distributed -- !!merge <<: *mlx-distributed - name: "metal-mlx-distributed-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-mlx-distributed" +- name: metal-mlx-distributed-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run distributed LLM inference with MLX across multiple Apple Silicon Macs + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + - distributed + capabilities: + default: cpu-mlx-distributed + metal: metal-mlx-distributed + nvidia: cuda12-mlx-distributed + nvidia-cuda-12: cuda12-mlx-distributed + nvidia-cuda-13: cuda13-mlx-distributed + nvidia-l4t: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-12: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-distributed + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-mlx-distributed mirrors: - localai/localai-backends:master-metal-darwin-arm64-mlx-distributed -- !!merge <<: *mlx-distributed - name: "mlx-distributed-development" +- name: mlx-distributed-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run distributed LLM inference with MLX across multiple Apple Silicon Macs + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + - distributed capabilities: - default: "cpu-mlx-distributed-development" - nvidia: "cuda12-mlx-distributed-development" - metal: "metal-mlx-distributed-development" - nvidia-cuda-12: "cuda12-mlx-distributed-development" - nvidia-cuda-13: "cuda13-mlx-distributed-development" - nvidia-l4t: "nvidia-l4t-mlx-distributed-development" - nvidia-l4t-cuda-12: "nvidia-l4t-mlx-distributed-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx-distributed-development" -## mlx -- !!merge <<: *mlx - name: "cpu-mlx" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-mlx" + default: cpu-mlx-distributed-development + metal: metal-mlx-distributed-development + nvidia: cuda12-mlx-distributed-development + nvidia-cuda-12: cuda12-mlx-distributed-development + nvidia-cuda-13: cuda13-mlx-distributed-development + nvidia-l4t: nvidia-l4t-mlx-distributed-development + nvidia-l4t-cuda-12: nvidia-l4t-mlx-distributed-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-distributed-development +- name: cpu-mlx + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run LLMs with MLX + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + capabilities: + default: cpu-mlx + metal: metal-mlx + nvidia: cuda12-mlx + nvidia-cuda-12: cuda12-mlx + nvidia-cuda-13: cuda13-mlx + nvidia-l4t: nvidia-l4t-mlx + nvidia-l4t-cuda-12: nvidia-l4t-mlx + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-mlx mirrors: - localai/localai-backends:latest-cpu-mlx -- !!merge <<: *mlx - name: "cpu-mlx-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-mlx" +- name: cpu-mlx-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run LLMs with MLX + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + capabilities: + default: cpu-mlx + metal: metal-mlx + nvidia: cuda12-mlx + nvidia-cuda-12: cuda12-mlx + nvidia-cuda-13: cuda13-mlx + nvidia-l4t: nvidia-l4t-mlx + nvidia-l4t-cuda-12: nvidia-l4t-mlx + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx + uri: quay.io/go-skynet/local-ai-backends:master-cpu-mlx mirrors: - localai/localai-backends:master-cpu-mlx -- !!merge <<: *mlx - name: "cuda12-mlx" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-mlx" +- name: cuda12-mlx + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run LLMs with MLX + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + capabilities: + default: cpu-mlx + metal: metal-mlx + nvidia: cuda12-mlx + nvidia-cuda-12: cuda12-mlx + nvidia-cuda-13: cuda13-mlx + nvidia-l4t: nvidia-l4t-mlx + nvidia-l4t-cuda-12: nvidia-l4t-mlx + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-mlx mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-mlx -- !!merge <<: *mlx - name: "cuda12-mlx-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-mlx" +- name: cuda12-mlx-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run LLMs with MLX + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + capabilities: + default: cpu-mlx + metal: metal-mlx + nvidia: cuda12-mlx + nvidia-cuda-12: cuda12-mlx + nvidia-cuda-13: cuda13-mlx + nvidia-l4t: nvidia-l4t-mlx + nvidia-l4t-cuda-12: nvidia-l4t-mlx + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-mlx mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-mlx -- !!merge <<: *mlx - name: "cuda13-mlx" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-mlx" +- name: cuda13-mlx + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run LLMs with MLX + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + capabilities: + default: cpu-mlx + metal: metal-mlx + nvidia: cuda12-mlx + nvidia-cuda-12: cuda12-mlx + nvidia-cuda-13: cuda13-mlx + nvidia-l4t: nvidia-l4t-mlx + nvidia-l4t-cuda-12: nvidia-l4t-mlx + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-mlx mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-mlx -- !!merge <<: *mlx - name: "cuda13-mlx-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-mlx" +- name: cuda13-mlx-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run LLMs with MLX + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + capabilities: + default: cpu-mlx + metal: metal-mlx + nvidia: cuda12-mlx + nvidia-cuda-12: cuda12-mlx + nvidia-cuda-13: cuda13-mlx + nvidia-l4t: nvidia-l4t-mlx + nvidia-l4t-cuda-12: nvidia-l4t-mlx + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-mlx mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-mlx -- !!merge <<: *mlx - name: "nvidia-l4t-mlx" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-mlx" +- name: nvidia-l4t-mlx + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run LLMs with MLX + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + capabilities: + default: cpu-mlx + metal: metal-mlx + nvidia: cuda12-mlx + nvidia-cuda-12: cuda12-mlx + nvidia-cuda-13: cuda13-mlx + nvidia-l4t: nvidia-l4t-mlx + nvidia-l4t-cuda-12: nvidia-l4t-mlx + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-mlx mirrors: - localai/localai-backends:latest-nvidia-l4t-mlx -- !!merge <<: *mlx - name: "nvidia-l4t-mlx-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-mlx" +- name: nvidia-l4t-mlx-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run LLMs with MLX + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + capabilities: + default: cpu-mlx + metal: metal-mlx + nvidia: cuda12-mlx + nvidia-cuda-12: cuda12-mlx + nvidia-cuda-13: cuda13-mlx + nvidia-l4t: nvidia-l4t-mlx + nvidia-l4t-cuda-12: nvidia-l4t-mlx + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-mlx mirrors: - localai/localai-backends:master-nvidia-l4t-mlx -- !!merge <<: *mlx - name: "cuda13-nvidia-l4t-arm64-mlx" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx" +- name: cuda13-nvidia-l4t-arm64-mlx + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run LLMs with MLX + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + capabilities: + default: cpu-mlx + metal: metal-mlx + nvidia: cuda12-mlx + nvidia-cuda-12: cuda12-mlx + nvidia-cuda-13: cuda13-mlx + nvidia-l4t: nvidia-l4t-mlx + nvidia-l4t-cuda-12: nvidia-l4t-mlx + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx -- !!merge <<: *mlx - name: "cuda13-nvidia-l4t-arm64-mlx-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-mlx" +- name: cuda13-nvidia-l4t-arm64-mlx-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run LLMs with MLX + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + capabilities: + default: cpu-mlx + metal: metal-mlx + nvidia: cuda12-mlx + nvidia-cuda-12: cuda12-mlx + nvidia-cuda-13: cuda13-mlx + nvidia-l4t: nvidia-l4t-mlx + nvidia-l4t-cuda-12: nvidia-l4t-mlx + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-mlx mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-mlx -## mlx-vlm -- !!merge <<: *mlx-vlm - name: "cpu-mlx-vlm" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-mlx-vlm" +- name: cpu-mlx-vlm + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Vision-Language Models with MLX + urls: + - https://github.com/Blaizzy/mlx-vlm + tags: + - text-to-text + - multimodal + - vision-language + - LLM + - MLX + capabilities: + default: cpu-mlx-vlm + metal: metal-mlx-vlm + nvidia: cuda12-mlx-vlm + nvidia-cuda-12: cuda12-mlx-vlm + nvidia-cuda-13: cuda13-mlx-vlm + nvidia-l4t: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-12: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-vlm + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-mlx-vlm mirrors: - localai/localai-backends:latest-cpu-mlx-vlm -- !!merge <<: *mlx-vlm - name: "cpu-mlx-vlm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-mlx-vlm" +- name: cpu-mlx-vlm-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Vision-Language Models with MLX + urls: + - https://github.com/Blaizzy/mlx-vlm + tags: + - text-to-text + - multimodal + - vision-language + - LLM + - MLX + capabilities: + default: cpu-mlx-vlm + metal: metal-mlx-vlm + nvidia: cuda12-mlx-vlm + nvidia-cuda-12: cuda12-mlx-vlm + nvidia-cuda-13: cuda13-mlx-vlm + nvidia-l4t: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-12: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-vlm + uri: quay.io/go-skynet/local-ai-backends:master-cpu-mlx-vlm mirrors: - localai/localai-backends:master-cpu-mlx-vlm -- !!merge <<: *mlx-vlm - name: "cuda12-mlx-vlm" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-mlx-vlm" +- name: cuda12-mlx-vlm + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Vision-Language Models with MLX + urls: + - https://github.com/Blaizzy/mlx-vlm + tags: + - text-to-text + - multimodal + - vision-language + - LLM + - MLX + capabilities: + default: cpu-mlx-vlm + metal: metal-mlx-vlm + nvidia: cuda12-mlx-vlm + nvidia-cuda-12: cuda12-mlx-vlm + nvidia-cuda-13: cuda13-mlx-vlm + nvidia-l4t: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-12: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-vlm + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-mlx-vlm mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-mlx-vlm -- !!merge <<: *mlx-vlm - name: "cuda12-mlx-vlm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-mlx-vlm" +- name: cuda12-mlx-vlm-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Vision-Language Models with MLX + urls: + - https://github.com/Blaizzy/mlx-vlm + tags: + - text-to-text + - multimodal + - vision-language + - LLM + - MLX + capabilities: + default: cpu-mlx-vlm + metal: metal-mlx-vlm + nvidia: cuda12-mlx-vlm + nvidia-cuda-12: cuda12-mlx-vlm + nvidia-cuda-13: cuda13-mlx-vlm + nvidia-l4t: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-12: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-vlm + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-mlx-vlm mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-mlx-vlm -- !!merge <<: *mlx-vlm - name: "cuda13-mlx-vlm" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-mlx-vlm" +- name: cuda13-mlx-vlm + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Vision-Language Models with MLX + urls: + - https://github.com/Blaizzy/mlx-vlm + tags: + - text-to-text + - multimodal + - vision-language + - LLM + - MLX + capabilities: + default: cpu-mlx-vlm + metal: metal-mlx-vlm + nvidia: cuda12-mlx-vlm + nvidia-cuda-12: cuda12-mlx-vlm + nvidia-cuda-13: cuda13-mlx-vlm + nvidia-l4t: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-12: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-vlm + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-mlx-vlm mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-mlx-vlm -- !!merge <<: *mlx-vlm - name: "cuda13-mlx-vlm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-mlx-vlm" +- name: cuda13-mlx-vlm-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Vision-Language Models with MLX + urls: + - https://github.com/Blaizzy/mlx-vlm + tags: + - text-to-text + - multimodal + - vision-language + - LLM + - MLX + capabilities: + default: cpu-mlx-vlm + metal: metal-mlx-vlm + nvidia: cuda12-mlx-vlm + nvidia-cuda-12: cuda12-mlx-vlm + nvidia-cuda-13: cuda13-mlx-vlm + nvidia-l4t: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-12: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-vlm + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-mlx-vlm mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-mlx-vlm -- !!merge <<: *mlx-vlm - name: "nvidia-l4t-mlx-vlm" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-mlx-vlm" +- name: nvidia-l4t-mlx-vlm + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Vision-Language Models with MLX + urls: + - https://github.com/Blaizzy/mlx-vlm + tags: + - text-to-text + - multimodal + - vision-language + - LLM + - MLX + capabilities: + default: cpu-mlx-vlm + metal: metal-mlx-vlm + nvidia: cuda12-mlx-vlm + nvidia-cuda-12: cuda12-mlx-vlm + nvidia-cuda-13: cuda13-mlx-vlm + nvidia-l4t: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-12: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-vlm + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-mlx-vlm mirrors: - localai/localai-backends:latest-nvidia-l4t-mlx-vlm -- !!merge <<: *mlx-vlm - name: "nvidia-l4t-mlx-vlm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-mlx-vlm" +- name: nvidia-l4t-mlx-vlm-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Vision-Language Models with MLX + urls: + - https://github.com/Blaizzy/mlx-vlm + tags: + - text-to-text + - multimodal + - vision-language + - LLM + - MLX + capabilities: + default: cpu-mlx-vlm + metal: metal-mlx-vlm + nvidia: cuda12-mlx-vlm + nvidia-cuda-12: cuda12-mlx-vlm + nvidia-cuda-13: cuda13-mlx-vlm + nvidia-l4t: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-12: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-vlm + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-mlx-vlm mirrors: - localai/localai-backends:master-nvidia-l4t-mlx-vlm -- !!merge <<: *mlx-vlm - name: "cuda13-nvidia-l4t-arm64-mlx-vlm" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx-vlm" +- name: cuda13-nvidia-l4t-arm64-mlx-vlm + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Vision-Language Models with MLX + urls: + - https://github.com/Blaizzy/mlx-vlm + tags: + - text-to-text + - multimodal + - vision-language + - LLM + - MLX + capabilities: + default: cpu-mlx-vlm + metal: metal-mlx-vlm + nvidia: cuda12-mlx-vlm + nvidia-cuda-12: cuda12-mlx-vlm + nvidia-cuda-13: cuda13-mlx-vlm + nvidia-l4t: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-12: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-vlm + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx-vlm mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx-vlm -- !!merge <<: *mlx-vlm - name: "cuda13-nvidia-l4t-arm64-mlx-vlm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-mlx-vlm" +- name: cuda13-nvidia-l4t-arm64-mlx-vlm-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Vision-Language Models with MLX + urls: + - https://github.com/Blaizzy/mlx-vlm + tags: + - text-to-text + - multimodal + - vision-language + - LLM + - MLX + capabilities: + default: cpu-mlx-vlm + metal: metal-mlx-vlm + nvidia: cuda12-mlx-vlm + nvidia-cuda-12: cuda12-mlx-vlm + nvidia-cuda-13: cuda13-mlx-vlm + nvidia-l4t: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-12: nvidia-l4t-mlx-vlm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-vlm + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-mlx-vlm mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-mlx-vlm -## mlx-audio -- !!merge <<: *mlx-audio - name: "cpu-mlx-audio" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-mlx-audio" +- name: cpu-mlx-audio + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Audio Models with MLX + urls: + - https://github.com/Blaizzy/mlx-audio + tags: + - audio-to-text + - audio-generation + - text-to-audio + - LLM + - MLX + capabilities: + default: cpu-mlx-audio + metal: metal-mlx-audio + nvidia: cuda12-mlx-audio + nvidia-cuda-12: cuda12-mlx-audio + nvidia-cuda-13: cuda13-mlx-audio + nvidia-l4t: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-12: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-audio + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-mlx-audio mirrors: - localai/localai-backends:latest-cpu-mlx-audio -- !!merge <<: *mlx-audio - name: "cpu-mlx-audio-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-mlx-audio" +- name: cpu-mlx-audio-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Audio Models with MLX + urls: + - https://github.com/Blaizzy/mlx-audio + tags: + - audio-to-text + - audio-generation + - text-to-audio + - LLM + - MLX + capabilities: + default: cpu-mlx-audio + metal: metal-mlx-audio + nvidia: cuda12-mlx-audio + nvidia-cuda-12: cuda12-mlx-audio + nvidia-cuda-13: cuda13-mlx-audio + nvidia-l4t: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-12: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-audio + uri: quay.io/go-skynet/local-ai-backends:master-cpu-mlx-audio mirrors: - localai/localai-backends:master-cpu-mlx-audio -- !!merge <<: *mlx-audio - name: "cuda12-mlx-audio" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-mlx-audio" +- name: cuda12-mlx-audio + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Audio Models with MLX + urls: + - https://github.com/Blaizzy/mlx-audio + tags: + - audio-to-text + - audio-generation + - text-to-audio + - LLM + - MLX + capabilities: + default: cpu-mlx-audio + metal: metal-mlx-audio + nvidia: cuda12-mlx-audio + nvidia-cuda-12: cuda12-mlx-audio + nvidia-cuda-13: cuda13-mlx-audio + nvidia-l4t: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-12: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-audio + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-mlx-audio mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-mlx-audio -- !!merge <<: *mlx-audio - name: "cuda12-mlx-audio-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-mlx-audio" +- name: cuda12-mlx-audio-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Audio Models with MLX + urls: + - https://github.com/Blaizzy/mlx-audio + tags: + - audio-to-text + - audio-generation + - text-to-audio + - LLM + - MLX + capabilities: + default: cpu-mlx-audio + metal: metal-mlx-audio + nvidia: cuda12-mlx-audio + nvidia-cuda-12: cuda12-mlx-audio + nvidia-cuda-13: cuda13-mlx-audio + nvidia-l4t: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-12: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-audio + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-mlx-audio mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-mlx-audio -- !!merge <<: *mlx-audio - name: "cuda13-mlx-audio" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-mlx-audio" +- name: cuda13-mlx-audio + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Audio Models with MLX + urls: + - https://github.com/Blaizzy/mlx-audio + tags: + - audio-to-text + - audio-generation + - text-to-audio + - LLM + - MLX + capabilities: + default: cpu-mlx-audio + metal: metal-mlx-audio + nvidia: cuda12-mlx-audio + nvidia-cuda-12: cuda12-mlx-audio + nvidia-cuda-13: cuda13-mlx-audio + nvidia-l4t: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-12: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-audio + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-mlx-audio mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-mlx-audio -- !!merge <<: *mlx-audio - name: "cuda13-mlx-audio-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-mlx-audio" +- name: cuda13-mlx-audio-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Audio Models with MLX + urls: + - https://github.com/Blaizzy/mlx-audio + tags: + - audio-to-text + - audio-generation + - text-to-audio + - LLM + - MLX + capabilities: + default: cpu-mlx-audio + metal: metal-mlx-audio + nvidia: cuda12-mlx-audio + nvidia-cuda-12: cuda12-mlx-audio + nvidia-cuda-13: cuda13-mlx-audio + nvidia-l4t: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-12: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-audio + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-mlx-audio mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-mlx-audio -- !!merge <<: *mlx-audio - name: "nvidia-l4t-mlx-audio" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-mlx-audio" +- name: nvidia-l4t-mlx-audio + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Audio Models with MLX + urls: + - https://github.com/Blaizzy/mlx-audio + tags: + - audio-to-text + - audio-generation + - text-to-audio + - LLM + - MLX + capabilities: + default: cpu-mlx-audio + metal: metal-mlx-audio + nvidia: cuda12-mlx-audio + nvidia-cuda-12: cuda12-mlx-audio + nvidia-cuda-13: cuda13-mlx-audio + nvidia-l4t: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-12: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-audio + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-mlx-audio mirrors: - localai/localai-backends:latest-nvidia-l4t-mlx-audio -- !!merge <<: *mlx-audio - name: "nvidia-l4t-mlx-audio-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-mlx-audio" +- name: nvidia-l4t-mlx-audio-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Audio Models with MLX + urls: + - https://github.com/Blaizzy/mlx-audio + tags: + - audio-to-text + - audio-generation + - text-to-audio + - LLM + - MLX + capabilities: + default: cpu-mlx-audio + metal: metal-mlx-audio + nvidia: cuda12-mlx-audio + nvidia-cuda-12: cuda12-mlx-audio + nvidia-cuda-13: cuda13-mlx-audio + nvidia-l4t: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-12: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-audio + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-mlx-audio mirrors: - localai/localai-backends:master-nvidia-l4t-mlx-audio -- !!merge <<: *mlx-audio - name: "cuda13-nvidia-l4t-arm64-mlx-audio" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx-audio" +- name: cuda13-nvidia-l4t-arm64-mlx-audio + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Audio Models with MLX + urls: + - https://github.com/Blaizzy/mlx-audio + tags: + - audio-to-text + - audio-generation + - text-to-audio + - LLM + - MLX + capabilities: + default: cpu-mlx-audio + metal: metal-mlx-audio + nvidia: cuda12-mlx-audio + nvidia-cuda-12: cuda12-mlx-audio + nvidia-cuda-13: cuda13-mlx-audio + nvidia-l4t: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-12: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-audio + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx-audio mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx-audio -- !!merge <<: *mlx-audio - name: "cuda13-nvidia-l4t-arm64-mlx-audio-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-mlx-audio" +- name: cuda13-nvidia-l4t-arm64-mlx-audio-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run Audio Models with MLX + urls: + - https://github.com/Blaizzy/mlx-audio + tags: + - audio-to-text + - audio-generation + - text-to-audio + - LLM + - MLX + capabilities: + default: cpu-mlx-audio + metal: metal-mlx-audio + nvidia: cuda12-mlx-audio + nvidia-cuda-12: cuda12-mlx-audio + nvidia-cuda-13: cuda13-mlx-audio + nvidia-l4t: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-12: nvidia-l4t-mlx-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-audio + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-mlx-audio mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-mlx-audio -## mlx-distributed -- !!merge <<: *mlx-distributed - name: "cpu-mlx-distributed" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-mlx-distributed" +- name: cpu-mlx-distributed + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run distributed LLM inference with MLX across multiple Apple Silicon Macs + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + - distributed + capabilities: + default: cpu-mlx-distributed + metal: metal-mlx-distributed + nvidia: cuda12-mlx-distributed + nvidia-cuda-12: cuda12-mlx-distributed + nvidia-cuda-13: cuda13-mlx-distributed + nvidia-l4t: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-12: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-distributed + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-mlx-distributed mirrors: - localai/localai-backends:latest-cpu-mlx-distributed -- !!merge <<: *mlx-distributed - name: "cpu-mlx-distributed-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-mlx-distributed" +- name: cpu-mlx-distributed-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run distributed LLM inference with MLX across multiple Apple Silicon Macs + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + - distributed + capabilities: + default: cpu-mlx-distributed + metal: metal-mlx-distributed + nvidia: cuda12-mlx-distributed + nvidia-cuda-12: cuda12-mlx-distributed + nvidia-cuda-13: cuda13-mlx-distributed + nvidia-l4t: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-12: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-distributed + uri: quay.io/go-skynet/local-ai-backends:master-cpu-mlx-distributed mirrors: - localai/localai-backends:master-cpu-mlx-distributed -- !!merge <<: *mlx-distributed - name: "cuda12-mlx-distributed" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-mlx-distributed" +- name: cuda12-mlx-distributed + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run distributed LLM inference with MLX across multiple Apple Silicon Macs + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + - distributed + capabilities: + default: cpu-mlx-distributed + metal: metal-mlx-distributed + nvidia: cuda12-mlx-distributed + nvidia-cuda-12: cuda12-mlx-distributed + nvidia-cuda-13: cuda13-mlx-distributed + nvidia-l4t: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-12: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-distributed + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-mlx-distributed mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-mlx-distributed -- !!merge <<: *mlx-distributed - name: "cuda12-mlx-distributed-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-mlx-distributed" +- name: cuda12-mlx-distributed-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run distributed LLM inference with MLX across multiple Apple Silicon Macs + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + - distributed + capabilities: + default: cpu-mlx-distributed + metal: metal-mlx-distributed + nvidia: cuda12-mlx-distributed + nvidia-cuda-12: cuda12-mlx-distributed + nvidia-cuda-13: cuda13-mlx-distributed + nvidia-l4t: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-12: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-distributed + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-mlx-distributed mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-mlx-distributed -- !!merge <<: *mlx-distributed - name: "cuda13-mlx-distributed" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-mlx-distributed" +- name: cuda13-mlx-distributed + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run distributed LLM inference with MLX across multiple Apple Silicon Macs + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + - distributed + capabilities: + default: cpu-mlx-distributed + metal: metal-mlx-distributed + nvidia: cuda12-mlx-distributed + nvidia-cuda-12: cuda12-mlx-distributed + nvidia-cuda-13: cuda13-mlx-distributed + nvidia-l4t: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-12: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-distributed + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-mlx-distributed mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-mlx-distributed -- !!merge <<: *mlx-distributed - name: "cuda13-mlx-distributed-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-mlx-distributed" +- name: cuda13-mlx-distributed-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run distributed LLM inference with MLX across multiple Apple Silicon Macs + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + - distributed + capabilities: + default: cpu-mlx-distributed + metal: metal-mlx-distributed + nvidia: cuda12-mlx-distributed + nvidia-cuda-12: cuda12-mlx-distributed + nvidia-cuda-13: cuda13-mlx-distributed + nvidia-l4t: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-12: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-distributed + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-mlx-distributed mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-mlx-distributed -- !!merge <<: *mlx-distributed - name: "nvidia-l4t-mlx-distributed" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-mlx-distributed" +- name: nvidia-l4t-mlx-distributed + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run distributed LLM inference with MLX across multiple Apple Silicon Macs + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + - distributed + capabilities: + default: cpu-mlx-distributed + metal: metal-mlx-distributed + nvidia: cuda12-mlx-distributed + nvidia-cuda-12: cuda12-mlx-distributed + nvidia-cuda-13: cuda13-mlx-distributed + nvidia-l4t: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-12: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-distributed + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-mlx-distributed mirrors: - localai/localai-backends:latest-nvidia-l4t-mlx-distributed -- !!merge <<: *mlx-distributed - name: "nvidia-l4t-mlx-distributed-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-mlx-distributed" +- name: nvidia-l4t-mlx-distributed-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run distributed LLM inference with MLX across multiple Apple Silicon Macs + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + - distributed + capabilities: + default: cpu-mlx-distributed + metal: metal-mlx-distributed + nvidia: cuda12-mlx-distributed + nvidia-cuda-12: cuda12-mlx-distributed + nvidia-cuda-13: cuda13-mlx-distributed + nvidia-l4t: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-12: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-distributed + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-mlx-distributed mirrors: - localai/localai-backends:master-nvidia-l4t-mlx-distributed -- !!merge <<: *mlx-distributed - name: "cuda13-nvidia-l4t-arm64-mlx-distributed" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx-distributed" +- name: cuda13-nvidia-l4t-arm64-mlx-distributed + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run distributed LLM inference with MLX across multiple Apple Silicon Macs + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + - distributed + capabilities: + default: cpu-mlx-distributed + metal: metal-mlx-distributed + nvidia: cuda12-mlx-distributed + nvidia-cuda-12: cuda12-mlx-distributed + nvidia-cuda-13: cuda13-mlx-distributed + nvidia-l4t: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-12: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-distributed + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx-distributed mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx-distributed -- !!merge <<: *mlx-distributed - name: "cuda13-nvidia-l4t-arm64-mlx-distributed-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-mlx-distributed" +- name: cuda13-nvidia-l4t-arm64-mlx-distributed-development + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run distributed LLM inference with MLX across multiple Apple Silicon Macs + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + - distributed + capabilities: + default: cpu-mlx-distributed + metal: metal-mlx-distributed + nvidia: cuda12-mlx-distributed + nvidia-cuda-12: cuda12-mlx-distributed + nvidia-cuda-13: cuda13-mlx-distributed + nvidia-l4t: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-12: nvidia-l4t-mlx-distributed + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx-distributed + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-mlx-distributed mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-mlx-distributed -- !!merge <<: *kitten-tts - name: "cpu-kitten-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-kitten-tts" +- name: cpu-kitten-tts + license: apache-2.0 + description: | + Kitten TTS is a text-to-speech model that can generate speech from text. + urls: + - https://github.com/KittenML/KittenTTS + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-kitten-tts + metal: metal-kitten-tts + uri: quay.io/go-skynet/local-ai-backends:latest-kitten-tts mirrors: - localai/localai-backends:latest-kitten-tts -- !!merge <<: *kitten-tts - name: "cpu-kitten-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-kitten-tts" +- name: cpu-kitten-tts-development + license: apache-2.0 + description: | + Kitten TTS is a text-to-speech model that can generate speech from text. + urls: + - https://github.com/KittenML/KittenTTS + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-kitten-tts + metal: metal-kitten-tts + uri: quay.io/go-skynet/local-ai-backends:master-kitten-tts mirrors: - localai/localai-backends:master-kitten-tts -- !!merge <<: *kitten-tts - name: "kitten-tts-development" +- name: kitten-tts-development + license: apache-2.0 + description: | + Kitten TTS is a text-to-speech model that can generate speech from text. + urls: + - https://github.com/KittenML/KittenTTS + tags: + - text-to-speech + - TTS capabilities: - default: "cpu-kitten-tts-development" - metal: "metal-kitten-tts-development" -- !!merge <<: *kitten-tts - name: "metal-kitten-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-kitten-tts" + default: cpu-kitten-tts-development + metal: metal-kitten-tts-development +- name: metal-kitten-tts + license: apache-2.0 + description: | + Kitten TTS is a text-to-speech model that can generate speech from text. + urls: + - https://github.com/KittenML/KittenTTS + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-kitten-tts + metal: metal-kitten-tts + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-kitten-tts mirrors: - localai/localai-backends:latest-metal-darwin-arm64-kitten-tts -- !!merge <<: *kitten-tts - name: "metal-kitten-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-kitten-tts" +- name: metal-kitten-tts-development + license: apache-2.0 + description: | + Kitten TTS is a text-to-speech model that can generate speech from text. + urls: + - https://github.com/KittenML/KittenTTS + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-kitten-tts + metal: metal-kitten-tts + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-kitten-tts mirrors: - localai/localai-backends:master-metal-darwin-arm64-kitten-tts -- !!merge <<: *local-store - name: "cpu-local-store" - alias: "local-store" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-local-store" +- name: cpu-local-store + alias: local-store + license: MIT + description: | + Local Store is a local-first, self-hosted, and open-source vector database. + urls: + - https://github.com/mudler/LocalAI + tags: + - vector-database + - local-first + - open-source + - CPU + capabilities: + default: cpu-local-store + metal: metal-local-store + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-local-store mirrors: - localai/localai-backends:latest-cpu-local-store -- !!merge <<: *local-store - name: "cpu-local-store-development" - alias: "local-store" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-local-store" +- name: cpu-local-store-development + alias: local-store + license: MIT + description: | + Local Store is a local-first, self-hosted, and open-source vector database. + urls: + - https://github.com/mudler/LocalAI + tags: + - vector-database + - local-first + - open-source + - CPU + capabilities: + default: cpu-local-store + metal: metal-local-store + uri: quay.io/go-skynet/local-ai-backends:master-cpu-local-store mirrors: - localai/localai-backends:master-cpu-local-store -- !!merge <<: *local-store - name: "local-store-development" - alias: "local-store" +- name: local-store-development + alias: local-store + license: MIT + description: | + Local Store is a local-first, self-hosted, and open-source vector database. + urls: + - https://github.com/mudler/LocalAI + tags: + - vector-database + - local-first + - open-source + - CPU capabilities: - default: "cpu-local-store-development" - metal: "metal-local-store-development" -- !!merge <<: *local-store - name: "metal-local-store" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-local-store" + default: cpu-local-store-development + metal: metal-local-store-development +- name: metal-local-store + license: MIT + description: | + Local Store is a local-first, self-hosted, and open-source vector database. + urls: + - https://github.com/mudler/LocalAI + tags: + - vector-database + - local-first + - open-source + - CPU + capabilities: + default: cpu-local-store + metal: metal-local-store + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-local-store mirrors: - localai/localai-backends:latest-metal-darwin-arm64-local-store -- !!merge <<: *local-store - name: "metal-local-store-development" - alias: "local-store" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-local-store" +- name: metal-local-store-development + alias: local-store + license: MIT + description: | + Local Store is a local-first, self-hosted, and open-source vector database. + urls: + - https://github.com/mudler/LocalAI + tags: + - vector-database + - local-first + - open-source + - CPU + capabilities: + default: cpu-local-store + metal: metal-local-store + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-local-store mirrors: - localai/localai-backends:master-metal-darwin-arm64-local-store -- !!merge <<: *cloud-proxy - name: "cpu-cloud-proxy" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-cloud-proxy" +- name: cpu-cloud-proxy + alias: cloud-proxy + license: MIT + description: | + Forward OpenAI-compatible and Anthropic chat requests to external providers. + urls: + - https://github.com/mudler/LocalAI/tree/master/backend/go/cloud-proxy + tags: + - text-to-text + - cloud + - proxy + - CPU + capabilities: + default: cpu-cloud-proxy + metal: metal-cloud-proxy + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-cloud-proxy mirrors: - localai/localai-backends:latest-cpu-cloud-proxy -- !!merge <<: *cloud-proxy - name: "cpu-cloud-proxy-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-cloud-proxy" +- name: cpu-cloud-proxy-development + alias: cloud-proxy + license: MIT + description: | + Forward OpenAI-compatible and Anthropic chat requests to external providers. + urls: + - https://github.com/mudler/LocalAI/tree/master/backend/go/cloud-proxy + tags: + - text-to-text + - cloud + - proxy + - CPU + capabilities: + default: cpu-cloud-proxy + metal: metal-cloud-proxy + uri: quay.io/go-skynet/local-ai-backends:master-cpu-cloud-proxy mirrors: - localai/localai-backends:master-cpu-cloud-proxy -- !!merge <<: *cloud-proxy - name: "cloud-proxy-development" +- name: cloud-proxy-development + alias: cloud-proxy + license: MIT + description: | + Forward OpenAI-compatible and Anthropic chat requests to external providers. + urls: + - https://github.com/mudler/LocalAI/tree/master/backend/go/cloud-proxy + tags: + - text-to-text + - cloud + - proxy + - CPU capabilities: - default: "cpu-cloud-proxy-development" - metal: "metal-cloud-proxy-development" -- !!merge <<: *cloud-proxy - name: "metal-cloud-proxy" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-cloud-proxy" + default: cpu-cloud-proxy-development + metal: metal-cloud-proxy-development +- name: metal-cloud-proxy + alias: cloud-proxy + license: MIT + description: | + Forward OpenAI-compatible and Anthropic chat requests to external providers. + urls: + - https://github.com/mudler/LocalAI/tree/master/backend/go/cloud-proxy + tags: + - text-to-text + - cloud + - proxy + - CPU + capabilities: + default: cpu-cloud-proxy + metal: metal-cloud-proxy + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-cloud-proxy mirrors: - localai/localai-backends:latest-metal-darwin-arm64-cloud-proxy -- !!merge <<: *cloud-proxy - name: "metal-cloud-proxy-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-cloud-proxy" +- name: metal-cloud-proxy-development + alias: cloud-proxy + license: MIT + description: | + Forward OpenAI-compatible and Anthropic chat requests to external providers. + urls: + - https://github.com/mudler/LocalAI/tree/master/backend/go/cloud-proxy + tags: + - text-to-text + - cloud + - proxy + - CPU + capabilities: + default: cpu-cloud-proxy + metal: metal-cloud-proxy + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-cloud-proxy mirrors: - localai/localai-backends:master-metal-darwin-arm64-cloud-proxy -- !!merge <<: *localai-proxy - name: "cpu-localai-proxy" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-localai-proxy" +- name: cpu-localai-proxy + alias: localai-proxy + license: MIT + description: | + Serve a model from another LocalAI instance: text, embeddings, rerank, audio, image and video requests are forwarded to its REST API. + urls: + - https://github.com/mudler/LocalAI/tree/master/backend/go/localai-proxy + tags: + - text-to-text + - proxy + - CPU + capabilities: + default: cpu-localai-proxy + metal: metal-localai-proxy + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-localai-proxy mirrors: - localai/localai-backends:latest-cpu-localai-proxy -- !!merge <<: *localai-proxy - name: "cpu-localai-proxy-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-localai-proxy" +- name: cpu-localai-proxy-development + alias: localai-proxy + license: MIT + description: | + Serve a model from another LocalAI instance: text, embeddings, rerank, audio, image and video requests are forwarded to its REST API. + urls: + - https://github.com/mudler/LocalAI/tree/master/backend/go/localai-proxy + tags: + - text-to-text + - proxy + - CPU + capabilities: + default: cpu-localai-proxy + metal: metal-localai-proxy + uri: quay.io/go-skynet/local-ai-backends:master-cpu-localai-proxy mirrors: - localai/localai-backends:master-cpu-localai-proxy -- !!merge <<: *localai-proxy - name: "localai-proxy-development" +- name: localai-proxy-development + alias: localai-proxy + license: MIT + description: | + Serve a model from another LocalAI instance: text, embeddings, rerank, audio, image and video requests are forwarded to its REST API. + urls: + - https://github.com/mudler/LocalAI/tree/master/backend/go/localai-proxy + tags: + - text-to-text + - proxy + - CPU capabilities: - default: "cpu-localai-proxy-development" - metal: "metal-localai-proxy-development" -- !!merge <<: *localai-proxy - name: "metal-localai-proxy" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-localai-proxy" + default: cpu-localai-proxy-development + metal: metal-localai-proxy-development +- name: metal-localai-proxy + alias: localai-proxy + license: MIT + description: | + Serve a model from another LocalAI instance: text, embeddings, rerank, audio, image and video requests are forwarded to its REST API. + urls: + - https://github.com/mudler/LocalAI/tree/master/backend/go/localai-proxy + tags: + - text-to-text + - proxy + - CPU + capabilities: + default: cpu-localai-proxy + metal: metal-localai-proxy + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-localai-proxy mirrors: - localai/localai-backends:latest-metal-darwin-arm64-localai-proxy -- !!merge <<: *localai-proxy - name: "metal-localai-proxy-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-localai-proxy" +- name: metal-localai-proxy-development + alias: localai-proxy + license: MIT + description: | + Serve a model from another LocalAI instance: text, embeddings, rerank, audio, image and video requests are forwarded to its REST API. + urls: + - https://github.com/mudler/LocalAI/tree/master/backend/go/localai-proxy + tags: + - text-to-text + - proxy + - CPU + capabilities: + default: cpu-localai-proxy + metal: metal-localai-proxy + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-localai-proxy mirrors: - localai/localai-backends:master-metal-darwin-arm64-localai-proxy -- !!merge <<: *valkey-store - name: "cpu-valkey-store" - alias: "valkey-store" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-valkey-store" +- name: cpu-valkey-store + alias: valkey-store + license: MIT + description: | + Valkey Store is a Valkey Search (FT.*) backed vector store for LocalAI. It + persists vectors across restarts and supports opt-in HNSW indexing. Requires + a reachable Valkey Search server (valkey/valkey-bundle). + urls: + - https://github.com/mudler/LocalAI + tags: + - vector-database + - valkey + - open-source + - CPU + capabilities: + default: cpu-valkey-store + metal: metal-valkey-store + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-valkey-store mirrors: - localai/localai-backends:latest-cpu-valkey-store -- !!merge <<: *valkey-store - name: "cpu-valkey-store-development" - alias: "valkey-store" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-valkey-store" +- name: cpu-valkey-store-development + alias: valkey-store + license: MIT + description: | + Valkey Store is a Valkey Search (FT.*) backed vector store for LocalAI. It + persists vectors across restarts and supports opt-in HNSW indexing. Requires + a reachable Valkey Search server (valkey/valkey-bundle). + urls: + - https://github.com/mudler/LocalAI + tags: + - vector-database + - valkey + - open-source + - CPU + capabilities: + default: cpu-valkey-store + metal: metal-valkey-store + uri: quay.io/go-skynet/local-ai-backends:master-cpu-valkey-store mirrors: - localai/localai-backends:master-cpu-valkey-store -- !!merge <<: *valkey-store - name: "valkey-store-development" - alias: "valkey-store" +- name: valkey-store-development + alias: valkey-store + license: MIT + description: | + Valkey Store is a Valkey Search (FT.*) backed vector store for LocalAI. It + persists vectors across restarts and supports opt-in HNSW indexing. Requires + a reachable Valkey Search server (valkey/valkey-bundle). + urls: + - https://github.com/mudler/LocalAI + tags: + - vector-database + - valkey + - open-source + - CPU capabilities: - default: "cpu-valkey-store-development" - metal: "metal-valkey-store-development" -- !!merge <<: *valkey-store - name: "metal-valkey-store" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-valkey-store" + default: cpu-valkey-store-development + metal: metal-valkey-store-development +- name: metal-valkey-store + license: MIT + description: | + Valkey Store is a Valkey Search (FT.*) backed vector store for LocalAI. It + persists vectors across restarts and supports opt-in HNSW indexing. Requires + a reachable Valkey Search server (valkey/valkey-bundle). + urls: + - https://github.com/mudler/LocalAI + tags: + - vector-database + - valkey + - open-source + - CPU + capabilities: + default: cpu-valkey-store + metal: metal-valkey-store + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-valkey-store mirrors: - localai/localai-backends:latest-metal-darwin-arm64-valkey-store -- !!merge <<: *valkey-store - name: "metal-valkey-store-development" - alias: "valkey-store" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-valkey-store" +- name: metal-valkey-store-development + alias: valkey-store + license: MIT + description: | + Valkey Store is a Valkey Search (FT.*) backed vector store for LocalAI. It + persists vectors across restarts and supports opt-in HNSW indexing. Requires + a reachable Valkey Search server (valkey/valkey-bundle). + urls: + - https://github.com/mudler/LocalAI + tags: + - vector-database + - valkey + - open-source + - CPU + capabilities: + default: cpu-valkey-store + metal: metal-valkey-store + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-valkey-store mirrors: - localai/localai-backends:master-metal-darwin-arm64-valkey-store -- !!merge <<: *qdrant-store - name: "cpu-qdrant-store" - alias: "qdrant-store" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-qdrant-store" +- name: cpu-qdrant-store + alias: qdrant-store + license: MIT + description: | + Qdrant Store is a Qdrant-backed vector store for LocalAI. It persists + vectors across restarts in HNSW-indexed collections and works with + self-hosted Qdrant (single node or cluster) and Qdrant Cloud. Requires a + reachable Qdrant server (gRPC port, 6334 by default). + urls: + - https://github.com/mudler/LocalAI + - https://github.com/qdrant/qdrant + tags: + - vector-database + - qdrant + - open-source + - CPU + capabilities: + default: cpu-qdrant-store + metal: metal-qdrant-store + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-qdrant-store mirrors: - localai/localai-backends:latest-cpu-qdrant-store -- !!merge <<: *qdrant-store - name: "cpu-qdrant-store-development" - alias: "qdrant-store" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-qdrant-store" +- name: cpu-qdrant-store-development + alias: qdrant-store + license: MIT + description: | + Qdrant Store is a Qdrant-backed vector store for LocalAI. It persists + vectors across restarts in HNSW-indexed collections and works with + self-hosted Qdrant (single node or cluster) and Qdrant Cloud. Requires a + reachable Qdrant server (gRPC port, 6334 by default). + urls: + - https://github.com/mudler/LocalAI + - https://github.com/qdrant/qdrant + tags: + - vector-database + - qdrant + - open-source + - CPU + capabilities: + default: cpu-qdrant-store + metal: metal-qdrant-store + uri: quay.io/go-skynet/local-ai-backends:master-cpu-qdrant-store mirrors: - localai/localai-backends:master-cpu-qdrant-store -- !!merge <<: *qdrant-store - name: "qdrant-store-development" - alias: "qdrant-store" +- name: qdrant-store-development + alias: qdrant-store + license: MIT + description: | + Qdrant Store is a Qdrant-backed vector store for LocalAI. It persists + vectors across restarts in HNSW-indexed collections and works with + self-hosted Qdrant (single node or cluster) and Qdrant Cloud. Requires a + reachable Qdrant server (gRPC port, 6334 by default). + urls: + - https://github.com/mudler/LocalAI + - https://github.com/qdrant/qdrant + tags: + - vector-database + - qdrant + - open-source + - CPU capabilities: - default: "cpu-qdrant-store-development" - metal: "metal-qdrant-store-development" -- !!merge <<: *qdrant-store - name: "metal-qdrant-store" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-qdrant-store" + default: cpu-qdrant-store-development + metal: metal-qdrant-store-development +- name: metal-qdrant-store + license: MIT + description: | + Qdrant Store is a Qdrant-backed vector store for LocalAI. It persists + vectors across restarts in HNSW-indexed collections and works with + self-hosted Qdrant (single node or cluster) and Qdrant Cloud. Requires a + reachable Qdrant server (gRPC port, 6334 by default). + urls: + - https://github.com/mudler/LocalAI + - https://github.com/qdrant/qdrant + tags: + - vector-database + - qdrant + - open-source + - CPU + capabilities: + default: cpu-qdrant-store + metal: metal-qdrant-store + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-qdrant-store mirrors: - localai/localai-backends:latest-metal-darwin-arm64-qdrant-store -- !!merge <<: *qdrant-store - name: "metal-qdrant-store-development" - alias: "qdrant-store" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-qdrant-store" +- name: metal-qdrant-store-development + alias: qdrant-store + license: MIT + description: | + Qdrant Store is a Qdrant-backed vector store for LocalAI. It persists + vectors across restarts in HNSW-indexed collections and works with + self-hosted Qdrant (single node or cluster) and Qdrant Cloud. Requires a + reachable Qdrant server (gRPC port, 6334 by default). + urls: + - https://github.com/mudler/LocalAI + - https://github.com/qdrant/qdrant + tags: + - vector-database + - qdrant + - open-source + - CPU + capabilities: + default: cpu-qdrant-store + metal: metal-qdrant-store + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-qdrant-store mirrors: - localai/localai-backends:master-metal-darwin-arm64-qdrant-store -- !!merge <<: *opus - name: "cpu-opus" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-opus" +- name: cpu-opus + alias: opus + license: BSD-3-Clause + description: | + Opus audio codec backend for encoding and decoding audio. + Required for WebRTC transport in the Realtime API. + urls: + - https://opus-codec.org/ + tags: + - audio-codec + - opus + - WebRTC + - realtime + capabilities: + default: cpu-opus + metal: metal-opus + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-opus mirrors: - localai/localai-backends:latest-cpu-opus -- !!merge <<: *opus - name: "cpu-opus-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-opus" +- name: cpu-opus-development + alias: opus + license: BSD-3-Clause + description: | + Opus audio codec backend for encoding and decoding audio. + Required for WebRTC transport in the Realtime API. + urls: + - https://opus-codec.org/ + tags: + - audio-codec + - opus + - WebRTC + - realtime + capabilities: + default: cpu-opus + metal: metal-opus + uri: quay.io/go-skynet/local-ai-backends:master-cpu-opus mirrors: - localai/localai-backends:master-cpu-opus -- !!merge <<: *opus - name: "metal-opus" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-opus" +- name: metal-opus + alias: opus + license: BSD-3-Clause + description: | + Opus audio codec backend for encoding and decoding audio. + Required for WebRTC transport in the Realtime API. + urls: + - https://opus-codec.org/ + tags: + - audio-codec + - opus + - WebRTC + - realtime + capabilities: + default: cpu-opus + metal: metal-opus + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-opus mirrors: - localai/localai-backends:latest-metal-darwin-arm64-opus -- !!merge <<: *opus - name: "metal-opus-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-opus" +- name: metal-opus-development + alias: opus + license: BSD-3-Clause + description: | + Opus audio codec backend for encoding and decoding audio. + Required for WebRTC transport in the Realtime API. + urls: + - https://opus-codec.org/ + tags: + - audio-codec + - opus + - WebRTC + - realtime + capabilities: + default: cpu-opus + metal: metal-opus + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-opus mirrors: - localai/localai-backends:master-metal-darwin-arm64-opus -- !!merge <<: *silero-vad - name: "cpu-silero-vad" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-silero-vad" +- name: cpu-silero-vad + icon: https://user-images.githubusercontent.com/12515440/89997349-b3523080-dc94-11ea-9906-ca2e8bc50535.png + description: | + Silero VAD: pre-trained enterprise-grade Voice Activity Detector. + Silero VAD is a voice activity detection model that can be used to detect whether a given audio contains speech or not. + urls: + - https://github.com/snakers4/silero-vad + tags: + - voice-activity-detection + - VAD + - silero-vad + - CPU + capabilities: + default: cpu-silero-vad + metal: metal-silero-vad + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-silero-vad mirrors: - localai/localai-backends:latest-cpu-silero-vad -- !!merge <<: *silero-vad - name: "cpu-silero-vad-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-silero-vad" +- name: cpu-silero-vad-development + icon: https://user-images.githubusercontent.com/12515440/89997349-b3523080-dc94-11ea-9906-ca2e8bc50535.png + description: | + Silero VAD: pre-trained enterprise-grade Voice Activity Detector. + Silero VAD is a voice activity detection model that can be used to detect whether a given audio contains speech or not. + urls: + - https://github.com/snakers4/silero-vad + tags: + - voice-activity-detection + - VAD + - silero-vad + - CPU + capabilities: + default: cpu-silero-vad + metal: metal-silero-vad + uri: quay.io/go-skynet/local-ai-backends:master-cpu-silero-vad mirrors: - localai/localai-backends:master-cpu-silero-vad -- !!merge <<: *silero-vad - name: "silero-vad-development" +- name: silero-vad-development + icon: https://user-images.githubusercontent.com/12515440/89997349-b3523080-dc94-11ea-9906-ca2e8bc50535.png + description: | + Silero VAD: pre-trained enterprise-grade Voice Activity Detector. + Silero VAD is a voice activity detection model that can be used to detect whether a given audio contains speech or not. + urls: + - https://github.com/snakers4/silero-vad + tags: + - voice-activity-detection + - VAD + - silero-vad + - CPU capabilities: - default: "cpu-silero-vad-development" - metal: "metal-silero-vad-development" -- !!merge <<: *silero-vad - name: "metal-silero-vad" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-silero-vad" + default: cpu-silero-vad-development + metal: metal-silero-vad-development +- name: metal-silero-vad + icon: https://user-images.githubusercontent.com/12515440/89997349-b3523080-dc94-11ea-9906-ca2e8bc50535.png + description: | + Silero VAD: pre-trained enterprise-grade Voice Activity Detector. + Silero VAD is a voice activity detection model that can be used to detect whether a given audio contains speech or not. + urls: + - https://github.com/snakers4/silero-vad + tags: + - voice-activity-detection + - VAD + - silero-vad + - CPU + capabilities: + default: cpu-silero-vad + metal: metal-silero-vad + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-silero-vad mirrors: - localai/localai-backends:latest-metal-darwin-arm64-silero-vad -- !!merge <<: *silero-vad - name: "metal-silero-vad-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-silero-vad" +- name: metal-silero-vad-development + icon: https://user-images.githubusercontent.com/12515440/89997349-b3523080-dc94-11ea-9906-ca2e8bc50535.png + description: | + Silero VAD: pre-trained enterprise-grade Voice Activity Detector. + Silero VAD is a voice activity detection model that can be used to detect whether a given audio contains speech or not. + urls: + - https://github.com/snakers4/silero-vad + tags: + - voice-activity-detection + - VAD + - silero-vad + - CPU + capabilities: + default: cpu-silero-vad + metal: metal-silero-vad + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-silero-vad mirrors: - localai/localai-backends:master-metal-darwin-arm64-silero-vad -- !!merge <<: *piper - name: "cpu-piper" - uri: "quay.io/go-skynet/local-ai-backends:latest-piper" +- name: cpu-piper + license: MIT + icon: https://github.com/OHF-Voice/piper1-gpl/raw/main/etc/logo.png + description: | + A fast, local neural text to speech system + urls: + - https://github.com/rhasspy/piper + - https://github.com/mudler/go-piper + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-piper + metal: metal-piper + uri: quay.io/go-skynet/local-ai-backends:latest-piper mirrors: - localai/localai-backends:latest-piper -- !!merge <<: *piper - name: "cpu-piper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-piper" +- name: cpu-piper-development + license: MIT + icon: https://github.com/OHF-Voice/piper1-gpl/raw/main/etc/logo.png + description: | + A fast, local neural text to speech system + urls: + - https://github.com/rhasspy/piper + - https://github.com/mudler/go-piper + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-piper + metal: metal-piper + uri: quay.io/go-skynet/local-ai-backends:master-piper mirrors: - localai/localai-backends:master-piper -- !!merge <<: *piper - name: "piper-development" +- name: piper-development + license: MIT + icon: https://github.com/OHF-Voice/piper1-gpl/raw/main/etc/logo.png + description: | + A fast, local neural text to speech system + urls: + - https://github.com/rhasspy/piper + - https://github.com/mudler/go-piper + tags: + - text-to-speech + - TTS capabilities: - default: "cpu-piper-development" - metal: "metal-piper-development" -- !!merge <<: *piper - name: "metal-piper" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-piper" + default: cpu-piper-development + metal: metal-piper-development +- name: metal-piper + license: MIT + icon: https://github.com/OHF-Voice/piper1-gpl/raw/main/etc/logo.png + description: | + A fast, local neural text to speech system + urls: + - https://github.com/rhasspy/piper + - https://github.com/mudler/go-piper + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-piper + metal: metal-piper + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-piper mirrors: - localai/localai-backends:latest-metal-darwin-arm64-piper -- !!merge <<: *piper - name: "metal-piper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-piper" +- name: metal-piper-development + license: MIT + icon: https://github.com/OHF-Voice/piper1-gpl/raw/main/etc/logo.png + description: | + A fast, local neural text to speech system + urls: + - https://github.com/rhasspy/piper + - https://github.com/mudler/go-piper + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-piper + metal: metal-piper + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-piper mirrors: - localai/localai-backends:master-metal-darwin-arm64-piper -## llama-cpp -- !!merge <<: *llamacpp - name: "nvidia-l4t-arm64-llama-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-llama-cpp" +- name: nvidia-l4t-arm64-llama-cpp + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-llama-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-llama-cpp -- !!merge <<: *llamacpp - name: "nvidia-l4t-arm64-llama-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-llama-cpp" +- name: nvidia-l4t-arm64-llama-cpp-development + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-llama-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-llama-cpp -- !!merge <<: *llamacpp - name: "cuda13-nvidia-l4t-arm64-llama-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-llama-cpp" +- name: cuda13-nvidia-l4t-arm64-llama-cpp + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-llama-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-llama-cpp -- !!merge <<: *llamacpp - name: "cuda13-nvidia-l4t-arm64-llama-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-llama-cpp" +- name: cuda13-nvidia-l4t-arm64-llama-cpp-development + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-llama-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-llama-cpp -- !!merge <<: *llamacpp - name: "cpu-llama-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-llama-cpp" +- name: cpu-llama-cpp + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-llama-cpp mirrors: - localai/localai-backends:latest-cpu-llama-cpp -- !!merge <<: *llamacpp - name: "cpu-llama-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-llama-cpp" +- name: cpu-llama-cpp-development + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-llama-cpp mirrors: - localai/localai-backends:master-cpu-llama-cpp -- !!merge <<: *llamacpp - name: "cuda12-llama-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-llama-cpp" +- name: cuda12-llama-cpp + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-llama-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-llama-cpp -- !!merge <<: *llamacpp - name: "rocm-llama-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-llama-cpp" +- name: rocm-llama-cpp + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-llama-cpp mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-llama-cpp -- !!merge <<: *llamacpp - name: "intel-sycl-f32-llama-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-llama-cpp" +- name: intel-sycl-f32-llama-cpp + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-llama-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-llama-cpp -- !!merge <<: *llamacpp - name: "intel-sycl-f16-llama-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-llama-cpp" +- name: intel-sycl-f16-llama-cpp + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-llama-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-llama-cpp -- !!merge <<: *llamacpp - name: "vulkan-llama-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-llama-cpp" +- name: vulkan-llama-cpp + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-llama-cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-llama-cpp -- !!merge <<: *llamacpp - name: "vulkan-llama-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-llama-cpp" +- name: vulkan-llama-cpp-development + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-llama-cpp mirrors: - localai/localai-backends:master-gpu-vulkan-llama-cpp -- !!merge <<: *llamacpp - name: "metal-llama-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-llama-cpp" +- name: metal-llama-cpp + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-llama-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-llama-cpp -- !!merge <<: *llamacpp - name: "metal-llama-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-llama-cpp" +- name: metal-llama-cpp-development + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-llama-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-llama-cpp -- !!merge <<: *llamacpp - name: "cuda12-llama-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-llama-cpp" +- name: cuda12-llama-cpp-development + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-llama-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-llama-cpp -- !!merge <<: *llamacpp - name: "rocm-llama-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-llama-cpp" +- name: rocm-llama-cpp-development + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-llama-cpp mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-llama-cpp -- !!merge <<: *llamacpp - name: "intel-sycl-f32-llama-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-llama-cpp" +- name: intel-sycl-f32-llama-cpp-development + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-llama-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-llama-cpp -- !!merge <<: *llamacpp - name: "intel-sycl-f16-llama-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-llama-cpp" +- name: intel-sycl-f16-llama-cpp-development + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-llama-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-llama-cpp -- !!merge <<: *llamacpp - name: "cuda13-llama-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-llama-cpp" +- name: cuda13-llama-cpp + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-llama-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-llama-cpp -- !!merge <<: *llamacpp - name: "cuda13-llama-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-llama-cpp" +- name: cuda13-llama-cpp-development + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-llama-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-llama-cpp -## ik-llama-cpp -- !!merge <<: *ikllamacpp - name: "cpu-ik-llama-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-ik-llama-cpp" +- name: cpu-ik-llama-cpp + alias: ik-llama-cpp + license: mit + description: | + Fork of llama.cpp optimized for CPU performance by ikawrakow + urls: + - https://github.com/ikawrakow/ik_llama.cpp + tags: + - text-to-text + - LLM + - CPU + capabilities: + default: cpu-ik-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-ik-llama-cpp mirrors: - localai/localai-backends:latest-cpu-ik-llama-cpp -- !!merge <<: *ikllamacpp - name: "cpu-ik-llama-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-ik-llama-cpp" +- name: cpu-ik-llama-cpp-development + alias: ik-llama-cpp + license: mit + description: | + Fork of llama.cpp optimized for CPU performance by ikawrakow + urls: + - https://github.com/ikawrakow/ik_llama.cpp + tags: + - text-to-text + - LLM + - CPU + capabilities: + default: cpu-ik-llama-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-ik-llama-cpp mirrors: - localai/localai-backends:master-cpu-ik-llama-cpp -## turboquant -- !!merge <<: *turboquant - name: "cpu-turboquant" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-turboquant" +- name: cpu-turboquant + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-turboquant mirrors: - localai/localai-backends:latest-cpu-turboquant -- !!merge <<: *turboquant - name: "cpu-turboquant-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-turboquant" +- name: cpu-turboquant-development + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:master-cpu-turboquant mirrors: - localai/localai-backends:master-cpu-turboquant -- !!merge <<: *turboquant - name: "cuda12-turboquant" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-turboquant" +- name: cuda12-turboquant + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-turboquant mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-turboquant -- !!merge <<: *turboquant - name: "cuda12-turboquant-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-turboquant" +- name: cuda12-turboquant-development + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-turboquant mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-turboquant -- !!merge <<: *turboquant - name: "cuda13-turboquant" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-turboquant" +- name: cuda13-turboquant + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-turboquant mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-turboquant -- !!merge <<: *turboquant - name: "cuda13-turboquant-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-turboquant" +- name: cuda13-turboquant-development + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-turboquant mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-turboquant -- !!merge <<: *turboquant - name: "rocm-turboquant" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-turboquant" +- name: rocm-turboquant + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-turboquant mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-turboquant -- !!merge <<: *turboquant - name: "rocm-turboquant-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-turboquant" +- name: rocm-turboquant-development + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-turboquant mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-turboquant -- !!merge <<: *turboquant - name: "intel-sycl-f32-turboquant" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-turboquant" +- name: intel-sycl-f32-turboquant + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-turboquant mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-turboquant -- !!merge <<: *turboquant - name: "intel-sycl-f32-turboquant-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-turboquant" +- name: intel-sycl-f32-turboquant-development + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-turboquant mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-turboquant -- !!merge <<: *turboquant - name: "intel-sycl-f16-turboquant" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-turboquant" +- name: intel-sycl-f16-turboquant + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-turboquant mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-turboquant -- !!merge <<: *turboquant - name: "intel-sycl-f16-turboquant-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-turboquant" +- name: intel-sycl-f16-turboquant-development + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-turboquant mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-turboquant -- !!merge <<: *turboquant - name: "vulkan-turboquant" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-turboquant" +- name: vulkan-turboquant + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-turboquant mirrors: - localai/localai-backends:latest-gpu-vulkan-turboquant -- !!merge <<: *turboquant - name: "vulkan-turboquant-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-turboquant" +- name: vulkan-turboquant-development + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-turboquant mirrors: - localai/localai-backends:master-gpu-vulkan-turboquant -- !!merge <<: *turboquant - name: "nvidia-l4t-arm64-turboquant" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-turboquant" +- name: nvidia-l4t-arm64-turboquant + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-turboquant mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-turboquant -- !!merge <<: *turboquant - name: "nvidia-l4t-arm64-turboquant-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-turboquant" +- name: nvidia-l4t-arm64-turboquant-development + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-turboquant mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-turboquant -- !!merge <<: *turboquant - name: "cuda13-nvidia-l4t-arm64-turboquant" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-turboquant" +- name: cuda13-nvidia-l4t-arm64-turboquant + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-turboquant mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-turboquant -- !!merge <<: *turboquant - name: "cuda13-nvidia-l4t-arm64-turboquant-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-turboquant" +- name: cuda13-nvidia-l4t-arm64-turboquant-development + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-turboquant mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-turboquant -## bonsai -- !!merge <<: *bonsai - name: "cpu-bonsai" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-bonsai" +- name: cpu-bonsai + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-bonsai mirrors: - localai/localai-backends:latest-cpu-bonsai -- !!merge <<: *bonsai - name: "cpu-bonsai-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-bonsai" +- name: cpu-bonsai-development + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:master-cpu-bonsai mirrors: - localai/localai-backends:master-cpu-bonsai -- !!merge <<: *bonsai - name: "cuda12-bonsai" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-bonsai" +- name: cuda12-bonsai + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-bonsai mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-bonsai -- !!merge <<: *bonsai - name: "cuda12-bonsai-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-bonsai" +- name: cuda12-bonsai-development + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-bonsai mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-bonsai -- !!merge <<: *bonsai - name: "cuda13-bonsai" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-bonsai" +- name: cuda13-bonsai + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-bonsai mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-bonsai -- !!merge <<: *bonsai - name: "cuda13-bonsai-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-bonsai" +- name: cuda13-bonsai-development + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-bonsai mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-bonsai -- !!merge <<: *bonsai - name: "rocm-bonsai" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-bonsai" +- name: rocm-bonsai + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-bonsai mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-bonsai -- !!merge <<: *bonsai - name: "rocm-bonsai-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-bonsai" +- name: rocm-bonsai-development + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-bonsai mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-bonsai -- !!merge <<: *bonsai - name: "intel-sycl-f32-bonsai" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-bonsai" +- name: intel-sycl-f32-bonsai + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-bonsai mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-bonsai -- !!merge <<: *bonsai - name: "intel-sycl-f32-bonsai-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-bonsai" +- name: intel-sycl-f32-bonsai-development + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-bonsai mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-bonsai -- !!merge <<: *bonsai - name: "intel-sycl-f16-bonsai" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-bonsai" +- name: intel-sycl-f16-bonsai + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-bonsai mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-bonsai -- !!merge <<: *bonsai - name: "intel-sycl-f16-bonsai-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-bonsai" +- name: intel-sycl-f16-bonsai-development + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-bonsai mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-bonsai -- !!merge <<: *bonsai - name: "vulkan-bonsai" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-bonsai" +- name: vulkan-bonsai + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-bonsai mirrors: - localai/localai-backends:latest-gpu-vulkan-bonsai -- !!merge <<: *bonsai - name: "vulkan-bonsai-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-bonsai" +- name: vulkan-bonsai-development + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-bonsai mirrors: - localai/localai-backends:master-gpu-vulkan-bonsai -- !!merge <<: *bonsai - name: "nvidia-l4t-arm64-bonsai" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-bonsai" +- name: nvidia-l4t-arm64-bonsai + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-bonsai mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-bonsai -- !!merge <<: *bonsai - name: "nvidia-l4t-arm64-bonsai-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-bonsai" +- name: nvidia-l4t-arm64-bonsai-development + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-bonsai mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-bonsai -- !!merge <<: *bonsai - name: "cuda13-nvidia-l4t-arm64-bonsai" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-bonsai" +- name: cuda13-nvidia-l4t-arm64-bonsai + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-bonsai mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-bonsai -- !!merge <<: *bonsai - name: "cuda13-nvidia-l4t-arm64-bonsai-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-bonsai" +- name: cuda13-nvidia-l4t-arm64-bonsai-development + alias: bonsai + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + amd: rocm-bonsai + default: cpu-bonsai + intel: intel-sycl-f16-bonsai + nvidia: cuda12-bonsai + nvidia-cuda-12: cuda12-bonsai + nvidia-cuda-13: cuda13-bonsai + nvidia-l4t: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-12: nvidia-l4t-arm64-bonsai + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-bonsai + vulkan: vulkan-bonsai + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-bonsai mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-bonsai -## ds4 -- !!merge <<: *ds4 - name: "cpu-ds4" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-ds4" +- name: cpu-ds4 + alias: ds4 + license: mit + description: | + antirez/ds4 - DeepSeek V4 Flash inference engine. Single-model, + optimized for Metal (Darwin) and CUDA (Linux). Requires the GGUFs + published at huggingface.co/antirez/deepseek-v4-gguf. + urls: + - https://github.com/antirez/ds4 + tags: + - text-to-text + - LLM + - CPU + - CUDA + - Metal + capabilities: + default: cpu-ds4 + metal: metal-ds4 + metal-darwin-arm64: metal-ds4 + nvidia: cuda13-ds4 + nvidia-cuda-13: cuda13-ds4 + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ds4 + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-ds4 mirrors: - localai/localai-backends:latest-cpu-ds4 -- !!merge <<: *ds4 - name: "cpu-ds4-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-ds4" +- name: cpu-ds4-development + alias: ds4 + license: mit + description: | + antirez/ds4 - DeepSeek V4 Flash inference engine. Single-model, + optimized for Metal (Darwin) and CUDA (Linux). Requires the GGUFs + published at huggingface.co/antirez/deepseek-v4-gguf. + urls: + - https://github.com/antirez/ds4 + tags: + - text-to-text + - LLM + - CPU + - CUDA + - Metal + capabilities: + default: cpu-ds4 + metal: metal-ds4 + metal-darwin-arm64: metal-ds4 + nvidia: cuda13-ds4 + nvidia-cuda-13: cuda13-ds4 + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ds4 + uri: quay.io/go-skynet/local-ai-backends:master-cpu-ds4 mirrors: - localai/localai-backends:master-cpu-ds4 -- !!merge <<: *ds4 - name: "cuda13-ds4" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-ds4" +- name: cuda13-ds4 + alias: ds4 + license: mit + description: | + antirez/ds4 - DeepSeek V4 Flash inference engine. Single-model, + optimized for Metal (Darwin) and CUDA (Linux). Requires the GGUFs + published at huggingface.co/antirez/deepseek-v4-gguf. + urls: + - https://github.com/antirez/ds4 + tags: + - text-to-text + - LLM + - CPU + - CUDA + - Metal + capabilities: + default: cpu-ds4 + metal: metal-ds4 + metal-darwin-arm64: metal-ds4 + nvidia: cuda13-ds4 + nvidia-cuda-13: cuda13-ds4 + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ds4 + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-ds4 mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-ds4 -- !!merge <<: *ds4 - name: "cuda13-ds4-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-ds4" +- name: cuda13-ds4-development + alias: ds4 + license: mit + description: | + antirez/ds4 - DeepSeek V4 Flash inference engine. Single-model, + optimized for Metal (Darwin) and CUDA (Linux). Requires the GGUFs + published at huggingface.co/antirez/deepseek-v4-gguf. + urls: + - https://github.com/antirez/ds4 + tags: + - text-to-text + - LLM + - CPU + - CUDA + - Metal + capabilities: + default: cpu-ds4 + metal: metal-ds4 + metal-darwin-arm64: metal-ds4 + nvidia: cuda13-ds4 + nvidia-cuda-13: cuda13-ds4 + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ds4 + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-ds4 mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-ds4 -- !!merge <<: *ds4 - name: "cuda13-nvidia-l4t-arm64-ds4" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-ds4" +- name: cuda13-nvidia-l4t-arm64-ds4 + alias: ds4 + license: mit + description: | + antirez/ds4 - DeepSeek V4 Flash inference engine. Single-model, + optimized for Metal (Darwin) and CUDA (Linux). Requires the GGUFs + published at huggingface.co/antirez/deepseek-v4-gguf. + urls: + - https://github.com/antirez/ds4 + tags: + - text-to-text + - LLM + - CPU + - CUDA + - Metal + capabilities: + default: cpu-ds4 + metal: metal-ds4 + metal-darwin-arm64: metal-ds4 + nvidia: cuda13-ds4 + nvidia-cuda-13: cuda13-ds4 + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ds4 + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-ds4 mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-ds4 -- !!merge <<: *ds4 - name: "cuda13-nvidia-l4t-arm64-ds4-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-ds4" +- name: cuda13-nvidia-l4t-arm64-ds4-development + alias: ds4 + license: mit + description: | + antirez/ds4 - DeepSeek V4 Flash inference engine. Single-model, + optimized for Metal (Darwin) and CUDA (Linux). Requires the GGUFs + published at huggingface.co/antirez/deepseek-v4-gguf. + urls: + - https://github.com/antirez/ds4 + tags: + - text-to-text + - LLM + - CPU + - CUDA + - Metal + capabilities: + default: cpu-ds4 + metal: metal-ds4 + metal-darwin-arm64: metal-ds4 + nvidia: cuda13-ds4 + nvidia-cuda-13: cuda13-ds4 + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ds4 + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-ds4 mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-ds4 -- !!merge <<: *ds4 - name: "metal-ds4" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-ds4" +- name: metal-ds4 + alias: ds4 + license: mit + description: | + antirez/ds4 - DeepSeek V4 Flash inference engine. Single-model, + optimized for Metal (Darwin) and CUDA (Linux). Requires the GGUFs + published at huggingface.co/antirez/deepseek-v4-gguf. + urls: + - https://github.com/antirez/ds4 + tags: + - text-to-text + - LLM + - CPU + - CUDA + - Metal + capabilities: + default: cpu-ds4 + metal: metal-ds4 + metal-darwin-arm64: metal-ds4 + nvidia: cuda13-ds4 + nvidia-cuda-13: cuda13-ds4 + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ds4 + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-ds4 mirrors: - localai/localai-backends:latest-metal-darwin-arm64-ds4 -- !!merge <<: *ds4 - name: "metal-ds4-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-ds4" +- name: metal-ds4-development + alias: ds4 + license: mit + description: | + antirez/ds4 - DeepSeek V4 Flash inference engine. Single-model, + optimized for Metal (Darwin) and CUDA (Linux). Requires the GGUFs + published at huggingface.co/antirez/deepseek-v4-gguf. + urls: + - https://github.com/antirez/ds4 + tags: + - text-to-text + - LLM + - CPU + - CUDA + - Metal + capabilities: + default: cpu-ds4 + metal: metal-ds4 + metal-darwin-arm64: metal-ds4 + nvidia: cuda13-ds4 + nvidia-cuda-13: cuda13-ds4 + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ds4 + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-ds4 mirrors: - localai/localai-backends:master-metal-darwin-arm64-ds4 -## whisper -- !!merge <<: *whispercpp - name: "whisper-development" +- name: whisper-development + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP capabilities: - default: "cpu-whisper-development" - nvidia: "cuda12-whisper-development" - intel: "intel-sycl-f16-whisper-development" - metal: "metal-whisper-development" - amd: "rocm-whisper-development" - vulkan: "vulkan-whisper-development" - nvidia-l4t: "nvidia-l4t-arm64-whisper-development" - nvidia-cuda-13: "cuda13-whisper-development" - nvidia-cuda-12: "cuda12-whisper-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-whisper-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-whisper-development" -- !!merge <<: *whispercpp - name: "nvidia-l4t-arm64-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-whisper" + amd: rocm-whisper-development + default: cpu-whisper-development + intel: intel-sycl-f16-whisper-development + metal: metal-whisper-development + nvidia: cuda12-whisper-development + nvidia-cuda-12: cuda12-whisper-development + nvidia-cuda-13: cuda13-whisper-development + nvidia-l4t: nvidia-l4t-arm64-whisper-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper-development + vulkan: vulkan-whisper-development +- name: nvidia-l4t-arm64-whisper + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-whisper mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-whisper -- !!merge <<: *whispercpp - name: "nvidia-l4t-arm64-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-whisper" +- name: nvidia-l4t-arm64-whisper-development + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-whisper mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-whisper -- !!merge <<: *whispercpp - name: "cuda13-nvidia-l4t-arm64-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-whisper" +- name: cuda13-nvidia-l4t-arm64-whisper + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-whisper mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-whisper -- !!merge <<: *whispercpp - name: "cuda13-nvidia-l4t-arm64-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-whisper" +- name: cuda13-nvidia-l4t-arm64-whisper-development + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-whisper mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-whisper -- !!merge <<: *whispercpp - name: "cpu-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-whisper" +- name: cpu-whisper + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-whisper mirrors: - localai/localai-backends:latest-cpu-whisper -- !!merge <<: *whispercpp - name: "metal-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-whisper" +- name: metal-whisper + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-whisper mirrors: - localai/localai-backends:latest-metal-darwin-arm64-whisper -- !!merge <<: *whispercpp - name: "metal-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-whisper" +- name: metal-whisper-development + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-whisper mirrors: - localai/localai-backends:master-metal-darwin-arm64-whisper -- !!merge <<: *whispercpp - name: "cpu-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-whisper" +- name: cpu-whisper-development + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:master-cpu-whisper mirrors: - localai/localai-backends:master-cpu-whisper -- !!merge <<: *whispercpp - name: "cuda12-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-whisper" +- name: cuda12-whisper + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-whisper mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-whisper -- !!merge <<: *whispercpp - name: "rocm-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-whisper" +- name: rocm-whisper + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-whisper mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-whisper -- !!merge <<: *whispercpp - name: "intel-sycl-f32-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-whisper" +- name: intel-sycl-f32-whisper + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-whisper mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-whisper -- !!merge <<: *whispercpp - name: "intel-sycl-f16-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-whisper" +- name: intel-sycl-f16-whisper + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-whisper mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-whisper -- !!merge <<: *whispercpp - name: "vulkan-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-whisper" +- name: vulkan-whisper + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-whisper mirrors: - localai/localai-backends:latest-gpu-vulkan-whisper -- !!merge <<: *whispercpp - name: "vulkan-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-whisper" +- name: vulkan-whisper-development + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-whisper mirrors: - localai/localai-backends:master-gpu-vulkan-whisper -- !!merge <<: *whispercpp - name: "metal-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-whisper" - mirrors: - - localai/localai-backends:latest-metal-darwin-arm64-whisper -- !!merge <<: *whispercpp - name: "metal-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-whisper" - mirrors: - - localai/localai-backends:master-metal-darwin-arm64-whisper -- !!merge <<: *whispercpp - name: "cuda12-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-whisper" +- name: cuda12-whisper-development + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-whisper mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-whisper -- !!merge <<: *whispercpp - name: "rocm-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-whisper" +- name: rocm-whisper-development + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-whisper mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-whisper -- !!merge <<: *whispercpp - name: "intel-sycl-f32-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-whisper" +- name: intel-sycl-f32-whisper-development + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-whisper mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-whisper -- !!merge <<: *whispercpp - name: "intel-sycl-f16-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-whisper" +- name: intel-sycl-f16-whisper-development + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-whisper mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-whisper -- !!merge <<: *whispercpp - name: "cuda13-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-whisper" +- name: cuda13-whisper + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-whisper mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-whisper -- !!merge <<: *whispercpp - name: "cuda13-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-whisper" +- name: cuda13-whisper-development + alias: whisper + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-whisper + default: cpu-whisper + intel: intel-sycl-f16-whisper + metal: metal-whisper + nvidia: cuda12-whisper + nvidia-cuda-12: cuda12-whisper + nvidia-cuda-13: cuda13-whisper + nvidia-l4t: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisper + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-whisper + vulkan: vulkan-whisper + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-whisper mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-whisper -## crispasr -- !!merge <<: *crispasr - name: "crispasr-development" +- name: crispasr-development + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP capabilities: - default: "cpu-crispasr-development" - nvidia: "cuda12-crispasr-development" - intel: "intel-sycl-f16-crispasr-development" - metal: "metal-crispasr-development" - amd: "rocm-crispasr-development" - vulkan: "vulkan-crispasr-development" - nvidia-l4t: "nvidia-l4t-arm64-crispasr-development" - nvidia-cuda-13: "cuda13-crispasr-development" - nvidia-cuda-12: "cuda12-crispasr-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-crispasr-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-crispasr-development" -- !!merge <<: *crispasr - name: "nvidia-l4t-arm64-crispasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-crispasr" + amd: rocm-crispasr-development + default: cpu-crispasr-development + intel: intel-sycl-f16-crispasr-development + metal: metal-crispasr-development + nvidia: cuda12-crispasr-development + nvidia-cuda-12: cuda12-crispasr-development + nvidia-cuda-13: cuda13-crispasr-development + nvidia-l4t: nvidia-l4t-arm64-crispasr-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr-development + vulkan: vulkan-crispasr-development +- name: nvidia-l4t-arm64-crispasr + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-crispasr mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-crispasr -- !!merge <<: *crispasr - name: "nvidia-l4t-arm64-crispasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-crispasr" +- name: nvidia-l4t-arm64-crispasr-development + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-crispasr mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-crispasr -- !!merge <<: *crispasr - name: "cuda13-nvidia-l4t-arm64-crispasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-crispasr" +- name: cuda13-nvidia-l4t-arm64-crispasr + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-crispasr mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-crispasr -- !!merge <<: *crispasr - name: "cuda13-nvidia-l4t-arm64-crispasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-crispasr" +- name: cuda13-nvidia-l4t-arm64-crispasr-development + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-crispasr mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-crispasr -- !!merge <<: *crispasr - name: "cpu-crispasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-crispasr" +- name: cpu-crispasr + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-crispasr mirrors: - localai/localai-backends:latest-cpu-crispasr -- !!merge <<: *crispasr - name: "metal-crispasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-crispasr" +- name: metal-crispasr + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-crispasr mirrors: - localai/localai-backends:latest-metal-darwin-arm64-crispasr -- !!merge <<: *crispasr - name: "metal-crispasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-crispasr" +- name: metal-crispasr-development + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-crispasr mirrors: - localai/localai-backends:master-metal-darwin-arm64-crispasr -- !!merge <<: *crispasr - name: "cpu-crispasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-crispasr" +- name: cpu-crispasr-development + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:master-cpu-crispasr mirrors: - localai/localai-backends:master-cpu-crispasr -- !!merge <<: *crispasr - name: "cuda12-crispasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-crispasr" +- name: cuda12-crispasr + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-crispasr mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-crispasr -- !!merge <<: *crispasr - name: "rocm-crispasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-crispasr" +- name: rocm-crispasr + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-crispasr mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-crispasr -- !!merge <<: *crispasr - name: "intel-sycl-f32-crispasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-crispasr" +- name: intel-sycl-f32-crispasr + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-crispasr mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-crispasr -- !!merge <<: *crispasr - name: "intel-sycl-f16-crispasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-crispasr" +- name: intel-sycl-f16-crispasr + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-crispasr mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-crispasr -- !!merge <<: *crispasr - name: "vulkan-crispasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-crispasr" +- name: vulkan-crispasr + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-crispasr mirrors: - localai/localai-backends:latest-gpu-vulkan-crispasr -- !!merge <<: *crispasr - name: "vulkan-crispasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-crispasr" +- name: vulkan-crispasr-development + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-crispasr mirrors: - localai/localai-backends:master-gpu-vulkan-crispasr -- !!merge <<: *crispasr - name: "metal-crispasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-crispasr" - mirrors: - - localai/localai-backends:latest-metal-darwin-arm64-crispasr -- !!merge <<: *crispasr - name: "metal-crispasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-crispasr" - mirrors: - - localai/localai-backends:master-metal-darwin-arm64-crispasr -- !!merge <<: *crispasr - name: "cuda12-crispasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-crispasr" +- name: cuda12-crispasr-development + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-crispasr mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-crispasr -- !!merge <<: *crispasr - name: "rocm-crispasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-crispasr" +- name: rocm-crispasr-development + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-crispasr mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-crispasr -- !!merge <<: *crispasr - name: "intel-sycl-f32-crispasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-crispasr" +- name: intel-sycl-f32-crispasr-development + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-crispasr mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-crispasr -- !!merge <<: *crispasr - name: "intel-sycl-f16-crispasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-crispasr" +- name: intel-sycl-f16-crispasr-development + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-crispasr mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-crispasr -- !!merge <<: *crispasr - name: "cuda13-crispasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-crispasr" +- name: cuda13-crispasr + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-crispasr mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-crispasr -- !!merge <<: *crispasr - name: "cuda13-crispasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-crispasr" +- name: cuda13-crispasr-development + alias: crispasr + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-crispasr + default: cpu-crispasr + intel: intel-sycl-f16-crispasr + metal: metal-crispasr + nvidia: cuda12-crispasr + nvidia-cuda-12: cuda12-crispasr + nvidia-cuda-13: cuda13-crispasr + nvidia-l4t: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-crispasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-crispasr + vulkan: vulkan-crispasr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-crispasr mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-crispasr -## parakeet-cpp -- !!merge <<: *parakeetcpp - name: "parakeet-cpp-development" +- name: parakeet-cpp-development + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP capabilities: - default: "cpu-parakeet-cpp-development" - nvidia: "cuda12-parakeet-cpp-development" - intel: "intel-sycl-f16-parakeet-cpp-development" - metal: "metal-parakeet-cpp-development" - amd: "rocm-parakeet-cpp-development" - vulkan: "vulkan-parakeet-cpp-development" - nvidia-l4t: "nvidia-l4t-arm64-parakeet-cpp-development" - nvidia-cuda-13: "cuda13-parakeet-cpp-development" - nvidia-cuda-12: "cuda12-parakeet-cpp-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-parakeet-cpp-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-parakeet-cpp-development" -- !!merge <<: *parakeetcpp - name: "nvidia-l4t-arm64-parakeet-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-parakeet-cpp" + amd: rocm-parakeet-cpp-development + default: cpu-parakeet-cpp-development + intel: intel-sycl-f16-parakeet-cpp-development + metal: metal-parakeet-cpp-development + nvidia: cuda12-parakeet-cpp-development + nvidia-cuda-12: cuda12-parakeet-cpp-development + nvidia-cuda-13: cuda13-parakeet-cpp-development + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp-development + vulkan: vulkan-parakeet-cpp-development +- name: nvidia-l4t-arm64-parakeet-cpp + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-parakeet-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "nvidia-l4t-arm64-parakeet-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-parakeet-cpp" +- name: nvidia-l4t-arm64-parakeet-cpp-development + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-parakeet-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "cuda13-nvidia-l4t-arm64-parakeet-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-parakeet-cpp" +- name: cuda13-nvidia-l4t-arm64-parakeet-cpp + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-parakeet-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "cuda13-nvidia-l4t-arm64-parakeet-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-parakeet-cpp" +- name: cuda13-nvidia-l4t-arm64-parakeet-cpp-development + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-parakeet-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "cpu-parakeet-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-parakeet-cpp" +- name: cpu-parakeet-cpp + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-parakeet-cpp mirrors: - localai/localai-backends:latest-cpu-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "cpu-parakeet-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-parakeet-cpp" +- name: cpu-parakeet-cpp-development + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-parakeet-cpp mirrors: - localai/localai-backends:master-cpu-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "metal-parakeet-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-parakeet-cpp" +- name: metal-parakeet-cpp + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-parakeet-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "metal-parakeet-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-parakeet-cpp" +- name: metal-parakeet-cpp-development + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-parakeet-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "cuda12-parakeet-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-parakeet-cpp" +- name: cuda12-parakeet-cpp + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-parakeet-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "cuda12-parakeet-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-parakeet-cpp" +- name: cuda12-parakeet-cpp-development + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-parakeet-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "rocm-parakeet-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-parakeet-cpp" +- name: rocm-parakeet-cpp + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-parakeet-cpp mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "rocm-parakeet-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-parakeet-cpp" +- name: rocm-parakeet-cpp-development + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-parakeet-cpp mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "intel-sycl-f32-parakeet-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-parakeet-cpp" +- name: intel-sycl-f32-parakeet-cpp + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-parakeet-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "intel-sycl-f32-parakeet-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-parakeet-cpp" +- name: intel-sycl-f32-parakeet-cpp-development + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-parakeet-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "intel-sycl-f16-parakeet-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-parakeet-cpp" +- name: intel-sycl-f16-parakeet-cpp + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-parakeet-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "intel-sycl-f16-parakeet-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-parakeet-cpp" +- name: intel-sycl-f16-parakeet-cpp-development + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-parakeet-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "vulkan-parakeet-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-parakeet-cpp" +- name: vulkan-parakeet-cpp + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-parakeet-cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "vulkan-parakeet-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-parakeet-cpp" +- name: vulkan-parakeet-cpp-development + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-parakeet-cpp mirrors: - localai/localai-backends:master-gpu-vulkan-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "cuda13-parakeet-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-parakeet-cpp" +- name: cuda13-parakeet-cpp + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-parakeet-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-parakeet-cpp -- !!merge <<: *parakeetcpp - name: "cuda13-parakeet-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-parakeet-cpp" +- name: cuda13-parakeet-cpp-development + alias: parakeet-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-parakeet-cpp + default: cpu-parakeet-cpp + intel: intel-sycl-f16-parakeet-cpp + metal: metal-parakeet-cpp + nvidia: cuda12-parakeet-cpp + nvidia-cuda-12: cuda12-parakeet-cpp + nvidia-cuda-13: cuda13-parakeet-cpp + nvidia-l4t: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-parakeet-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-parakeet-cpp + vulkan: vulkan-parakeet-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-parakeet-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-parakeet-cpp -## nemo-speech-cpp -- !!merge <<: *nemospeechcpp - name: "nemo-speech-cpp-development" +- name: nemo-speech-cpp-development + alias: nemo-speech-cpp + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal capabilities: - default: "cpu-nemo-speech-cpp-development" - nvidia: "cuda12-nemo-speech-cpp-development" - metal: "metal-nemo-speech-cpp-development" - vulkan: "vulkan-nemo-speech-cpp-development" - nvidia-l4t: "nvidia-l4t-arm64-nemo-speech-cpp-development" - nvidia-cuda-13: "cuda13-nemo-speech-cpp-development" - nvidia-cuda-12: "cuda12-nemo-speech-cpp-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-nemo-speech-cpp-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-nemo-speech-cpp-development" -- !!merge <<: *nemospeechcpp - name: "cpu-nemo-speech-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-nemo-speech-cpp" + default: cpu-nemo-speech-cpp-development + metal: metal-nemo-speech-cpp-development + nvidia: cuda12-nemo-speech-cpp-development + nvidia-cuda-12: cuda12-nemo-speech-cpp-development + nvidia-cuda-13: cuda13-nemo-speech-cpp-development + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp-development + vulkan: vulkan-nemo-speech-cpp-development +- name: cpu-nemo-speech-cpp + alias: nemo-speech-cpp + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-nemo-speech-cpp + metal: metal-nemo-speech-cpp + nvidia: cuda12-nemo-speech-cpp + nvidia-cuda-12: cuda12-nemo-speech-cpp + nvidia-cuda-13: cuda13-nemo-speech-cpp + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + vulkan: vulkan-nemo-speech-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-nemo-speech-cpp mirrors: - localai/localai-backends:latest-cpu-nemo-speech-cpp -- !!merge <<: *nemospeechcpp - name: "cpu-nemo-speech-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-nemo-speech-cpp" +- name: cpu-nemo-speech-cpp-development + alias: nemo-speech-cpp + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-nemo-speech-cpp + metal: metal-nemo-speech-cpp + nvidia: cuda12-nemo-speech-cpp + nvidia-cuda-12: cuda12-nemo-speech-cpp + nvidia-cuda-13: cuda13-nemo-speech-cpp + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + vulkan: vulkan-nemo-speech-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-nemo-speech-cpp mirrors: - localai/localai-backends:master-cpu-nemo-speech-cpp -- !!merge <<: *nemospeechcpp - name: "cuda12-nemo-speech-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-nemo-speech-cpp" +- name: cuda12-nemo-speech-cpp + alias: nemo-speech-cpp + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-nemo-speech-cpp + metal: metal-nemo-speech-cpp + nvidia: cuda12-nemo-speech-cpp + nvidia-cuda-12: cuda12-nemo-speech-cpp + nvidia-cuda-13: cuda13-nemo-speech-cpp + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + vulkan: vulkan-nemo-speech-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-nemo-speech-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-nemo-speech-cpp -- !!merge <<: *nemospeechcpp - name: "cuda12-nemo-speech-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-nemo-speech-cpp" +- name: cuda12-nemo-speech-cpp-development + alias: nemo-speech-cpp + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-nemo-speech-cpp + metal: metal-nemo-speech-cpp + nvidia: cuda12-nemo-speech-cpp + nvidia-cuda-12: cuda12-nemo-speech-cpp + nvidia-cuda-13: cuda13-nemo-speech-cpp + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + vulkan: vulkan-nemo-speech-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-nemo-speech-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-nemo-speech-cpp -- !!merge <<: *nemospeechcpp - name: "cuda13-nemo-speech-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-nemo-speech-cpp" +- name: cuda13-nemo-speech-cpp + alias: nemo-speech-cpp + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-nemo-speech-cpp + metal: metal-nemo-speech-cpp + nvidia: cuda12-nemo-speech-cpp + nvidia-cuda-12: cuda12-nemo-speech-cpp + nvidia-cuda-13: cuda13-nemo-speech-cpp + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + vulkan: vulkan-nemo-speech-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-nemo-speech-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-nemo-speech-cpp -- !!merge <<: *nemospeechcpp - name: "cuda13-nemo-speech-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-nemo-speech-cpp" +- name: cuda13-nemo-speech-cpp-development + alias: nemo-speech-cpp + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-nemo-speech-cpp + metal: metal-nemo-speech-cpp + nvidia: cuda12-nemo-speech-cpp + nvidia-cuda-12: cuda12-nemo-speech-cpp + nvidia-cuda-13: cuda13-nemo-speech-cpp + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + vulkan: vulkan-nemo-speech-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-nemo-speech-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-nemo-speech-cpp -- !!merge <<: *nemospeechcpp - name: "vulkan-nemo-speech-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-nemo-speech-cpp" +- name: vulkan-nemo-speech-cpp + alias: nemo-speech-cpp + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-nemo-speech-cpp + metal: metal-nemo-speech-cpp + nvidia: cuda12-nemo-speech-cpp + nvidia-cuda-12: cuda12-nemo-speech-cpp + nvidia-cuda-13: cuda13-nemo-speech-cpp + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + vulkan: vulkan-nemo-speech-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-nemo-speech-cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-nemo-speech-cpp -- !!merge <<: *nemospeechcpp - name: "vulkan-nemo-speech-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-nemo-speech-cpp" +- name: vulkan-nemo-speech-cpp-development + alias: nemo-speech-cpp + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-nemo-speech-cpp + metal: metal-nemo-speech-cpp + nvidia: cuda12-nemo-speech-cpp + nvidia-cuda-12: cuda12-nemo-speech-cpp + nvidia-cuda-13: cuda13-nemo-speech-cpp + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + vulkan: vulkan-nemo-speech-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-nemo-speech-cpp mirrors: - localai/localai-backends:master-gpu-vulkan-nemo-speech-cpp -- !!merge <<: *nemospeechcpp - name: "nvidia-l4t-arm64-nemo-speech-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-nemo-speech-cpp" +- name: nvidia-l4t-arm64-nemo-speech-cpp + alias: nemo-speech-cpp + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-nemo-speech-cpp + metal: metal-nemo-speech-cpp + nvidia: cuda12-nemo-speech-cpp + nvidia-cuda-12: cuda12-nemo-speech-cpp + nvidia-cuda-13: cuda13-nemo-speech-cpp + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + vulkan: vulkan-nemo-speech-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-nemo-speech-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-nemo-speech-cpp -- !!merge <<: *nemospeechcpp - name: "nvidia-l4t-arm64-nemo-speech-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-nemo-speech-cpp" +- name: nvidia-l4t-arm64-nemo-speech-cpp-development + alias: nemo-speech-cpp + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-nemo-speech-cpp + metal: metal-nemo-speech-cpp + nvidia: cuda12-nemo-speech-cpp + nvidia-cuda-12: cuda12-nemo-speech-cpp + nvidia-cuda-13: cuda13-nemo-speech-cpp + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + vulkan: vulkan-nemo-speech-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-nemo-speech-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-nemo-speech-cpp -- !!merge <<: *nemospeechcpp - name: "cuda13-nvidia-l4t-arm64-nemo-speech-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-nemo-speech-cpp" +- name: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + alias: nemo-speech-cpp + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-nemo-speech-cpp + metal: metal-nemo-speech-cpp + nvidia: cuda12-nemo-speech-cpp + nvidia-cuda-12: cuda12-nemo-speech-cpp + nvidia-cuda-13: cuda13-nemo-speech-cpp + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + vulkan: vulkan-nemo-speech-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-nemo-speech-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-nemo-speech-cpp -- !!merge <<: *nemospeechcpp - name: "cuda13-nvidia-l4t-arm64-nemo-speech-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-nemo-speech-cpp" +- name: cuda13-nvidia-l4t-arm64-nemo-speech-cpp-development + alias: nemo-speech-cpp + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-nemo-speech-cpp + metal: metal-nemo-speech-cpp + nvidia: cuda12-nemo-speech-cpp + nvidia-cuda-12: cuda12-nemo-speech-cpp + nvidia-cuda-13: cuda13-nemo-speech-cpp + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + vulkan: vulkan-nemo-speech-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-nemo-speech-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-nemo-speech-cpp -- !!merge <<: *nemospeechcpp - name: "metal-nemo-speech-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-nemo-speech-cpp" +- name: metal-nemo-speech-cpp + alias: nemo-speech-cpp + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-nemo-speech-cpp + metal: metal-nemo-speech-cpp + nvidia: cuda12-nemo-speech-cpp + nvidia-cuda-12: cuda12-nemo-speech-cpp + nvidia-cuda-13: cuda13-nemo-speech-cpp + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + vulkan: vulkan-nemo-speech-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-nemo-speech-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-nemo-speech-cpp -- !!merge <<: *nemospeechcpp - name: "metal-nemo-speech-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-nemo-speech-cpp" +- name: metal-nemo-speech-cpp-development + alias: nemo-speech-cpp + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-nemo-speech-cpp + metal: metal-nemo-speech-cpp + nvidia: cuda12-nemo-speech-cpp + nvidia-cuda-12: cuda12-nemo-speech-cpp + nvidia-cuda-13: cuda13-nemo-speech-cpp + nvidia-l4t: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-nemo-speech-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-nemo-speech-cpp + vulkan: vulkan-nemo-speech-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-nemo-speech-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-nemo-speech-cpp -## moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "moss-transcribe-cpp-development" +- name: moss-transcribe-cpp-development + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP capabilities: - default: "cpu-moss-transcribe-cpp-development" - nvidia: "cuda12-moss-transcribe-cpp-development" - intel: "intel-sycl-f16-moss-transcribe-cpp-development" - metal: "metal-moss-transcribe-cpp-development" - amd: "rocm-moss-transcribe-cpp-development" - vulkan: "vulkan-moss-transcribe-cpp-development" - nvidia-l4t: "nvidia-l4t-arm64-moss-transcribe-cpp-development" - nvidia-cuda-13: "cuda13-moss-transcribe-cpp-development" - nvidia-cuda-12: "cuda12-moss-transcribe-cpp-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-moss-transcribe-cpp-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-moss-transcribe-cpp-development" -- !!merge <<: *mosstranscribecpp - name: "nvidia-l4t-arm64-moss-transcribe-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-moss-transcribe-cpp" + amd: rocm-moss-transcribe-cpp-development + default: cpu-moss-transcribe-cpp-development + intel: intel-sycl-f16-moss-transcribe-cpp-development + metal: metal-moss-transcribe-cpp-development + nvidia: cuda12-moss-transcribe-cpp-development + nvidia-cuda-12: cuda12-moss-transcribe-cpp-development + nvidia-cuda-13: cuda13-moss-transcribe-cpp-development + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp-development + vulkan: vulkan-moss-transcribe-cpp-development +- name: nvidia-l4t-arm64-moss-transcribe-cpp + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-moss-transcribe-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "nvidia-l4t-arm64-moss-transcribe-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-moss-transcribe-cpp" +- name: nvidia-l4t-arm64-moss-transcribe-cpp-development + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-moss-transcribe-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "cuda13-nvidia-l4t-arm64-moss-transcribe-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-moss-transcribe-cpp" +- name: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-moss-transcribe-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "cuda13-nvidia-l4t-arm64-moss-transcribe-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-moss-transcribe-cpp" +- name: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp-development + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-moss-transcribe-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "cpu-moss-transcribe-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-moss-transcribe-cpp" +- name: cpu-moss-transcribe-cpp + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-moss-transcribe-cpp mirrors: - localai/localai-backends:latest-cpu-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "cpu-moss-transcribe-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-moss-transcribe-cpp" +- name: cpu-moss-transcribe-cpp-development + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-moss-transcribe-cpp mirrors: - localai/localai-backends:master-cpu-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "metal-moss-transcribe-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-moss-transcribe-cpp" +- name: metal-moss-transcribe-cpp + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-moss-transcribe-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "metal-moss-transcribe-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-moss-transcribe-cpp" +- name: metal-moss-transcribe-cpp-development + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-moss-transcribe-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "cuda12-moss-transcribe-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-moss-transcribe-cpp" +- name: cuda12-moss-transcribe-cpp + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-moss-transcribe-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "cuda12-moss-transcribe-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-moss-transcribe-cpp" +- name: cuda12-moss-transcribe-cpp-development + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-moss-transcribe-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "rocm-moss-transcribe-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-moss-transcribe-cpp" +- name: rocm-moss-transcribe-cpp + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-moss-transcribe-cpp mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "rocm-moss-transcribe-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-moss-transcribe-cpp" +- name: rocm-moss-transcribe-cpp-development + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-moss-transcribe-cpp mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "intel-sycl-f32-moss-transcribe-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-moss-transcribe-cpp" +- name: intel-sycl-f32-moss-transcribe-cpp + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-moss-transcribe-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "intel-sycl-f32-moss-transcribe-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-moss-transcribe-cpp" +- name: intel-sycl-f32-moss-transcribe-cpp-development + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-moss-transcribe-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "intel-sycl-f16-moss-transcribe-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-moss-transcribe-cpp" +- name: intel-sycl-f16-moss-transcribe-cpp + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-moss-transcribe-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "intel-sycl-f16-moss-transcribe-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-moss-transcribe-cpp" +- name: intel-sycl-f16-moss-transcribe-cpp-development + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-moss-transcribe-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "vulkan-moss-transcribe-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-moss-transcribe-cpp" +- name: vulkan-moss-transcribe-cpp + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-moss-transcribe-cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "vulkan-moss-transcribe-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-moss-transcribe-cpp" +- name: vulkan-moss-transcribe-cpp-development + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-moss-transcribe-cpp mirrors: - localai/localai-backends:master-gpu-vulkan-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "cuda13-moss-transcribe-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-moss-transcribe-cpp" +- name: cuda13-moss-transcribe-cpp + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-moss-transcribe-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-moss-transcribe-cpp -- !!merge <<: *mosstranscribecpp - name: "cuda13-moss-transcribe-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-moss-transcribe-cpp" +- name: cuda13-moss-transcribe-cpp-development + alias: moss-transcribe-cpp + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-moss-transcribe-cpp + default: cpu-moss-transcribe-cpp + intel: intel-sycl-f16-moss-transcribe-cpp + metal: metal-moss-transcribe-cpp + nvidia: cuda12-moss-transcribe-cpp + nvidia-cuda-12: cuda12-moss-transcribe-cpp + nvidia-cuda-13: cuda13-moss-transcribe-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-transcribe-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-transcribe-cpp + vulkan: vulkan-moss-transcribe-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-moss-transcribe-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-moss-transcribe-cpp -## ced -- !!merge <<: *ced - name: "ced-development" +- name: ced-development + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP capabilities: - default: "cpu-ced-development" - nvidia: "cuda12-ced-development" - intel: "intel-sycl-f16-ced-development" - metal: "metal-ced-development" - amd: "rocm-ced-development" - vulkan: "vulkan-ced-development" - nvidia-l4t: "nvidia-l4t-arm64-ced-development" - nvidia-cuda-13: "cuda13-ced-development" - nvidia-cuda-12: "cuda12-ced-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-ced-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-ced-development" -- !!merge <<: *ced - name: "nvidia-l4t-arm64-ced" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-ced" + amd: rocm-ced-development + default: cpu-ced-development + intel: intel-sycl-f16-ced-development + metal: metal-ced-development + nvidia: cuda12-ced-development + nvidia-cuda-12: cuda12-ced-development + nvidia-cuda-13: cuda13-ced-development + nvidia-l4t: nvidia-l4t-arm64-ced-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced-development + vulkan: vulkan-ced-development +- name: nvidia-l4t-arm64-ced + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-ced mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-ced -- !!merge <<: *ced - name: "nvidia-l4t-arm64-ced-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-ced" +- name: nvidia-l4t-arm64-ced-development + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-ced mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-ced -- !!merge <<: *ced - name: "cuda13-nvidia-l4t-arm64-ced" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-ced" +- name: cuda13-nvidia-l4t-arm64-ced + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-ced mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-ced -- !!merge <<: *ced - name: "cuda13-nvidia-l4t-arm64-ced-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-ced" +- name: cuda13-nvidia-l4t-arm64-ced-development + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-ced mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-ced -- !!merge <<: *ced - name: "cpu-ced" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-ced" +- name: cpu-ced + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-ced mirrors: - localai/localai-backends:latest-cpu-ced -- !!merge <<: *ced - name: "cpu-ced-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-ced" +- name: cpu-ced-development + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:master-cpu-ced mirrors: - localai/localai-backends:master-cpu-ced -- !!merge <<: *ced - name: "metal-ced" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-ced" +- name: metal-ced + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-ced mirrors: - localai/localai-backends:latest-metal-darwin-arm64-ced -- !!merge <<: *ced - name: "metal-ced-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-ced" +- name: metal-ced-development + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-ced mirrors: - localai/localai-backends:master-metal-darwin-arm64-ced -- !!merge <<: *ced - name: "cuda12-ced" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-ced" +- name: cuda12-ced + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-ced mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-ced -- !!merge <<: *ced - name: "cuda12-ced-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-ced" +- name: cuda12-ced-development + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-ced mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-ced -- !!merge <<: *ced - name: "rocm-ced" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-ced" +- name: rocm-ced + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-ced mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-ced -- !!merge <<: *ced - name: "rocm-ced-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-ced" +- name: rocm-ced-development + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-ced mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-ced -- !!merge <<: *ced - name: "intel-sycl-f32-ced" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-ced" +- name: intel-sycl-f32-ced + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-ced mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-ced -- !!merge <<: *ced - name: "intel-sycl-f32-ced-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-ced" +- name: intel-sycl-f32-ced-development + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-ced mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-ced -- !!merge <<: *ced - name: "intel-sycl-f16-ced" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-ced" +- name: intel-sycl-f16-ced + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-ced mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-ced -- !!merge <<: *ced - name: "intel-sycl-f16-ced-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-ced" +- name: intel-sycl-f16-ced-development + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-ced mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-ced -- !!merge <<: *ced - name: "vulkan-ced" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-ced" +- name: vulkan-ced + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-ced mirrors: - localai/localai-backends:latest-gpu-vulkan-ced -- !!merge <<: *ced - name: "vulkan-ced-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-ced" +- name: vulkan-ced-development + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-ced mirrors: - localai/localai-backends:master-gpu-vulkan-ced -- !!merge <<: *ced - name: "cuda13-ced" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-ced" +- name: cuda13-ced + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-ced mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-ced -- !!merge <<: *ced - name: "cuda13-ced-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-ced" +- name: cuda13-ced-development + alias: ced + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-ced + default: cpu-ced + intel: intel-sycl-f16-ced + metal: metal-ced + nvidia: cuda12-ced + nvidia-cuda-12: cuda12-ced + nvidia-cuda-13: cuda13-ced + nvidia-l4t: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-12: nvidia-l4t-arm64-ced + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-ced + vulkan: vulkan-ced + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-ced mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-ced -## voice-detect -- !!merge <<: *voicedetect - name: "voice-detect-development" +- name: voice-detect-development + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP capabilities: - default: "cpu-voice-detect-development" - nvidia: "cuda12-voice-detect-development" - intel: "intel-sycl-f16-voice-detect-development" - metal: "metal-voice-detect-development" - amd: "rocm-voice-detect-development" - vulkan: "vulkan-voice-detect-development" - nvidia-l4t: "nvidia-l4t-arm64-voice-detect-development" - nvidia-cuda-13: "cuda13-voice-detect-development" - nvidia-cuda-12: "cuda12-voice-detect-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-voice-detect-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-voice-detect-development" -- !!merge <<: *voicedetect - name: "nvidia-l4t-arm64-voice-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-voice-detect" + amd: rocm-voice-detect-development + default: cpu-voice-detect-development + intel: intel-sycl-f16-voice-detect-development + metal: metal-voice-detect-development + nvidia: cuda12-voice-detect-development + nvidia-cuda-12: cuda12-voice-detect-development + nvidia-cuda-13: cuda13-voice-detect-development + nvidia-l4t: nvidia-l4t-arm64-voice-detect-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect-development + vulkan: vulkan-voice-detect-development +- name: nvidia-l4t-arm64-voice-detect + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-voice-detect mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-voice-detect -- !!merge <<: *voicedetect - name: "nvidia-l4t-arm64-voice-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-voice-detect" +- name: nvidia-l4t-arm64-voice-detect-development + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-voice-detect mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-voice-detect -- !!merge <<: *voicedetect - name: "cuda13-nvidia-l4t-arm64-voice-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-voice-detect" +- name: cuda13-nvidia-l4t-arm64-voice-detect + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-voice-detect mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-voice-detect -- !!merge <<: *voicedetect - name: "cuda13-nvidia-l4t-arm64-voice-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-voice-detect" +- name: cuda13-nvidia-l4t-arm64-voice-detect-development + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-voice-detect mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-voice-detect -- !!merge <<: *voicedetect - name: "cpu-voice-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-voice-detect" +- name: cpu-voice-detect + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-voice-detect mirrors: - localai/localai-backends:latest-cpu-voice-detect -- !!merge <<: *voicedetect - name: "cpu-voice-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-voice-detect" +- name: cpu-voice-detect-development + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:master-cpu-voice-detect mirrors: - localai/localai-backends:master-cpu-voice-detect -- !!merge <<: *voicedetect - name: "metal-voice-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-voice-detect" +- name: metal-voice-detect + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-voice-detect mirrors: - localai/localai-backends:latest-metal-darwin-arm64-voice-detect -- !!merge <<: *voicedetect - name: "metal-voice-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-voice-detect" +- name: metal-voice-detect-development + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-voice-detect mirrors: - localai/localai-backends:master-metal-darwin-arm64-voice-detect -- !!merge <<: *voicedetect - name: "cuda12-voice-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-voice-detect" +- name: cuda12-voice-detect + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-voice-detect mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-voice-detect -- !!merge <<: *voicedetect - name: "cuda12-voice-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-voice-detect" +- name: cuda12-voice-detect-development + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-voice-detect mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-voice-detect -- !!merge <<: *voicedetect - name: "rocm-voice-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-voice-detect" +- name: rocm-voice-detect + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-voice-detect mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-voice-detect -- !!merge <<: *voicedetect - name: "rocm-voice-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-voice-detect" +- name: rocm-voice-detect-development + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-voice-detect mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-voice-detect -- !!merge <<: *voicedetect - name: "intel-sycl-f32-voice-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-voice-detect" +- name: intel-sycl-f32-voice-detect + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-voice-detect mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-voice-detect -- !!merge <<: *voicedetect - name: "intel-sycl-f32-voice-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-voice-detect" +- name: intel-sycl-f32-voice-detect-development + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-voice-detect mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-voice-detect -- !!merge <<: *voicedetect - name: "intel-sycl-f16-voice-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-voice-detect" +- name: intel-sycl-f16-voice-detect + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-voice-detect mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-voice-detect -- !!merge <<: *voicedetect - name: "intel-sycl-f16-voice-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-voice-detect" +- name: intel-sycl-f16-voice-detect-development + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-voice-detect mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-voice-detect -- !!merge <<: *voicedetect - name: "vulkan-voice-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-voice-detect" +- name: vulkan-voice-detect + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-voice-detect mirrors: - localai/localai-backends:latest-gpu-vulkan-voice-detect -- !!merge <<: *voicedetect - name: "vulkan-voice-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-voice-detect" +- name: vulkan-voice-detect-development + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-voice-detect mirrors: - localai/localai-backends:master-gpu-vulkan-voice-detect -- !!merge <<: *voicedetect - name: "cuda13-voice-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-voice-detect" +- name: cuda13-voice-detect + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-voice-detect mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-voice-detect -- !!merge <<: *voicedetect - name: "cuda13-voice-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-voice-detect" +- name: cuda13-voice-detect-development + alias: voice-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-voice-detect + default: cpu-voice-detect + intel: intel-sycl-f16-voice-detect + metal: metal-voice-detect + nvidia: cuda12-voice-detect + nvidia-cuda-12: cuda12-voice-detect + nvidia-cuda-13: cuda13-voice-detect + nvidia-l4t: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-voice-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-voice-detect + vulkan: vulkan-voice-detect + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-voice-detect mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-voice-detect -## face-detect -- !!merge <<: *facedetect - name: "face-detect-development" +- name: face-detect-development + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP capabilities: - default: "cpu-face-detect-development" - nvidia: "cuda12-face-detect-development" - intel: "intel-sycl-f16-face-detect-development" - metal: "metal-face-detect-development" - amd: "rocm-face-detect-development" - vulkan: "vulkan-face-detect-development" - nvidia-l4t: "nvidia-l4t-arm64-face-detect-development" - nvidia-cuda-13: "cuda13-face-detect-development" - nvidia-cuda-12: "cuda12-face-detect-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-face-detect-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-face-detect-development" -- !!merge <<: *facedetect - name: "nvidia-l4t-arm64-face-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-face-detect" + amd: rocm-face-detect-development + default: cpu-face-detect-development + intel: intel-sycl-f16-face-detect-development + metal: metal-face-detect-development + nvidia: cuda12-face-detect-development + nvidia-cuda-12: cuda12-face-detect-development + nvidia-cuda-13: cuda13-face-detect-development + nvidia-l4t: nvidia-l4t-arm64-face-detect-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect-development + vulkan: vulkan-face-detect-development +- name: nvidia-l4t-arm64-face-detect + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-face-detect mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-face-detect -- !!merge <<: *facedetect - name: "nvidia-l4t-arm64-face-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-face-detect" +- name: nvidia-l4t-arm64-face-detect-development + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-face-detect mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-face-detect -- !!merge <<: *facedetect - name: "cuda13-nvidia-l4t-arm64-face-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-face-detect" +- name: cuda13-nvidia-l4t-arm64-face-detect + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-face-detect mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-face-detect -- !!merge <<: *facedetect - name: "cuda13-nvidia-l4t-arm64-face-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-face-detect" +- name: cuda13-nvidia-l4t-arm64-face-detect-development + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-face-detect mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-face-detect -- !!merge <<: *facedetect - name: "cpu-face-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-face-detect" +- name: cpu-face-detect + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-face-detect mirrors: - localai/localai-backends:latest-cpu-face-detect -- !!merge <<: *facedetect - name: "cpu-face-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-face-detect" +- name: cpu-face-detect-development + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:master-cpu-face-detect mirrors: - localai/localai-backends:master-cpu-face-detect -- !!merge <<: *facedetect - name: "metal-face-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-face-detect" +- name: metal-face-detect + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-face-detect mirrors: - localai/localai-backends:latest-metal-darwin-arm64-face-detect -- !!merge <<: *facedetect - name: "metal-face-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-face-detect" +- name: metal-face-detect-development + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-face-detect mirrors: - localai/localai-backends:master-metal-darwin-arm64-face-detect -- !!merge <<: *facedetect - name: "cuda12-face-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-face-detect" +- name: cuda12-face-detect + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-face-detect mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-face-detect -- !!merge <<: *facedetect - name: "cuda12-face-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-face-detect" +- name: cuda12-face-detect-development + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-face-detect mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-face-detect -- !!merge <<: *facedetect - name: "rocm-face-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-face-detect" +- name: rocm-face-detect + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-face-detect mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-face-detect -- !!merge <<: *facedetect - name: "rocm-face-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-face-detect" +- name: rocm-face-detect-development + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-face-detect mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-face-detect -- !!merge <<: *facedetect - name: "intel-sycl-f32-face-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-face-detect" +- name: intel-sycl-f32-face-detect + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-face-detect mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-face-detect -- !!merge <<: *facedetect - name: "intel-sycl-f32-face-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-face-detect" +- name: intel-sycl-f32-face-detect-development + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-face-detect mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-face-detect -- !!merge <<: *facedetect - name: "intel-sycl-f16-face-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-face-detect" +- name: intel-sycl-f16-face-detect + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-face-detect mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-face-detect -- !!merge <<: *facedetect - name: "intel-sycl-f16-face-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-face-detect" +- name: intel-sycl-f16-face-detect-development + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-face-detect mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-face-detect -- !!merge <<: *facedetect - name: "vulkan-face-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-face-detect" +- name: vulkan-face-detect + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-face-detect mirrors: - localai/localai-backends:latest-gpu-vulkan-face-detect -- !!merge <<: *facedetect - name: "vulkan-face-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-face-detect" +- name: vulkan-face-detect-development + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-face-detect mirrors: - localai/localai-backends:master-gpu-vulkan-face-detect -- !!merge <<: *facedetect - name: "cuda13-face-detect" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-face-detect" +- name: cuda13-face-detect + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-face-detect mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-face-detect -- !!merge <<: *facedetect - name: "cuda13-face-detect-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-face-detect" +- name: cuda13-face-detect-development + alias: face-detect + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + amd: rocm-face-detect + default: cpu-face-detect + intel: intel-sycl-f16-face-detect + metal: metal-face-detect + nvidia: cuda12-face-detect + nvidia-cuda-12: cuda12-face-detect + nvidia-cuda-13: cuda13-face-detect + nvidia-l4t: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-12: nvidia-l4t-arm64-face-detect + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-face-detect + vulkan: vulkan-face-detect + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-face-detect mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-face-detect -## stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "cpu-stablediffusion-ggml" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-stablediffusion-ggml" +- name: cpu-stablediffusion-ggml + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-stablediffusion-ggml mirrors: - localai/localai-backends:latest-cpu-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "cpu-stablediffusion-ggml-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-stablediffusion-ggml" +- name: cpu-stablediffusion-ggml-development + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:master-cpu-stablediffusion-ggml mirrors: - localai/localai-backends:master-cpu-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "metal-stablediffusion-ggml" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-stablediffusion-ggml" +- name: metal-stablediffusion-ggml + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-stablediffusion-ggml mirrors: - localai/localai-backends:latest-metal-darwin-arm64-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "metal-stablediffusion-ggml-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-stablediffusion-ggml" +- name: metal-stablediffusion-ggml-development + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-stablediffusion-ggml mirrors: - localai/localai-backends:master-metal-darwin-arm64-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "vulkan-stablediffusion-ggml" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-stablediffusion-ggml" +- name: vulkan-stablediffusion-ggml + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-stablediffusion-ggml mirrors: - localai/localai-backends:latest-gpu-vulkan-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "vulkan-stablediffusion-ggml-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-stablediffusion-ggml" +- name: vulkan-stablediffusion-ggml-development + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-stablediffusion-ggml mirrors: - localai/localai-backends:master-gpu-vulkan-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "cuda12-stablediffusion-ggml" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-stablediffusion-ggml" +- name: cuda12-stablediffusion-ggml + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-stablediffusion-ggml mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "rocm-stablediffusion-ggml" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-stablediffusion-ggml" +- name: rocm-stablediffusion-ggml + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-stablediffusion-ggml mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "intel-sycl-f32-stablediffusion-ggml" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-stablediffusion-ggml" -- !!merge <<: *stablediffusionggml - name: "intel-sycl-f16-stablediffusion-ggml" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-stablediffusion-ggml" +- name: intel-sycl-f32-stablediffusion-ggml + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-stablediffusion-ggml +- name: intel-sycl-f16-stablediffusion-ggml + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-stablediffusion-ggml mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "cuda12-stablediffusion-ggml-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-stablediffusion-ggml" +- name: cuda12-stablediffusion-ggml-development + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-stablediffusion-ggml mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "rocm-stablediffusion-ggml-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-stablediffusion-ggml" +- name: rocm-stablediffusion-ggml-development + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-stablediffusion-ggml mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "intel-sycl-f32-stablediffusion-ggml-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-stablediffusion-ggml" +- name: intel-sycl-f32-stablediffusion-ggml-development + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-stablediffusion-ggml mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "intel-sycl-f16-stablediffusion-ggml-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-stablediffusion-ggml" +- name: intel-sycl-f16-stablediffusion-ggml-development + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-stablediffusion-ggml mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "nvidia-l4t-arm64-stablediffusion-ggml-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-stablediffusion-ggml" +- name: nvidia-l4t-arm64-stablediffusion-ggml-development + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-stablediffusion-ggml mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "nvidia-l4t-arm64-stablediffusion-ggml" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-stablediffusion-ggml" +- name: nvidia-l4t-arm64-stablediffusion-ggml + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-stablediffusion-ggml mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "cuda13-nvidia-l4t-arm64-stablediffusion-ggml" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-stablediffusion-ggml" +- name: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-stablediffusion-ggml mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "cuda13-nvidia-l4t-arm64-stablediffusion-ggml-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-stablediffusion-ggml" +- name: cuda13-nvidia-l4t-arm64-stablediffusion-ggml-development + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-stablediffusion-ggml mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "cuda13-stablediffusion-ggml" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-stablediffusion-ggml" +- name: cuda13-stablediffusion-ggml + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-stablediffusion-ggml mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-stablediffusion-ggml -- !!merge <<: *stablediffusionggml - name: "cuda13-stablediffusion-ggml-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-stablediffusion-ggml" +- name: cuda13-stablediffusion-ggml-development + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-stablediffusion-ggml mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-stablediffusion-ggml -## kimodo.cpp -- !!merge <<: *kimodocpp - name: "kimodocpp-development" +- name: kimodocpp-development + alias: kimodocpp + license: apache-2.0 + description: | + kimodo.cpp text-to-motion: animated skeleton GLB on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/kimodo.cpp + tags: + - 3d-animation + - text-to-motion + - CPU + - Vulkan capabilities: - default: "cpu-kimodocpp-development" - vulkan: "vulkan-kimodocpp-development" - nvidia: "vulkan-kimodocpp-development" - nvidia-cuda-12: "vulkan-kimodocpp-development" - nvidia-cuda-13: "vulkan-kimodocpp-development" - amd: "vulkan-kimodocpp-development" - intel: "vulkan-kimodocpp-development" - metal: "cpu-darwin-arm64-kimodocpp-development" -- !!merge <<: *kimodocpp - name: "cpu-kimodocpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-kimodocpp" + amd: vulkan-kimodocpp-development + default: cpu-kimodocpp-development + intel: vulkan-kimodocpp-development + metal: cpu-darwin-arm64-kimodocpp-development + nvidia: vulkan-kimodocpp-development + nvidia-cuda-12: vulkan-kimodocpp-development + nvidia-cuda-13: vulkan-kimodocpp-development + vulkan: vulkan-kimodocpp-development +- name: cpu-kimodocpp + alias: kimodocpp + license: apache-2.0 + description: | + kimodo.cpp text-to-motion: animated skeleton GLB on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/kimodo.cpp + tags: + - 3d-animation + - text-to-motion + - CPU + - Vulkan + capabilities: + amd: vulkan-kimodocpp + default: cpu-kimodocpp + intel: vulkan-kimodocpp + metal: cpu-darwin-arm64-kimodocpp + nvidia: vulkan-kimodocpp + nvidia-cuda-12: vulkan-kimodocpp + nvidia-cuda-13: vulkan-kimodocpp + vulkan: vulkan-kimodocpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-kimodocpp mirrors: - localai/localai-backends:latest-cpu-kimodocpp -- !!merge <<: *kimodocpp - name: "cpu-kimodocpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-kimodocpp" +- name: cpu-kimodocpp-development + alias: kimodocpp + license: apache-2.0 + description: | + kimodo.cpp text-to-motion: animated skeleton GLB on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/kimodo.cpp + tags: + - 3d-animation + - text-to-motion + - CPU + - Vulkan + capabilities: + amd: vulkan-kimodocpp + default: cpu-kimodocpp + intel: vulkan-kimodocpp + metal: cpu-darwin-arm64-kimodocpp + nvidia: vulkan-kimodocpp + nvidia-cuda-12: vulkan-kimodocpp + nvidia-cuda-13: vulkan-kimodocpp + vulkan: vulkan-kimodocpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-kimodocpp mirrors: - localai/localai-backends:master-cpu-kimodocpp -- !!merge <<: *kimodocpp - name: "vulkan-kimodocpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-kimodocpp" +- name: vulkan-kimodocpp + alias: kimodocpp + license: apache-2.0 + description: | + kimodo.cpp text-to-motion: animated skeleton GLB on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/kimodo.cpp + tags: + - 3d-animation + - text-to-motion + - CPU + - Vulkan + capabilities: + amd: vulkan-kimodocpp + default: cpu-kimodocpp + intel: vulkan-kimodocpp + metal: cpu-darwin-arm64-kimodocpp + nvidia: vulkan-kimodocpp + nvidia-cuda-12: vulkan-kimodocpp + nvidia-cuda-13: vulkan-kimodocpp + vulkan: vulkan-kimodocpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-kimodocpp mirrors: - localai/localai-backends:latest-gpu-vulkan-kimodocpp -- !!merge <<: *kimodocpp - name: "vulkan-kimodocpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-kimodocpp" +- name: vulkan-kimodocpp-development + alias: kimodocpp + license: apache-2.0 + description: | + kimodo.cpp text-to-motion: animated skeleton GLB on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/kimodo.cpp + tags: + - 3d-animation + - text-to-motion + - CPU + - Vulkan + capabilities: + amd: vulkan-kimodocpp + default: cpu-kimodocpp + intel: vulkan-kimodocpp + metal: cpu-darwin-arm64-kimodocpp + nvidia: vulkan-kimodocpp + nvidia-cuda-12: vulkan-kimodocpp + nvidia-cuda-13: vulkan-kimodocpp + vulkan: vulkan-kimodocpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-kimodocpp mirrors: - localai/localai-backends:master-gpu-vulkan-kimodocpp -- !!merge <<: *kimodocpp - name: "cpu-darwin-arm64-kimodocpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-darwin-arm64-kimodocpp" +- name: cpu-darwin-arm64-kimodocpp + alias: kimodocpp + license: apache-2.0 + description: | + kimodo.cpp text-to-motion: animated skeleton GLB on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/kimodo.cpp + tags: + - 3d-animation + - text-to-motion + - CPU + - Vulkan + capabilities: + amd: vulkan-kimodocpp + default: cpu-kimodocpp + intel: vulkan-kimodocpp + metal: cpu-darwin-arm64-kimodocpp + nvidia: vulkan-kimodocpp + nvidia-cuda-12: vulkan-kimodocpp + nvidia-cuda-13: vulkan-kimodocpp + vulkan: vulkan-kimodocpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-darwin-arm64-kimodocpp mirrors: - localai/localai-backends:latest-cpu-darwin-arm64-kimodocpp -- !!merge <<: *kimodocpp - name: "cpu-darwin-arm64-kimodocpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-darwin-arm64-kimodocpp" +- name: cpu-darwin-arm64-kimodocpp-development + alias: kimodocpp + license: apache-2.0 + description: | + kimodo.cpp text-to-motion: animated skeleton GLB on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/kimodo.cpp + tags: + - 3d-animation + - text-to-motion + - CPU + - Vulkan + capabilities: + amd: vulkan-kimodocpp + default: cpu-kimodocpp + intel: vulkan-kimodocpp + metal: cpu-darwin-arm64-kimodocpp + nvidia: vulkan-kimodocpp + nvidia-cuda-12: vulkan-kimodocpp + nvidia-cuda-13: vulkan-kimodocpp + vulkan: vulkan-kimodocpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-darwin-arm64-kimodocpp mirrors: - localai/localai-backends:master-cpu-darwin-arm64-kimodocpp - -## gem-x.cpp -- !!merge <<: *gemxcpp - name: "gemxcpp-development" +- name: gemxcpp-development + alias: gemxcpp + license: apache-2.0 + description: | + gem-x.cpp live human motion: SOMA and SMPL pose streams on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/gem-x.cpp + tags: + - motion + - pose-estimation + - CPU + - Vulkan capabilities: - default: "cpu-gemxcpp-development" - vulkan: "vulkan-gemxcpp-development" - nvidia: "vulkan-gemxcpp-development" - nvidia-cuda-12: "vulkan-gemxcpp-development" - nvidia-cuda-13: "vulkan-gemxcpp-development" - amd: "vulkan-gemxcpp-development" - intel: "vulkan-gemxcpp-development" - metal: "cpu-darwin-arm64-gemxcpp-development" -- !!merge <<: *gemxcpp - name: "cpu-gemxcpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-gemxcpp" + amd: vulkan-gemxcpp-development + default: cpu-gemxcpp-development + intel: vulkan-gemxcpp-development + metal: cpu-darwin-arm64-gemxcpp-development + nvidia: vulkan-gemxcpp-development + nvidia-cuda-12: vulkan-gemxcpp-development + nvidia-cuda-13: vulkan-gemxcpp-development + vulkan: vulkan-gemxcpp-development +- name: cpu-gemxcpp + alias: gemxcpp + license: apache-2.0 + description: | + gem-x.cpp live human motion: SOMA and SMPL pose streams on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/gem-x.cpp + tags: + - motion + - pose-estimation + - CPU + - Vulkan + capabilities: + amd: vulkan-gemxcpp + default: cpu-gemxcpp + intel: vulkan-gemxcpp + metal: cpu-darwin-arm64-gemxcpp + nvidia: vulkan-gemxcpp + nvidia-cuda-12: vulkan-gemxcpp + nvidia-cuda-13: vulkan-gemxcpp + vulkan: vulkan-gemxcpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-gemxcpp mirrors: - localai/localai-backends:latest-cpu-gemxcpp -- !!merge <<: *gemxcpp - name: "cpu-gemxcpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-gemxcpp" +- name: cpu-gemxcpp-development + alias: gemxcpp + license: apache-2.0 + description: | + gem-x.cpp live human motion: SOMA and SMPL pose streams on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/gem-x.cpp + tags: + - motion + - pose-estimation + - CPU + - Vulkan + capabilities: + amd: vulkan-gemxcpp + default: cpu-gemxcpp + intel: vulkan-gemxcpp + metal: cpu-darwin-arm64-gemxcpp + nvidia: vulkan-gemxcpp + nvidia-cuda-12: vulkan-gemxcpp + nvidia-cuda-13: vulkan-gemxcpp + vulkan: vulkan-gemxcpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-gemxcpp mirrors: - localai/localai-backends:master-cpu-gemxcpp -- !!merge <<: *gemxcpp - name: "vulkan-gemxcpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-gemxcpp" +- name: vulkan-gemxcpp + alias: gemxcpp + license: apache-2.0 + description: | + gem-x.cpp live human motion: SOMA and SMPL pose streams on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/gem-x.cpp + tags: + - motion + - pose-estimation + - CPU + - Vulkan + capabilities: + amd: vulkan-gemxcpp + default: cpu-gemxcpp + intel: vulkan-gemxcpp + metal: cpu-darwin-arm64-gemxcpp + nvidia: vulkan-gemxcpp + nvidia-cuda-12: vulkan-gemxcpp + nvidia-cuda-13: vulkan-gemxcpp + vulkan: vulkan-gemxcpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-gemxcpp mirrors: - localai/localai-backends:latest-gpu-vulkan-gemxcpp -- !!merge <<: *gemxcpp - name: "vulkan-gemxcpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-gemxcpp" +- name: vulkan-gemxcpp-development + alias: gemxcpp + license: apache-2.0 + description: | + gem-x.cpp live human motion: SOMA and SMPL pose streams on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/gem-x.cpp + tags: + - motion + - pose-estimation + - CPU + - Vulkan + capabilities: + amd: vulkan-gemxcpp + default: cpu-gemxcpp + intel: vulkan-gemxcpp + metal: cpu-darwin-arm64-gemxcpp + nvidia: vulkan-gemxcpp + nvidia-cuda-12: vulkan-gemxcpp + nvidia-cuda-13: vulkan-gemxcpp + vulkan: vulkan-gemxcpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-gemxcpp mirrors: - localai/localai-backends:master-gpu-vulkan-gemxcpp -- !!merge <<: *gemxcpp - name: "cpu-darwin-arm64-gemxcpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-darwin-arm64-gemxcpp" +- name: cpu-darwin-arm64-gemxcpp + alias: gemxcpp + license: apache-2.0 + description: | + gem-x.cpp live human motion: SOMA and SMPL pose streams on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/gem-x.cpp + tags: + - motion + - pose-estimation + - CPU + - Vulkan + capabilities: + amd: vulkan-gemxcpp + default: cpu-gemxcpp + intel: vulkan-gemxcpp + metal: cpu-darwin-arm64-gemxcpp + nvidia: vulkan-gemxcpp + nvidia-cuda-12: vulkan-gemxcpp + nvidia-cuda-13: vulkan-gemxcpp + vulkan: vulkan-gemxcpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-darwin-arm64-gemxcpp mirrors: - localai/localai-backends:latest-cpu-darwin-arm64-gemxcpp -- !!merge <<: *gemxcpp - name: "cpu-darwin-arm64-gemxcpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-darwin-arm64-gemxcpp" +- name: cpu-darwin-arm64-gemxcpp-development + alias: gemxcpp + license: apache-2.0 + description: | + gem-x.cpp live human motion: SOMA and SMPL pose streams on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/gem-x.cpp + tags: + - motion + - pose-estimation + - CPU + - Vulkan + capabilities: + amd: vulkan-gemxcpp + default: cpu-gemxcpp + intel: vulkan-gemxcpp + metal: cpu-darwin-arm64-gemxcpp + nvidia: vulkan-gemxcpp + nvidia-cuda-12: vulkan-gemxcpp + nvidia-cuda-13: vulkan-gemxcpp + vulkan: vulkan-gemxcpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-darwin-arm64-gemxcpp mirrors: - localai/localai-backends:master-cpu-darwin-arm64-gemxcpp - -## trellis2cpp -- !!merge <<: *trellis2cpp - name: "cpu-trellis2cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-trellis2cpp" +- name: cpu-trellis2cpp + alias: trellis2cpp + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-trellis2cpp + metal: metal-trellis2cpp + nvidia: cuda12-trellis2cpp + nvidia-cuda-12: cuda12-trellis2cpp + nvidia-cuda-13: cuda13-trellis2cpp + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp + vulkan: vulkan-trellis2cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-trellis2cpp mirrors: - localai/localai-backends:latest-cpu-trellis2cpp -- !!merge <<: *trellis2cpp - name: "cpu-trellis2cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-trellis2cpp" +- name: cpu-trellis2cpp-development + alias: trellis2cpp + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-trellis2cpp + metal: metal-trellis2cpp + nvidia: cuda12-trellis2cpp + nvidia-cuda-12: cuda12-trellis2cpp + nvidia-cuda-13: cuda13-trellis2cpp + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp + vulkan: vulkan-trellis2cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-trellis2cpp mirrors: - localai/localai-backends:master-cpu-trellis2cpp -- !!merge <<: *trellis2cpp - name: "metal-trellis2cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-trellis2cpp" +- name: metal-trellis2cpp + alias: trellis2cpp + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-trellis2cpp + metal: metal-trellis2cpp + nvidia: cuda12-trellis2cpp + nvidia-cuda-12: cuda12-trellis2cpp + nvidia-cuda-13: cuda13-trellis2cpp + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp + vulkan: vulkan-trellis2cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-trellis2cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-trellis2cpp -- !!merge <<: *trellis2cpp - name: "metal-trellis2cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-trellis2cpp" +- name: metal-trellis2cpp-development + alias: trellis2cpp + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-trellis2cpp + metal: metal-trellis2cpp + nvidia: cuda12-trellis2cpp + nvidia-cuda-12: cuda12-trellis2cpp + nvidia-cuda-13: cuda13-trellis2cpp + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp + vulkan: vulkan-trellis2cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-trellis2cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-trellis2cpp -- !!merge <<: *trellis2cpp - name: "vulkan-trellis2cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-trellis2cpp" +- name: vulkan-trellis2cpp + alias: trellis2cpp + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-trellis2cpp + metal: metal-trellis2cpp + nvidia: cuda12-trellis2cpp + nvidia-cuda-12: cuda12-trellis2cpp + nvidia-cuda-13: cuda13-trellis2cpp + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp + vulkan: vulkan-trellis2cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-trellis2cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-trellis2cpp -- !!merge <<: *trellis2cpp - name: "vulkan-trellis2cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-trellis2cpp" +- name: vulkan-trellis2cpp-development + alias: trellis2cpp + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-trellis2cpp + metal: metal-trellis2cpp + nvidia: cuda12-trellis2cpp + nvidia-cuda-12: cuda12-trellis2cpp + nvidia-cuda-13: cuda13-trellis2cpp + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp + vulkan: vulkan-trellis2cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-trellis2cpp mirrors: - localai/localai-backends:master-gpu-vulkan-trellis2cpp -- !!merge <<: *trellis2cpp - name: "cuda12-trellis2cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-trellis2cpp" +- name: cuda12-trellis2cpp + alias: trellis2cpp + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-trellis2cpp + metal: metal-trellis2cpp + nvidia: cuda12-trellis2cpp + nvidia-cuda-12: cuda12-trellis2cpp + nvidia-cuda-13: cuda13-trellis2cpp + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp + vulkan: vulkan-trellis2cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-trellis2cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-trellis2cpp -- !!merge <<: *trellis2cpp - name: "cuda12-trellis2cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-trellis2cpp" +- name: cuda12-trellis2cpp-development + alias: trellis2cpp + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-trellis2cpp + metal: metal-trellis2cpp + nvidia: cuda12-trellis2cpp + nvidia-cuda-12: cuda12-trellis2cpp + nvidia-cuda-13: cuda13-trellis2cpp + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp + vulkan: vulkan-trellis2cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-trellis2cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-trellis2cpp -- !!merge <<: *trellis2cpp - name: "cuda13-trellis2cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-trellis2cpp" +- name: cuda13-trellis2cpp + alias: trellis2cpp + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-trellis2cpp + metal: metal-trellis2cpp + nvidia: cuda12-trellis2cpp + nvidia-cuda-12: cuda12-trellis2cpp + nvidia-cuda-13: cuda13-trellis2cpp + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp + vulkan: vulkan-trellis2cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-trellis2cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-trellis2cpp -- !!merge <<: *trellis2cpp - name: "cuda13-trellis2cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-trellis2cpp" +- name: cuda13-trellis2cpp-development + alias: trellis2cpp + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-trellis2cpp + metal: metal-trellis2cpp + nvidia: cuda12-trellis2cpp + nvidia-cuda-12: cuda12-trellis2cpp + nvidia-cuda-13: cuda13-trellis2cpp + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp + vulkan: vulkan-trellis2cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-trellis2cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-trellis2cpp -- !!merge <<: *trellis2cpp - name: "nvidia-l4t-arm64-trellis2cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-trellis2cpp" +- name: nvidia-l4t-arm64-trellis2cpp + alias: trellis2cpp + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-trellis2cpp + metal: metal-trellis2cpp + nvidia: cuda12-trellis2cpp + nvidia-cuda-12: cuda12-trellis2cpp + nvidia-cuda-13: cuda13-trellis2cpp + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp + vulkan: vulkan-trellis2cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-trellis2cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-trellis2cpp -- !!merge <<: *trellis2cpp - name: "nvidia-l4t-arm64-trellis2cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-trellis2cpp" +- name: nvidia-l4t-arm64-trellis2cpp-development + alias: trellis2cpp + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-trellis2cpp + metal: metal-trellis2cpp + nvidia: cuda12-trellis2cpp + nvidia-cuda-12: cuda12-trellis2cpp + nvidia-cuda-13: cuda13-trellis2cpp + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp + vulkan: vulkan-trellis2cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-trellis2cpp mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-trellis2cpp -- !!merge <<: *trellis2cpp - name: "cuda13-nvidia-l4t-arm64-trellis2cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-trellis2cpp" +- name: cuda13-nvidia-l4t-arm64-trellis2cpp + alias: trellis2cpp + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-trellis2cpp + metal: metal-trellis2cpp + nvidia: cuda12-trellis2cpp + nvidia-cuda-12: cuda12-trellis2cpp + nvidia-cuda-13: cuda13-trellis2cpp + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp + vulkan: vulkan-trellis2cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-trellis2cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-trellis2cpp -- !!merge <<: *trellis2cpp - name: "cuda13-nvidia-l4t-arm64-trellis2cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-trellis2cpp" +- name: cuda13-nvidia-l4t-arm64-trellis2cpp-development + alias: trellis2cpp + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: cpu-trellis2cpp + metal: metal-trellis2cpp + nvidia: cuda12-trellis2cpp + nvidia-cuda-12: cuda12-trellis2cpp + nvidia-cuda-13: cuda13-trellis2cpp + nvidia-l4t: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-trellis2cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-trellis2cpp + vulkan: vulkan-trellis2cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-trellis2cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-trellis2cpp -## privacy-filter -- !!merge <<: *privacyfilter - name: "cpu-privacy-filter" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-privacy-filter" +- name: cpu-privacy-filter + alias: privacy-filter + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/5fd5e18a90b6dc4633f6d292/QPiv8pt4JNxr0FdGnpFef.png + description: | + Standalone GGML engine (privacy-filter.cpp) for the OpenMed privacy-filter + PII/NER token-classification model family. It runs the openai-privacy-filter + architecture (a gpt-oss-style sparse-MoE bidirectional token classifier) on + stock upstream GGML — no llama.cpp coupling and no Python — and serves the + TokenClassify RPC (constrained BIOES Viterbi decode into UTF-8 byte-offset + entity spans) used by LocalAI's NER PII redaction tier. + urls: + - https://github.com/localai-org/privacy-filter.cpp + tags: + - token-classification + - ner + - pii + - privacy + - CPU + - GPU + capabilities: + amd: vulkan-privacy-filter + default: cpu-privacy-filter + intel: vulkan-privacy-filter + metal: metal-privacy-filter + nvidia: vulkan-privacy-filter + nvidia-cuda-12: vulkan-privacy-filter + nvidia-cuda-13: cuda13-privacy-filter + vulkan: vulkan-privacy-filter + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-privacy-filter mirrors: - localai/localai-backends:latest-cpu-privacy-filter -- !!merge <<: *privacyfilter - name: "cpu-privacy-filter-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-privacy-filter" +- name: cpu-privacy-filter-development + alias: privacy-filter + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/5fd5e18a90b6dc4633f6d292/QPiv8pt4JNxr0FdGnpFef.png + description: | + Standalone GGML engine (privacy-filter.cpp) for the OpenMed privacy-filter + PII/NER token-classification model family. It runs the openai-privacy-filter + architecture (a gpt-oss-style sparse-MoE bidirectional token classifier) on + stock upstream GGML — no llama.cpp coupling and no Python — and serves the + TokenClassify RPC (constrained BIOES Viterbi decode into UTF-8 byte-offset + entity spans) used by LocalAI's NER PII redaction tier. + urls: + - https://github.com/localai-org/privacy-filter.cpp + tags: + - token-classification + - ner + - pii + - privacy + - CPU + - GPU + capabilities: + amd: vulkan-privacy-filter + default: cpu-privacy-filter + intel: vulkan-privacy-filter + metal: metal-privacy-filter + nvidia: vulkan-privacy-filter + nvidia-cuda-12: vulkan-privacy-filter + nvidia-cuda-13: cuda13-privacy-filter + vulkan: vulkan-privacy-filter + uri: quay.io/go-skynet/local-ai-backends:master-cpu-privacy-filter mirrors: - localai/localai-backends:master-cpu-privacy-filter -- !!merge <<: *privacyfilter - name: "vulkan-privacy-filter" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-privacy-filter" +- name: vulkan-privacy-filter + alias: privacy-filter + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/5fd5e18a90b6dc4633f6d292/QPiv8pt4JNxr0FdGnpFef.png + description: | + Standalone GGML engine (privacy-filter.cpp) for the OpenMed privacy-filter + PII/NER token-classification model family. It runs the openai-privacy-filter + architecture (a gpt-oss-style sparse-MoE bidirectional token classifier) on + stock upstream GGML — no llama.cpp coupling and no Python — and serves the + TokenClassify RPC (constrained BIOES Viterbi decode into UTF-8 byte-offset + entity spans) used by LocalAI's NER PII redaction tier. + urls: + - https://github.com/localai-org/privacy-filter.cpp + tags: + - token-classification + - ner + - pii + - privacy + - CPU + - GPU + capabilities: + amd: vulkan-privacy-filter + default: cpu-privacy-filter + intel: vulkan-privacy-filter + metal: metal-privacy-filter + nvidia: vulkan-privacy-filter + nvidia-cuda-12: vulkan-privacy-filter + nvidia-cuda-13: cuda13-privacy-filter + vulkan: vulkan-privacy-filter + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-privacy-filter mirrors: - localai/localai-backends:latest-gpu-vulkan-privacy-filter -- !!merge <<: *privacyfilter - name: "vulkan-privacy-filter-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-privacy-filter" +- name: vulkan-privacy-filter-development + alias: privacy-filter + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/5fd5e18a90b6dc4633f6d292/QPiv8pt4JNxr0FdGnpFef.png + description: | + Standalone GGML engine (privacy-filter.cpp) for the OpenMed privacy-filter + PII/NER token-classification model family. It runs the openai-privacy-filter + architecture (a gpt-oss-style sparse-MoE bidirectional token classifier) on + stock upstream GGML — no llama.cpp coupling and no Python — and serves the + TokenClassify RPC (constrained BIOES Viterbi decode into UTF-8 byte-offset + entity spans) used by LocalAI's NER PII redaction tier. + urls: + - https://github.com/localai-org/privacy-filter.cpp + tags: + - token-classification + - ner + - pii + - privacy + - CPU + - GPU + capabilities: + amd: vulkan-privacy-filter + default: cpu-privacy-filter + intel: vulkan-privacy-filter + metal: metal-privacy-filter + nvidia: vulkan-privacy-filter + nvidia-cuda-12: vulkan-privacy-filter + nvidia-cuda-13: cuda13-privacy-filter + vulkan: vulkan-privacy-filter + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-privacy-filter mirrors: - localai/localai-backends:master-gpu-vulkan-privacy-filter -- !!merge <<: *privacyfilter - name: "metal-privacy-filter" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-privacy-filter" +- name: metal-privacy-filter + alias: privacy-filter + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/5fd5e18a90b6dc4633f6d292/QPiv8pt4JNxr0FdGnpFef.png + description: | + Standalone GGML engine (privacy-filter.cpp) for the OpenMed privacy-filter + PII/NER token-classification model family. It runs the openai-privacy-filter + architecture (a gpt-oss-style sparse-MoE bidirectional token classifier) on + stock upstream GGML — no llama.cpp coupling and no Python — and serves the + TokenClassify RPC (constrained BIOES Viterbi decode into UTF-8 byte-offset + entity spans) used by LocalAI's NER PII redaction tier. + urls: + - https://github.com/localai-org/privacy-filter.cpp + tags: + - token-classification + - ner + - pii + - privacy + - CPU + - GPU + capabilities: + amd: vulkan-privacy-filter + default: cpu-privacy-filter + intel: vulkan-privacy-filter + metal: metal-privacy-filter + nvidia: vulkan-privacy-filter + nvidia-cuda-12: vulkan-privacy-filter + nvidia-cuda-13: cuda13-privacy-filter + vulkan: vulkan-privacy-filter + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-privacy-filter mirrors: - localai/localai-backends:latest-metal-darwin-arm64-privacy-filter -- !!merge <<: *privacyfilter - name: "metal-privacy-filter-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-privacy-filter" +- name: metal-privacy-filter-development + alias: privacy-filter + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/5fd5e18a90b6dc4633f6d292/QPiv8pt4JNxr0FdGnpFef.png + description: | + Standalone GGML engine (privacy-filter.cpp) for the OpenMed privacy-filter + PII/NER token-classification model family. It runs the openai-privacy-filter + architecture (a gpt-oss-style sparse-MoE bidirectional token classifier) on + stock upstream GGML — no llama.cpp coupling and no Python — and serves the + TokenClassify RPC (constrained BIOES Viterbi decode into UTF-8 byte-offset + entity spans) used by LocalAI's NER PII redaction tier. + urls: + - https://github.com/localai-org/privacy-filter.cpp + tags: + - token-classification + - ner + - pii + - privacy + - CPU + - GPU + capabilities: + amd: vulkan-privacy-filter + default: cpu-privacy-filter + intel: vulkan-privacy-filter + metal: metal-privacy-filter + nvidia: vulkan-privacy-filter + nvidia-cuda-12: vulkan-privacy-filter + nvidia-cuda-13: cuda13-privacy-filter + vulkan: vulkan-privacy-filter + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-privacy-filter mirrors: - localai/localai-backends:master-metal-darwin-arm64-privacy-filter -- !!merge <<: *privacyfilter - name: "cuda13-privacy-filter" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-privacy-filter" +- name: cuda13-privacy-filter + alias: privacy-filter + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/5fd5e18a90b6dc4633f6d292/QPiv8pt4JNxr0FdGnpFef.png + description: | + Standalone GGML engine (privacy-filter.cpp) for the OpenMed privacy-filter + PII/NER token-classification model family. It runs the openai-privacy-filter + architecture (a gpt-oss-style sparse-MoE bidirectional token classifier) on + stock upstream GGML — no llama.cpp coupling and no Python — and serves the + TokenClassify RPC (constrained BIOES Viterbi decode into UTF-8 byte-offset + entity spans) used by LocalAI's NER PII redaction tier. + urls: + - https://github.com/localai-org/privacy-filter.cpp + tags: + - token-classification + - ner + - pii + - privacy + - CPU + - GPU + capabilities: + amd: vulkan-privacy-filter + default: cpu-privacy-filter + intel: vulkan-privacy-filter + metal: metal-privacy-filter + nvidia: vulkan-privacy-filter + nvidia-cuda-12: vulkan-privacy-filter + nvidia-cuda-13: cuda13-privacy-filter + vulkan: vulkan-privacy-filter + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-privacy-filter mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-privacy-filter -- !!merge <<: *privacyfilter - name: "cuda13-privacy-filter-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-privacy-filter" +- name: cuda13-privacy-filter-development + alias: privacy-filter + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/5fd5e18a90b6dc4633f6d292/QPiv8pt4JNxr0FdGnpFef.png + description: | + Standalone GGML engine (privacy-filter.cpp) for the OpenMed privacy-filter + PII/NER token-classification model family. It runs the openai-privacy-filter + architecture (a gpt-oss-style sparse-MoE bidirectional token classifier) on + stock upstream GGML — no llama.cpp coupling and no Python — and serves the + TokenClassify RPC (constrained BIOES Viterbi decode into UTF-8 byte-offset + entity spans) used by LocalAI's NER PII redaction tier. + urls: + - https://github.com/localai-org/privacy-filter.cpp + tags: + - token-classification + - ner + - pii + - privacy + - CPU + - GPU + capabilities: + amd: vulkan-privacy-filter + default: cpu-privacy-filter + intel: vulkan-privacy-filter + metal: metal-privacy-filter + nvidia: vulkan-privacy-filter + nvidia-cuda-12: vulkan-privacy-filter + nvidia-cuda-13: cuda13-privacy-filter + vulkan: vulkan-privacy-filter + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-privacy-filter mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-privacy-filter -# vllm -- !!merge <<: *vllm - name: "vllm-development" +- name: vllm-development + alias: vllm + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 capabilities: - nvidia: "cuda12-vllm-development" - amd: "rocm-vllm-development" - intel: "intel-vllm-development" - nvidia-cuda-12: "cuda12-vllm-development" - nvidia-cuda-13: "cuda13-vllm-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-vllm-development" - cpu: "cpu-vllm-development" - metal: "metal-vllm-development" -- !!merge <<: *vllm - name: "metal-vllm" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-vllm" + amd: rocm-vllm-development + cpu: cpu-vllm-development + intel: intel-vllm-development + metal: metal-vllm-development + nvidia: cuda12-vllm-development + nvidia-cuda-12: cuda12-vllm-development + nvidia-cuda-13: cuda13-vllm-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm-development +- name: metal-vllm + alias: vllm + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + capabilities: + amd: rocm-vllm + cpu: cpu-vllm + intel: intel-vllm + metal: metal-vllm + nvidia: cuda12-vllm + nvidia-cuda-12: cuda12-vllm + nvidia-cuda-13: cuda13-vllm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-vllm mirrors: - localai/localai-backends:latest-metal-darwin-arm64-vllm -- !!merge <<: *vllm - name: "metal-vllm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-vllm" +- name: metal-vllm-development + alias: vllm + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + capabilities: + amd: rocm-vllm + cpu: cpu-vllm + intel: intel-vllm + metal: metal-vllm + nvidia: cuda12-vllm + nvidia-cuda-12: cuda12-vllm + nvidia-cuda-13: cuda13-vllm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-vllm mirrors: - localai/localai-backends:master-metal-darwin-arm64-vllm -- !!merge <<: *vllm - name: "cuda12-vllm" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-vllm" +- name: cuda12-vllm + alias: vllm + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + capabilities: + amd: rocm-vllm + cpu: cpu-vllm + intel: intel-vllm + metal: metal-vllm + nvidia: cuda12-vllm + nvidia-cuda-12: cuda12-vllm + nvidia-cuda-13: cuda13-vllm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-vllm mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-vllm -- !!merge <<: *vllm - name: "cuda13-vllm" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-vllm" +- name: cuda13-vllm + alias: vllm + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + capabilities: + amd: rocm-vllm + cpu: cpu-vllm + intel: intel-vllm + metal: metal-vllm + nvidia: cuda12-vllm + nvidia-cuda-12: cuda12-vllm + nvidia-cuda-13: cuda13-vllm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-vllm mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-vllm -- !!merge <<: *vllm - name: "cuda13-nvidia-l4t-arm64-vllm" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-vllm" +- name: cuda13-nvidia-l4t-arm64-vllm + alias: vllm + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + capabilities: + amd: rocm-vllm + cpu: cpu-vllm + intel: intel-vllm + metal: metal-vllm + nvidia: cuda12-vllm + nvidia-cuda-12: cuda12-vllm + nvidia-cuda-13: cuda13-vllm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-vllm mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-vllm -- !!merge <<: *vllm - name: "rocm-vllm" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-vllm" +- name: rocm-vllm + alias: vllm + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + capabilities: + amd: rocm-vllm + cpu: cpu-vllm + intel: intel-vllm + metal: metal-vllm + nvidia: cuda12-vllm + nvidia-cuda-12: cuda12-vllm + nvidia-cuda-13: cuda13-vllm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-vllm mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-vllm -- !!merge <<: *vllm - name: "intel-vllm" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-vllm" +- name: intel-vllm + alias: vllm + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + capabilities: + amd: rocm-vllm + cpu: cpu-vllm + intel: intel-vllm + metal: metal-vllm + nvidia: cuda12-vllm + nvidia-cuda-12: cuda12-vllm + nvidia-cuda-13: cuda13-vllm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-vllm mirrors: - localai/localai-backends:latest-gpu-intel-vllm -- !!merge <<: *vllm - name: "cpu-vllm" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-vllm" +- name: cpu-vllm + alias: vllm + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + capabilities: + amd: rocm-vllm + cpu: cpu-vllm + intel: intel-vllm + metal: metal-vllm + nvidia: cuda12-vllm + nvidia-cuda-12: cuda12-vllm + nvidia-cuda-13: cuda13-vllm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-vllm mirrors: - localai/localai-backends:latest-cpu-vllm -- !!merge <<: *vllm - name: "cuda12-vllm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-vllm" +- name: cuda12-vllm-development + alias: vllm + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + capabilities: + amd: rocm-vllm + cpu: cpu-vllm + intel: intel-vllm + metal: metal-vllm + nvidia: cuda12-vllm + nvidia-cuda-12: cuda12-vllm + nvidia-cuda-13: cuda13-vllm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-vllm mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-vllm -- !!merge <<: *vllm - name: "cuda13-vllm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-vllm" +- name: cuda13-vllm-development + alias: vllm + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + capabilities: + amd: rocm-vllm + cpu: cpu-vllm + intel: intel-vllm + metal: metal-vllm + nvidia: cuda12-vllm + nvidia-cuda-12: cuda12-vllm + nvidia-cuda-13: cuda13-vllm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-vllm mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-vllm -- !!merge <<: *vllm - name: "cuda13-nvidia-l4t-arm64-vllm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-vllm" +- name: cuda13-nvidia-l4t-arm64-vllm-development + alias: vllm + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + capabilities: + amd: rocm-vllm + cpu: cpu-vllm + intel: intel-vllm + metal: metal-vllm + nvidia: cuda12-vllm + nvidia-cuda-12: cuda12-vllm + nvidia-cuda-13: cuda13-vllm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-vllm mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-vllm -- !!merge <<: *vllm - name: "rocm-vllm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-vllm" +- name: rocm-vllm-development + alias: vllm + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + capabilities: + amd: rocm-vllm + cpu: cpu-vllm + intel: intel-vllm + metal: metal-vllm + nvidia: cuda12-vllm + nvidia-cuda-12: cuda12-vllm + nvidia-cuda-13: cuda13-vllm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-vllm mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-vllm -- !!merge <<: *vllm - name: "intel-vllm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-vllm" +- name: intel-vllm-development + alias: vllm + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + capabilities: + amd: rocm-vllm + cpu: cpu-vllm + intel: intel-vllm + metal: metal-vllm + nvidia: cuda12-vllm + nvidia-cuda-12: cuda12-vllm + nvidia-cuda-13: cuda13-vllm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-vllm mirrors: - localai/localai-backends:master-gpu-intel-vllm -- !!merge <<: *vllm - name: "cpu-vllm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-vllm" +- name: cpu-vllm-development + alias: vllm + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + capabilities: + amd: rocm-vllm + cpu: cpu-vllm + intel: intel-vllm + metal: metal-vllm + nvidia: cuda12-vllm + nvidia-cuda-12: cuda12-vllm + nvidia-cuda-13: cuda13-vllm + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm + uri: quay.io/go-skynet/local-ai-backends:master-cpu-vllm mirrors: - localai/localai-backends:master-cpu-vllm -# sglang -- !!merge <<: *sglang - name: "sglang-development" +- name: sglang-development + alias: sglang + license: apache-2.0 + icon: https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png + description: | + SGLang is a fast serving framework for large language models and vision language models. + It co-designs the backend runtime (RadixAttention, continuous batching, structured + decoding) and the frontend language to make interaction with models faster and more + controllable. Features include fast backend runtime, flexible frontend language, + extensive model support, and an active community. + urls: + - https://github.com/sgl-project/sglang + tags: + - text-to-text + - multimodal capabilities: - nvidia: "cuda12-sglang-development" - amd: "rocm-sglang-development" - intel: "intel-sglang-development" - nvidia-cuda-12: "cuda12-sglang-development" - nvidia-cuda-13: "cuda13-sglang-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-sglang-development" - cpu: "cpu-sglang-development" -- !!merge <<: *sglang - name: "cuda12-sglang" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-sglang" + amd: rocm-sglang-development + cpu: cpu-sglang-development + intel: intel-sglang-development + nvidia: cuda12-sglang-development + nvidia-cuda-12: cuda12-sglang-development + nvidia-cuda-13: cuda13-sglang-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sglang-development +- name: cuda12-sglang + alias: sglang + license: apache-2.0 + icon: https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png + description: | + SGLang is a fast serving framework for large language models and vision language models. + It co-designs the backend runtime (RadixAttention, continuous batching, structured + decoding) and the frontend language to make interaction with models faster and more + controllable. Features include fast backend runtime, flexible frontend language, + extensive model support, and an active community. + urls: + - https://github.com/sgl-project/sglang + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-sglang + cpu: cpu-sglang + intel: intel-sglang + nvidia: cuda12-sglang + nvidia-cuda-12: cuda12-sglang + nvidia-cuda-13: cuda13-sglang + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sglang + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-sglang mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-sglang -- !!merge <<: *sglang - name: "cuda13-sglang" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-sglang" +- name: cuda13-sglang + alias: sglang + license: apache-2.0 + icon: https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png + description: | + SGLang is a fast serving framework for large language models and vision language models. + It co-designs the backend runtime (RadixAttention, continuous batching, structured + decoding) and the frontend language to make interaction with models faster and more + controllable. Features include fast backend runtime, flexible frontend language, + extensive model support, and an active community. + urls: + - https://github.com/sgl-project/sglang + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-sglang + cpu: cpu-sglang + intel: intel-sglang + nvidia: cuda12-sglang + nvidia-cuda-12: cuda12-sglang + nvidia-cuda-13: cuda13-sglang + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sglang + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-sglang mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-sglang -- !!merge <<: *sglang - name: "cuda13-nvidia-l4t-arm64-sglang" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-sglang" +- name: cuda13-nvidia-l4t-arm64-sglang + alias: sglang + license: apache-2.0 + icon: https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png + description: | + SGLang is a fast serving framework for large language models and vision language models. + It co-designs the backend runtime (RadixAttention, continuous batching, structured + decoding) and the frontend language to make interaction with models faster and more + controllable. Features include fast backend runtime, flexible frontend language, + extensive model support, and an active community. + urls: + - https://github.com/sgl-project/sglang + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-sglang + cpu: cpu-sglang + intel: intel-sglang + nvidia: cuda12-sglang + nvidia-cuda-12: cuda12-sglang + nvidia-cuda-13: cuda13-sglang + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sglang + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-sglang mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-sglang -- !!merge <<: *sglang - name: "rocm-sglang" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-sglang" +- name: rocm-sglang + alias: sglang + license: apache-2.0 + icon: https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png + description: | + SGLang is a fast serving framework for large language models and vision language models. + It co-designs the backend runtime (RadixAttention, continuous batching, structured + decoding) and the frontend language to make interaction with models faster and more + controllable. Features include fast backend runtime, flexible frontend language, + extensive model support, and an active community. + urls: + - https://github.com/sgl-project/sglang + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-sglang + cpu: cpu-sglang + intel: intel-sglang + nvidia: cuda12-sglang + nvidia-cuda-12: cuda12-sglang + nvidia-cuda-13: cuda13-sglang + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sglang + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-sglang mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-sglang -- !!merge <<: *sglang - name: "intel-sglang" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sglang" +- name: intel-sglang + alias: sglang + license: apache-2.0 + icon: https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png + description: | + SGLang is a fast serving framework for large language models and vision language models. + It co-designs the backend runtime (RadixAttention, continuous batching, structured + decoding) and the frontend language to make interaction with models faster and more + controllable. Features include fast backend runtime, flexible frontend language, + extensive model support, and an active community. + urls: + - https://github.com/sgl-project/sglang + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-sglang + cpu: cpu-sglang + intel: intel-sglang + nvidia: cuda12-sglang + nvidia-cuda-12: cuda12-sglang + nvidia-cuda-13: cuda13-sglang + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sglang + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sglang mirrors: - localai/localai-backends:latest-gpu-intel-sglang -- !!merge <<: *sglang - name: "cpu-sglang" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-sglang" +- name: cpu-sglang + alias: sglang + license: apache-2.0 + icon: https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png + description: | + SGLang is a fast serving framework for large language models and vision language models. + It co-designs the backend runtime (RadixAttention, continuous batching, structured + decoding) and the frontend language to make interaction with models faster and more + controllable. Features include fast backend runtime, flexible frontend language, + extensive model support, and an active community. + urls: + - https://github.com/sgl-project/sglang + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-sglang + cpu: cpu-sglang + intel: intel-sglang + nvidia: cuda12-sglang + nvidia-cuda-12: cuda12-sglang + nvidia-cuda-13: cuda13-sglang + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sglang + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-sglang mirrors: - localai/localai-backends:latest-cpu-sglang -- !!merge <<: *sglang - name: "cuda12-sglang-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-sglang" +- name: cuda12-sglang-development + alias: sglang + license: apache-2.0 + icon: https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png + description: | + SGLang is a fast serving framework for large language models and vision language models. + It co-designs the backend runtime (RadixAttention, continuous batching, structured + decoding) and the frontend language to make interaction with models faster and more + controllable. Features include fast backend runtime, flexible frontend language, + extensive model support, and an active community. + urls: + - https://github.com/sgl-project/sglang + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-sglang + cpu: cpu-sglang + intel: intel-sglang + nvidia: cuda12-sglang + nvidia-cuda-12: cuda12-sglang + nvidia-cuda-13: cuda13-sglang + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sglang + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-sglang mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-sglang -- !!merge <<: *sglang - name: "cuda13-sglang-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-sglang" +- name: cuda13-sglang-development + alias: sglang + license: apache-2.0 + icon: https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png + description: | + SGLang is a fast serving framework for large language models and vision language models. + It co-designs the backend runtime (RadixAttention, continuous batching, structured + decoding) and the frontend language to make interaction with models faster and more + controllable. Features include fast backend runtime, flexible frontend language, + extensive model support, and an active community. + urls: + - https://github.com/sgl-project/sglang + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-sglang + cpu: cpu-sglang + intel: intel-sglang + nvidia: cuda12-sglang + nvidia-cuda-12: cuda12-sglang + nvidia-cuda-13: cuda13-sglang + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sglang + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-sglang mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-sglang -- !!merge <<: *sglang - name: "cuda13-nvidia-l4t-arm64-sglang-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-sglang" +- name: cuda13-nvidia-l4t-arm64-sglang-development + alias: sglang + license: apache-2.0 + icon: https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png + description: | + SGLang is a fast serving framework for large language models and vision language models. + It co-designs the backend runtime (RadixAttention, continuous batching, structured + decoding) and the frontend language to make interaction with models faster and more + controllable. Features include fast backend runtime, flexible frontend language, + extensive model support, and an active community. + urls: + - https://github.com/sgl-project/sglang + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-sglang + cpu: cpu-sglang + intel: intel-sglang + nvidia: cuda12-sglang + nvidia-cuda-12: cuda12-sglang + nvidia-cuda-13: cuda13-sglang + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sglang + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-sglang mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-sglang -- !!merge <<: *sglang - name: "rocm-sglang-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-sglang" +- name: rocm-sglang-development + alias: sglang + license: apache-2.0 + icon: https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png + description: | + SGLang is a fast serving framework for large language models and vision language models. + It co-designs the backend runtime (RadixAttention, continuous batching, structured + decoding) and the frontend language to make interaction with models faster and more + controllable. Features include fast backend runtime, flexible frontend language, + extensive model support, and an active community. + urls: + - https://github.com/sgl-project/sglang + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-sglang + cpu: cpu-sglang + intel: intel-sglang + nvidia: cuda12-sglang + nvidia-cuda-12: cuda12-sglang + nvidia-cuda-13: cuda13-sglang + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sglang + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-sglang mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-sglang -- !!merge <<: *sglang - name: "intel-sglang-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sglang" +- name: intel-sglang-development + alias: sglang + license: apache-2.0 + icon: https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png + description: | + SGLang is a fast serving framework for large language models and vision language models. + It co-designs the backend runtime (RadixAttention, continuous batching, structured + decoding) and the frontend language to make interaction with models faster and more + controllable. Features include fast backend runtime, flexible frontend language, + extensive model support, and an active community. + urls: + - https://github.com/sgl-project/sglang + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-sglang + cpu: cpu-sglang + intel: intel-sglang + nvidia: cuda12-sglang + nvidia-cuda-12: cuda12-sglang + nvidia-cuda-13: cuda13-sglang + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sglang + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sglang mirrors: - localai/localai-backends:master-gpu-intel-sglang -- !!merge <<: *sglang - name: "cpu-sglang-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-sglang" +- name: cpu-sglang-development + alias: sglang + license: apache-2.0 + icon: https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png + description: | + SGLang is a fast serving framework for large language models and vision language models. + It co-designs the backend runtime (RadixAttention, continuous batching, structured + decoding) and the frontend language to make interaction with models faster and more + controllable. Features include fast backend runtime, flexible frontend language, + extensive model support, and an active community. + urls: + - https://github.com/sgl-project/sglang + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-sglang + cpu: cpu-sglang + intel: intel-sglang + nvidia: cuda12-sglang + nvidia-cuda-12: cuda12-sglang + nvidia-cuda-13: cuda13-sglang + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sglang + uri: quay.io/go-skynet/local-ai-backends:master-cpu-sglang mirrors: - localai/localai-backends:master-cpu-sglang -# vllm-omni -- !!merge <<: *vllm-omni - name: "vllm-omni-development" +- name: vllm-omni-development + alias: vllm-omni + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM-Omni is a unified interface for multimodal generation with vLLM. + It supports image generation (text-to-image, image editing), video generation + (text-to-video, image-to-video), text generation with multimodal inputs, and + text-to-speech generation. Only supports NVIDIA (CUDA) and ROCm platforms. + urls: + - https://github.com/vllm-project/vllm-omni + tags: + - text-to-image + - image-generation + - text-to-video + - video-generation + - text-to-speech + - TTS + - multimodal + - LLM capabilities: - nvidia: "cuda12-vllm-omni-development" - amd: "rocm-vllm-omni-development" - nvidia-cuda-12: "cuda12-vllm-omni-development" - nvidia-cuda-13: "cuda13-vllm-omni-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-vllm-omni-development" -- !!merge <<: *vllm-omni - name: "cuda12-vllm-omni" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-vllm-omni" + amd: rocm-vllm-omni-development + nvidia: cuda12-vllm-omni-development + nvidia-cuda-12: cuda12-vllm-omni-development + nvidia-cuda-13: cuda13-vllm-omni-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm-omni-development +- name: cuda12-vllm-omni + alias: vllm-omni + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM-Omni is a unified interface for multimodal generation with vLLM. + It supports image generation (text-to-image, image editing), video generation + (text-to-video, image-to-video), text generation with multimodal inputs, and + text-to-speech generation. Only supports NVIDIA (CUDA) and ROCm platforms. + urls: + - https://github.com/vllm-project/vllm-omni + tags: + - text-to-image + - image-generation + - text-to-video + - video-generation + - text-to-speech + - TTS + - multimodal + - LLM + capabilities: + amd: rocm-vllm-omni + nvidia: cuda12-vllm-omni + nvidia-cuda-12: cuda12-vllm-omni + nvidia-cuda-13: cuda13-vllm-omni + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm-omni + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-vllm-omni mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-vllm-omni -- !!merge <<: *vllm-omni - name: "cuda13-vllm-omni" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-vllm-omni" +- name: cuda13-vllm-omni + alias: vllm-omni + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM-Omni is a unified interface for multimodal generation with vLLM. + It supports image generation (text-to-image, image editing), video generation + (text-to-video, image-to-video), text generation with multimodal inputs, and + text-to-speech generation. Only supports NVIDIA (CUDA) and ROCm platforms. + urls: + - https://github.com/vllm-project/vllm-omni + tags: + - text-to-image + - image-generation + - text-to-video + - video-generation + - text-to-speech + - TTS + - multimodal + - LLM + capabilities: + amd: rocm-vllm-omni + nvidia: cuda12-vllm-omni + nvidia-cuda-12: cuda12-vllm-omni + nvidia-cuda-13: cuda13-vllm-omni + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm-omni + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-vllm-omni mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-vllm-omni -- !!merge <<: *vllm-omni - name: "cuda13-nvidia-l4t-arm64-vllm-omni" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-vllm-omni" +- name: cuda13-nvidia-l4t-arm64-vllm-omni + alias: vllm-omni + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM-Omni is a unified interface for multimodal generation with vLLM. + It supports image generation (text-to-image, image editing), video generation + (text-to-video, image-to-video), text generation with multimodal inputs, and + text-to-speech generation. Only supports NVIDIA (CUDA) and ROCm platforms. + urls: + - https://github.com/vllm-project/vllm-omni + tags: + - text-to-image + - image-generation + - text-to-video + - video-generation + - text-to-speech + - TTS + - multimodal + - LLM + capabilities: + amd: rocm-vllm-omni + nvidia: cuda12-vllm-omni + nvidia-cuda-12: cuda12-vllm-omni + nvidia-cuda-13: cuda13-vllm-omni + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm-omni + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-vllm-omni mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-vllm-omni -- !!merge <<: *vllm-omni - name: "rocm-vllm-omni" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-vllm-omni" +- name: rocm-vllm-omni + alias: vllm-omni + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM-Omni is a unified interface for multimodal generation with vLLM. + It supports image generation (text-to-image, image editing), video generation + (text-to-video, image-to-video), text generation with multimodal inputs, and + text-to-speech generation. Only supports NVIDIA (CUDA) and ROCm platforms. + urls: + - https://github.com/vllm-project/vllm-omni + tags: + - text-to-image + - image-generation + - text-to-video + - video-generation + - text-to-speech + - TTS + - multimodal + - LLM + capabilities: + amd: rocm-vllm-omni + nvidia: cuda12-vllm-omni + nvidia-cuda-12: cuda12-vllm-omni + nvidia-cuda-13: cuda13-vllm-omni + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm-omni + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-vllm-omni mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-vllm-omni -- !!merge <<: *vllm-omni - name: "cuda12-vllm-omni-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-vllm-omni" +- name: cuda12-vllm-omni-development + alias: vllm-omni + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM-Omni is a unified interface for multimodal generation with vLLM. + It supports image generation (text-to-image, image editing), video generation + (text-to-video, image-to-video), text generation with multimodal inputs, and + text-to-speech generation. Only supports NVIDIA (CUDA) and ROCm platforms. + urls: + - https://github.com/vllm-project/vllm-omni + tags: + - text-to-image + - image-generation + - text-to-video + - video-generation + - text-to-speech + - TTS + - multimodal + - LLM + capabilities: + amd: rocm-vllm-omni + nvidia: cuda12-vllm-omni + nvidia-cuda-12: cuda12-vllm-omni + nvidia-cuda-13: cuda13-vllm-omni + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm-omni + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-vllm-omni mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-vllm-omni -- !!merge <<: *vllm-omni - name: "cuda13-vllm-omni-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-vllm-omni" +- name: cuda13-vllm-omni-development + alias: vllm-omni + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM-Omni is a unified interface for multimodal generation with vLLM. + It supports image generation (text-to-image, image editing), video generation + (text-to-video, image-to-video), text generation with multimodal inputs, and + text-to-speech generation. Only supports NVIDIA (CUDA) and ROCm platforms. + urls: + - https://github.com/vllm-project/vllm-omni + tags: + - text-to-image + - image-generation + - text-to-video + - video-generation + - text-to-speech + - TTS + - multimodal + - LLM + capabilities: + amd: rocm-vllm-omni + nvidia: cuda12-vllm-omni + nvidia-cuda-12: cuda12-vllm-omni + nvidia-cuda-13: cuda13-vllm-omni + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm-omni + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-vllm-omni mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-vllm-omni -- !!merge <<: *vllm-omni - name: "cuda13-nvidia-l4t-arm64-vllm-omni-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-vllm-omni" +- name: cuda13-nvidia-l4t-arm64-vllm-omni-development + alias: vllm-omni + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM-Omni is a unified interface for multimodal generation with vLLM. + It supports image generation (text-to-image, image editing), video generation + (text-to-video, image-to-video), text generation with multimodal inputs, and + text-to-speech generation. Only supports NVIDIA (CUDA) and ROCm platforms. + urls: + - https://github.com/vllm-project/vllm-omni + tags: + - text-to-image + - image-generation + - text-to-video + - video-generation + - text-to-speech + - TTS + - multimodal + - LLM + capabilities: + amd: rocm-vllm-omni + nvidia: cuda12-vllm-omni + nvidia-cuda-12: cuda12-vllm-omni + nvidia-cuda-13: cuda13-vllm-omni + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm-omni + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-vllm-omni mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-vllm-omni -- !!merge <<: *vllm-omni - name: "rocm-vllm-omni-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-vllm-omni" +- name: rocm-vllm-omni-development + alias: vllm-omni + license: apache-2.0 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM-Omni is a unified interface for multimodal generation with vLLM. + It supports image generation (text-to-image, image editing), video generation + (text-to-video, image-to-video), text generation with multimodal inputs, and + text-to-speech generation. Only supports NVIDIA (CUDA) and ROCm platforms. + urls: + - https://github.com/vllm-project/vllm-omni + tags: + - text-to-image + - image-generation + - text-to-video + - video-generation + - text-to-speech + - TTS + - multimodal + - LLM + capabilities: + amd: rocm-vllm-omni + nvidia: cuda12-vllm-omni + nvidia-cuda-12: cuda12-vllm-omni + nvidia-cuda-13: cuda13-vllm-omni + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vllm-omni + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-vllm-omni mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-vllm-omni -# longcat-video -- !!merge <<: *longcat-video - name: "longcat-video-development" +- name: longcat-video-development + alias: longcat-video + license: mit + icon: https://raw.githubusercontent.com/meituan-longcat/LongCat-Video/main/assets/longcat-video_logo.svg + description: | + LongCat-Video generation for text, image, and audio-conditioned avatars. + Supports LongCat-Video and LongCat-Video-Avatar-1.5, including multi-segment + talking-head continuation and an SDPA path for NVIDIA Blackwell ARM64 systems. + Requires Linux with an NVIDIA CUDA GPU; CPU, ROCm, and macOS are unsupported. + urls: + - https://github.com/meituan-longcat/LongCat-Video + tags: + - text-to-video + - image-to-video + - audio-to-video + - avatar-generation + - video-generation + - CUDA capabilities: - nvidia: "cuda12-longcat-video-development" - nvidia-cuda-12: "cuda12-longcat-video-development" - nvidia-cuda-13: "cuda13-longcat-video-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-longcat-video-development" -- !!merge <<: *longcat-video - name: "cuda12-longcat-video" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-longcat-video" + nvidia: cuda12-longcat-video-development + nvidia-cuda-12: cuda12-longcat-video-development + nvidia-cuda-13: cuda13-longcat-video-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-longcat-video-development +- name: cuda12-longcat-video + alias: longcat-video + license: mit + icon: https://raw.githubusercontent.com/meituan-longcat/LongCat-Video/main/assets/longcat-video_logo.svg + description: | + LongCat-Video generation for text, image, and audio-conditioned avatars. + Supports LongCat-Video and LongCat-Video-Avatar-1.5, including multi-segment + talking-head continuation and an SDPA path for NVIDIA Blackwell ARM64 systems. + Requires Linux with an NVIDIA CUDA GPU; CPU, ROCm, and macOS are unsupported. + urls: + - https://github.com/meituan-longcat/LongCat-Video + tags: + - text-to-video + - image-to-video + - audio-to-video + - avatar-generation + - video-generation + - CUDA + capabilities: + nvidia: cuda12-longcat-video + nvidia-cuda-12: cuda12-longcat-video + nvidia-cuda-13: cuda13-longcat-video + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-longcat-video + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-longcat-video mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-longcat-video -- !!merge <<: *longcat-video - name: "cuda13-longcat-video" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-longcat-video" +- name: cuda13-longcat-video + alias: longcat-video + license: mit + icon: https://raw.githubusercontent.com/meituan-longcat/LongCat-Video/main/assets/longcat-video_logo.svg + description: | + LongCat-Video generation for text, image, and audio-conditioned avatars. + Supports LongCat-Video and LongCat-Video-Avatar-1.5, including multi-segment + talking-head continuation and an SDPA path for NVIDIA Blackwell ARM64 systems. + Requires Linux with an NVIDIA CUDA GPU; CPU, ROCm, and macOS are unsupported. + urls: + - https://github.com/meituan-longcat/LongCat-Video + tags: + - text-to-video + - image-to-video + - audio-to-video + - avatar-generation + - video-generation + - CUDA + capabilities: + nvidia: cuda12-longcat-video + nvidia-cuda-12: cuda12-longcat-video + nvidia-cuda-13: cuda13-longcat-video + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-longcat-video + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-longcat-video mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-longcat-video -- !!merge <<: *longcat-video - name: "cuda13-nvidia-l4t-arm64-longcat-video" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-longcat-video" +- name: cuda13-nvidia-l4t-arm64-longcat-video + alias: longcat-video + license: mit + icon: https://raw.githubusercontent.com/meituan-longcat/LongCat-Video/main/assets/longcat-video_logo.svg + description: | + LongCat-Video generation for text, image, and audio-conditioned avatars. + Supports LongCat-Video and LongCat-Video-Avatar-1.5, including multi-segment + talking-head continuation and an SDPA path for NVIDIA Blackwell ARM64 systems. + Requires Linux with an NVIDIA CUDA GPU; CPU, ROCm, and macOS are unsupported. + urls: + - https://github.com/meituan-longcat/LongCat-Video + tags: + - text-to-video + - image-to-video + - audio-to-video + - avatar-generation + - video-generation + - CUDA + capabilities: + nvidia: cuda12-longcat-video + nvidia-cuda-12: cuda12-longcat-video + nvidia-cuda-13: cuda13-longcat-video + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-longcat-video + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-longcat-video mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-longcat-video -- !!merge <<: *longcat-video - name: "cuda12-longcat-video-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-longcat-video" +- name: cuda12-longcat-video-development + alias: longcat-video + license: mit + icon: https://raw.githubusercontent.com/meituan-longcat/LongCat-Video/main/assets/longcat-video_logo.svg + description: | + LongCat-Video generation for text, image, and audio-conditioned avatars. + Supports LongCat-Video and LongCat-Video-Avatar-1.5, including multi-segment + talking-head continuation and an SDPA path for NVIDIA Blackwell ARM64 systems. + Requires Linux with an NVIDIA CUDA GPU; CPU, ROCm, and macOS are unsupported. + urls: + - https://github.com/meituan-longcat/LongCat-Video + tags: + - text-to-video + - image-to-video + - audio-to-video + - avatar-generation + - video-generation + - CUDA + capabilities: + nvidia: cuda12-longcat-video + nvidia-cuda-12: cuda12-longcat-video + nvidia-cuda-13: cuda13-longcat-video + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-longcat-video + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-longcat-video mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-longcat-video -- !!merge <<: *longcat-video - name: "cuda13-longcat-video-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-longcat-video" +- name: cuda13-longcat-video-development + alias: longcat-video + license: mit + icon: https://raw.githubusercontent.com/meituan-longcat/LongCat-Video/main/assets/longcat-video_logo.svg + description: | + LongCat-Video generation for text, image, and audio-conditioned avatars. + Supports LongCat-Video and LongCat-Video-Avatar-1.5, including multi-segment + talking-head continuation and an SDPA path for NVIDIA Blackwell ARM64 systems. + Requires Linux with an NVIDIA CUDA GPU; CPU, ROCm, and macOS are unsupported. + urls: + - https://github.com/meituan-longcat/LongCat-Video + tags: + - text-to-video + - image-to-video + - audio-to-video + - avatar-generation + - video-generation + - CUDA + capabilities: + nvidia: cuda12-longcat-video + nvidia-cuda-12: cuda12-longcat-video + nvidia-cuda-13: cuda13-longcat-video + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-longcat-video + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-longcat-video mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-longcat-video -- !!merge <<: *longcat-video - name: "cuda13-nvidia-l4t-arm64-longcat-video-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-longcat-video" +- name: cuda13-nvidia-l4t-arm64-longcat-video-development + alias: longcat-video + license: mit + icon: https://raw.githubusercontent.com/meituan-longcat/LongCat-Video/main/assets/longcat-video_logo.svg + description: | + LongCat-Video generation for text, image, and audio-conditioned avatars. + Supports LongCat-Video and LongCat-Video-Avatar-1.5, including multi-segment + talking-head continuation and an SDPA path for NVIDIA Blackwell ARM64 systems. + Requires Linux with an NVIDIA CUDA GPU; CPU, ROCm, and macOS are unsupported. + urls: + - https://github.com/meituan-longcat/LongCat-Video + tags: + - text-to-video + - image-to-video + - audio-to-video + - avatar-generation + - video-generation + - CUDA + capabilities: + nvidia: cuda12-longcat-video + nvidia-cuda-12: cuda12-longcat-video + nvidia-cuda-13: cuda13-longcat-video + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-longcat-video + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-longcat-video mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-longcat-video -# rfdetr -- !!merge <<: *rfdetr - name: "rfdetr-development" +- name: rfdetr-development + alias: rfdetr + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/53104118?s=200&v=4 + description: | + RF-DETR is a real-time, transformer-based object detection model architecture developed by Roboflow and released under the Apache 2.0 license. + RF-DETR is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark alongside competitive performance at base sizes. It also achieves state-of-the-art performance on RF100-VL, an object detection benchmark that measures model domain adaptability to real world problems. RF-DETR is fastest and most accurate for its size when compared current real-time objection models. + RF-DETR is small enough to run on the edge using Inference, making it an ideal model for deployments that need both strong accuracy and real-time performance. + urls: + - https://github.com/roboflow/rf-detr + tags: + - object-detection + - rfdetr + - gpu + - cpu capabilities: - nvidia: "cuda12-rfdetr-development" - intel: "intel-rfdetr-development" - #amd: "rocm-rfdetr-development" - nvidia-l4t: "nvidia-l4t-arm64-rfdetr-development" - metal: "metal-rfdetr-development" - default: "cpu-rfdetr-development" - nvidia-cuda-13: "cuda13-rfdetr-development" -- !!merge <<: *rfdetr - name: "cuda12-rfdetr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-rfdetr" + default: cpu-rfdetr-development + intel: intel-rfdetr-development + metal: metal-rfdetr-development + nvidia: cuda12-rfdetr-development + nvidia-cuda-13: cuda13-rfdetr-development + nvidia-l4t: nvidia-l4t-arm64-rfdetr-development +- name: cuda12-rfdetr + alias: rfdetr + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/53104118?s=200&v=4 + description: | + RF-DETR is a real-time, transformer-based object detection model architecture developed by Roboflow and released under the Apache 2.0 license. + RF-DETR is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark alongside competitive performance at base sizes. It also achieves state-of-the-art performance on RF100-VL, an object detection benchmark that measures model domain adaptability to real world problems. RF-DETR is fastest and most accurate for its size when compared current real-time objection models. + RF-DETR is small enough to run on the edge using Inference, making it an ideal model for deployments that need both strong accuracy and real-time performance. + urls: + - https://github.com/roboflow/rf-detr + tags: + - object-detection + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr + intel: intel-rfdetr + metal: metal-rfdetr + nvidia: cuda12-rfdetr + nvidia-cuda-12: cuda12-rfdetr + nvidia-cuda-13: cuda13-rfdetr + nvidia-l4t: nvidia-l4t-arm64-rfdetr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-rfdetr mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-rfdetr -- !!merge <<: *rfdetr - name: "intel-rfdetr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-rfdetr" +- name: intel-rfdetr + alias: rfdetr + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/53104118?s=200&v=4 + description: | + RF-DETR is a real-time, transformer-based object detection model architecture developed by Roboflow and released under the Apache 2.0 license. + RF-DETR is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark alongside competitive performance at base sizes. It also achieves state-of-the-art performance on RF100-VL, an object detection benchmark that measures model domain adaptability to real world problems. RF-DETR is fastest and most accurate for its size when compared current real-time objection models. + RF-DETR is small enough to run on the edge using Inference, making it an ideal model for deployments that need both strong accuracy and real-time performance. + urls: + - https://github.com/roboflow/rf-detr + tags: + - object-detection + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr + intel: intel-rfdetr + metal: metal-rfdetr + nvidia: cuda12-rfdetr + nvidia-cuda-12: cuda12-rfdetr + nvidia-cuda-13: cuda13-rfdetr + nvidia-l4t: nvidia-l4t-arm64-rfdetr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-rfdetr mirrors: - localai/localai-backends:latest-gpu-intel-rfdetr -# - !!merge <<: *rfdetr -# name: "rocm-rfdetr" -# uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-hipblas-rfdetr" -# mirrors: -# - localai/localai-backends:latest-gpu-hipblas-rfdetr -- !!merge <<: *rfdetr - name: "nvidia-l4t-arm64-rfdetr" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-rfdetr" +- name: nvidia-l4t-arm64-rfdetr + alias: rfdetr + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/53104118?s=200&v=4 + description: | + RF-DETR is a real-time, transformer-based object detection model architecture developed by Roboflow and released under the Apache 2.0 license. + RF-DETR is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark alongside competitive performance at base sizes. It also achieves state-of-the-art performance on RF100-VL, an object detection benchmark that measures model domain adaptability to real world problems. RF-DETR is fastest and most accurate for its size when compared current real-time objection models. + RF-DETR is small enough to run on the edge using Inference, making it an ideal model for deployments that need both strong accuracy and real-time performance. + urls: + - https://github.com/roboflow/rf-detr + tags: + - object-detection + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr + intel: intel-rfdetr + metal: metal-rfdetr + nvidia: cuda12-rfdetr + nvidia-cuda-12: cuda12-rfdetr + nvidia-cuda-13: cuda13-rfdetr + nvidia-l4t: nvidia-l4t-arm64-rfdetr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-rfdetr mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-rfdetr -- !!merge <<: *rfdetr - name: "nvidia-l4t-arm64-rfdetr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-rfdetr" +- name: nvidia-l4t-arm64-rfdetr-development + alias: rfdetr + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/53104118?s=200&v=4 + description: | + RF-DETR is a real-time, transformer-based object detection model architecture developed by Roboflow and released under the Apache 2.0 license. + RF-DETR is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark alongside competitive performance at base sizes. It also achieves state-of-the-art performance on RF100-VL, an object detection benchmark that measures model domain adaptability to real world problems. RF-DETR is fastest and most accurate for its size when compared current real-time objection models. + RF-DETR is small enough to run on the edge using Inference, making it an ideal model for deployments that need both strong accuracy and real-time performance. + urls: + - https://github.com/roboflow/rf-detr + tags: + - object-detection + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr + intel: intel-rfdetr + metal: metal-rfdetr + nvidia: cuda12-rfdetr + nvidia-cuda-12: cuda12-rfdetr + nvidia-cuda-13: cuda13-rfdetr + nvidia-l4t: nvidia-l4t-arm64-rfdetr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-rfdetr mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-rfdetr -- !!merge <<: *rfdetr - name: "cpu-rfdetr" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-rfdetr" +- name: cpu-rfdetr + alias: rfdetr + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/53104118?s=200&v=4 + description: | + RF-DETR is a real-time, transformer-based object detection model architecture developed by Roboflow and released under the Apache 2.0 license. + RF-DETR is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark alongside competitive performance at base sizes. It also achieves state-of-the-art performance on RF100-VL, an object detection benchmark that measures model domain adaptability to real world problems. RF-DETR is fastest and most accurate for its size when compared current real-time objection models. + RF-DETR is small enough to run on the edge using Inference, making it an ideal model for deployments that need both strong accuracy and real-time performance. + urls: + - https://github.com/roboflow/rf-detr + tags: + - object-detection + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr + intel: intel-rfdetr + metal: metal-rfdetr + nvidia: cuda12-rfdetr + nvidia-cuda-12: cuda12-rfdetr + nvidia-cuda-13: cuda13-rfdetr + nvidia-l4t: nvidia-l4t-arm64-rfdetr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-rfdetr mirrors: - localai/localai-backends:latest-cpu-rfdetr -- !!merge <<: *rfdetr - name: "cuda12-rfdetr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-rfdetr" +- name: cuda12-rfdetr-development + alias: rfdetr + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/53104118?s=200&v=4 + description: | + RF-DETR is a real-time, transformer-based object detection model architecture developed by Roboflow and released under the Apache 2.0 license. + RF-DETR is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark alongside competitive performance at base sizes. It also achieves state-of-the-art performance on RF100-VL, an object detection benchmark that measures model domain adaptability to real world problems. RF-DETR is fastest and most accurate for its size when compared current real-time objection models. + RF-DETR is small enough to run on the edge using Inference, making it an ideal model for deployments that need both strong accuracy and real-time performance. + urls: + - https://github.com/roboflow/rf-detr + tags: + - object-detection + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr + intel: intel-rfdetr + metal: metal-rfdetr + nvidia: cuda12-rfdetr + nvidia-cuda-12: cuda12-rfdetr + nvidia-cuda-13: cuda13-rfdetr + nvidia-l4t: nvidia-l4t-arm64-rfdetr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-rfdetr mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-rfdetr -- !!merge <<: *rfdetr - name: "intel-rfdetr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-rfdetr" +- name: intel-rfdetr-development + alias: rfdetr + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/53104118?s=200&v=4 + description: | + RF-DETR is a real-time, transformer-based object detection model architecture developed by Roboflow and released under the Apache 2.0 license. + RF-DETR is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark alongside competitive performance at base sizes. It also achieves state-of-the-art performance on RF100-VL, an object detection benchmark that measures model domain adaptability to real world problems. RF-DETR is fastest and most accurate for its size when compared current real-time objection models. + RF-DETR is small enough to run on the edge using Inference, making it an ideal model for deployments that need both strong accuracy and real-time performance. + urls: + - https://github.com/roboflow/rf-detr + tags: + - object-detection + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr + intel: intel-rfdetr + metal: metal-rfdetr + nvidia: cuda12-rfdetr + nvidia-cuda-12: cuda12-rfdetr + nvidia-cuda-13: cuda13-rfdetr + nvidia-l4t: nvidia-l4t-arm64-rfdetr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-rfdetr mirrors: - localai/localai-backends:master-gpu-intel-rfdetr -# - !!merge <<: *rfdetr -# name: "rocm-rfdetr-development" -# uri: "quay.io/go-skynet/local-ai-backends:master-gpu-hipblas-rfdetr" -# mirrors: -# - localai/localai-backends:master-gpu-hipblas-rfdetr -- !!merge <<: *rfdetr - name: "cpu-rfdetr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-rfdetr" +- name: cpu-rfdetr-development + alias: rfdetr + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/53104118?s=200&v=4 + description: | + RF-DETR is a real-time, transformer-based object detection model architecture developed by Roboflow and released under the Apache 2.0 license. + RF-DETR is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark alongside competitive performance at base sizes. It also achieves state-of-the-art performance on RF100-VL, an object detection benchmark that measures model domain adaptability to real world problems. RF-DETR is fastest and most accurate for its size when compared current real-time objection models. + RF-DETR is small enough to run on the edge using Inference, making it an ideal model for deployments that need both strong accuracy and real-time performance. + urls: + - https://github.com/roboflow/rf-detr + tags: + - object-detection + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr + intel: intel-rfdetr + metal: metal-rfdetr + nvidia: cuda12-rfdetr + nvidia-cuda-12: cuda12-rfdetr + nvidia-cuda-13: cuda13-rfdetr + nvidia-l4t: nvidia-l4t-arm64-rfdetr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr + uri: quay.io/go-skynet/local-ai-backends:master-cpu-rfdetr mirrors: - localai/localai-backends:master-cpu-rfdetr -- !!merge <<: *rfdetr - name: "intel-rfdetr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-rfdetr" - mirrors: - - localai/localai-backends:latest-gpu-intel-rfdetr -- !!merge <<: *rfdetr - name: "cuda13-rfdetr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-rfdetr" +- name: cuda13-rfdetr + alias: rfdetr + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/53104118?s=200&v=4 + description: | + RF-DETR is a real-time, transformer-based object detection model architecture developed by Roboflow and released under the Apache 2.0 license. + RF-DETR is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark alongside competitive performance at base sizes. It also achieves state-of-the-art performance on RF100-VL, an object detection benchmark that measures model domain adaptability to real world problems. RF-DETR is fastest and most accurate for its size when compared current real-time objection models. + RF-DETR is small enough to run on the edge using Inference, making it an ideal model for deployments that need both strong accuracy and real-time performance. + urls: + - https://github.com/roboflow/rf-detr + tags: + - object-detection + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr + intel: intel-rfdetr + metal: metal-rfdetr + nvidia: cuda12-rfdetr + nvidia-cuda-12: cuda12-rfdetr + nvidia-cuda-13: cuda13-rfdetr + nvidia-l4t: nvidia-l4t-arm64-rfdetr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-rfdetr mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-rfdetr -- !!merge <<: *rfdetr - name: "cuda13-rfdetr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-rfdetr" +- name: cuda13-rfdetr-development + alias: rfdetr + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/53104118?s=200&v=4 + description: | + RF-DETR is a real-time, transformer-based object detection model architecture developed by Roboflow and released under the Apache 2.0 license. + RF-DETR is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark alongside competitive performance at base sizes. It also achieves state-of-the-art performance on RF100-VL, an object detection benchmark that measures model domain adaptability to real world problems. RF-DETR is fastest and most accurate for its size when compared current real-time objection models. + RF-DETR is small enough to run on the edge using Inference, making it an ideal model for deployments that need both strong accuracy and real-time performance. + urls: + - https://github.com/roboflow/rf-detr + tags: + - object-detection + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr + intel: intel-rfdetr + metal: metal-rfdetr + nvidia: cuda12-rfdetr + nvidia-cuda-12: cuda12-rfdetr + nvidia-cuda-13: cuda13-rfdetr + nvidia-l4t: nvidia-l4t-arm64-rfdetr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-rfdetr mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-rfdetr -- !!merge <<: *rfdetr - name: "metal-rfdetr" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-rfdetr" +- name: metal-rfdetr + alias: rfdetr + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/53104118?s=200&v=4 + description: | + RF-DETR is a real-time, transformer-based object detection model architecture developed by Roboflow and released under the Apache 2.0 license. + RF-DETR is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark alongside competitive performance at base sizes. It also achieves state-of-the-art performance on RF100-VL, an object detection benchmark that measures model domain adaptability to real world problems. RF-DETR is fastest and most accurate for its size when compared current real-time objection models. + RF-DETR is small enough to run on the edge using Inference, making it an ideal model for deployments that need both strong accuracy and real-time performance. + urls: + - https://github.com/roboflow/rf-detr + tags: + - object-detection + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr + intel: intel-rfdetr + metal: metal-rfdetr + nvidia: cuda12-rfdetr + nvidia-cuda-12: cuda12-rfdetr + nvidia-cuda-13: cuda13-rfdetr + nvidia-l4t: nvidia-l4t-arm64-rfdetr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-rfdetr mirrors: - localai/localai-backends:latest-metal-darwin-arm64-rfdetr -- !!merge <<: *rfdetr - name: "metal-rfdetr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-rfdetr" +- name: metal-rfdetr-development + alias: rfdetr + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/53104118?s=200&v=4 + description: | + RF-DETR is a real-time, transformer-based object detection model architecture developed by Roboflow and released under the Apache 2.0 license. + RF-DETR is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark alongside competitive performance at base sizes. It also achieves state-of-the-art performance on RF100-VL, an object detection benchmark that measures model domain adaptability to real world problems. RF-DETR is fastest and most accurate for its size when compared current real-time objection models. + RF-DETR is small enough to run on the edge using Inference, making it an ideal model for deployments that need both strong accuracy and real-time performance. + urls: + - https://github.com/roboflow/rf-detr + tags: + - object-detection + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr + intel: intel-rfdetr + metal: metal-rfdetr + nvidia: cuda12-rfdetr + nvidia-cuda-12: cuda12-rfdetr + nvidia-cuda-13: cuda13-rfdetr + nvidia-l4t: nvidia-l4t-arm64-rfdetr + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-rfdetr mirrors: - localai/localai-backends:master-metal-darwin-arm64-rfdetr -## sam3-cpp -- !!merge <<: *sam3cpp - name: "sam3-cpp-development" +- name: sam3-cpp-development + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu capabilities: - default: "cpu-sam3-cpp-development" - nvidia: "cuda12-sam3-cpp-development" - nvidia-cuda-12: "cuda12-sam3-cpp-development" - nvidia-cuda-13: "cuda13-sam3-cpp-development" - nvidia-l4t: "nvidia-l4t-arm64-sam3-cpp-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-sam3-cpp-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-sam3-cpp-development" - intel: "intel-sycl-f32-sam3-cpp-development" - vulkan: "vulkan-sam3-cpp-development" - metal: "metal-sam3-cpp-development" -- !!merge <<: *sam3cpp - name: "cpu-sam3-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-sam3-cpp" + default: cpu-sam3-cpp-development + intel: intel-sycl-f32-sam3-cpp-development + metal: metal-sam3-cpp-development + nvidia: cuda12-sam3-cpp-development + nvidia-cuda-12: cuda12-sam3-cpp-development + nvidia-cuda-13: cuda13-sam3-cpp-development + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp-development + vulkan: vulkan-sam3-cpp-development +- name: cpu-sam3-cpp + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-sam3-cpp mirrors: - localai/localai-backends:latest-cpu-sam3-cpp -- !!merge <<: *sam3cpp - name: "cpu-sam3-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-sam3-cpp" +- name: cpu-sam3-cpp-development + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-sam3-cpp mirrors: - localai/localai-backends:master-cpu-sam3-cpp -- !!merge <<: *sam3cpp - name: "metal-sam3-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-sam3-cpp" +- name: metal-sam3-cpp + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-sam3-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-sam3-cpp -- !!merge <<: *sam3cpp - name: "metal-sam3-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-sam3-cpp" +- name: metal-sam3-cpp-development + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-sam3-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-sam3-cpp -- !!merge <<: *sam3cpp - name: "cuda12-sam3-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-sam3-cpp" +- name: cuda12-sam3-cpp + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-sam3-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-sam3-cpp -- !!merge <<: *sam3cpp - name: "cuda12-sam3-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-sam3-cpp" +- name: cuda12-sam3-cpp-development + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-sam3-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-sam3-cpp -- !!merge <<: *sam3cpp - name: "cuda13-sam3-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-sam3-cpp" +- name: cuda13-sam3-cpp + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-sam3-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-sam3-cpp -- !!merge <<: *sam3cpp - name: "cuda13-sam3-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-sam3-cpp" +- name: cuda13-sam3-cpp-development + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-sam3-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-sam3-cpp -- !!merge <<: *sam3cpp - name: "nvidia-l4t-arm64-sam3-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-sam3-cpp" +- name: nvidia-l4t-arm64-sam3-cpp + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-sam3-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-sam3-cpp -- !!merge <<: *sam3cpp - name: "nvidia-l4t-arm64-sam3-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-sam3-cpp" +- name: nvidia-l4t-arm64-sam3-cpp-development + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-sam3-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-sam3-cpp -- !!merge <<: *sam3cpp - name: "cuda13-nvidia-l4t-arm64-sam3-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-sam3-cpp" +- name: cuda13-nvidia-l4t-arm64-sam3-cpp + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-sam3-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-sam3-cpp -- !!merge <<: *sam3cpp - name: "cuda13-nvidia-l4t-arm64-sam3-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-sam3-cpp" +- name: cuda13-nvidia-l4t-arm64-sam3-cpp-development + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-sam3-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-sam3-cpp -- !!merge <<: *sam3cpp - name: "intel-sycl-f32-sam3-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-sam3-cpp" +- name: intel-sycl-f32-sam3-cpp + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-sam3-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-sam3-cpp -- !!merge <<: *sam3cpp - name: "intel-sycl-f32-sam3-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-sam3-cpp" +- name: intel-sycl-f32-sam3-cpp-development + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-sam3-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-sam3-cpp -- !!merge <<: *sam3cpp - name: "vulkan-sam3-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-sam3-cpp" +- name: vulkan-sam3-cpp + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-sam3-cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-sam3-cpp -- !!merge <<: *sam3cpp - name: "vulkan-sam3-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-sam3-cpp" +- name: vulkan-sam3-cpp-development + alias: sam3-cpp + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: cpu-sam3-cpp + intel: intel-sycl-f32-sam3-cpp + metal: metal-sam3-cpp + nvidia: cuda12-sam3-cpp + nvidia-cuda-12: cuda12-sam3-cpp + nvidia-cuda-13: cuda13-sam3-cpp + nvidia-l4t: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-sam3-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-sam3-cpp + vulkan: vulkan-sam3-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-sam3-cpp mirrors: - localai/localai-backends:master-gpu-vulkan-sam3-cpp -## rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "rfdetr-cpp-development" +- name: rfdetr-cpp-development + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu capabilities: - default: "cpu-rfdetr-cpp-development" - nvidia: "cuda12-rfdetr-cpp-development" - nvidia-cuda-12: "cuda12-rfdetr-cpp-development" - nvidia-cuda-13: "cuda13-rfdetr-cpp-development" - nvidia-l4t: "nvidia-l4t-arm64-rfdetr-cpp-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-rfdetr-cpp-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-rfdetr-cpp-development" - intel: "intel-sycl-f32-rfdetr-cpp-development" - vulkan: "vulkan-rfdetr-cpp-development" - metal: "metal-rfdetr-cpp-development" -- !!merge <<: *rfdetrcpp - name: "cpu-rfdetr-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-rfdetr-cpp" + default: cpu-rfdetr-cpp-development + intel: intel-sycl-f32-rfdetr-cpp-development + metal: metal-rfdetr-cpp-development + nvidia: cuda12-rfdetr-cpp-development + nvidia-cuda-12: cuda12-rfdetr-cpp-development + nvidia-cuda-13: cuda13-rfdetr-cpp-development + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp-development + vulkan: vulkan-rfdetr-cpp-development +- name: cpu-rfdetr-cpp + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-rfdetr-cpp mirrors: - localai/localai-backends:latest-cpu-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "cpu-rfdetr-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-rfdetr-cpp" +- name: cpu-rfdetr-cpp-development + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-rfdetr-cpp mirrors: - localai/localai-backends:master-cpu-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "metal-rfdetr-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-rfdetr-cpp" +- name: metal-rfdetr-cpp + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-rfdetr-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "metal-rfdetr-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-rfdetr-cpp" +- name: metal-rfdetr-cpp-development + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-rfdetr-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "cuda12-rfdetr-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-rfdetr-cpp" +- name: cuda12-rfdetr-cpp + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-rfdetr-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "cuda12-rfdetr-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-rfdetr-cpp" +- name: cuda12-rfdetr-cpp-development + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-rfdetr-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "cuda13-rfdetr-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-rfdetr-cpp" +- name: cuda13-rfdetr-cpp + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-rfdetr-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "cuda13-rfdetr-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-rfdetr-cpp" +- name: cuda13-rfdetr-cpp-development + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-rfdetr-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "nvidia-l4t-arm64-rfdetr-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-rfdetr-cpp" +- name: nvidia-l4t-arm64-rfdetr-cpp + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-rfdetr-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "nvidia-l4t-arm64-rfdetr-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-rfdetr-cpp" +- name: nvidia-l4t-arm64-rfdetr-cpp-development + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-rfdetr-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "cuda13-nvidia-l4t-arm64-rfdetr-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-rfdetr-cpp" +- name: cuda13-nvidia-l4t-arm64-rfdetr-cpp + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-rfdetr-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "cuda13-nvidia-l4t-arm64-rfdetr-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-rfdetr-cpp" +- name: cuda13-nvidia-l4t-arm64-rfdetr-cpp-development + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-rfdetr-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "intel-sycl-f32-rfdetr-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-rfdetr-cpp" +- name: intel-sycl-f32-rfdetr-cpp + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-rfdetr-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "intel-sycl-f32-rfdetr-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-rfdetr-cpp" +- name: intel-sycl-f32-rfdetr-cpp-development + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-rfdetr-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "intel-sycl-f16-rfdetr-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-rfdetr-cpp" +- name: intel-sycl-f16-rfdetr-cpp + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-rfdetr-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "intel-sycl-f16-rfdetr-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-rfdetr-cpp" +- name: intel-sycl-f16-rfdetr-cpp-development + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-rfdetr-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "vulkan-rfdetr-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-rfdetr-cpp" +- name: vulkan-rfdetr-cpp + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-rfdetr-cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-rfdetr-cpp -- !!merge <<: *rfdetrcpp - name: "vulkan-rfdetr-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-rfdetr-cpp" +- name: vulkan-rfdetr-cpp-development + alias: rfdetr-cpp + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: cpu-rfdetr-cpp + intel: intel-sycl-f32-rfdetr-cpp + metal: metal-rfdetr-cpp + nvidia: cuda12-rfdetr-cpp + nvidia-cuda-12: cuda12-rfdetr-cpp + nvidia-cuda-13: cuda13-rfdetr-cpp + nvidia-l4t: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-rfdetr-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-rfdetr-cpp + vulkan: vulkan-rfdetr-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-rfdetr-cpp mirrors: - localai/localai-backends:master-gpu-vulkan-rfdetr-cpp -## Rerankers -- !!merge <<: *rerankers - name: "rerankers-development" +- name: rerankers-development + alias: rerankers capabilities: - nvidia: "cuda12-rerankers-development" - intel: "intel-rerankers-development" - amd: "rocm-rerankers-development" - metal: "metal-rerankers-development" - nvidia-cuda-13: "cuda13-rerankers-development" -- !!merge <<: *rerankers - name: "cuda12-rerankers" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-rerankers" + amd: rocm-rerankers-development + intel: intel-rerankers-development + metal: metal-rerankers-development + nvidia: cuda12-rerankers-development + nvidia-cuda-13: cuda13-rerankers-development +- name: cuda12-rerankers + alias: rerankers + capabilities: + amd: rocm-rerankers + intel: intel-rerankers + metal: metal-rerankers + nvidia: cuda12-rerankers + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-rerankers mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-rerankers -- !!merge <<: *rerankers - name: "intel-rerankers" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-rerankers" +- name: intel-rerankers + alias: rerankers + capabilities: + amd: rocm-rerankers + intel: intel-rerankers + metal: metal-rerankers + nvidia: cuda12-rerankers + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-rerankers mirrors: - localai/localai-backends:latest-gpu-intel-rerankers -- !!merge <<: *rerankers - name: "rocm-rerankers" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-rerankers" +- name: rocm-rerankers + alias: rerankers + capabilities: + amd: rocm-rerankers + intel: intel-rerankers + metal: metal-rerankers + nvidia: cuda12-rerankers + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-rerankers mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-rerankers -- !!merge <<: *rerankers - name: "cuda12-rerankers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-rerankers" +- name: cuda12-rerankers-development + alias: rerankers + capabilities: + amd: rocm-rerankers + intel: intel-rerankers + metal: metal-rerankers + nvidia: cuda12-rerankers + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-rerankers mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-rerankers -- !!merge <<: *rerankers - name: "rocm-rerankers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-rerankers" +- name: rocm-rerankers-development + alias: rerankers + capabilities: + amd: rocm-rerankers + intel: intel-rerankers + metal: metal-rerankers + nvidia: cuda12-rerankers + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-rerankers mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-rerankers -- !!merge <<: *rerankers - name: "intel-rerankers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-rerankers" +- name: intel-rerankers-development + alias: rerankers + capabilities: + amd: rocm-rerankers + intel: intel-rerankers + metal: metal-rerankers + nvidia: cuda12-rerankers + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-rerankers mirrors: - localai/localai-backends:master-gpu-intel-rerankers -- !!merge <<: *rerankers - name: "cuda13-rerankers" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-rerankers" +- name: cuda13-rerankers + alias: rerankers + capabilities: + amd: rocm-rerankers + intel: intel-rerankers + metal: metal-rerankers + nvidia: cuda12-rerankers + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-rerankers mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-rerankers -- !!merge <<: *rerankers - name: "cuda13-rerankers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-rerankers" +- name: cuda13-rerankers-development + alias: rerankers + capabilities: + amd: rocm-rerankers + intel: intel-rerankers + metal: metal-rerankers + nvidia: cuda12-rerankers + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-rerankers mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-rerankers -- !!merge <<: *rerankers - name: "metal-rerankers" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-rerankers" +- name: metal-rerankers + alias: rerankers + capabilities: + amd: rocm-rerankers + intel: intel-rerankers + metal: metal-rerankers + nvidia: cuda12-rerankers + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-rerankers mirrors: - localai/localai-backends:latest-metal-darwin-arm64-rerankers -- !!merge <<: *rerankers - name: "metal-rerankers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-rerankers" +- name: metal-rerankers-development + alias: rerankers + capabilities: + amd: rocm-rerankers + intel: intel-rerankers + metal: metal-rerankers + nvidia: cuda12-rerankers + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-rerankers mirrors: - localai/localai-backends:master-metal-darwin-arm64-rerankers -## tinygrad -## Single image — the meta anchor above carries the latest uri directly -## since there is only one variant. The development entry below points at -## the master tag. -- !!merge <<: *tinygrad - name: "tinygrad-development" - uri: "quay.io/go-skynet/local-ai-backends:master-tinygrad" +- name: tinygrad-development + alias: tinygrad + license: MIT + description: | + tinygrad is a minimalist deep-learning framework with zero runtime + dependencies that targets CUDA, ROCm, Metal, WebGPU and CPU (CLANG). + The LocalAI tinygrad backend exposes a single multimodal runtime that + covers LLM text generation (Llama / Qwen / Mistral via safetensors or + GGUF) with native tool-call extraction, BERT-family embeddings, + Stable Diffusion 1.x / 2 / XL image generation, and Whisper speech-to-text. + + Single image: tinygrad generates its own GPU kernels and dlopens the + host driver libraries at runtime, so there is no per-toolkit build + split. The same image runs CPU-only or accelerates against + CUDA / ROCm / Metal when the host driver is visible. + urls: + - https://github.com/tinygrad/tinygrad + tags: + - text-to-text + - LLM + - embeddings + - image-generation + - transcription + - multimodal + uri: quay.io/go-skynet/local-ai-backends:master-tinygrad mirrors: - localai/localai-backends:master-tinygrad -## Transformers -- !!merge <<: *transformers - name: "transformers-development" +- name: transformers-development + alias: transformers + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/25720743?s=200&v=4 + description: | + Transformers acts as the model-definition framework for state-of-the-art machine learning models in text, computer vision, audio, video, and multimodal model, for both inference and training. + It centralizes the model definition so that this definition is agreed upon across the ecosystem. transformers is the pivot across frameworks: if a model definition is supported, it will be compatible with the majority of training frameworks (Axolotl, Unsloth, DeepSpeed, FSDP, PyTorch-Lightning, ...), inference engines (vLLM, SGLang, TGI, ...), and adjacent modeling libraries (llama.cpp, mlx, ...) which leverage the model definition from transformers. + urls: + - https://github.com/huggingface/transformers + tags: + - text-to-text + - multimodal capabilities: - nvidia: "cuda12-transformers-development" - intel: "intel-transformers-development" - amd: "rocm-transformers-development" - metal: "metal-transformers-development" - nvidia-cuda-13: "cuda13-transformers-development" -- !!merge <<: *transformers - name: "cuda12-transformers" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-transformers" + amd: rocm-transformers-development + intel: intel-transformers-development + metal: metal-transformers-development + nvidia: cuda12-transformers-development + nvidia-cuda-13: cuda13-transformers-development +- name: cuda12-transformers + alias: transformers + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/25720743?s=200&v=4 + description: | + Transformers acts as the model-definition framework for state-of-the-art machine learning models in text, computer vision, audio, video, and multimodal model, for both inference and training. + It centralizes the model definition so that this definition is agreed upon across the ecosystem. transformers is the pivot across frameworks: if a model definition is supported, it will be compatible with the majority of training frameworks (Axolotl, Unsloth, DeepSpeed, FSDP, PyTorch-Lightning, ...), inference engines (vLLM, SGLang, TGI, ...), and adjacent modeling libraries (llama.cpp, mlx, ...) which leverage the model definition from transformers. + urls: + - https://github.com/huggingface/transformers + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-transformers + intel: intel-transformers + metal: metal-transformers + nvidia: cuda12-transformers + nvidia-cuda-12: cuda12-transformers + nvidia-cuda-13: cuda13-transformers + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-transformers mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-transformers -- !!merge <<: *transformers - name: "rocm-transformers" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-transformers" +- name: rocm-transformers + alias: transformers + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/25720743?s=200&v=4 + description: | + Transformers acts as the model-definition framework for state-of-the-art machine learning models in text, computer vision, audio, video, and multimodal model, for both inference and training. + It centralizes the model definition so that this definition is agreed upon across the ecosystem. transformers is the pivot across frameworks: if a model definition is supported, it will be compatible with the majority of training frameworks (Axolotl, Unsloth, DeepSpeed, FSDP, PyTorch-Lightning, ...), inference engines (vLLM, SGLang, TGI, ...), and adjacent modeling libraries (llama.cpp, mlx, ...) which leverage the model definition from transformers. + urls: + - https://github.com/huggingface/transformers + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-transformers + intel: intel-transformers + metal: metal-transformers + nvidia: cuda12-transformers + nvidia-cuda-12: cuda12-transformers + nvidia-cuda-13: cuda13-transformers + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-transformers mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-transformers -- !!merge <<: *transformers - name: "intel-transformers" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-transformers" +- name: intel-transformers + alias: transformers + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/25720743?s=200&v=4 + description: | + Transformers acts as the model-definition framework for state-of-the-art machine learning models in text, computer vision, audio, video, and multimodal model, for both inference and training. + It centralizes the model definition so that this definition is agreed upon across the ecosystem. transformers is the pivot across frameworks: if a model definition is supported, it will be compatible with the majority of training frameworks (Axolotl, Unsloth, DeepSpeed, FSDP, PyTorch-Lightning, ...), inference engines (vLLM, SGLang, TGI, ...), and adjacent modeling libraries (llama.cpp, mlx, ...) which leverage the model definition from transformers. + urls: + - https://github.com/huggingface/transformers + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-transformers + intel: intel-transformers + metal: metal-transformers + nvidia: cuda12-transformers + nvidia-cuda-12: cuda12-transformers + nvidia-cuda-13: cuda13-transformers + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-transformers mirrors: - localai/localai-backends:latest-gpu-intel-transformers -- !!merge <<: *transformers - name: "cuda12-transformers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-transformers" +- name: cuda12-transformers-development + alias: transformers + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/25720743?s=200&v=4 + description: | + Transformers acts as the model-definition framework for state-of-the-art machine learning models in text, computer vision, audio, video, and multimodal model, for both inference and training. + It centralizes the model definition so that this definition is agreed upon across the ecosystem. transformers is the pivot across frameworks: if a model definition is supported, it will be compatible with the majority of training frameworks (Axolotl, Unsloth, DeepSpeed, FSDP, PyTorch-Lightning, ...), inference engines (vLLM, SGLang, TGI, ...), and adjacent modeling libraries (llama.cpp, mlx, ...) which leverage the model definition from transformers. + urls: + - https://github.com/huggingface/transformers + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-transformers + intel: intel-transformers + metal: metal-transformers + nvidia: cuda12-transformers + nvidia-cuda-12: cuda12-transformers + nvidia-cuda-13: cuda13-transformers + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-transformers mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-transformers -- !!merge <<: *transformers - name: "rocm-transformers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-transformers" +- name: rocm-transformers-development + alias: transformers + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/25720743?s=200&v=4 + description: | + Transformers acts as the model-definition framework for state-of-the-art machine learning models in text, computer vision, audio, video, and multimodal model, for both inference and training. + It centralizes the model definition so that this definition is agreed upon across the ecosystem. transformers is the pivot across frameworks: if a model definition is supported, it will be compatible with the majority of training frameworks (Axolotl, Unsloth, DeepSpeed, FSDP, PyTorch-Lightning, ...), inference engines (vLLM, SGLang, TGI, ...), and adjacent modeling libraries (llama.cpp, mlx, ...) which leverage the model definition from transformers. + urls: + - https://github.com/huggingface/transformers + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-transformers + intel: intel-transformers + metal: metal-transformers + nvidia: cuda12-transformers + nvidia-cuda-12: cuda12-transformers + nvidia-cuda-13: cuda13-transformers + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-transformers mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-transformers -- !!merge <<: *transformers - name: "intel-transformers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-transformers" +- name: intel-transformers-development + alias: transformers + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/25720743?s=200&v=4 + description: | + Transformers acts as the model-definition framework for state-of-the-art machine learning models in text, computer vision, audio, video, and multimodal model, for both inference and training. + It centralizes the model definition so that this definition is agreed upon across the ecosystem. transformers is the pivot across frameworks: if a model definition is supported, it will be compatible with the majority of training frameworks (Axolotl, Unsloth, DeepSpeed, FSDP, PyTorch-Lightning, ...), inference engines (vLLM, SGLang, TGI, ...), and adjacent modeling libraries (llama.cpp, mlx, ...) which leverage the model definition from transformers. + urls: + - https://github.com/huggingface/transformers + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-transformers + intel: intel-transformers + metal: metal-transformers + nvidia: cuda12-transformers + nvidia-cuda-12: cuda12-transformers + nvidia-cuda-13: cuda13-transformers + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-transformers mirrors: - localai/localai-backends:master-gpu-intel-transformers -- !!merge <<: *transformers - name: "cuda13-transformers" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-transformers" +- name: cuda13-transformers + alias: transformers + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/25720743?s=200&v=4 + description: | + Transformers acts as the model-definition framework for state-of-the-art machine learning models in text, computer vision, audio, video, and multimodal model, for both inference and training. + It centralizes the model definition so that this definition is agreed upon across the ecosystem. transformers is the pivot across frameworks: if a model definition is supported, it will be compatible with the majority of training frameworks (Axolotl, Unsloth, DeepSpeed, FSDP, PyTorch-Lightning, ...), inference engines (vLLM, SGLang, TGI, ...), and adjacent modeling libraries (llama.cpp, mlx, ...) which leverage the model definition from transformers. + urls: + - https://github.com/huggingface/transformers + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-transformers + intel: intel-transformers + metal: metal-transformers + nvidia: cuda12-transformers + nvidia-cuda-12: cuda12-transformers + nvidia-cuda-13: cuda13-transformers + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-transformers mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-transformers -- !!merge <<: *transformers - name: "cuda13-transformers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-transformers" +- name: cuda13-transformers-development + alias: transformers + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/25720743?s=200&v=4 + description: | + Transformers acts as the model-definition framework for state-of-the-art machine learning models in text, computer vision, audio, video, and multimodal model, for both inference and training. + It centralizes the model definition so that this definition is agreed upon across the ecosystem. transformers is the pivot across frameworks: if a model definition is supported, it will be compatible with the majority of training frameworks (Axolotl, Unsloth, DeepSpeed, FSDP, PyTorch-Lightning, ...), inference engines (vLLM, SGLang, TGI, ...), and adjacent modeling libraries (llama.cpp, mlx, ...) which leverage the model definition from transformers. + urls: + - https://github.com/huggingface/transformers + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-transformers + intel: intel-transformers + metal: metal-transformers + nvidia: cuda12-transformers + nvidia-cuda-12: cuda12-transformers + nvidia-cuda-13: cuda13-transformers + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-transformers mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-transformers -- !!merge <<: *transformers - name: "metal-transformers" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-transformers" +- name: metal-transformers + alias: transformers + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/25720743?s=200&v=4 + description: | + Transformers acts as the model-definition framework for state-of-the-art machine learning models in text, computer vision, audio, video, and multimodal model, for both inference and training. + It centralizes the model definition so that this definition is agreed upon across the ecosystem. transformers is the pivot across frameworks: if a model definition is supported, it will be compatible with the majority of training frameworks (Axolotl, Unsloth, DeepSpeed, FSDP, PyTorch-Lightning, ...), inference engines (vLLM, SGLang, TGI, ...), and adjacent modeling libraries (llama.cpp, mlx, ...) which leverage the model definition from transformers. + urls: + - https://github.com/huggingface/transformers + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-transformers + intel: intel-transformers + metal: metal-transformers + nvidia: cuda12-transformers + nvidia-cuda-12: cuda12-transformers + nvidia-cuda-13: cuda13-transformers + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-transformers mirrors: - localai/localai-backends:latest-metal-darwin-arm64-transformers -- !!merge <<: *transformers - name: "metal-transformers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-transformers" +- name: metal-transformers-development + alias: transformers + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/25720743?s=200&v=4 + description: | + Transformers acts as the model-definition framework for state-of-the-art machine learning models in text, computer vision, audio, video, and multimodal model, for both inference and training. + It centralizes the model definition so that this definition is agreed upon across the ecosystem. transformers is the pivot across frameworks: if a model definition is supported, it will be compatible with the majority of training frameworks (Axolotl, Unsloth, DeepSpeed, FSDP, PyTorch-Lightning, ...), inference engines (vLLM, SGLang, TGI, ...), and adjacent modeling libraries (llama.cpp, mlx, ...) which leverage the model definition from transformers. + urls: + - https://github.com/huggingface/transformers + tags: + - text-to-text + - multimodal + capabilities: + amd: rocm-transformers + intel: intel-transformers + metal: metal-transformers + nvidia: cuda12-transformers + nvidia-cuda-12: cuda12-transformers + nvidia-cuda-13: cuda13-transformers + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-transformers mirrors: - localai/localai-backends:master-metal-darwin-arm64-transformers -## Diffusers -- !!merge <<: *diffusers - name: "diffusers-development" +- name: diffusers-development + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models capabilities: - nvidia: "cuda12-diffusers-development" - intel: "intel-diffusers-development" - amd: "rocm-diffusers-development" - nvidia-l4t: "nvidia-l4t-diffusers-development" - metal: "metal-diffusers-development" - default: "cpu-diffusers-development" - nvidia-cuda-13: "cuda13-diffusers-development" -- !!merge <<: *diffusers - name: "cpu-diffusers" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-diffusers" + amd: rocm-diffusers-development + default: cpu-diffusers-development + intel: intel-diffusers-development + metal: metal-diffusers-development + nvidia: cuda12-diffusers-development + nvidia-cuda-13: cuda13-diffusers-development + nvidia-l4t: nvidia-l4t-diffusers-development +- name: cpu-diffusers + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-diffusers mirrors: - localai/localai-backends:latest-cpu-diffusers -- !!merge <<: *diffusers - name: "cpu-diffusers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-diffusers" +- name: cpu-diffusers-development + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:master-cpu-diffusers mirrors: - localai/localai-backends:master-cpu-diffusers -- !!merge <<: *diffusers - name: "nvidia-l4t-diffusers" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-diffusers" +- name: nvidia-l4t-diffusers + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-diffusers mirrors: - localai/localai-backends:latest-nvidia-l4t-diffusers -- !!merge <<: *diffusers - name: "nvidia-l4t-diffusers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-diffusers" +- name: nvidia-l4t-diffusers-development + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-diffusers mirrors: - localai/localai-backends:master-nvidia-l4t-diffusers -- !!merge <<: *diffusers - name: "cuda13-nvidia-l4t-arm64-diffusers" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-diffusers" +- name: cuda13-nvidia-l4t-arm64-diffusers + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-diffusers mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-diffusers -- !!merge <<: *diffusers - name: "cuda13-nvidia-l4t-arm64-diffusers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-diffusers" +- name: cuda13-nvidia-l4t-arm64-diffusers-development + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-diffusers mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-diffusers -- !!merge <<: *diffusers - name: "cuda12-diffusers" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-diffusers" +- name: cuda12-diffusers + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-diffusers mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-diffusers -- !!merge <<: *diffusers - name: "rocm-diffusers" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-diffusers" +- name: rocm-diffusers + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-diffusers mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-diffusers -- !!merge <<: *diffusers - name: "intel-diffusers" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-diffusers" +- name: intel-diffusers + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-diffusers mirrors: - localai/localai-backends:latest-gpu-intel-diffusers -- !!merge <<: *diffusers - name: "cuda12-diffusers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-diffusers" +- name: cuda12-diffusers-development + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-diffusers mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-diffusers -- !!merge <<: *diffusers - name: "rocm-diffusers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-diffusers" +- name: rocm-diffusers-development + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-diffusers mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-diffusers -- !!merge <<: *diffusers - name: "intel-diffusers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-diffusers" +- name: intel-diffusers-development + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-diffusers mirrors: - localai/localai-backends:master-gpu-intel-diffusers -- !!merge <<: *diffusers - name: "cuda13-diffusers" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-diffusers" +- name: cuda13-diffusers + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-diffusers mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-diffusers -- !!merge <<: *diffusers - name: "cuda13-diffusers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-diffusers" +- name: cuda13-diffusers-development + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-diffusers mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-diffusers -- !!merge <<: *diffusers - name: "metal-diffusers" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-diffusers" +- name: metal-diffusers + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-diffusers mirrors: - localai/localai-backends:latest-metal-darwin-arm64-diffusers -- !!merge <<: *diffusers - name: "metal-diffusers-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-diffusers" +- name: metal-diffusers-development + alias: diffusers + license: apache-2.0 + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: "\U0001F917 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, \U0001F917 Diffusers is a modular toolbox that supports both.\n" + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + capabilities: + amd: rocm-diffusers + default: cpu-diffusers + intel: intel-diffusers + metal: metal-diffusers + nvidia: cuda12-diffusers + nvidia-cuda-12: cuda12-diffusers + nvidia-cuda-13: cuda13-diffusers + nvidia-l4t: nvidia-l4t-diffusers + nvidia-l4t-cuda-12: nvidia-l4t-diffusers + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-diffusers + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-diffusers mirrors: - localai/localai-backends:master-metal-darwin-arm64-diffusers -## ace-step -- !!merge <<: *ace-step - name: "cpu-ace-step" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-ace-step" +- name: cpu-ace-step + alias: ace-step + description: | + ACE-Step 1.5 is an open-source music generation model. It supports simple mode (natural language description) and advanced mode (caption, lyrics, think, bpm, keyscale, etc.). Uses in-process acestep (LLMHandler for metadata, DiT for audio). + urls: + - https://github.com/ace-step/ACE-Step-1.5 + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-ace-step + default: cpu-ace-step + intel: intel-ace-step + metal: metal-ace-step + nvidia: cuda12-ace-step + nvidia-cuda-12: cuda12-ace-step + nvidia-cuda-13: cuda13-ace-step + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-ace-step mirrors: - localai/localai-backends:latest-cpu-ace-step -- !!merge <<: *ace-step - name: "cpu-ace-step-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-ace-step" +- name: cpu-ace-step-development + alias: ace-step + description: | + ACE-Step 1.5 is an open-source music generation model. It supports simple mode (natural language description) and advanced mode (caption, lyrics, think, bpm, keyscale, etc.). Uses in-process acestep (LLMHandler for metadata, DiT for audio). + urls: + - https://github.com/ace-step/ACE-Step-1.5 + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-ace-step + default: cpu-ace-step + intel: intel-ace-step + metal: metal-ace-step + nvidia: cuda12-ace-step + nvidia-cuda-12: cuda12-ace-step + nvidia-cuda-13: cuda13-ace-step + uri: quay.io/go-skynet/local-ai-backends:master-cpu-ace-step mirrors: - localai/localai-backends:master-cpu-ace-step -- !!merge <<: *ace-step - name: "cuda12-ace-step" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-ace-step" +- name: cuda12-ace-step + alias: ace-step + description: | + ACE-Step 1.5 is an open-source music generation model. It supports simple mode (natural language description) and advanced mode (caption, lyrics, think, bpm, keyscale, etc.). Uses in-process acestep (LLMHandler for metadata, DiT for audio). + urls: + - https://github.com/ace-step/ACE-Step-1.5 + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-ace-step + default: cpu-ace-step + intel: intel-ace-step + metal: metal-ace-step + nvidia: cuda12-ace-step + nvidia-cuda-12: cuda12-ace-step + nvidia-cuda-13: cuda13-ace-step + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-ace-step mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-ace-step -- !!merge <<: *ace-step - name: "cuda12-ace-step-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-ace-step" +- name: cuda12-ace-step-development + alias: ace-step + description: | + ACE-Step 1.5 is an open-source music generation model. It supports simple mode (natural language description) and advanced mode (caption, lyrics, think, bpm, keyscale, etc.). Uses in-process acestep (LLMHandler for metadata, DiT for audio). + urls: + - https://github.com/ace-step/ACE-Step-1.5 + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-ace-step + default: cpu-ace-step + intel: intel-ace-step + metal: metal-ace-step + nvidia: cuda12-ace-step + nvidia-cuda-12: cuda12-ace-step + nvidia-cuda-13: cuda13-ace-step + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-ace-step mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-ace-step -- !!merge <<: *ace-step - name: "cuda13-ace-step" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-ace-step" +- name: cuda13-ace-step + alias: ace-step + description: | + ACE-Step 1.5 is an open-source music generation model. It supports simple mode (natural language description) and advanced mode (caption, lyrics, think, bpm, keyscale, etc.). Uses in-process acestep (LLMHandler for metadata, DiT for audio). + urls: + - https://github.com/ace-step/ACE-Step-1.5 + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-ace-step + default: cpu-ace-step + intel: intel-ace-step + metal: metal-ace-step + nvidia: cuda12-ace-step + nvidia-cuda-12: cuda12-ace-step + nvidia-cuda-13: cuda13-ace-step + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-ace-step mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-ace-step -- !!merge <<: *ace-step - name: "cuda13-ace-step-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-ace-step" +- name: cuda13-ace-step-development + alias: ace-step + description: | + ACE-Step 1.5 is an open-source music generation model. It supports simple mode (natural language description) and advanced mode (caption, lyrics, think, bpm, keyscale, etc.). Uses in-process acestep (LLMHandler for metadata, DiT for audio). + urls: + - https://github.com/ace-step/ACE-Step-1.5 + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-ace-step + default: cpu-ace-step + intel: intel-ace-step + metal: metal-ace-step + nvidia: cuda12-ace-step + nvidia-cuda-12: cuda12-ace-step + nvidia-cuda-13: cuda13-ace-step + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-ace-step mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-ace-step -- !!merge <<: *ace-step - name: "rocm-ace-step" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-ace-step" +- name: rocm-ace-step + alias: ace-step + description: | + ACE-Step 1.5 is an open-source music generation model. It supports simple mode (natural language description) and advanced mode (caption, lyrics, think, bpm, keyscale, etc.). Uses in-process acestep (LLMHandler for metadata, DiT for audio). + urls: + - https://github.com/ace-step/ACE-Step-1.5 + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-ace-step + default: cpu-ace-step + intel: intel-ace-step + metal: metal-ace-step + nvidia: cuda12-ace-step + nvidia-cuda-12: cuda12-ace-step + nvidia-cuda-13: cuda13-ace-step + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-ace-step mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-ace-step -- !!merge <<: *ace-step - name: "rocm-ace-step-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-ace-step" +- name: rocm-ace-step-development + alias: ace-step + description: | + ACE-Step 1.5 is an open-source music generation model. It supports simple mode (natural language description) and advanced mode (caption, lyrics, think, bpm, keyscale, etc.). Uses in-process acestep (LLMHandler for metadata, DiT for audio). + urls: + - https://github.com/ace-step/ACE-Step-1.5 + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-ace-step + default: cpu-ace-step + intel: intel-ace-step + metal: metal-ace-step + nvidia: cuda12-ace-step + nvidia-cuda-12: cuda12-ace-step + nvidia-cuda-13: cuda13-ace-step + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-ace-step mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-ace-step -- !!merge <<: *ace-step - name: "intel-ace-step" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-ace-step" +- name: intel-ace-step + alias: ace-step + description: | + ACE-Step 1.5 is an open-source music generation model. It supports simple mode (natural language description) and advanced mode (caption, lyrics, think, bpm, keyscale, etc.). Uses in-process acestep (LLMHandler for metadata, DiT for audio). + urls: + - https://github.com/ace-step/ACE-Step-1.5 + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-ace-step + default: cpu-ace-step + intel: intel-ace-step + metal: metal-ace-step + nvidia: cuda12-ace-step + nvidia-cuda-12: cuda12-ace-step + nvidia-cuda-13: cuda13-ace-step + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-ace-step mirrors: - localai/localai-backends:latest-gpu-intel-ace-step -- !!merge <<: *ace-step - name: "intel-ace-step-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-ace-step" +- name: intel-ace-step-development + alias: ace-step + description: | + ACE-Step 1.5 is an open-source music generation model. It supports simple mode (natural language description) and advanced mode (caption, lyrics, think, bpm, keyscale, etc.). Uses in-process acestep (LLMHandler for metadata, DiT for audio). + urls: + - https://github.com/ace-step/ACE-Step-1.5 + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-ace-step + default: cpu-ace-step + intel: intel-ace-step + metal: metal-ace-step + nvidia: cuda12-ace-step + nvidia-cuda-12: cuda12-ace-step + nvidia-cuda-13: cuda13-ace-step + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-ace-step mirrors: - localai/localai-backends:master-gpu-intel-ace-step -- !!merge <<: *ace-step - name: "metal-ace-step" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-ace-step" +- name: metal-ace-step + alias: ace-step + description: | + ACE-Step 1.5 is an open-source music generation model. It supports simple mode (natural language description) and advanced mode (caption, lyrics, think, bpm, keyscale, etc.). Uses in-process acestep (LLMHandler for metadata, DiT for audio). + urls: + - https://github.com/ace-step/ACE-Step-1.5 + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-ace-step + default: cpu-ace-step + intel: intel-ace-step + metal: metal-ace-step + nvidia: cuda12-ace-step + nvidia-cuda-12: cuda12-ace-step + nvidia-cuda-13: cuda13-ace-step + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-ace-step mirrors: - localai/localai-backends:latest-metal-darwin-arm64-ace-step -- !!merge <<: *ace-step - name: "metal-ace-step-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-ace-step" +- name: metal-ace-step-development + alias: ace-step + description: | + ACE-Step 1.5 is an open-source music generation model. It supports simple mode (natural language description) and advanced mode (caption, lyrics, think, bpm, keyscale, etc.). Uses in-process acestep (LLMHandler for metadata, DiT for audio). + urls: + - https://github.com/ace-step/ACE-Step-1.5 + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-ace-step + default: cpu-ace-step + intel: intel-ace-step + metal: metal-ace-step + nvidia: cuda12-ace-step + nvidia-cuda-12: cuda12-ace-step + nvidia-cuda-13: cuda13-ace-step + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-ace-step mirrors: - localai/localai-backends:master-metal-darwin-arm64-ace-step -## acestep-cpp -- !!merge <<: *acestepcpp - name: "nvidia-l4t-arm64-acestep-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-acestep-cpp" +- name: nvidia-l4t-arm64-acestep-cpp + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-acestep-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-acestep-cpp -- !!merge <<: *acestepcpp - name: "nvidia-l4t-arm64-acestep-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-acestep-cpp" +- name: nvidia-l4t-arm64-acestep-cpp-development + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-acestep-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-acestep-cpp -- !!merge <<: *acestepcpp - name: "cuda13-nvidia-l4t-arm64-acestep-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-acestep-cpp" +- name: cuda13-nvidia-l4t-arm64-acestep-cpp + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-acestep-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-acestep-cpp -- !!merge <<: *acestepcpp - name: "cuda13-nvidia-l4t-arm64-acestep-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-acestep-cpp" +- name: cuda13-nvidia-l4t-arm64-acestep-cpp-development + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-acestep-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-acestep-cpp -- !!merge <<: *acestepcpp - name: "cpu-acestep-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-acestep-cpp" +- name: cpu-acestep-cpp + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-acestep-cpp mirrors: - localai/localai-backends:latest-cpu-acestep-cpp -- !!merge <<: *acestepcpp - name: "metal-acestep-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-acestep-cpp" +- name: metal-acestep-cpp + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-acestep-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-acestep-cpp -- !!merge <<: *acestepcpp - name: "metal-acestep-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-acestep-cpp" +- name: metal-acestep-cpp-development + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-acestep-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-acestep-cpp -- !!merge <<: *acestepcpp - name: "cpu-acestep-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-acestep-cpp" +- name: cpu-acestep-cpp-development + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-acestep-cpp mirrors: - localai/localai-backends:master-cpu-acestep-cpp -- !!merge <<: *acestepcpp - name: "cuda12-acestep-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-acestep-cpp" +- name: cuda12-acestep-cpp + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-acestep-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-acestep-cpp -- !!merge <<: *acestepcpp - name: "rocm-acestep-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-acestep-cpp" +- name: rocm-acestep-cpp + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-acestep-cpp mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-acestep-cpp -- !!merge <<: *acestepcpp - name: "intel-sycl-f32-acestep-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-acestep-cpp" +- name: intel-sycl-f32-acestep-cpp + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-acestep-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-acestep-cpp -- !!merge <<: *acestepcpp - name: "intel-sycl-f16-acestep-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-acestep-cpp" +- name: intel-sycl-f16-acestep-cpp + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-acestep-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-acestep-cpp -- !!merge <<: *acestepcpp - name: "vulkan-acestep-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-acestep-cpp" +- name: vulkan-acestep-cpp + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-acestep-cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-acestep-cpp -- !!merge <<: *acestepcpp - name: "vulkan-acestep-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-acestep-cpp" +- name: vulkan-acestep-cpp-development + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-acestep-cpp mirrors: - localai/localai-backends:master-gpu-vulkan-acestep-cpp -- !!merge <<: *acestepcpp - name: "cuda12-acestep-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-acestep-cpp" +- name: cuda12-acestep-cpp-development + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-acestep-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-acestep-cpp -- !!merge <<: *acestepcpp - name: "rocm-acestep-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-acestep-cpp" +- name: rocm-acestep-cpp-development + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-acestep-cpp mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-acestep-cpp -- !!merge <<: *acestepcpp - name: "intel-sycl-f32-acestep-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-acestep-cpp" +- name: intel-sycl-f32-acestep-cpp-development + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-acestep-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-acestep-cpp -- !!merge <<: *acestepcpp - name: "intel-sycl-f16-acestep-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-acestep-cpp" +- name: intel-sycl-f16-acestep-cpp-development + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-acestep-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-acestep-cpp -- !!merge <<: *acestepcpp - name: "cuda13-acestep-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-acestep-cpp" +- name: cuda13-acestep-cpp + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-acestep-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-acestep-cpp -- !!merge <<: *acestepcpp - name: "cuda13-acestep-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-acestep-cpp" +- name: cuda13-acestep-cpp-development + alias: acestep-cpp + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + capabilities: + amd: rocm-acestep-cpp + default: cpu-acestep-cpp + intel: intel-sycl-f16-acestep-cpp + metal: metal-acestep-cpp + nvidia: cuda12-acestep-cpp + nvidia-cuda-12: cuda12-acestep-cpp + nvidia-cuda-13: cuda13-acestep-cpp + nvidia-l4t: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-acestep-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-acestep-cpp + vulkan: vulkan-acestep-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-acestep-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-acestep-cpp -## qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "nvidia-l4t-arm64-qwen3-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-qwen3-tts-cpp" +- name: nvidia-l4t-arm64-qwen3-tts-cpp + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-qwen3-tts-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "nvidia-l4t-arm64-qwen3-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-qwen3-tts-cpp" +- name: nvidia-l4t-arm64-qwen3-tts-cpp-development + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-qwen3-tts-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "cuda13-nvidia-l4t-arm64-qwen3-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-qwen3-tts-cpp" +- name: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-qwen3-tts-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "cuda13-nvidia-l4t-arm64-qwen3-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-qwen3-tts-cpp" +- name: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp-development + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-qwen3-tts-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "cpu-qwen3-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-qwen3-tts-cpp" +- name: cpu-qwen3-tts-cpp + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-qwen3-tts-cpp mirrors: - localai/localai-backends:latest-cpu-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "metal-qwen3-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-qwen3-tts-cpp" +- name: metal-qwen3-tts-cpp + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-qwen3-tts-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "metal-qwen3-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-qwen3-tts-cpp" +- name: metal-qwen3-tts-cpp-development + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-qwen3-tts-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "cpu-qwen3-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-qwen3-tts-cpp" +- name: cpu-qwen3-tts-cpp-development + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-qwen3-tts-cpp mirrors: - localai/localai-backends:master-cpu-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "cuda12-qwen3-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-qwen3-tts-cpp" +- name: cuda12-qwen3-tts-cpp + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-qwen3-tts-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "rocm-qwen3-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-qwen3-tts-cpp" +- name: rocm-qwen3-tts-cpp + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-qwen3-tts-cpp mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "intel-sycl-f32-qwen3-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-qwen3-tts-cpp" +- name: intel-sycl-f32-qwen3-tts-cpp + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-qwen3-tts-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "intel-sycl-f16-qwen3-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-qwen3-tts-cpp" +- name: intel-sycl-f16-qwen3-tts-cpp + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-qwen3-tts-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "vulkan-qwen3-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-qwen3-tts-cpp" +- name: vulkan-qwen3-tts-cpp + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-qwen3-tts-cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "vulkan-qwen3-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-qwen3-tts-cpp" +- name: vulkan-qwen3-tts-cpp-development + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-qwen3-tts-cpp mirrors: - localai/localai-backends:master-gpu-vulkan-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "cuda12-qwen3-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-qwen3-tts-cpp" +- name: cuda12-qwen3-tts-cpp-development + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-qwen3-tts-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "rocm-qwen3-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-qwen3-tts-cpp" +- name: rocm-qwen3-tts-cpp-development + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-qwen3-tts-cpp mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "intel-sycl-f32-qwen3-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-qwen3-tts-cpp" +- name: intel-sycl-f32-qwen3-tts-cpp-development + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-qwen3-tts-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "intel-sycl-f16-qwen3-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-qwen3-tts-cpp" +- name: intel-sycl-f16-qwen3-tts-cpp-development + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-qwen3-tts-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "cuda13-qwen3-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-qwen3-tts-cpp" +- name: cuda13-qwen3-tts-cpp + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-qwen3-tts-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-qwen3-tts-cpp -- !!merge <<: *qwen3ttscpp - name: "cuda13-qwen3-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-qwen3-tts-cpp" +- name: cuda13-qwen3-tts-cpp-development + alias: qwen3-tts-cpp + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + capabilities: + amd: rocm-qwen3-tts-cpp + default: cpu-qwen3-tts-cpp + intel: intel-sycl-f16-qwen3-tts-cpp + metal: metal-qwen3-tts-cpp + nvidia: cuda12-qwen3-tts-cpp + nvidia-cuda-12: cuda12-qwen3-tts-cpp + nvidia-cuda-13: cuda13-qwen3-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-qwen3-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen3-tts-cpp + vulkan: vulkan-qwen3-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-qwen3-tts-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-qwen3-tts-cpp -## moss-tts-cpp -- !!merge <<: *mossttscpp - name: "nvidia-l4t-arm64-moss-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-moss-tts-cpp" +- name: nvidia-l4t-arm64-moss-tts-cpp + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-moss-tts-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "nvidia-l4t-arm64-moss-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-moss-tts-cpp" +- name: nvidia-l4t-arm64-moss-tts-cpp-development + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-moss-tts-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "cuda13-nvidia-l4t-arm64-moss-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-moss-tts-cpp" +- name: cuda13-nvidia-l4t-arm64-moss-tts-cpp + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-moss-tts-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "cuda13-nvidia-l4t-arm64-moss-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-moss-tts-cpp" +- name: cuda13-nvidia-l4t-arm64-moss-tts-cpp-development + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-moss-tts-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "cpu-moss-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-moss-tts-cpp" +- name: cpu-moss-tts-cpp + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-moss-tts-cpp mirrors: - localai/localai-backends:latest-cpu-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "metal-moss-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-moss-tts-cpp" +- name: metal-moss-tts-cpp + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-moss-tts-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "metal-moss-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-moss-tts-cpp" +- name: metal-moss-tts-cpp-development + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-moss-tts-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "cpu-moss-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-moss-tts-cpp" +- name: cpu-moss-tts-cpp-development + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-moss-tts-cpp mirrors: - localai/localai-backends:master-cpu-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "cuda12-moss-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-moss-tts-cpp" +- name: cuda12-moss-tts-cpp + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-moss-tts-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "rocm-moss-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-moss-tts-cpp" +- name: rocm-moss-tts-cpp + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-moss-tts-cpp mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "intel-sycl-f32-moss-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-moss-tts-cpp" +- name: intel-sycl-f32-moss-tts-cpp + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-moss-tts-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "intel-sycl-f16-moss-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-moss-tts-cpp" +- name: intel-sycl-f16-moss-tts-cpp + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-moss-tts-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "vulkan-moss-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-moss-tts-cpp" +- name: vulkan-moss-tts-cpp + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-moss-tts-cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "vulkan-moss-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-moss-tts-cpp" +- name: vulkan-moss-tts-cpp-development + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-moss-tts-cpp mirrors: - localai/localai-backends:master-gpu-vulkan-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "cuda12-moss-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-moss-tts-cpp" +- name: cuda12-moss-tts-cpp-development + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-moss-tts-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "rocm-moss-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-moss-tts-cpp" +- name: rocm-moss-tts-cpp-development + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-moss-tts-cpp mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "intel-sycl-f32-moss-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-moss-tts-cpp" +- name: intel-sycl-f32-moss-tts-cpp-development + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-moss-tts-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "intel-sycl-f16-moss-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-moss-tts-cpp" +- name: intel-sycl-f16-moss-tts-cpp-development + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-moss-tts-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "cuda13-moss-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-moss-tts-cpp" +- name: cuda13-moss-tts-cpp + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-moss-tts-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-moss-tts-cpp -- !!merge <<: *mossttscpp - name: "cuda13-moss-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-moss-tts-cpp" +- name: cuda13-moss-tts-cpp-development + alias: moss-tts-cpp + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + capabilities: + amd: rocm-moss-tts-cpp + default: cpu-moss-tts-cpp + intel: intel-sycl-f16-moss-tts-cpp + metal: metal-moss-tts-cpp + nvidia: cuda12-moss-tts-cpp + nvidia-cuda-12: cuda12-moss-tts-cpp + nvidia-cuda-13: cuda13-moss-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-moss-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-moss-tts-cpp + vulkan: vulkan-moss-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-moss-tts-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-moss-tts-cpp -## magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "nvidia-l4t-arm64-magpie-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-magpie-tts-cpp" +- name: nvidia-l4t-arm64-magpie-tts-cpp + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-magpie-tts-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "nvidia-l4t-arm64-magpie-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-magpie-tts-cpp" +- name: nvidia-l4t-arm64-magpie-tts-cpp-development + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-magpie-tts-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "cuda13-nvidia-l4t-arm64-magpie-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-magpie-tts-cpp" +- name: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-magpie-tts-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "cuda13-nvidia-l4t-arm64-magpie-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-magpie-tts-cpp" +- name: cuda13-nvidia-l4t-arm64-magpie-tts-cpp-development + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-magpie-tts-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "cpu-magpie-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-magpie-tts-cpp" +- name: cpu-magpie-tts-cpp + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-magpie-tts-cpp mirrors: - localai/localai-backends:latest-cpu-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "metal-magpie-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-magpie-tts-cpp" +- name: metal-magpie-tts-cpp + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-magpie-tts-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "metal-magpie-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-magpie-tts-cpp" +- name: metal-magpie-tts-cpp-development + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-magpie-tts-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "cpu-magpie-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-magpie-tts-cpp" +- name: cpu-magpie-tts-cpp-development + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-magpie-tts-cpp mirrors: - localai/localai-backends:master-cpu-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "cuda12-magpie-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-magpie-tts-cpp" +- name: cuda12-magpie-tts-cpp + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-magpie-tts-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "rocm-magpie-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-magpie-tts-cpp" +- name: rocm-magpie-tts-cpp + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-magpie-tts-cpp mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "intel-sycl-f32-magpie-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-magpie-tts-cpp" +- name: intel-sycl-f32-magpie-tts-cpp + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-magpie-tts-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "intel-sycl-f16-magpie-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-magpie-tts-cpp" +- name: intel-sycl-f16-magpie-tts-cpp + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-magpie-tts-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "vulkan-magpie-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-magpie-tts-cpp" +- name: vulkan-magpie-tts-cpp + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-magpie-tts-cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "vulkan-magpie-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-magpie-tts-cpp" +- name: vulkan-magpie-tts-cpp-development + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-magpie-tts-cpp mirrors: - localai/localai-backends:master-gpu-vulkan-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "cuda12-magpie-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-magpie-tts-cpp" +- name: cuda12-magpie-tts-cpp-development + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-magpie-tts-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "rocm-magpie-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-magpie-tts-cpp" +- name: rocm-magpie-tts-cpp-development + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-magpie-tts-cpp mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "intel-sycl-f32-magpie-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-magpie-tts-cpp" +- name: intel-sycl-f32-magpie-tts-cpp-development + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-magpie-tts-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "intel-sycl-f16-magpie-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-magpie-tts-cpp" +- name: intel-sycl-f16-magpie-tts-cpp-development + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-magpie-tts-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "cuda13-magpie-tts-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-magpie-tts-cpp" +- name: cuda13-magpie-tts-cpp + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-magpie-tts-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-magpie-tts-cpp -- !!merge <<: *magpiettscpp - name: "cuda13-magpie-tts-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-magpie-tts-cpp" +- name: cuda13-magpie-tts-cpp-development + alias: magpie-tts-cpp + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + capabilities: + amd: rocm-magpie-tts-cpp + default: cpu-magpie-tts-cpp + intel: intel-sycl-f16-magpie-tts-cpp + metal: metal-magpie-tts-cpp + nvidia: cuda12-magpie-tts-cpp + nvidia-cuda-12: cuda12-magpie-tts-cpp + nvidia-cuda-13: cuda13-magpie-tts-cpp + nvidia-l4t: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-magpie-tts-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-magpie-tts-cpp + vulkan: vulkan-magpie-tts-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-magpie-tts-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-magpie-tts-cpp -## omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "omnivoice-cpp-development" +- name: omnivoice-cpp-development + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design capabilities: - default: "cpu-omnivoice-cpp-development" - nvidia: "cuda12-omnivoice-cpp-development" - nvidia-cuda-13: "cuda13-omnivoice-cpp-development" - nvidia-cuda-12: "cuda12-omnivoice-cpp-development" - intel: "intel-sycl-f16-omnivoice-cpp-development" - metal: "metal-omnivoice-cpp-development" - amd: "rocm-omnivoice-cpp-development" - vulkan: "vulkan-omnivoice-cpp-development" - nvidia-l4t: "nvidia-l4t-arm64-omnivoice-cpp-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-omnivoice-cpp-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-omnivoice-cpp-development" -- !!merge <<: *omnivoicecpp - name: "nvidia-l4t-arm64-omnivoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-omnivoice-cpp" + amd: rocm-omnivoice-cpp-development + default: cpu-omnivoice-cpp-development + intel: intel-sycl-f16-omnivoice-cpp-development + metal: metal-omnivoice-cpp-development + nvidia: cuda12-omnivoice-cpp-development + nvidia-cuda-12: cuda12-omnivoice-cpp-development + nvidia-cuda-13: cuda13-omnivoice-cpp-development + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp-development + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp-development + vulkan: vulkan-omnivoice-cpp-development +- name: nvidia-l4t-arm64-omnivoice-cpp + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-omnivoice-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "nvidia-l4t-arm64-omnivoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-omnivoice-cpp" +- name: nvidia-l4t-arm64-omnivoice-cpp-development + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-omnivoice-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "cuda13-nvidia-l4t-arm64-omnivoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-omnivoice-cpp" +- name: cuda13-nvidia-l4t-arm64-omnivoice-cpp + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-omnivoice-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "cuda13-nvidia-l4t-arm64-omnivoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-omnivoice-cpp" +- name: cuda13-nvidia-l4t-arm64-omnivoice-cpp-development + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-omnivoice-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "cpu-omnivoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-omnivoice-cpp" +- name: cpu-omnivoice-cpp + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-omnivoice-cpp mirrors: - localai/localai-backends:latest-cpu-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "metal-omnivoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-omnivoice-cpp" +- name: metal-omnivoice-cpp + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-omnivoice-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "metal-omnivoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-omnivoice-cpp" +- name: metal-omnivoice-cpp-development + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-omnivoice-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "cpu-omnivoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-omnivoice-cpp" +- name: cpu-omnivoice-cpp-development + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-omnivoice-cpp mirrors: - localai/localai-backends:master-cpu-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "cuda12-omnivoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-omnivoice-cpp" +- name: cuda12-omnivoice-cpp + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-omnivoice-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "rocm-omnivoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-omnivoice-cpp" +- name: rocm-omnivoice-cpp + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-omnivoice-cpp mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "intel-sycl-f32-omnivoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-omnivoice-cpp" +- name: intel-sycl-f32-omnivoice-cpp + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-omnivoice-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "intel-sycl-f16-omnivoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-omnivoice-cpp" +- name: intel-sycl-f16-omnivoice-cpp + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-omnivoice-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "vulkan-omnivoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-omnivoice-cpp" +- name: vulkan-omnivoice-cpp + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-omnivoice-cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "vulkan-omnivoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-omnivoice-cpp" +- name: vulkan-omnivoice-cpp-development + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-omnivoice-cpp mirrors: - localai/localai-backends:master-gpu-vulkan-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "cuda12-omnivoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-omnivoice-cpp" +- name: cuda12-omnivoice-cpp-development + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-omnivoice-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "rocm-omnivoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-omnivoice-cpp" +- name: rocm-omnivoice-cpp-development + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-omnivoice-cpp mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "intel-sycl-f32-omnivoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-omnivoice-cpp" +- name: intel-sycl-f32-omnivoice-cpp-development + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-omnivoice-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "intel-sycl-f16-omnivoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-omnivoice-cpp" +- name: intel-sycl-f16-omnivoice-cpp-development + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-omnivoice-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "cuda13-omnivoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-omnivoice-cpp" +- name: cuda13-omnivoice-cpp + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-omnivoice-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-omnivoice-cpp -- !!merge <<: *omnivoicecpp - name: "cuda13-omnivoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-omnivoice-cpp" +- name: cuda13-omnivoice-cpp-development + alias: omnivoice-cpp + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + capabilities: + amd: rocm-omnivoice-cpp + default: cpu-omnivoice-cpp + intel: intel-sycl-f16-omnivoice-cpp + metal: metal-omnivoice-cpp + nvidia: cuda12-omnivoice-cpp + nvidia-cuda-12: cuda12-omnivoice-cpp + nvidia-cuda-13: cuda13-omnivoice-cpp + nvidia-l4t: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-omnivoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-omnivoice-cpp + vulkan: vulkan-omnivoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-omnivoice-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-omnivoice-cpp -## vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "nvidia-l4t-arm64-vibevoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-vibevoice-cpp" +- name: nvidia-l4t-arm64-vibevoice-cpp + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-vibevoice-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "nvidia-l4t-arm64-vibevoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-vibevoice-cpp" +- name: nvidia-l4t-arm64-vibevoice-cpp-development + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-vibevoice-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "cuda13-nvidia-l4t-arm64-vibevoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-vibevoice-cpp" +- name: cuda13-nvidia-l4t-arm64-vibevoice-cpp + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-vibevoice-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "cuda13-nvidia-l4t-arm64-vibevoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-vibevoice-cpp" +- name: cuda13-nvidia-l4t-arm64-vibevoice-cpp-development + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-vibevoice-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "cpu-vibevoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-vibevoice-cpp" +- name: cpu-vibevoice-cpp + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-vibevoice-cpp mirrors: - localai/localai-backends:latest-cpu-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "metal-vibevoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-vibevoice-cpp" +- name: metal-vibevoice-cpp + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-vibevoice-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "metal-vibevoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-vibevoice-cpp" +- name: metal-vibevoice-cpp-development + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-vibevoice-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "cpu-vibevoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-vibevoice-cpp" +- name: cpu-vibevoice-cpp-development + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-vibevoice-cpp mirrors: - localai/localai-backends:master-cpu-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "cuda12-vibevoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-vibevoice-cpp" +- name: cuda12-vibevoice-cpp + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-vibevoice-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "rocm-vibevoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-vibevoice-cpp" +- name: rocm-vibevoice-cpp + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-vibevoice-cpp mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "intel-sycl-f32-vibevoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-vibevoice-cpp" +- name: intel-sycl-f32-vibevoice-cpp + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-vibevoice-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f32-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "intel-sycl-f16-vibevoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-vibevoice-cpp" +- name: intel-sycl-f16-vibevoice-cpp + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-vibevoice-cpp mirrors: - localai/localai-backends:latest-gpu-intel-sycl-f16-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "vulkan-vibevoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-vibevoice-cpp" +- name: vulkan-vibevoice-cpp + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-vibevoice-cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "vulkan-vibevoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-vibevoice-cpp" +- name: vulkan-vibevoice-cpp-development + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-vibevoice-cpp mirrors: - localai/localai-backends:master-gpu-vulkan-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "cuda12-vibevoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-vibevoice-cpp" +- name: cuda12-vibevoice-cpp-development + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-vibevoice-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "rocm-vibevoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-vibevoice-cpp" +- name: rocm-vibevoice-cpp-development + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-vibevoice-cpp mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "intel-sycl-f32-vibevoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-vibevoice-cpp" +- name: intel-sycl-f32-vibevoice-cpp-development + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-vibevoice-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f32-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "intel-sycl-f16-vibevoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-vibevoice-cpp" +- name: intel-sycl-f16-vibevoice-cpp-development + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-vibevoice-cpp mirrors: - localai/localai-backends:master-gpu-intel-sycl-f16-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "cuda13-vibevoice-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-vibevoice-cpp" +- name: cuda13-vibevoice-cpp + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-vibevoice-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-vibevoice-cpp -- !!merge <<: *vibevoicecpp - name: "cuda13-vibevoice-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-vibevoice-cpp" +- name: cuda13-vibevoice-cpp-development + alias: vibevoice-cpp + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + capabilities: + amd: rocm-vibevoice-cpp + default: cpu-vibevoice-cpp + intel: intel-sycl-f16-vibevoice-cpp + metal: metal-vibevoice-cpp + nvidia: cuda12-vibevoice-cpp + nvidia-cuda-12: cuda12-vibevoice-cpp + nvidia-cuda-13: cuda13-vibevoice-cpp + nvidia-l4t: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-vibevoice-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-cpp + vulkan: vulkan-vibevoice-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-vibevoice-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-vibevoice-cpp -## localvqe -- !!merge <<: *localvqecpp - name: "cpu-localvqe" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-localvqe" +- name: cpu-localvqe + alias: localvqe + license: apache2 + description: | + LocalVQE C++ backend using GGML — joint acoustic echo cancellation, noise + suppression, and dereverberation (DeepVQE-style architecture). 16 kHz mono + in / out, supports both batch and low-latency streaming. Implements the + audio-transform capability. + urls: + - https://github.com/localai-org/LocalVQE + tags: + - audio-transform + - aec + - acoustic-echo-cancellation + - noise-suppression + - dereverberation + capabilities: + amd: vulkan-localvqe + default: cpu-localvqe + intel: vulkan-localvqe + metal: metal-localvqe + nvidia: vulkan-localvqe + nvidia-cuda-12: vulkan-localvqe + nvidia-cuda-13: vulkan-localvqe + nvidia-l4t: vulkan-localvqe + nvidia-l4t-cuda-12: vulkan-localvqe + nvidia-l4t-cuda-13: vulkan-localvqe + vulkan: vulkan-localvqe + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-localvqe mirrors: - localai/localai-backends:latest-cpu-localvqe -- !!merge <<: *localvqecpp - name: "cpu-localvqe-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-localvqe" +- name: cpu-localvqe-development + alias: localvqe + license: apache2 + description: | + LocalVQE C++ backend using GGML — joint acoustic echo cancellation, noise + suppression, and dereverberation (DeepVQE-style architecture). 16 kHz mono + in / out, supports both batch and low-latency streaming. Implements the + audio-transform capability. + urls: + - https://github.com/localai-org/LocalVQE + tags: + - audio-transform + - aec + - acoustic-echo-cancellation + - noise-suppression + - dereverberation + capabilities: + amd: vulkan-localvqe + default: cpu-localvqe + intel: vulkan-localvqe + metal: metal-localvqe + nvidia: vulkan-localvqe + nvidia-cuda-12: vulkan-localvqe + nvidia-cuda-13: vulkan-localvqe + nvidia-l4t: vulkan-localvqe + nvidia-l4t-cuda-12: vulkan-localvqe + nvidia-l4t-cuda-13: vulkan-localvqe + vulkan: vulkan-localvqe + uri: quay.io/go-skynet/local-ai-backends:master-cpu-localvqe mirrors: - localai/localai-backends:master-cpu-localvqe -- !!merge <<: *localvqecpp - name: "vulkan-localvqe" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-localvqe" +- name: vulkan-localvqe + alias: localvqe + license: apache2 + description: | + LocalVQE C++ backend using GGML — joint acoustic echo cancellation, noise + suppression, and dereverberation (DeepVQE-style architecture). 16 kHz mono + in / out, supports both batch and low-latency streaming. Implements the + audio-transform capability. + urls: + - https://github.com/localai-org/LocalVQE + tags: + - audio-transform + - aec + - acoustic-echo-cancellation + - noise-suppression + - dereverberation + capabilities: + amd: vulkan-localvqe + default: cpu-localvqe + intel: vulkan-localvqe + metal: metal-localvqe + nvidia: vulkan-localvqe + nvidia-cuda-12: vulkan-localvqe + nvidia-cuda-13: vulkan-localvqe + nvidia-l4t: vulkan-localvqe + nvidia-l4t-cuda-12: vulkan-localvqe + nvidia-l4t-cuda-13: vulkan-localvqe + vulkan: vulkan-localvqe + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-localvqe mirrors: - localai/localai-backends:latest-gpu-vulkan-localvqe -- !!merge <<: *localvqecpp - name: "vulkan-localvqe-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-localvqe" +- name: vulkan-localvqe-development + alias: localvqe + license: apache2 + description: | + LocalVQE C++ backend using GGML — joint acoustic echo cancellation, noise + suppression, and dereverberation (DeepVQE-style architecture). 16 kHz mono + in / out, supports both batch and low-latency streaming. Implements the + audio-transform capability. + urls: + - https://github.com/localai-org/LocalVQE + tags: + - audio-transform + - aec + - acoustic-echo-cancellation + - noise-suppression + - dereverberation + capabilities: + amd: vulkan-localvqe + default: cpu-localvqe + intel: vulkan-localvqe + metal: metal-localvqe + nvidia: vulkan-localvqe + nvidia-cuda-12: vulkan-localvqe + nvidia-cuda-13: vulkan-localvqe + nvidia-l4t: vulkan-localvqe + nvidia-l4t-cuda-12: vulkan-localvqe + nvidia-l4t-cuda-13: vulkan-localvqe + vulkan: vulkan-localvqe + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-localvqe mirrors: - localai/localai-backends:master-gpu-vulkan-localvqe -- !!merge <<: *localvqecpp - name: "metal-localvqe" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-localvqe" +- name: metal-localvqe + alias: localvqe + license: apache2 + description: | + LocalVQE C++ backend using GGML — joint acoustic echo cancellation, noise + suppression, and dereverberation (DeepVQE-style architecture). 16 kHz mono + in / out, supports both batch and low-latency streaming. Implements the + audio-transform capability. + urls: + - https://github.com/localai-org/LocalVQE + tags: + - audio-transform + - aec + - acoustic-echo-cancellation + - noise-suppression + - dereverberation + capabilities: + amd: vulkan-localvqe + default: cpu-localvqe + intel: vulkan-localvqe + metal: metal-localvqe + nvidia: vulkan-localvqe + nvidia-cuda-12: vulkan-localvqe + nvidia-cuda-13: vulkan-localvqe + nvidia-l4t: vulkan-localvqe + nvidia-l4t-cuda-12: vulkan-localvqe + nvidia-l4t-cuda-13: vulkan-localvqe + vulkan: vulkan-localvqe + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-localvqe mirrors: - localai/localai-backends:latest-metal-darwin-arm64-localvqe -- !!merge <<: *localvqecpp - name: "metal-localvqe-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-localvqe" +- name: metal-localvqe-development + alias: localvqe + license: apache2 + description: | + LocalVQE C++ backend using GGML — joint acoustic echo cancellation, noise + suppression, and dereverberation (DeepVQE-style architecture). 16 kHz mono + in / out, supports both batch and low-latency streaming. Implements the + audio-transform capability. + urls: + - https://github.com/localai-org/LocalVQE + tags: + - audio-transform + - aec + - acoustic-echo-cancellation + - noise-suppression + - dereverberation + capabilities: + amd: vulkan-localvqe + default: cpu-localvqe + intel: vulkan-localvqe + metal: metal-localvqe + nvidia: vulkan-localvqe + nvidia-cuda-12: vulkan-localvqe + nvidia-cuda-13: vulkan-localvqe + nvidia-l4t: vulkan-localvqe + nvidia-l4t-cuda-12: vulkan-localvqe + nvidia-l4t-cuda-13: vulkan-localvqe + vulkan: vulkan-localvqe + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-localvqe mirrors: - localai/localai-backends:master-metal-darwin-arm64-localvqe -## kokoro -- !!merge <<: *kokoro - name: "kokoro-development" +- name: kokoro-development + alias: kokoro + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM capabilities: - default: "cpu-kokoro-development" - nvidia: "cuda12-kokoro-development" - intel: "intel-kokoro-development" - amd: "rocm-kokoro-development" - nvidia-l4t: "nvidia-l4t-kokoro-development" - metal: "metal-kokoro-development" -- !!merge <<: *kokoro - name: "cpu-kokoro" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-kokoro" + amd: rocm-kokoro-development + default: cpu-kokoro-development + intel: intel-kokoro-development + metal: metal-kokoro-development + nvidia: cuda12-kokoro-development + nvidia-l4t: nvidia-l4t-kokoro-development +- name: cpu-kokoro + alias: kokoro + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM + capabilities: + amd: rocm-kokoro + default: cpu-kokoro + intel: intel-kokoro + metal: metal-kokoro + nvidia: cuda12-kokoro + nvidia-cuda-12: cuda12-kokoro + nvidia-cuda-13: cuda13-kokoro + nvidia-l4t: nvidia-l4t-kokoro + nvidia-l4t-cuda-12: nvidia-l4t-kokoro + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-kokoro mirrors: - localai/localai-backends:latest-cpu-kokoro -- !!merge <<: *kokoro - name: "cpu-kokoro-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-kokoro" +- name: cpu-kokoro-development + alias: kokoro + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM + capabilities: + amd: rocm-kokoro + default: cpu-kokoro + intel: intel-kokoro + metal: metal-kokoro + nvidia: cuda12-kokoro + nvidia-cuda-12: cuda12-kokoro + nvidia-cuda-13: cuda13-kokoro + nvidia-l4t: nvidia-l4t-kokoro + nvidia-l4t-cuda-12: nvidia-l4t-kokoro + uri: quay.io/go-skynet/local-ai-backends:master-cpu-kokoro mirrors: - localai/localai-backends:master-cpu-kokoro -- !!merge <<: *kokoro - name: "cuda12-kokoro-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-kokoro" +- name: cuda12-kokoro-development + alias: kokoro + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM + capabilities: + amd: rocm-kokoro + default: cpu-kokoro + intel: intel-kokoro + metal: metal-kokoro + nvidia: cuda12-kokoro + nvidia-cuda-12: cuda12-kokoro + nvidia-cuda-13: cuda13-kokoro + nvidia-l4t: nvidia-l4t-kokoro + nvidia-l4t-cuda-12: nvidia-l4t-kokoro + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-kokoro mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-kokoro -- !!merge <<: *kokoro - name: "rocm-kokoro-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-kokoro" +- name: rocm-kokoro-development + alias: kokoro + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM + capabilities: + amd: rocm-kokoro + default: cpu-kokoro + intel: intel-kokoro + metal: metal-kokoro + nvidia: cuda12-kokoro + nvidia-cuda-12: cuda12-kokoro + nvidia-cuda-13: cuda13-kokoro + nvidia-l4t: nvidia-l4t-kokoro + nvidia-l4t-cuda-12: nvidia-l4t-kokoro + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-kokoro mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-kokoro -- !!merge <<: *kokoro - name: "intel-kokoro" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-kokoro" +- name: intel-kokoro + alias: kokoro + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM + capabilities: + amd: rocm-kokoro + default: cpu-kokoro + intel: intel-kokoro + metal: metal-kokoro + nvidia: cuda12-kokoro + nvidia-cuda-12: cuda12-kokoro + nvidia-cuda-13: cuda13-kokoro + nvidia-l4t: nvidia-l4t-kokoro + nvidia-l4t-cuda-12: nvidia-l4t-kokoro + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-kokoro mirrors: - localai/localai-backends:latest-gpu-intel-kokoro -- !!merge <<: *kokoro - name: "intel-kokoro-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-kokoro" +- name: intel-kokoro-development + alias: kokoro + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM + capabilities: + amd: rocm-kokoro + default: cpu-kokoro + intel: intel-kokoro + metal: metal-kokoro + nvidia: cuda12-kokoro + nvidia-cuda-12: cuda12-kokoro + nvidia-cuda-13: cuda13-kokoro + nvidia-l4t: nvidia-l4t-kokoro + nvidia-l4t-cuda-12: nvidia-l4t-kokoro + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-kokoro mirrors: - localai/localai-backends:master-gpu-intel-kokoro -- !!merge <<: *kokoro - name: "nvidia-l4t-kokoro" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-kokoro" +- name: nvidia-l4t-kokoro + alias: kokoro + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM + capabilities: + amd: rocm-kokoro + default: cpu-kokoro + intel: intel-kokoro + metal: metal-kokoro + nvidia: cuda12-kokoro + nvidia-cuda-12: cuda12-kokoro + nvidia-cuda-13: cuda13-kokoro + nvidia-l4t: nvidia-l4t-kokoro + nvidia-l4t-cuda-12: nvidia-l4t-kokoro + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-kokoro mirrors: - localai/localai-backends:latest-nvidia-l4t-kokoro -- !!merge <<: *kokoro - name: "nvidia-l4t-kokoro-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-kokoro" +- name: nvidia-l4t-kokoro-development + alias: kokoro + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM + capabilities: + amd: rocm-kokoro + default: cpu-kokoro + intel: intel-kokoro + metal: metal-kokoro + nvidia: cuda12-kokoro + nvidia-cuda-12: cuda12-kokoro + nvidia-cuda-13: cuda13-kokoro + nvidia-l4t: nvidia-l4t-kokoro + nvidia-l4t-cuda-12: nvidia-l4t-kokoro + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-kokoro mirrors: - localai/localai-backends:master-nvidia-l4t-kokoro -- !!merge <<: *kokoro - name: "cuda12-kokoro" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-kokoro" +- name: cuda12-kokoro + alias: kokoro + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM + capabilities: + amd: rocm-kokoro + default: cpu-kokoro + intel: intel-kokoro + metal: metal-kokoro + nvidia: cuda12-kokoro + nvidia-cuda-12: cuda12-kokoro + nvidia-cuda-13: cuda13-kokoro + nvidia-l4t: nvidia-l4t-kokoro + nvidia-l4t-cuda-12: nvidia-l4t-kokoro + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-kokoro mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-kokoro -- !!merge <<: *kokoro - name: "rocm-kokoro" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-kokoro" +- name: rocm-kokoro + alias: kokoro + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM + capabilities: + amd: rocm-kokoro + default: cpu-kokoro + intel: intel-kokoro + metal: metal-kokoro + nvidia: cuda12-kokoro + nvidia-cuda-12: cuda12-kokoro + nvidia-cuda-13: cuda13-kokoro + nvidia-l4t: nvidia-l4t-kokoro + nvidia-l4t-cuda-12: nvidia-l4t-kokoro + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-kokoro mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-kokoro -- !!merge <<: *kokoro - name: "cuda13-kokoro" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-kokoro" +- name: cuda13-kokoro + alias: kokoro + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM + capabilities: + amd: rocm-kokoro + default: cpu-kokoro + intel: intel-kokoro + metal: metal-kokoro + nvidia: cuda12-kokoro + nvidia-cuda-12: cuda12-kokoro + nvidia-cuda-13: cuda13-kokoro + nvidia-l4t: nvidia-l4t-kokoro + nvidia-l4t-cuda-12: nvidia-l4t-kokoro + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-kokoro mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-kokoro -- !!merge <<: *kokoro - name: "cuda13-kokoro-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-kokoro" +- name: cuda13-kokoro-development + alias: kokoro + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM + capabilities: + amd: rocm-kokoro + default: cpu-kokoro + intel: intel-kokoro + metal: metal-kokoro + nvidia: cuda12-kokoro + nvidia-cuda-12: cuda12-kokoro + nvidia-cuda-13: cuda13-kokoro + nvidia-l4t: nvidia-l4t-kokoro + nvidia-l4t-cuda-12: nvidia-l4t-kokoro + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-kokoro mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-kokoro -- !!merge <<: *kokoro - name: "metal-kokoro" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-kokoro" +- name: metal-kokoro + alias: kokoro + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM + capabilities: + amd: rocm-kokoro + default: cpu-kokoro + intel: intel-kokoro + metal: metal-kokoro + nvidia: cuda12-kokoro + nvidia-cuda-12: cuda12-kokoro + nvidia-cuda-13: cuda13-kokoro + nvidia-l4t: nvidia-l4t-kokoro + nvidia-l4t-cuda-12: nvidia-l4t-kokoro + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-kokoro mirrors: - localai/localai-backends:latest-metal-darwin-arm64-kokoro -- !!merge <<: *kokoro - name: "metal-kokoro-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-kokoro" +- name: metal-kokoro-development + alias: kokoro + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM + capabilities: + amd: rocm-kokoro + default: cpu-kokoro + intel: intel-kokoro + metal: metal-kokoro + nvidia: cuda12-kokoro + nvidia-cuda-12: cuda12-kokoro + nvidia-cuda-13: cuda13-kokoro + nvidia-l4t: nvidia-l4t-kokoro + nvidia-l4t-cuda-12: nvidia-l4t-kokoro + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-kokoro mirrors: - localai/localai-backends:master-metal-darwin-arm64-kokoro -## kokoros (Rust) -- !!merge <<: *kokoros - name: "kokoros-development" +- name: kokoros-development + alias: kokoros + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoros is a pure Rust TTS backend using the Kokoro ONNX model (82M parameters). + It provides fast, high-quality text-to-speech with streaming support, built on + ONNX Runtime for efficient CPU inference. Supports English, Japanese, Mandarin + Chinese, and German. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/lucasjinreal/Kokoros + tags: + - text-to-speech + - TTS + - Rust + - ONNX capabilities: - default: "cpu-kokoros-development" -- !!merge <<: *kokoros - name: "cpu-kokoros" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-kokoros" + default: cpu-kokoros-development +- name: cpu-kokoros + alias: kokoros + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoros is a pure Rust TTS backend using the Kokoro ONNX model (82M parameters). + It provides fast, high-quality text-to-speech with streaming support, built on + ONNX Runtime for efficient CPU inference. Supports English, Japanese, Mandarin + Chinese, and German. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/lucasjinreal/Kokoros + tags: + - text-to-speech + - TTS + - Rust + - ONNX + capabilities: + default: cpu-kokoros + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-kokoros mirrors: - localai/localai-backends:latest-cpu-kokoros -- !!merge <<: *kokoros - name: "cpu-kokoros-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-kokoros" +- name: cpu-kokoros-development + alias: kokoros + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoros is a pure Rust TTS backend using the Kokoro ONNX model (82M parameters). + It provides fast, high-quality text-to-speech with streaming support, built on + ONNX Runtime for efficient CPU inference. Supports English, Japanese, Mandarin + Chinese, and German. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/lucasjinreal/Kokoros + tags: + - text-to-speech + - TTS + - Rust + - ONNX + capabilities: + default: cpu-kokoros + uri: quay.io/go-skynet/local-ai-backends:master-cpu-kokoros mirrors: - localai/localai-backends:master-cpu-kokoros -## faster-whisper -- !!merge <<: *faster-whisper - name: "faster-whisper-development" +- name: faster-whisper-development + license: MIT + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper capabilities: - default: "cpu-faster-whisper-development" - nvidia: "cuda12-faster-whisper-development" - intel: "intel-faster-whisper-development" - amd: "rocm-faster-whisper-development" - metal: "metal-faster-whisper-development" - nvidia-cuda-13: "cuda13-faster-whisper-development" - nvidia-l4t: "nvidia-l4t-arm64-faster-whisper-development" -- !!merge <<: *faster-whisper - name: "cuda12-faster-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-faster-whisper" + amd: rocm-faster-whisper-development + default: cpu-faster-whisper-development + intel: intel-faster-whisper-development + metal: metal-faster-whisper-development + nvidia: cuda12-faster-whisper-development + nvidia-cuda-13: cuda13-faster-whisper-development + nvidia-l4t: nvidia-l4t-arm64-faster-whisper-development +- name: cuda12-faster-whisper-development + license: MIT + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper + capabilities: + amd: rocm-faster-whisper + default: cpu-faster-whisper + intel: intel-faster-whisper + metal: metal-faster-whisper + nvidia: cuda12-faster-whisper + nvidia-cuda-12: cuda12-faster-whisper + nvidia-cuda-13: cuda13-faster-whisper + nvidia-l4t: nvidia-l4t-arm64-faster-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-faster-whisper + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-faster-whisper mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-faster-whisper -- !!merge <<: *faster-whisper - name: "rocm-faster-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-faster-whisper" +- name: rocm-faster-whisper-development + license: MIT + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper + capabilities: + amd: rocm-faster-whisper + default: cpu-faster-whisper + intel: intel-faster-whisper + metal: metal-faster-whisper + nvidia: cuda12-faster-whisper + nvidia-cuda-12: cuda12-faster-whisper + nvidia-cuda-13: cuda13-faster-whisper + nvidia-l4t: nvidia-l4t-arm64-faster-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-faster-whisper + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-faster-whisper mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-faster-whisper -- !!merge <<: *faster-whisper - name: "intel-faster-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-faster-whisper" +- name: intel-faster-whisper + license: MIT + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper + capabilities: + amd: rocm-faster-whisper + default: cpu-faster-whisper + intel: intel-faster-whisper + metal: metal-faster-whisper + nvidia: cuda12-faster-whisper + nvidia-cuda-12: cuda12-faster-whisper + nvidia-cuda-13: cuda13-faster-whisper + nvidia-l4t: nvidia-l4t-arm64-faster-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-faster-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-faster-whisper mirrors: - localai/localai-backends:latest-gpu-intel-faster-whisper -- !!merge <<: *faster-whisper - name: "intel-faster-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-faster-whisper" +- name: intel-faster-whisper-development + license: MIT + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper + capabilities: + amd: rocm-faster-whisper + default: cpu-faster-whisper + intel: intel-faster-whisper + metal: metal-faster-whisper + nvidia: cuda12-faster-whisper + nvidia-cuda-12: cuda12-faster-whisper + nvidia-cuda-13: cuda13-faster-whisper + nvidia-l4t: nvidia-l4t-arm64-faster-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-faster-whisper + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-faster-whisper mirrors: - localai/localai-backends:master-gpu-intel-faster-whisper -- !!merge <<: *faster-whisper - name: "cuda13-faster-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-faster-whisper" +- name: cuda13-faster-whisper + license: MIT + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper + capabilities: + amd: rocm-faster-whisper + default: cpu-faster-whisper + intel: intel-faster-whisper + metal: metal-faster-whisper + nvidia: cuda12-faster-whisper + nvidia-cuda-12: cuda12-faster-whisper + nvidia-cuda-13: cuda13-faster-whisper + nvidia-l4t: nvidia-l4t-arm64-faster-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-faster-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-faster-whisper mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-faster-whisper -- !!merge <<: *faster-whisper - name: "cuda13-faster-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-faster-whisper" +- name: cuda13-faster-whisper-development + license: MIT + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper + capabilities: + amd: rocm-faster-whisper + default: cpu-faster-whisper + intel: intel-faster-whisper + metal: metal-faster-whisper + nvidia: cuda12-faster-whisper + nvidia-cuda-12: cuda12-faster-whisper + nvidia-cuda-13: cuda13-faster-whisper + nvidia-l4t: nvidia-l4t-arm64-faster-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-faster-whisper + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-faster-whisper mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-faster-whisper -- !!merge <<: *faster-whisper - name: "metal-faster-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-faster-whisper" +- name: metal-faster-whisper + license: MIT + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper + capabilities: + amd: rocm-faster-whisper + default: cpu-faster-whisper + intel: intel-faster-whisper + metal: metal-faster-whisper + nvidia: cuda12-faster-whisper + nvidia-cuda-12: cuda12-faster-whisper + nvidia-cuda-13: cuda13-faster-whisper + nvidia-l4t: nvidia-l4t-arm64-faster-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-faster-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-faster-whisper mirrors: - localai/localai-backends:latest-metal-darwin-arm64-faster-whisper -- !!merge <<: *faster-whisper - name: "metal-faster-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-faster-whisper" +- name: metal-faster-whisper-development + license: MIT + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper + capabilities: + amd: rocm-faster-whisper + default: cpu-faster-whisper + intel: intel-faster-whisper + metal: metal-faster-whisper + nvidia: cuda12-faster-whisper + nvidia-cuda-12: cuda12-faster-whisper + nvidia-cuda-13: cuda13-faster-whisper + nvidia-l4t: nvidia-l4t-arm64-faster-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-faster-whisper + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-faster-whisper mirrors: - localai/localai-backends:master-metal-darwin-arm64-faster-whisper -- !!merge <<: *faster-whisper - name: "cuda12-faster-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-faster-whisper" +- name: cuda12-faster-whisper + license: MIT + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper + capabilities: + amd: rocm-faster-whisper + default: cpu-faster-whisper + intel: intel-faster-whisper + metal: metal-faster-whisper + nvidia: cuda12-faster-whisper + nvidia-cuda-12: cuda12-faster-whisper + nvidia-cuda-13: cuda13-faster-whisper + nvidia-l4t: nvidia-l4t-arm64-faster-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-faster-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-faster-whisper mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-faster-whisper -- !!merge <<: *faster-whisper - name: "rocm-faster-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-faster-whisper" +- name: rocm-faster-whisper + license: MIT + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper + capabilities: + amd: rocm-faster-whisper + default: cpu-faster-whisper + intel: intel-faster-whisper + metal: metal-faster-whisper + nvidia: cuda12-faster-whisper + nvidia-cuda-12: cuda12-faster-whisper + nvidia-cuda-13: cuda13-faster-whisper + nvidia-l4t: nvidia-l4t-arm64-faster-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-faster-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-faster-whisper mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-faster-whisper -- !!merge <<: *faster-whisper - name: "cpu-faster-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-faster-whisper" +- name: cpu-faster-whisper + license: MIT + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper + capabilities: + amd: rocm-faster-whisper + default: cpu-faster-whisper + intel: intel-faster-whisper + metal: metal-faster-whisper + nvidia: cuda12-faster-whisper + nvidia-cuda-12: cuda12-faster-whisper + nvidia-cuda-13: cuda13-faster-whisper + nvidia-l4t: nvidia-l4t-arm64-faster-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-faster-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-faster-whisper mirrors: - localai/localai-backends:latest-cpu-faster-whisper -- !!merge <<: *faster-whisper - name: "cpu-faster-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-faster-whisper" +- name: cpu-faster-whisper-development + license: MIT + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper + capabilities: + amd: rocm-faster-whisper + default: cpu-faster-whisper + intel: intel-faster-whisper + metal: metal-faster-whisper + nvidia: cuda12-faster-whisper + nvidia-cuda-12: cuda12-faster-whisper + nvidia-cuda-13: cuda13-faster-whisper + nvidia-l4t: nvidia-l4t-arm64-faster-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-faster-whisper + uri: quay.io/go-skynet/local-ai-backends:master-cpu-faster-whisper mirrors: - localai/localai-backends:master-cpu-faster-whisper -- !!merge <<: *faster-whisper - name: "nvidia-l4t-arm64-faster-whisper" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-faster-whisper" +- name: nvidia-l4t-arm64-faster-whisper + license: MIT + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper + capabilities: + amd: rocm-faster-whisper + default: cpu-faster-whisper + intel: intel-faster-whisper + metal: metal-faster-whisper + nvidia: cuda12-faster-whisper + nvidia-cuda-12: cuda12-faster-whisper + nvidia-cuda-13: cuda13-faster-whisper + nvidia-l4t: nvidia-l4t-arm64-faster-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-faster-whisper + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-faster-whisper mirrors: - localai/localai-backends:latest-nvidia-l4t-faster-whisper -- !!merge <<: *faster-whisper - name: "nvidia-l4t-arm64-faster-whisper-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-faster-whisper" +- name: nvidia-l4t-arm64-faster-whisper-development + license: MIT + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper + capabilities: + amd: rocm-faster-whisper + default: cpu-faster-whisper + intel: intel-faster-whisper + metal: metal-faster-whisper + nvidia: cuda12-faster-whisper + nvidia-cuda-12: cuda12-faster-whisper + nvidia-cuda-13: cuda13-faster-whisper + nvidia-l4t: nvidia-l4t-arm64-faster-whisper + nvidia-l4t-cuda-12: nvidia-l4t-arm64-faster-whisper + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-faster-whisper mirrors: - localai/localai-backends:master-nvidia-l4t-faster-whisper -## moonshine -- !!merge <<: *moonshine - name: "moonshine-development" +- name: moonshine-development + alias: moonshine + license: MIT + description: | + Moonshine is a fast, accurate, and efficient speech-to-text transcription model using ONNX Runtime. + It provides real-time transcription capabilities with support for multiple model sizes and GPU acceleration. + urls: + - https://github.com/moonshine-ai/moonshine + tags: + - speech-to-text + - transcription + - ONNX capabilities: - nvidia: "cuda12-moonshine-development" - default: "cpu-moonshine-development" - nvidia-cuda-13: "cuda13-moonshine-development" - nvidia-cuda-12: "cuda12-moonshine-development" -- !!merge <<: *moonshine - name: "cpu-moonshine" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-moonshine" + default: cpu-moonshine-development + nvidia: cuda12-moonshine-development + nvidia-cuda-12: cuda12-moonshine-development + nvidia-cuda-13: cuda13-moonshine-development +- name: cpu-moonshine + alias: moonshine + license: MIT + description: | + Moonshine is a fast, accurate, and efficient speech-to-text transcription model using ONNX Runtime. + It provides real-time transcription capabilities with support for multiple model sizes and GPU acceleration. + urls: + - https://github.com/moonshine-ai/moonshine + tags: + - speech-to-text + - transcription + - ONNX + capabilities: + default: cpu-moonshine + metal: metal-moonshine + nvidia: cuda12-moonshine + nvidia-cuda-12: cuda12-moonshine + nvidia-cuda-13: cuda13-moonshine + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-moonshine mirrors: - localai/localai-backends:latest-cpu-moonshine -- !!merge <<: *moonshine - name: "cpu-moonshine-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-moonshine" +- name: cpu-moonshine-development + alias: moonshine + license: MIT + description: | + Moonshine is a fast, accurate, and efficient speech-to-text transcription model using ONNX Runtime. + It provides real-time transcription capabilities with support for multiple model sizes and GPU acceleration. + urls: + - https://github.com/moonshine-ai/moonshine + tags: + - speech-to-text + - transcription + - ONNX + capabilities: + default: cpu-moonshine + metal: metal-moonshine + nvidia: cuda12-moonshine + nvidia-cuda-12: cuda12-moonshine + nvidia-cuda-13: cuda13-moonshine + uri: quay.io/go-skynet/local-ai-backends:master-cpu-moonshine mirrors: - localai/localai-backends:master-cpu-moonshine -- !!merge <<: *moonshine - name: "cuda12-moonshine" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-moonshine" +- name: cuda12-moonshine + alias: moonshine + license: MIT + description: | + Moonshine is a fast, accurate, and efficient speech-to-text transcription model using ONNX Runtime. + It provides real-time transcription capabilities with support for multiple model sizes and GPU acceleration. + urls: + - https://github.com/moonshine-ai/moonshine + tags: + - speech-to-text + - transcription + - ONNX + capabilities: + default: cpu-moonshine + metal: metal-moonshine + nvidia: cuda12-moonshine + nvidia-cuda-12: cuda12-moonshine + nvidia-cuda-13: cuda13-moonshine + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-moonshine mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-moonshine -- !!merge <<: *moonshine - name: "cuda12-moonshine-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-moonshine" +- name: cuda12-moonshine-development + alias: moonshine + license: MIT + description: | + Moonshine is a fast, accurate, and efficient speech-to-text transcription model using ONNX Runtime. + It provides real-time transcription capabilities with support for multiple model sizes and GPU acceleration. + urls: + - https://github.com/moonshine-ai/moonshine + tags: + - speech-to-text + - transcription + - ONNX + capabilities: + default: cpu-moonshine + metal: metal-moonshine + nvidia: cuda12-moonshine + nvidia-cuda-12: cuda12-moonshine + nvidia-cuda-13: cuda13-moonshine + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-moonshine mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-moonshine -- !!merge <<: *moonshine - name: "cuda13-moonshine" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-moonshine" +- name: cuda13-moonshine + alias: moonshine + license: MIT + description: | + Moonshine is a fast, accurate, and efficient speech-to-text transcription model using ONNX Runtime. + It provides real-time transcription capabilities with support for multiple model sizes and GPU acceleration. + urls: + - https://github.com/moonshine-ai/moonshine + tags: + - speech-to-text + - transcription + - ONNX + capabilities: + default: cpu-moonshine + metal: metal-moonshine + nvidia: cuda12-moonshine + nvidia-cuda-12: cuda12-moonshine + nvidia-cuda-13: cuda13-moonshine + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-moonshine mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-moonshine -- !!merge <<: *moonshine - name: "cuda13-moonshine-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-moonshine" +- name: cuda13-moonshine-development + alias: moonshine + license: MIT + description: | + Moonshine is a fast, accurate, and efficient speech-to-text transcription model using ONNX Runtime. + It provides real-time transcription capabilities with support for multiple model sizes and GPU acceleration. + urls: + - https://github.com/moonshine-ai/moonshine + tags: + - speech-to-text + - transcription + - ONNX + capabilities: + default: cpu-moonshine + metal: metal-moonshine + nvidia: cuda12-moonshine + nvidia-cuda-12: cuda12-moonshine + nvidia-cuda-13: cuda13-moonshine + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-moonshine mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-moonshine -- !!merge <<: *moonshine - name: "metal-moonshine" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-moonshine" +- name: metal-moonshine + alias: moonshine + license: MIT + description: | + Moonshine is a fast, accurate, and efficient speech-to-text transcription model using ONNX Runtime. + It provides real-time transcription capabilities with support for multiple model sizes and GPU acceleration. + urls: + - https://github.com/moonshine-ai/moonshine + tags: + - speech-to-text + - transcription + - ONNX + capabilities: + default: cpu-moonshine + metal: metal-moonshine + nvidia: cuda12-moonshine + nvidia-cuda-12: cuda12-moonshine + nvidia-cuda-13: cuda13-moonshine + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-moonshine mirrors: - localai/localai-backends:latest-metal-darwin-arm64-moonshine -- !!merge <<: *moonshine - name: "metal-moonshine-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-moonshine" +- name: metal-moonshine-development + alias: moonshine + license: MIT + description: | + Moonshine is a fast, accurate, and efficient speech-to-text transcription model using ONNX Runtime. + It provides real-time transcription capabilities with support for multiple model sizes and GPU acceleration. + urls: + - https://github.com/moonshine-ai/moonshine + tags: + - speech-to-text + - transcription + - ONNX + capabilities: + default: cpu-moonshine + metal: metal-moonshine + nvidia: cuda12-moonshine + nvidia-cuda-12: cuda12-moonshine + nvidia-cuda-13: cuda13-moonshine + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-moonshine mirrors: - localai/localai-backends:master-metal-darwin-arm64-moonshine -## whisperx -- !!merge <<: *whisperx - name: "whisperx-development" +- name: whisperx-development + alias: whisperx + license: BSD-4-Clause + description: | + WhisperX provides fast automatic speech recognition with word-level timestamps, speaker diarization, + and forced alignment. Built on faster-whisper and pyannote-audio for high-accuracy transcription + with speaker identification. + urls: + - https://github.com/m-bain/whisperX + tags: + - speech-to-text + - diarization + - whisperx capabilities: - nvidia: "cuda12-whisperx-development" - metal: "metal-whisperx-development" - default: "cpu-whisperx-development" - nvidia-cuda-13: "cuda13-whisperx-development" - nvidia-cuda-12: "cuda12-whisperx-development" - nvidia-l4t: "nvidia-l4t-arm64-whisperx-development" -- !!merge <<: *whisperx - name: "cpu-whisperx" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-whisperx" + default: cpu-whisperx-development + metal: metal-whisperx-development + nvidia: cuda12-whisperx-development + nvidia-cuda-12: cuda12-whisperx-development + nvidia-cuda-13: cuda13-whisperx-development + nvidia-l4t: nvidia-l4t-arm64-whisperx-development +- name: cpu-whisperx + alias: whisperx + license: BSD-4-Clause + description: | + WhisperX provides fast automatic speech recognition with word-level timestamps, speaker diarization, + and forced alignment. Built on faster-whisper and pyannote-audio for high-accuracy transcription + with speaker identification. + urls: + - https://github.com/m-bain/whisperX + tags: + - speech-to-text + - diarization + - whisperx + capabilities: + default: cpu-whisperx + metal: metal-whisperx + nvidia: cuda12-whisperx + nvidia-cuda-12: cuda12-whisperx + nvidia-cuda-13: cuda13-whisperx + nvidia-l4t: nvidia-l4t-arm64-whisperx + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisperx + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-whisperx mirrors: - localai/localai-backends:latest-cpu-whisperx -- !!merge <<: *whisperx - name: "cpu-whisperx-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-whisperx" +- name: cpu-whisperx-development + alias: whisperx + license: BSD-4-Clause + description: | + WhisperX provides fast automatic speech recognition with word-level timestamps, speaker diarization, + and forced alignment. Built on faster-whisper and pyannote-audio for high-accuracy transcription + with speaker identification. + urls: + - https://github.com/m-bain/whisperX + tags: + - speech-to-text + - diarization + - whisperx + capabilities: + default: cpu-whisperx + metal: metal-whisperx + nvidia: cuda12-whisperx + nvidia-cuda-12: cuda12-whisperx + nvidia-cuda-13: cuda13-whisperx + nvidia-l4t: nvidia-l4t-arm64-whisperx + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisperx + uri: quay.io/go-skynet/local-ai-backends:master-cpu-whisperx mirrors: - localai/localai-backends:master-cpu-whisperx -- !!merge <<: *whisperx - name: "cuda12-whisperx" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-whisperx" +- name: cuda12-whisperx + alias: whisperx + license: BSD-4-Clause + description: | + WhisperX provides fast automatic speech recognition with word-level timestamps, speaker diarization, + and forced alignment. Built on faster-whisper and pyannote-audio for high-accuracy transcription + with speaker identification. + urls: + - https://github.com/m-bain/whisperX + tags: + - speech-to-text + - diarization + - whisperx + capabilities: + default: cpu-whisperx + metal: metal-whisperx + nvidia: cuda12-whisperx + nvidia-cuda-12: cuda12-whisperx + nvidia-cuda-13: cuda13-whisperx + nvidia-l4t: nvidia-l4t-arm64-whisperx + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisperx + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-whisperx mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-whisperx -- !!merge <<: *whisperx - name: "cuda12-whisperx-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-whisperx" +- name: cuda12-whisperx-development + alias: whisperx + license: BSD-4-Clause + description: | + WhisperX provides fast automatic speech recognition with word-level timestamps, speaker diarization, + and forced alignment. Built on faster-whisper and pyannote-audio for high-accuracy transcription + with speaker identification. + urls: + - https://github.com/m-bain/whisperX + tags: + - speech-to-text + - diarization + - whisperx + capabilities: + default: cpu-whisperx + metal: metal-whisperx + nvidia: cuda12-whisperx + nvidia-cuda-12: cuda12-whisperx + nvidia-cuda-13: cuda13-whisperx + nvidia-l4t: nvidia-l4t-arm64-whisperx + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisperx + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-whisperx mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-whisperx -- !!merge <<: *whisperx - name: "cuda13-whisperx" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-whisperx" +- name: cuda13-whisperx + alias: whisperx + license: BSD-4-Clause + description: | + WhisperX provides fast automatic speech recognition with word-level timestamps, speaker diarization, + and forced alignment. Built on faster-whisper and pyannote-audio for high-accuracy transcription + with speaker identification. + urls: + - https://github.com/m-bain/whisperX + tags: + - speech-to-text + - diarization + - whisperx + capabilities: + default: cpu-whisperx + metal: metal-whisperx + nvidia: cuda12-whisperx + nvidia-cuda-12: cuda12-whisperx + nvidia-cuda-13: cuda13-whisperx + nvidia-l4t: nvidia-l4t-arm64-whisperx + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisperx + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-whisperx mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-whisperx -- !!merge <<: *whisperx - name: "cuda13-whisperx-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-whisperx" +- name: cuda13-whisperx-development + alias: whisperx + license: BSD-4-Clause + description: | + WhisperX provides fast automatic speech recognition with word-level timestamps, speaker diarization, + and forced alignment. Built on faster-whisper and pyannote-audio for high-accuracy transcription + with speaker identification. + urls: + - https://github.com/m-bain/whisperX + tags: + - speech-to-text + - diarization + - whisperx + capabilities: + default: cpu-whisperx + metal: metal-whisperx + nvidia: cuda12-whisperx + nvidia-cuda-12: cuda12-whisperx + nvidia-cuda-13: cuda13-whisperx + nvidia-l4t: nvidia-l4t-arm64-whisperx + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisperx + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-whisperx mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-whisperx -- !!merge <<: *whisperx - name: "metal-whisperx" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-whisperx" +- name: metal-whisperx + alias: whisperx + license: BSD-4-Clause + description: | + WhisperX provides fast automatic speech recognition with word-level timestamps, speaker diarization, + and forced alignment. Built on faster-whisper and pyannote-audio for high-accuracy transcription + with speaker identification. + urls: + - https://github.com/m-bain/whisperX + tags: + - speech-to-text + - diarization + - whisperx + capabilities: + default: cpu-whisperx + metal: metal-whisperx + nvidia: cuda12-whisperx + nvidia-cuda-12: cuda12-whisperx + nvidia-cuda-13: cuda13-whisperx + nvidia-l4t: nvidia-l4t-arm64-whisperx + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisperx + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-whisperx mirrors: - localai/localai-backends:latest-metal-darwin-arm64-whisperx -- !!merge <<: *whisperx - name: "metal-whisperx-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-whisperx" +- name: metal-whisperx-development + alias: whisperx + license: BSD-4-Clause + description: | + WhisperX provides fast automatic speech recognition with word-level timestamps, speaker diarization, + and forced alignment. Built on faster-whisper and pyannote-audio for high-accuracy transcription + with speaker identification. + urls: + - https://github.com/m-bain/whisperX + tags: + - speech-to-text + - diarization + - whisperx + capabilities: + default: cpu-whisperx + metal: metal-whisperx + nvidia: cuda12-whisperx + nvidia-cuda-12: cuda12-whisperx + nvidia-cuda-13: cuda13-whisperx + nvidia-l4t: nvidia-l4t-arm64-whisperx + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisperx + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-whisperx mirrors: - localai/localai-backends:master-metal-darwin-arm64-whisperx -- !!merge <<: *whisperx - name: "nvidia-l4t-arm64-whisperx" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-whisperx" +- name: nvidia-l4t-arm64-whisperx + alias: whisperx + license: BSD-4-Clause + description: | + WhisperX provides fast automatic speech recognition with word-level timestamps, speaker diarization, + and forced alignment. Built on faster-whisper and pyannote-audio for high-accuracy transcription + with speaker identification. + urls: + - https://github.com/m-bain/whisperX + tags: + - speech-to-text + - diarization + - whisperx + capabilities: + default: cpu-whisperx + metal: metal-whisperx + nvidia: cuda12-whisperx + nvidia-cuda-12: cuda12-whisperx + nvidia-cuda-13: cuda13-whisperx + nvidia-l4t: nvidia-l4t-arm64-whisperx + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisperx + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-whisperx mirrors: - localai/localai-backends:latest-nvidia-l4t-whisperx -- !!merge <<: *whisperx - name: "nvidia-l4t-arm64-whisperx-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-whisperx" +- name: nvidia-l4t-arm64-whisperx-development + alias: whisperx + license: BSD-4-Clause + description: | + WhisperX provides fast automatic speech recognition with word-level timestamps, speaker diarization, + and forced alignment. Built on faster-whisper and pyannote-audio for high-accuracy transcription + with speaker identification. + urls: + - https://github.com/m-bain/whisperX + tags: + - speech-to-text + - diarization + - whisperx + capabilities: + default: cpu-whisperx + metal: metal-whisperx + nvidia: cuda12-whisperx + nvidia-cuda-12: cuda12-whisperx + nvidia-cuda-13: cuda13-whisperx + nvidia-l4t: nvidia-l4t-arm64-whisperx + nvidia-l4t-cuda-12: nvidia-l4t-arm64-whisperx + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-whisperx mirrors: - localai/localai-backends:master-nvidia-l4t-whisperx -## coqui - -- !!merge <<: *coqui - name: "coqui-development" +- name: coqui-development + alias: coqui + license: mpl-2.0 + icon: https://avatars.githubusercontent.com/u/1338804?s=200&v=4 + description: "\U0001F438 Coqui TTS is a library for advanced Text-to-Speech generation.\n\n\U0001F680 Pretrained models in +1100 languages.\n\n\U0001F6E0️ Tools for training new models and fine-tuning existing models in any language.\n\n\U0001F4DA Utilities for dataset analysis and curation.\n" + urls: + - https://github.com/idiap/coqui-ai-TTS + tags: + - text-to-speech + - TTS capabilities: - nvidia: "cuda12-coqui-development" - intel: "intel-coqui-development" - amd: "rocm-coqui-development" - metal: "metal-coqui-development" -- !!merge <<: *coqui - name: "cuda12-coqui" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-coqui" + amd: rocm-coqui-development + intel: intel-coqui-development + metal: metal-coqui-development + nvidia: cuda12-coqui-development +- name: cuda12-coqui + alias: coqui + license: mpl-2.0 + icon: https://avatars.githubusercontent.com/u/1338804?s=200&v=4 + description: "\U0001F438 Coqui TTS is a library for advanced Text-to-Speech generation.\n\n\U0001F680 Pretrained models in +1100 languages.\n\n\U0001F6E0️ Tools for training new models and fine-tuning existing models in any language.\n\n\U0001F4DA Utilities for dataset analysis and curation.\n" + urls: + - https://github.com/idiap/coqui-ai-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-coqui + intel: intel-coqui + metal: metal-coqui + nvidia: cuda12-coqui + nvidia-cuda-12: cuda12-coqui + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-coqui mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-coqui -- !!merge <<: *coqui - name: "cuda12-coqui-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-coqui" +- name: cuda12-coqui-development + alias: coqui + license: mpl-2.0 + icon: https://avatars.githubusercontent.com/u/1338804?s=200&v=4 + description: "\U0001F438 Coqui TTS is a library for advanced Text-to-Speech generation.\n\n\U0001F680 Pretrained models in +1100 languages.\n\n\U0001F6E0️ Tools for training new models and fine-tuning existing models in any language.\n\n\U0001F4DA Utilities for dataset analysis and curation.\n" + urls: + - https://github.com/idiap/coqui-ai-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-coqui + intel: intel-coqui + metal: metal-coqui + nvidia: cuda12-coqui + nvidia-cuda-12: cuda12-coqui + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-coqui mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-coqui -- !!merge <<: *coqui - name: "rocm-coqui-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-coqui" +- name: rocm-coqui-development + alias: coqui + license: mpl-2.0 + icon: https://avatars.githubusercontent.com/u/1338804?s=200&v=4 + description: "\U0001F438 Coqui TTS is a library for advanced Text-to-Speech generation.\n\n\U0001F680 Pretrained models in +1100 languages.\n\n\U0001F6E0️ Tools for training new models and fine-tuning existing models in any language.\n\n\U0001F4DA Utilities for dataset analysis and curation.\n" + urls: + - https://github.com/idiap/coqui-ai-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-coqui + intel: intel-coqui + metal: metal-coqui + nvidia: cuda12-coqui + nvidia-cuda-12: cuda12-coqui + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-coqui mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-coqui -- !!merge <<: *coqui - name: "intel-coqui" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-coqui" +- name: intel-coqui + alias: coqui + license: mpl-2.0 + icon: https://avatars.githubusercontent.com/u/1338804?s=200&v=4 + description: "\U0001F438 Coqui TTS is a library for advanced Text-to-Speech generation.\n\n\U0001F680 Pretrained models in +1100 languages.\n\n\U0001F6E0️ Tools for training new models and fine-tuning existing models in any language.\n\n\U0001F4DA Utilities for dataset analysis and curation.\n" + urls: + - https://github.com/idiap/coqui-ai-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-coqui + intel: intel-coqui + metal: metal-coqui + nvidia: cuda12-coqui + nvidia-cuda-12: cuda12-coqui + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-coqui mirrors: - localai/localai-backends:latest-gpu-intel-coqui -- !!merge <<: *coqui - name: "intel-coqui-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-coqui" +- name: intel-coqui-development + alias: coqui + license: mpl-2.0 + icon: https://avatars.githubusercontent.com/u/1338804?s=200&v=4 + description: "\U0001F438 Coqui TTS is a library for advanced Text-to-Speech generation.\n\n\U0001F680 Pretrained models in +1100 languages.\n\n\U0001F6E0️ Tools for training new models and fine-tuning existing models in any language.\n\n\U0001F4DA Utilities for dataset analysis and curation.\n" + urls: + - https://github.com/idiap/coqui-ai-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-coqui + intel: intel-coqui + metal: metal-coqui + nvidia: cuda12-coqui + nvidia-cuda-12: cuda12-coqui + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-coqui mirrors: - localai/localai-backends:master-gpu-intel-coqui -- !!merge <<: *coqui - name: "rocm-coqui" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-coqui" +- name: rocm-coqui + alias: coqui + license: mpl-2.0 + icon: https://avatars.githubusercontent.com/u/1338804?s=200&v=4 + description: "\U0001F438 Coqui TTS is a library for advanced Text-to-Speech generation.\n\n\U0001F680 Pretrained models in +1100 languages.\n\n\U0001F6E0️ Tools for training new models and fine-tuning existing models in any language.\n\n\U0001F4DA Utilities for dataset analysis and curation.\n" + urls: + - https://github.com/idiap/coqui-ai-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-coqui + intel: intel-coqui + metal: metal-coqui + nvidia: cuda12-coqui + nvidia-cuda-12: cuda12-coqui + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-coqui mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-coqui -- !!merge <<: *coqui - name: "metal-coqui" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-coqui" +- name: metal-coqui + alias: coqui + license: mpl-2.0 + icon: https://avatars.githubusercontent.com/u/1338804?s=200&v=4 + description: "\U0001F438 Coqui TTS is a library for advanced Text-to-Speech generation.\n\n\U0001F680 Pretrained models in +1100 languages.\n\n\U0001F6E0️ Tools for training new models and fine-tuning existing models in any language.\n\n\U0001F4DA Utilities for dataset analysis and curation.\n" + urls: + - https://github.com/idiap/coqui-ai-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-coqui + intel: intel-coqui + metal: metal-coqui + nvidia: cuda12-coqui + nvidia-cuda-12: cuda12-coqui + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-coqui mirrors: - localai/localai-backends:latest-metal-darwin-arm64-coqui -- !!merge <<: *coqui - name: "metal-coqui-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-coqui" +- name: metal-coqui-development + alias: coqui + license: mpl-2.0 + icon: https://avatars.githubusercontent.com/u/1338804?s=200&v=4 + description: "\U0001F438 Coqui TTS is a library for advanced Text-to-Speech generation.\n\n\U0001F680 Pretrained models in +1100 languages.\n\n\U0001F6E0️ Tools for training new models and fine-tuning existing models in any language.\n\n\U0001F4DA Utilities for dataset analysis and curation.\n" + urls: + - https://github.com/idiap/coqui-ai-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-coqui + intel: intel-coqui + metal: metal-coqui + nvidia: cuda12-coqui + nvidia-cuda-12: cuda12-coqui + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-coqui mirrors: - localai/localai-backends:master-metal-darwin-arm64-coqui -## outetts -- !!merge <<: *outetts - name: "outetts-development" +- name: outetts-development + alias: outetts + license: apache-2.0 + description: | + OuteTTS is an open-weight text-to-speech model from OuteAI (OuteAI/OuteTTS-0.3-1B). + Supports custom speaker voices via audio path or default speakers. + urls: + - https://github.com/OuteAI/outetts + tags: + - text-to-speech + - TTS capabilities: - default: "cpu-outetts-development" - nvidia-cuda-12: "cuda12-outetts-development" -- !!merge <<: *outetts - name: "cpu-outetts" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-outetts" + default: cpu-outetts-development + nvidia-cuda-12: cuda12-outetts-development +- name: cpu-outetts + alias: outetts + license: apache-2.0 + description: | + OuteTTS is an open-weight text-to-speech model from OuteAI (OuteAI/OuteTTS-0.3-1B). + Supports custom speaker voices via audio path or default speakers. + urls: + - https://github.com/OuteAI/outetts + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-outetts + nvidia-cuda-12: cuda12-outetts + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-outetts mirrors: - localai/localai-backends:latest-cpu-outetts -- !!merge <<: *outetts - name: "cpu-outetts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-outetts" +- name: cpu-outetts-development + alias: outetts + license: apache-2.0 + description: | + OuteTTS is an open-weight text-to-speech model from OuteAI (OuteAI/OuteTTS-0.3-1B). + Supports custom speaker voices via audio path or default speakers. + urls: + - https://github.com/OuteAI/outetts + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-outetts + nvidia-cuda-12: cuda12-outetts + uri: quay.io/go-skynet/local-ai-backends:master-cpu-outetts mirrors: - localai/localai-backends:master-cpu-outetts -- !!merge <<: *outetts - name: "cuda12-outetts" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-outetts" +- name: cuda12-outetts + alias: outetts + license: apache-2.0 + description: | + OuteTTS is an open-weight text-to-speech model from OuteAI (OuteAI/OuteTTS-0.3-1B). + Supports custom speaker voices via audio path or default speakers. + urls: + - https://github.com/OuteAI/outetts + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-outetts + nvidia-cuda-12: cuda12-outetts + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-outetts mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-outetts -- !!merge <<: *outetts - name: "cuda12-outetts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-outetts" +- name: cuda12-outetts-development + alias: outetts + license: apache-2.0 + description: | + OuteTTS is an open-weight text-to-speech model from OuteAI (OuteAI/OuteTTS-0.3-1B). + Supports custom speaker voices via audio path or default speakers. + urls: + - https://github.com/OuteAI/outetts + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-outetts + nvidia-cuda-12: cuda12-outetts + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-outetts mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-outetts -## chatterbox -- !!merge <<: *chatterbox - name: "chatterbox-development" +- name: chatterbox-development + alias: chatterbox + license: MIT + icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 + description: | + Resemble AI's first production-grade open source TTS model. Licensed under MIT, Chatterbox has been benchmarked against leading closed-source systems like ElevenLabs, and is consistently preferred in side-by-side evaluations. + Whether you're working on memes, videos, games, or AI agents, Chatterbox brings your content to life. It's also the first open source TTS model to support emotion exaggeration control, a powerful feature that makes your voices stand out. + urls: + - https://github.com/resemble-ai/chatterbox + tags: + - text-to-speech + - TTS capabilities: - nvidia: "cuda12-chatterbox-development" - metal: "metal-chatterbox-development" - default: "cpu-chatterbox-development" - nvidia-l4t: "nvidia-l4t-arm64-chatterbox" - nvidia-cuda-13: "cuda13-chatterbox-development" - nvidia-cuda-12: "cuda12-chatterbox-development" - nvidia-l4t-cuda-12: "nvidia-l4t-arm64-chatterbox" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-chatterbox-development" -- !!merge <<: *chatterbox - name: "cpu-chatterbox" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-chatterbox" + default: cpu-chatterbox-development + metal: metal-chatterbox-development + nvidia: cuda12-chatterbox-development + nvidia-cuda-12: cuda12-chatterbox-development + nvidia-cuda-13: cuda13-chatterbox-development + nvidia-l4t: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-12: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-chatterbox-development +- name: cpu-chatterbox + alias: chatterbox + license: MIT + icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 + description: | + Resemble AI's first production-grade open source TTS model. Licensed under MIT, Chatterbox has been benchmarked against leading closed-source systems like ElevenLabs, and is consistently preferred in side-by-side evaluations. + Whether you're working on memes, videos, games, or AI agents, Chatterbox brings your content to life. It's also the first open source TTS model to support emotion exaggeration control, a powerful feature that makes your voices stand out. + urls: + - https://github.com/resemble-ai/chatterbox + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-chatterbox + metal: metal-chatterbox + nvidia: cuda12-chatterbox + nvidia-cuda-12: cuda12-chatterbox + nvidia-cuda-13: cuda13-chatterbox + nvidia-l4t: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-12: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-chatterbox + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-chatterbox mirrors: - localai/localai-backends:latest-cpu-chatterbox -- !!merge <<: *chatterbox - name: "cpu-chatterbox-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-chatterbox" +- name: cpu-chatterbox-development + alias: chatterbox + license: MIT + icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 + description: | + Resemble AI's first production-grade open source TTS model. Licensed under MIT, Chatterbox has been benchmarked against leading closed-source systems like ElevenLabs, and is consistently preferred in side-by-side evaluations. + Whether you're working on memes, videos, games, or AI agents, Chatterbox brings your content to life. It's also the first open source TTS model to support emotion exaggeration control, a powerful feature that makes your voices stand out. + urls: + - https://github.com/resemble-ai/chatterbox + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-chatterbox + metal: metal-chatterbox + nvidia: cuda12-chatterbox + nvidia-cuda-12: cuda12-chatterbox + nvidia-cuda-13: cuda13-chatterbox + nvidia-l4t: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-12: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-chatterbox + uri: quay.io/go-skynet/local-ai-backends:master-cpu-chatterbox mirrors: - localai/localai-backends:master-cpu-chatterbox -- !!merge <<: *chatterbox - name: "nvidia-l4t-arm64-chatterbox" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-chatterbox" +- name: nvidia-l4t-arm64-chatterbox + alias: chatterbox + license: MIT + icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 + description: | + Resemble AI's first production-grade open source TTS model. Licensed under MIT, Chatterbox has been benchmarked against leading closed-source systems like ElevenLabs, and is consistently preferred in side-by-side evaluations. + Whether you're working on memes, videos, games, or AI agents, Chatterbox brings your content to life. It's also the first open source TTS model to support emotion exaggeration control, a powerful feature that makes your voices stand out. + urls: + - https://github.com/resemble-ai/chatterbox + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-chatterbox + metal: metal-chatterbox + nvidia: cuda12-chatterbox + nvidia-cuda-12: cuda12-chatterbox + nvidia-cuda-13: cuda13-chatterbox + nvidia-l4t: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-12: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-chatterbox + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-chatterbox mirrors: - localai/localai-backends:latest-nvidia-l4t-arm64-chatterbox -- !!merge <<: *chatterbox - name: "nvidia-l4t-arm64-chatterbox-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-chatterbox" +- name: nvidia-l4t-arm64-chatterbox-development + alias: chatterbox + license: MIT + icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 + description: | + Resemble AI's first production-grade open source TTS model. Licensed under MIT, Chatterbox has been benchmarked against leading closed-source systems like ElevenLabs, and is consistently preferred in side-by-side evaluations. + Whether you're working on memes, videos, games, or AI agents, Chatterbox brings your content to life. It's also the first open source TTS model to support emotion exaggeration control, a powerful feature that makes your voices stand out. + urls: + - https://github.com/resemble-ai/chatterbox + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-chatterbox + metal: metal-chatterbox + nvidia: cuda12-chatterbox + nvidia-cuda-12: cuda12-chatterbox + nvidia-cuda-13: cuda13-chatterbox + nvidia-l4t: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-12: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-chatterbox + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-chatterbox mirrors: - localai/localai-backends:master-nvidia-l4t-arm64-chatterbox -- !!merge <<: *chatterbox - name: "metal-chatterbox" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-chatterbox" +- name: metal-chatterbox + alias: chatterbox + license: MIT + icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 + description: | + Resemble AI's first production-grade open source TTS model. Licensed under MIT, Chatterbox has been benchmarked against leading closed-source systems like ElevenLabs, and is consistently preferred in side-by-side evaluations. + Whether you're working on memes, videos, games, or AI agents, Chatterbox brings your content to life. It's also the first open source TTS model to support emotion exaggeration control, a powerful feature that makes your voices stand out. + urls: + - https://github.com/resemble-ai/chatterbox + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-chatterbox + metal: metal-chatterbox + nvidia: cuda12-chatterbox + nvidia-cuda-12: cuda12-chatterbox + nvidia-cuda-13: cuda13-chatterbox + nvidia-l4t: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-12: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-chatterbox + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-chatterbox mirrors: - localai/localai-backends:latest-metal-darwin-arm64-chatterbox -- !!merge <<: *chatterbox - name: "metal-chatterbox-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-chatterbox" +- name: metal-chatterbox-development + alias: chatterbox + license: MIT + icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 + description: | + Resemble AI's first production-grade open source TTS model. Licensed under MIT, Chatterbox has been benchmarked against leading closed-source systems like ElevenLabs, and is consistently preferred in side-by-side evaluations. + Whether you're working on memes, videos, games, or AI agents, Chatterbox brings your content to life. It's also the first open source TTS model to support emotion exaggeration control, a powerful feature that makes your voices stand out. + urls: + - https://github.com/resemble-ai/chatterbox + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-chatterbox + metal: metal-chatterbox + nvidia: cuda12-chatterbox + nvidia-cuda-12: cuda12-chatterbox + nvidia-cuda-13: cuda13-chatterbox + nvidia-l4t: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-12: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-chatterbox + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-chatterbox mirrors: - localai/localai-backends:master-metal-darwin-arm64-chatterbox -- !!merge <<: *chatterbox - name: "cuda12-chatterbox-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-chatterbox" +- name: cuda12-chatterbox-development + alias: chatterbox + license: MIT + icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 + description: | + Resemble AI's first production-grade open source TTS model. Licensed under MIT, Chatterbox has been benchmarked against leading closed-source systems like ElevenLabs, and is consistently preferred in side-by-side evaluations. + Whether you're working on memes, videos, games, or AI agents, Chatterbox brings your content to life. It's also the first open source TTS model to support emotion exaggeration control, a powerful feature that makes your voices stand out. + urls: + - https://github.com/resemble-ai/chatterbox + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-chatterbox + metal: metal-chatterbox + nvidia: cuda12-chatterbox + nvidia-cuda-12: cuda12-chatterbox + nvidia-cuda-13: cuda13-chatterbox + nvidia-l4t: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-12: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-chatterbox + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-chatterbox mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-chatterbox -- !!merge <<: *chatterbox - name: "cuda12-chatterbox" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-chatterbox" +- name: cuda12-chatterbox + alias: chatterbox + license: MIT + icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 + description: | + Resemble AI's first production-grade open source TTS model. Licensed under MIT, Chatterbox has been benchmarked against leading closed-source systems like ElevenLabs, and is consistently preferred in side-by-side evaluations. + Whether you're working on memes, videos, games, or AI agents, Chatterbox brings your content to life. It's also the first open source TTS model to support emotion exaggeration control, a powerful feature that makes your voices stand out. + urls: + - https://github.com/resemble-ai/chatterbox + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-chatterbox + metal: metal-chatterbox + nvidia: cuda12-chatterbox + nvidia-cuda-12: cuda12-chatterbox + nvidia-cuda-13: cuda13-chatterbox + nvidia-l4t: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-12: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-chatterbox + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-chatterbox mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-chatterbox -- !!merge <<: *chatterbox - name: "cuda13-chatterbox" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-chatterbox" +- name: cuda13-chatterbox + alias: chatterbox + license: MIT + icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 + description: | + Resemble AI's first production-grade open source TTS model. Licensed under MIT, Chatterbox has been benchmarked against leading closed-source systems like ElevenLabs, and is consistently preferred in side-by-side evaluations. + Whether you're working on memes, videos, games, or AI agents, Chatterbox brings your content to life. It's also the first open source TTS model to support emotion exaggeration control, a powerful feature that makes your voices stand out. + urls: + - https://github.com/resemble-ai/chatterbox + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-chatterbox + metal: metal-chatterbox + nvidia: cuda12-chatterbox + nvidia-cuda-12: cuda12-chatterbox + nvidia-cuda-13: cuda13-chatterbox + nvidia-l4t: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-12: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-chatterbox + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-chatterbox mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-chatterbox -- !!merge <<: *chatterbox - name: "cuda13-chatterbox-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-chatterbox" +- name: cuda13-chatterbox-development + alias: chatterbox + license: MIT + icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 + description: | + Resemble AI's first production-grade open source TTS model. Licensed under MIT, Chatterbox has been benchmarked against leading closed-source systems like ElevenLabs, and is consistently preferred in side-by-side evaluations. + Whether you're working on memes, videos, games, or AI agents, Chatterbox brings your content to life. It's also the first open source TTS model to support emotion exaggeration control, a powerful feature that makes your voices stand out. + urls: + - https://github.com/resemble-ai/chatterbox + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-chatterbox + metal: metal-chatterbox + nvidia: cuda12-chatterbox + nvidia-cuda-12: cuda12-chatterbox + nvidia-cuda-13: cuda13-chatterbox + nvidia-l4t: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-12: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-chatterbox + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-chatterbox mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-chatterbox -- !!merge <<: *chatterbox - name: "cuda13-nvidia-l4t-arm64-chatterbox" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-chatterbox" +- name: cuda13-nvidia-l4t-arm64-chatterbox + alias: chatterbox + license: MIT + icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 + description: | + Resemble AI's first production-grade open source TTS model. Licensed under MIT, Chatterbox has been benchmarked against leading closed-source systems like ElevenLabs, and is consistently preferred in side-by-side evaluations. + Whether you're working on memes, videos, games, or AI agents, Chatterbox brings your content to life. It's also the first open source TTS model to support emotion exaggeration control, a powerful feature that makes your voices stand out. + urls: + - https://github.com/resemble-ai/chatterbox + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-chatterbox + metal: metal-chatterbox + nvidia: cuda12-chatterbox + nvidia-cuda-12: cuda12-chatterbox + nvidia-cuda-13: cuda13-chatterbox + nvidia-l4t: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-12: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-chatterbox + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-chatterbox mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-chatterbox -- !!merge <<: *chatterbox - name: "cuda13-nvidia-l4t-arm64-chatterbox-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-chatterbox" +- name: cuda13-nvidia-l4t-arm64-chatterbox-development + alias: chatterbox + license: MIT + icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 + description: | + Resemble AI's first production-grade open source TTS model. Licensed under MIT, Chatterbox has been benchmarked against leading closed-source systems like ElevenLabs, and is consistently preferred in side-by-side evaluations. + Whether you're working on memes, videos, games, or AI agents, Chatterbox brings your content to life. It's also the first open source TTS model to support emotion exaggeration control, a powerful feature that makes your voices stand out. + urls: + - https://github.com/resemble-ai/chatterbox + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-chatterbox + metal: metal-chatterbox + nvidia: cuda12-chatterbox + nvidia-cuda-12: cuda12-chatterbox + nvidia-cuda-13: cuda13-chatterbox + nvidia-l4t: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-12: nvidia-l4t-arm64-chatterbox + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-chatterbox + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-chatterbox mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-chatterbox -## vibevoice -- !!merge <<: *vibevoice - name: "vibevoice-development" +- name: vibevoice-development + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS capabilities: - nvidia: "cuda12-vibevoice-development" - intel: "intel-vibevoice-development" - amd: "rocm-vibevoice-development" - nvidia-l4t: "nvidia-l4t-vibevoice-development" - metal: "metal-vibevoice-development" - default: "cpu-vibevoice-development" - nvidia-cuda-13: "cuda13-vibevoice-development" - nvidia-cuda-12: "cuda12-vibevoice-development" - nvidia-l4t-cuda-12: "nvidia-l4t-vibevoice-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-vibevoice-development" -- !!merge <<: *vibevoice - name: "cpu-vibevoice" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-vibevoice" + amd: rocm-vibevoice-development + default: cpu-vibevoice-development + intel: intel-vibevoice-development + metal: metal-vibevoice-development + nvidia: cuda12-vibevoice-development + nvidia-cuda-12: cuda12-vibevoice-development + nvidia-cuda-13: cuda13-vibevoice-development + nvidia-l4t: nvidia-l4t-vibevoice-development + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice-development +- name: cpu-vibevoice + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-vibevoice mirrors: - localai/localai-backends:latest-cpu-vibevoice -- !!merge <<: *vibevoice - name: "cpu-vibevoice-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-vibevoice" +- name: cpu-vibevoice-development + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:master-cpu-vibevoice mirrors: - localai/localai-backends:master-cpu-vibevoice -- !!merge <<: *vibevoice - name: "cuda12-vibevoice" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-vibevoice" +- name: cuda12-vibevoice + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-vibevoice mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-vibevoice -- !!merge <<: *vibevoice - name: "cuda12-vibevoice-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-vibevoice" +- name: cuda12-vibevoice-development + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-vibevoice mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-vibevoice -- !!merge <<: *vibevoice - name: "cuda13-vibevoice" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-vibevoice" +- name: cuda13-vibevoice + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-vibevoice mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-vibevoice -- !!merge <<: *vibevoice - name: "cuda13-vibevoice-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-vibevoice" +- name: cuda13-vibevoice-development + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-vibevoice mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-vibevoice -- !!merge <<: *vibevoice - name: "intel-vibevoice" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-vibevoice" +- name: intel-vibevoice + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-vibevoice mirrors: - localai/localai-backends:latest-gpu-intel-vibevoice -- !!merge <<: *vibevoice - name: "intel-vibevoice-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-vibevoice" +- name: intel-vibevoice-development + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-vibevoice mirrors: - localai/localai-backends:master-gpu-intel-vibevoice -- !!merge <<: *vibevoice - name: "rocm-vibevoice" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-vibevoice" +- name: rocm-vibevoice + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-vibevoice mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-vibevoice -- !!merge <<: *vibevoice - name: "rocm-vibevoice-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-vibevoice" +- name: rocm-vibevoice-development + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-vibevoice mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-vibevoice -- !!merge <<: *vibevoice - name: "nvidia-l4t-vibevoice" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-vibevoice" +- name: nvidia-l4t-vibevoice + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-vibevoice mirrors: - localai/localai-backends:latest-nvidia-l4t-vibevoice -- !!merge <<: *vibevoice - name: "nvidia-l4t-vibevoice-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-vibevoice" +- name: nvidia-l4t-vibevoice-development + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-vibevoice mirrors: - localai/localai-backends:master-nvidia-l4t-vibevoice -- !!merge <<: *vibevoice - name: "cuda13-nvidia-l4t-arm64-vibevoice" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-vibevoice" +- name: cuda13-nvidia-l4t-arm64-vibevoice + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-vibevoice mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-vibevoice -- !!merge <<: *vibevoice - name: "cuda13-nvidia-l4t-arm64-vibevoice-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-vibevoice" +- name: cuda13-nvidia-l4t-arm64-vibevoice-development + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-vibevoice mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-vibevoice -- !!merge <<: *vibevoice - name: "metal-vibevoice" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-vibevoice" +- name: metal-vibevoice + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-vibevoice mirrors: - localai/localai-backends:latest-metal-darwin-arm64-vibevoice -- !!merge <<: *vibevoice - name: "metal-vibevoice-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-vibevoice" +- name: metal-vibevoice-development + alias: vibevoice + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + urls: + - https://github.com/microsoft/VibeVoice + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-vibevoice + default: cpu-vibevoice + intel: intel-vibevoice + metal: metal-vibevoice + nvidia: cuda12-vibevoice + nvidia-cuda-12: cuda12-vibevoice + nvidia-cuda-13: cuda13-vibevoice + nvidia-l4t: nvidia-l4t-vibevoice + nvidia-l4t-cuda-12: nvidia-l4t-vibevoice + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-vibevoice + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-vibevoice mirrors: - localai/localai-backends:master-metal-darwin-arm64-vibevoice -## liquid-audio -- !!merge <<: *liquid-audio - name: "liquid-audio-development" +- name: liquid-audio-development + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime capabilities: - nvidia: "cuda12-liquid-audio-development" - intel: "intel-liquid-audio-development" - amd: "rocm-liquid-audio-development" - default: "cpu-liquid-audio-development" - nvidia-cuda-13: "cuda13-liquid-audio-development" - nvidia-cuda-12: "cuda12-liquid-audio-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-liquid-audio-development" - metal: "metal-liquid-audio-development" -- !!merge <<: *liquid-audio - name: "cpu-liquid-audio" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-liquid-audio" + amd: rocm-liquid-audio-development + default: cpu-liquid-audio-development + intel: intel-liquid-audio-development + metal: metal-liquid-audio-development + nvidia: cuda12-liquid-audio-development + nvidia-cuda-12: cuda12-liquid-audio-development + nvidia-cuda-13: cuda13-liquid-audio-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio-development +- name: cpu-liquid-audio + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime + capabilities: + amd: rocm-liquid-audio + default: cpu-liquid-audio + intel: intel-liquid-audio + metal: metal-liquid-audio + nvidia: cuda12-liquid-audio + nvidia-cuda-12: cuda12-liquid-audio + nvidia-cuda-13: cuda13-liquid-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-liquid-audio mirrors: - localai/localai-backends:latest-cpu-liquid-audio -- !!merge <<: *liquid-audio - name: "cpu-liquid-audio-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-liquid-audio" +- name: cpu-liquid-audio-development + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime + capabilities: + amd: rocm-liquid-audio + default: cpu-liquid-audio + intel: intel-liquid-audio + metal: metal-liquid-audio + nvidia: cuda12-liquid-audio + nvidia-cuda-12: cuda12-liquid-audio + nvidia-cuda-13: cuda13-liquid-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio + uri: quay.io/go-skynet/local-ai-backends:master-cpu-liquid-audio mirrors: - localai/localai-backends:master-cpu-liquid-audio -- !!merge <<: *liquid-audio - name: "metal-liquid-audio" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-liquid-audio" +- name: metal-liquid-audio + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime + capabilities: + amd: rocm-liquid-audio + default: cpu-liquid-audio + intel: intel-liquid-audio + metal: metal-liquid-audio + nvidia: cuda12-liquid-audio + nvidia-cuda-12: cuda12-liquid-audio + nvidia-cuda-13: cuda13-liquid-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-liquid-audio mirrors: - localai/localai-backends:latest-metal-darwin-arm64-liquid-audio -- !!merge <<: *liquid-audio - name: "metal-liquid-audio-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-liquid-audio" +- name: metal-liquid-audio-development + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime + capabilities: + amd: rocm-liquid-audio + default: cpu-liquid-audio + intel: intel-liquid-audio + metal: metal-liquid-audio + nvidia: cuda12-liquid-audio + nvidia-cuda-12: cuda12-liquid-audio + nvidia-cuda-13: cuda13-liquid-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-liquid-audio mirrors: - localai/localai-backends:master-metal-darwin-arm64-liquid-audio -- !!merge <<: *liquid-audio - name: "cuda12-liquid-audio" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-liquid-audio" +- name: cuda12-liquid-audio + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime + capabilities: + amd: rocm-liquid-audio + default: cpu-liquid-audio + intel: intel-liquid-audio + metal: metal-liquid-audio + nvidia: cuda12-liquid-audio + nvidia-cuda-12: cuda12-liquid-audio + nvidia-cuda-13: cuda13-liquid-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-liquid-audio mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-liquid-audio -- !!merge <<: *liquid-audio - name: "cuda12-liquid-audio-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-liquid-audio" +- name: cuda12-liquid-audio-development + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime + capabilities: + amd: rocm-liquid-audio + default: cpu-liquid-audio + intel: intel-liquid-audio + metal: metal-liquid-audio + nvidia: cuda12-liquid-audio + nvidia-cuda-12: cuda12-liquid-audio + nvidia-cuda-13: cuda13-liquid-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-liquid-audio mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-liquid-audio -- !!merge <<: *liquid-audio - name: "cuda13-liquid-audio" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-liquid-audio" +- name: cuda13-liquid-audio + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime + capabilities: + amd: rocm-liquid-audio + default: cpu-liquid-audio + intel: intel-liquid-audio + metal: metal-liquid-audio + nvidia: cuda12-liquid-audio + nvidia-cuda-12: cuda12-liquid-audio + nvidia-cuda-13: cuda13-liquid-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-liquid-audio mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-liquid-audio -- !!merge <<: *liquid-audio - name: "cuda13-liquid-audio-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-liquid-audio" +- name: cuda13-liquid-audio-development + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime + capabilities: + amd: rocm-liquid-audio + default: cpu-liquid-audio + intel: intel-liquid-audio + metal: metal-liquid-audio + nvidia: cuda12-liquid-audio + nvidia-cuda-12: cuda12-liquid-audio + nvidia-cuda-13: cuda13-liquid-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-liquid-audio mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-liquid-audio -- !!merge <<: *liquid-audio - name: "intel-liquid-audio" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-liquid-audio" +- name: intel-liquid-audio + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime + capabilities: + amd: rocm-liquid-audio + default: cpu-liquid-audio + intel: intel-liquid-audio + metal: metal-liquid-audio + nvidia: cuda12-liquid-audio + nvidia-cuda-12: cuda12-liquid-audio + nvidia-cuda-13: cuda13-liquid-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-liquid-audio mirrors: - localai/localai-backends:latest-gpu-intel-liquid-audio -- !!merge <<: *liquid-audio - name: "intel-liquid-audio-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-liquid-audio" +- name: intel-liquid-audio-development + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime + capabilities: + amd: rocm-liquid-audio + default: cpu-liquid-audio + intel: intel-liquid-audio + metal: metal-liquid-audio + nvidia: cuda12-liquid-audio + nvidia-cuda-12: cuda12-liquid-audio + nvidia-cuda-13: cuda13-liquid-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-liquid-audio mirrors: - localai/localai-backends:master-gpu-intel-liquid-audio -- !!merge <<: *liquid-audio - name: "rocm-liquid-audio" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-liquid-audio" +- name: rocm-liquid-audio + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime + capabilities: + amd: rocm-liquid-audio + default: cpu-liquid-audio + intel: intel-liquid-audio + metal: metal-liquid-audio + nvidia: cuda12-liquid-audio + nvidia-cuda-12: cuda12-liquid-audio + nvidia-cuda-13: cuda13-liquid-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-liquid-audio mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-liquid-audio -- !!merge <<: *liquid-audio - name: "rocm-liquid-audio-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-liquid-audio" +- name: rocm-liquid-audio-development + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime + capabilities: + amd: rocm-liquid-audio + default: cpu-liquid-audio + intel: intel-liquid-audio + metal: metal-liquid-audio + nvidia: cuda12-liquid-audio + nvidia-cuda-12: cuda12-liquid-audio + nvidia-cuda-13: cuda13-liquid-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-liquid-audio mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-liquid-audio -- !!merge <<: *liquid-audio - name: "cuda13-nvidia-l4t-arm64-liquid-audio" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-liquid-audio" +- name: cuda13-nvidia-l4t-arm64-liquid-audio + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime + capabilities: + amd: rocm-liquid-audio + default: cpu-liquid-audio + intel: intel-liquid-audio + metal: metal-liquid-audio + nvidia: cuda12-liquid-audio + nvidia-cuda-12: cuda12-liquid-audio + nvidia-cuda-13: cuda13-liquid-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-liquid-audio mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-liquid-audio -- !!merge <<: *liquid-audio - name: "cuda13-nvidia-l4t-arm64-liquid-audio-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-liquid-audio" +- name: cuda13-nvidia-l4t-arm64-liquid-audio-development + alias: liquid-audio + license: LFM-Open-License-v1.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime + capabilities: + amd: rocm-liquid-audio + default: cpu-liquid-audio + intel: intel-liquid-audio + metal: metal-liquid-audio + nvidia: cuda12-liquid-audio + nvidia-cuda-12: cuda12-liquid-audio + nvidia-cuda-13: cuda13-liquid-audio + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-liquid-audio + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-liquid-audio mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-liquid-audio -## qwen-tts -- !!merge <<: *qwen-tts - name: "qwen-tts-development" +- name: qwen-tts-development + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS capabilities: - nvidia: "cuda12-qwen-tts-development" - intel: "intel-qwen-tts-development" - amd: "rocm-qwen-tts-development" - nvidia-l4t: "nvidia-l4t-qwen-tts-development" - metal: "metal-qwen-tts-development" - default: "cpu-qwen-tts-development" - nvidia-cuda-13: "cuda13-qwen-tts-development" - nvidia-cuda-12: "cuda12-qwen-tts-development" - nvidia-l4t-cuda-12: "nvidia-l4t-qwen-tts-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-qwen-tts-development" -- !!merge <<: *qwen-tts - name: "cpu-qwen-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-qwen-tts" + amd: rocm-qwen-tts-development + default: cpu-qwen-tts-development + intel: intel-qwen-tts-development + metal: metal-qwen-tts-development + nvidia: cuda12-qwen-tts-development + nvidia-cuda-12: cuda12-qwen-tts-development + nvidia-cuda-13: cuda13-qwen-tts-development + nvidia-l4t: nvidia-l4t-qwen-tts-development + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts-development +- name: cpu-qwen-tts + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-qwen-tts mirrors: - localai/localai-backends:latest-cpu-qwen-tts -- !!merge <<: *qwen-tts - name: "cpu-qwen-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-qwen-tts" +- name: cpu-qwen-tts-development + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:master-cpu-qwen-tts mirrors: - localai/localai-backends:master-cpu-qwen-tts -- !!merge <<: *qwen-tts - name: "cuda12-qwen-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-qwen-tts" +- name: cuda12-qwen-tts + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-qwen-tts mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-qwen-tts -- !!merge <<: *qwen-tts - name: "cuda12-qwen-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-qwen-tts" +- name: cuda12-qwen-tts-development + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-qwen-tts mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-qwen-tts -- !!merge <<: *qwen-tts - name: "cuda13-qwen-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-qwen-tts" +- name: cuda13-qwen-tts + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-qwen-tts mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-qwen-tts -- !!merge <<: *qwen-tts - name: "cuda13-qwen-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-qwen-tts" +- name: cuda13-qwen-tts-development + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-qwen-tts mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-qwen-tts -- !!merge <<: *qwen-tts - name: "intel-qwen-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-qwen-tts" +- name: intel-qwen-tts + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-qwen-tts mirrors: - localai/localai-backends:latest-gpu-intel-qwen-tts -- !!merge <<: *qwen-tts - name: "intel-qwen-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-qwen-tts" +- name: intel-qwen-tts-development + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-qwen-tts mirrors: - localai/localai-backends:master-gpu-intel-qwen-tts -- !!merge <<: *qwen-tts - name: "rocm-qwen-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-qwen-tts" +- name: rocm-qwen-tts + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-qwen-tts mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-qwen-tts -- !!merge <<: *qwen-tts - name: "rocm-qwen-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-qwen-tts" +- name: rocm-qwen-tts-development + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-qwen-tts mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-qwen-tts -- !!merge <<: *qwen-tts - name: "nvidia-l4t-qwen-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-qwen-tts" +- name: nvidia-l4t-qwen-tts + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-qwen-tts mirrors: - localai/localai-backends:latest-nvidia-l4t-qwen-tts -- !!merge <<: *qwen-tts - name: "nvidia-l4t-qwen-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-qwen-tts" +- name: nvidia-l4t-qwen-tts-development + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-qwen-tts mirrors: - localai/localai-backends:master-nvidia-l4t-qwen-tts -- !!merge <<: *qwen-tts - name: "cuda13-nvidia-l4t-arm64-qwen-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-qwen-tts" +- name: cuda13-nvidia-l4t-arm64-qwen-tts + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-qwen-tts mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-qwen-tts -- !!merge <<: *qwen-tts - name: "cuda13-nvidia-l4t-arm64-qwen-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-qwen-tts" +- name: cuda13-nvidia-l4t-arm64-qwen-tts-development + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-qwen-tts mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-qwen-tts -- !!merge <<: *qwen-tts - name: "metal-qwen-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-qwen-tts" +- name: metal-qwen-tts + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-qwen-tts mirrors: - localai/localai-backends:latest-metal-darwin-arm64-qwen-tts -- !!merge <<: *qwen-tts - name: "metal-qwen-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-qwen-tts" +- name: metal-qwen-tts-development + alias: qwen-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + urls: + - https://github.com/QwenLM/Qwen3-TTS + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-qwen-tts + default: cpu-qwen-tts + intel: intel-qwen-tts + metal: metal-qwen-tts + nvidia: cuda12-qwen-tts + nvidia-cuda-12: cuda12-qwen-tts + nvidia-cuda-13: cuda13-qwen-tts + nvidia-l4t: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-12: nvidia-l4t-qwen-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-tts + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-qwen-tts mirrors: - localai/localai-backends:master-metal-darwin-arm64-qwen-tts -## fish-speech -- !!merge <<: *fish-speech - name: "fish-speech-development" +- name: fish-speech-development + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech + tags: + - text-to-speech + - TTS + - voice-cloning capabilities: - nvidia: "cuda12-fish-speech-development" - intel: "intel-fish-speech-development" - amd: "rocm-fish-speech-development" - nvidia-l4t: "nvidia-l4t-fish-speech-development" - default: "cpu-fish-speech-development" - nvidia-cuda-13: "cuda13-fish-speech-development" - nvidia-cuda-12: "cuda12-fish-speech-development" - nvidia-l4t-cuda-12: "nvidia-l4t-fish-speech-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-fish-speech-development" -- !!merge <<: *fish-speech - name: "cpu-fish-speech" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-fish-speech" + amd: rocm-fish-speech-development + default: cpu-fish-speech-development + intel: intel-fish-speech-development + nvidia: cuda12-fish-speech-development + nvidia-cuda-12: cuda12-fish-speech-development + nvidia-cuda-13: cuda13-fish-speech-development + nvidia-l4t: nvidia-l4t-fish-speech-development + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech-development +- name: cpu-fish-speech + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech + tags: + - text-to-speech + - TTS + - voice-cloning + capabilities: + amd: rocm-fish-speech + default: cpu-fish-speech + intel: intel-fish-speech + nvidia: cuda12-fish-speech + nvidia-cuda-12: cuda12-fish-speech + nvidia-cuda-13: cuda13-fish-speech + nvidia-l4t: nvidia-l4t-fish-speech + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-fish-speech mirrors: - localai/localai-backends:latest-cpu-fish-speech -- !!merge <<: *fish-speech - name: "cpu-fish-speech-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-fish-speech" +- name: cpu-fish-speech-development + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech + tags: + - text-to-speech + - TTS + - voice-cloning + capabilities: + amd: rocm-fish-speech + default: cpu-fish-speech + intel: intel-fish-speech + nvidia: cuda12-fish-speech + nvidia-cuda-12: cuda12-fish-speech + nvidia-cuda-13: cuda13-fish-speech + nvidia-l4t: nvidia-l4t-fish-speech + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech + uri: quay.io/go-skynet/local-ai-backends:master-cpu-fish-speech mirrors: - localai/localai-backends:master-cpu-fish-speech -- !!merge <<: *fish-speech - name: "cuda12-fish-speech" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-fish-speech" +- name: cuda12-fish-speech + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech + tags: + - text-to-speech + - TTS + - voice-cloning + capabilities: + amd: rocm-fish-speech + default: cpu-fish-speech + intel: intel-fish-speech + nvidia: cuda12-fish-speech + nvidia-cuda-12: cuda12-fish-speech + nvidia-cuda-13: cuda13-fish-speech + nvidia-l4t: nvidia-l4t-fish-speech + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-fish-speech mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-fish-speech -- !!merge <<: *fish-speech - name: "cuda12-fish-speech-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-fish-speech" +- name: cuda12-fish-speech-development + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech + tags: + - text-to-speech + - TTS + - voice-cloning + capabilities: + amd: rocm-fish-speech + default: cpu-fish-speech + intel: intel-fish-speech + nvidia: cuda12-fish-speech + nvidia-cuda-12: cuda12-fish-speech + nvidia-cuda-13: cuda13-fish-speech + nvidia-l4t: nvidia-l4t-fish-speech + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-fish-speech mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-fish-speech -- !!merge <<: *fish-speech - name: "cuda13-fish-speech" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-fish-speech" +- name: cuda13-fish-speech + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech + tags: + - text-to-speech + - TTS + - voice-cloning + capabilities: + amd: rocm-fish-speech + default: cpu-fish-speech + intel: intel-fish-speech + nvidia: cuda12-fish-speech + nvidia-cuda-12: cuda12-fish-speech + nvidia-cuda-13: cuda13-fish-speech + nvidia-l4t: nvidia-l4t-fish-speech + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-fish-speech mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-fish-speech -- !!merge <<: *fish-speech - name: "cuda13-fish-speech-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-fish-speech" +- name: cuda13-fish-speech-development + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech + tags: + - text-to-speech + - TTS + - voice-cloning + capabilities: + amd: rocm-fish-speech + default: cpu-fish-speech + intel: intel-fish-speech + nvidia: cuda12-fish-speech + nvidia-cuda-12: cuda12-fish-speech + nvidia-cuda-13: cuda13-fish-speech + nvidia-l4t: nvidia-l4t-fish-speech + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-fish-speech mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-fish-speech -- !!merge <<: *fish-speech - name: "intel-fish-speech" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-fish-speech" +- name: intel-fish-speech + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech + tags: + - text-to-speech + - TTS + - voice-cloning + capabilities: + amd: rocm-fish-speech + default: cpu-fish-speech + intel: intel-fish-speech + nvidia: cuda12-fish-speech + nvidia-cuda-12: cuda12-fish-speech + nvidia-cuda-13: cuda13-fish-speech + nvidia-l4t: nvidia-l4t-fish-speech + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-fish-speech mirrors: - localai/localai-backends:latest-gpu-intel-fish-speech -- !!merge <<: *fish-speech - name: "intel-fish-speech-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-fish-speech" +- name: intel-fish-speech-development + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech + tags: + - text-to-speech + - TTS + - voice-cloning + capabilities: + amd: rocm-fish-speech + default: cpu-fish-speech + intel: intel-fish-speech + nvidia: cuda12-fish-speech + nvidia-cuda-12: cuda12-fish-speech + nvidia-cuda-13: cuda13-fish-speech + nvidia-l4t: nvidia-l4t-fish-speech + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-fish-speech mirrors: - localai/localai-backends:master-gpu-intel-fish-speech -- !!merge <<: *fish-speech - name: "rocm-fish-speech" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-fish-speech" +- name: rocm-fish-speech + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech + tags: + - text-to-speech + - TTS + - voice-cloning + capabilities: + amd: rocm-fish-speech + default: cpu-fish-speech + intel: intel-fish-speech + nvidia: cuda12-fish-speech + nvidia-cuda-12: cuda12-fish-speech + nvidia-cuda-13: cuda13-fish-speech + nvidia-l4t: nvidia-l4t-fish-speech + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-fish-speech mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-fish-speech -- !!merge <<: *fish-speech - name: "rocm-fish-speech-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-fish-speech" +- name: rocm-fish-speech-development + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech + tags: + - text-to-speech + - TTS + - voice-cloning + capabilities: + amd: rocm-fish-speech + default: cpu-fish-speech + intel: intel-fish-speech + nvidia: cuda12-fish-speech + nvidia-cuda-12: cuda12-fish-speech + nvidia-cuda-13: cuda13-fish-speech + nvidia-l4t: nvidia-l4t-fish-speech + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-fish-speech mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-fish-speech -- !!merge <<: *fish-speech - name: "nvidia-l4t-fish-speech" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-fish-speech" +- name: nvidia-l4t-fish-speech + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech + tags: + - text-to-speech + - TTS + - voice-cloning + capabilities: + amd: rocm-fish-speech + default: cpu-fish-speech + intel: intel-fish-speech + nvidia: cuda12-fish-speech + nvidia-cuda-12: cuda12-fish-speech + nvidia-cuda-13: cuda13-fish-speech + nvidia-l4t: nvidia-l4t-fish-speech + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-fish-speech mirrors: - localai/localai-backends:latest-nvidia-l4t-fish-speech -- !!merge <<: *fish-speech - name: "nvidia-l4t-fish-speech-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-fish-speech" +- name: nvidia-l4t-fish-speech-development + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech + tags: + - text-to-speech + - TTS + - voice-cloning + capabilities: + amd: rocm-fish-speech + default: cpu-fish-speech + intel: intel-fish-speech + nvidia: cuda12-fish-speech + nvidia-cuda-12: cuda12-fish-speech + nvidia-cuda-13: cuda13-fish-speech + nvidia-l4t: nvidia-l4t-fish-speech + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-fish-speech mirrors: - localai/localai-backends:master-nvidia-l4t-fish-speech -- !!merge <<: *fish-speech - name: "cuda13-nvidia-l4t-arm64-fish-speech" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-fish-speech" +- name: cuda13-nvidia-l4t-arm64-fish-speech + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech + tags: + - text-to-speech + - TTS + - voice-cloning + capabilities: + amd: rocm-fish-speech + default: cpu-fish-speech + intel: intel-fish-speech + nvidia: cuda12-fish-speech + nvidia-cuda-12: cuda12-fish-speech + nvidia-cuda-13: cuda13-fish-speech + nvidia-l4t: nvidia-l4t-fish-speech + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-fish-speech mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-fish-speech -- !!merge <<: *fish-speech - name: "cuda13-nvidia-l4t-arm64-fish-speech-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-fish-speech" +- name: cuda13-nvidia-l4t-arm64-fish-speech-development + alias: fish-speech + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + urls: + - https://github.com/fishaudio/fish-speech + tags: + - text-to-speech + - TTS + - voice-cloning + capabilities: + amd: rocm-fish-speech + default: cpu-fish-speech + intel: intel-fish-speech + nvidia: cuda12-fish-speech + nvidia-cuda-12: cuda12-fish-speech + nvidia-cuda-13: cuda13-fish-speech + nvidia-l4t: nvidia-l4t-fish-speech + nvidia-l4t-cuda-12: nvidia-l4t-fish-speech + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-fish-speech + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-fish-speech mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-fish-speech -## faster-qwen3-tts -- !!merge <<: *faster-qwen3-tts - name: "faster-qwen3-tts-development" +- name: faster-qwen3-tts-development + alias: faster-qwen3-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Real-time Qwen3-TTS inference using CUDA graph capture. Voice clone only; requires NVIDIA GPU with CUDA. + urls: + - https://github.com/andimarafioti/faster-qwen3-tts + - https://pypi.org/project/faster-qwen3-tts/ + tags: + - text-to-speech + - TTS + - voice-clone capabilities: - nvidia: "cuda12-faster-qwen3-tts-development" - default: "cuda12-faster-qwen3-tts-development" - nvidia-cuda-13: "cuda13-faster-qwen3-tts-development" - nvidia-cuda-12: "cuda12-faster-qwen3-tts-development" - nvidia-l4t: "nvidia-l4t-faster-qwen3-tts-development" - nvidia-l4t-cuda-12: "nvidia-l4t-faster-qwen3-tts-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-faster-qwen3-tts-development" -- !!merge <<: *faster-qwen3-tts - name: "cuda12-faster-qwen3-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-faster-qwen3-tts" + default: cuda12-faster-qwen3-tts-development + nvidia: cuda12-faster-qwen3-tts-development + nvidia-cuda-12: cuda12-faster-qwen3-tts-development + nvidia-cuda-13: cuda13-faster-qwen3-tts-development + nvidia-l4t: nvidia-l4t-faster-qwen3-tts-development + nvidia-l4t-cuda-12: nvidia-l4t-faster-qwen3-tts-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-faster-qwen3-tts-development +- name: cuda12-faster-qwen3-tts + alias: faster-qwen3-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Real-time Qwen3-TTS inference using CUDA graph capture. Voice clone only; requires NVIDIA GPU with CUDA. + urls: + - https://github.com/andimarafioti/faster-qwen3-tts + - https://pypi.org/project/faster-qwen3-tts/ + tags: + - text-to-speech + - TTS + - voice-clone + capabilities: + default: cuda12-faster-qwen3-tts + nvidia: cuda12-faster-qwen3-tts + nvidia-cuda-12: cuda12-faster-qwen3-tts + nvidia-cuda-13: cuda13-faster-qwen3-tts + nvidia-l4t: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-12: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-faster-qwen3-tts + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-faster-qwen3-tts mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-faster-qwen3-tts -- !!merge <<: *faster-qwen3-tts - name: "cuda12-faster-qwen3-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-faster-qwen3-tts" +- name: cuda12-faster-qwen3-tts-development + alias: faster-qwen3-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Real-time Qwen3-TTS inference using CUDA graph capture. Voice clone only; requires NVIDIA GPU with CUDA. + urls: + - https://github.com/andimarafioti/faster-qwen3-tts + - https://pypi.org/project/faster-qwen3-tts/ + tags: + - text-to-speech + - TTS + - voice-clone + capabilities: + default: cuda12-faster-qwen3-tts + nvidia: cuda12-faster-qwen3-tts + nvidia-cuda-12: cuda12-faster-qwen3-tts + nvidia-cuda-13: cuda13-faster-qwen3-tts + nvidia-l4t: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-12: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-faster-qwen3-tts + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-faster-qwen3-tts mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-faster-qwen3-tts -- !!merge <<: *faster-qwen3-tts - name: "cuda13-faster-qwen3-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-faster-qwen3-tts" +- name: cuda13-faster-qwen3-tts + alias: faster-qwen3-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Real-time Qwen3-TTS inference using CUDA graph capture. Voice clone only; requires NVIDIA GPU with CUDA. + urls: + - https://github.com/andimarafioti/faster-qwen3-tts + - https://pypi.org/project/faster-qwen3-tts/ + tags: + - text-to-speech + - TTS + - voice-clone + capabilities: + default: cuda12-faster-qwen3-tts + nvidia: cuda12-faster-qwen3-tts + nvidia-cuda-12: cuda12-faster-qwen3-tts + nvidia-cuda-13: cuda13-faster-qwen3-tts + nvidia-l4t: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-12: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-faster-qwen3-tts + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-faster-qwen3-tts mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-faster-qwen3-tts -- !!merge <<: *faster-qwen3-tts - name: "cuda13-faster-qwen3-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-faster-qwen3-tts" +- name: cuda13-faster-qwen3-tts-development + alias: faster-qwen3-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Real-time Qwen3-TTS inference using CUDA graph capture. Voice clone only; requires NVIDIA GPU with CUDA. + urls: + - https://github.com/andimarafioti/faster-qwen3-tts + - https://pypi.org/project/faster-qwen3-tts/ + tags: + - text-to-speech + - TTS + - voice-clone + capabilities: + default: cuda12-faster-qwen3-tts + nvidia: cuda12-faster-qwen3-tts + nvidia-cuda-12: cuda12-faster-qwen3-tts + nvidia-cuda-13: cuda13-faster-qwen3-tts + nvidia-l4t: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-12: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-faster-qwen3-tts + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-faster-qwen3-tts mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-faster-qwen3-tts -- !!merge <<: *faster-qwen3-tts - name: "nvidia-l4t-faster-qwen3-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-faster-qwen3-tts" +- name: nvidia-l4t-faster-qwen3-tts + alias: faster-qwen3-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Real-time Qwen3-TTS inference using CUDA graph capture. Voice clone only; requires NVIDIA GPU with CUDA. + urls: + - https://github.com/andimarafioti/faster-qwen3-tts + - https://pypi.org/project/faster-qwen3-tts/ + tags: + - text-to-speech + - TTS + - voice-clone + capabilities: + default: cuda12-faster-qwen3-tts + nvidia: cuda12-faster-qwen3-tts + nvidia-cuda-12: cuda12-faster-qwen3-tts + nvidia-cuda-13: cuda13-faster-qwen3-tts + nvidia-l4t: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-12: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-faster-qwen3-tts + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-faster-qwen3-tts mirrors: - localai/localai-backends:latest-nvidia-l4t-faster-qwen3-tts -- !!merge <<: *faster-qwen3-tts - name: "nvidia-l4t-faster-qwen3-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-faster-qwen3-tts" +- name: nvidia-l4t-faster-qwen3-tts-development + alias: faster-qwen3-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Real-time Qwen3-TTS inference using CUDA graph capture. Voice clone only; requires NVIDIA GPU with CUDA. + urls: + - https://github.com/andimarafioti/faster-qwen3-tts + - https://pypi.org/project/faster-qwen3-tts/ + tags: + - text-to-speech + - TTS + - voice-clone + capabilities: + default: cuda12-faster-qwen3-tts + nvidia: cuda12-faster-qwen3-tts + nvidia-cuda-12: cuda12-faster-qwen3-tts + nvidia-cuda-13: cuda13-faster-qwen3-tts + nvidia-l4t: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-12: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-faster-qwen3-tts + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-faster-qwen3-tts mirrors: - localai/localai-backends:master-nvidia-l4t-faster-qwen3-tts -- !!merge <<: *faster-qwen3-tts - name: "cuda13-nvidia-l4t-arm64-faster-qwen3-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-faster-qwen3-tts" +- name: cuda13-nvidia-l4t-arm64-faster-qwen3-tts + alias: faster-qwen3-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Real-time Qwen3-TTS inference using CUDA graph capture. Voice clone only; requires NVIDIA GPU with CUDA. + urls: + - https://github.com/andimarafioti/faster-qwen3-tts + - https://pypi.org/project/faster-qwen3-tts/ + tags: + - text-to-speech + - TTS + - voice-clone + capabilities: + default: cuda12-faster-qwen3-tts + nvidia: cuda12-faster-qwen3-tts + nvidia-cuda-12: cuda12-faster-qwen3-tts + nvidia-cuda-13: cuda13-faster-qwen3-tts + nvidia-l4t: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-12: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-faster-qwen3-tts + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-faster-qwen3-tts mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-faster-qwen3-tts -- !!merge <<: *faster-qwen3-tts - name: "cuda13-nvidia-l4t-arm64-faster-qwen3-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-faster-qwen3-tts" +- name: cuda13-nvidia-l4t-arm64-faster-qwen3-tts-development + alias: faster-qwen3-tts + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Real-time Qwen3-TTS inference using CUDA graph capture. Voice clone only; requires NVIDIA GPU with CUDA. + urls: + - https://github.com/andimarafioti/faster-qwen3-tts + - https://pypi.org/project/faster-qwen3-tts/ + tags: + - text-to-speech + - TTS + - voice-clone + capabilities: + default: cuda12-faster-qwen3-tts + nvidia: cuda12-faster-qwen3-tts + nvidia-cuda-12: cuda12-faster-qwen3-tts + nvidia-cuda-13: cuda13-faster-qwen3-tts + nvidia-l4t: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-12: nvidia-l4t-faster-qwen3-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-faster-qwen3-tts + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-faster-qwen3-tts mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-faster-qwen3-tts -## whisper-medusa -- !!merge <<: *whisper-medusa - name: "whisper-medusa-development" +- name: whisper-medusa-development + alias: whisper-medusa + license: MIT + description: | + Whisper-Medusa accelerates Whisper transcription by predicting multiple tokens per decoding step. + The upstream checkpoints use custom Transformers generation code and accept audio clips up to 30 seconds. + urls: + - https://github.com/aiola-lab/whisper-medusa + - https://huggingface.co/collections/aiola/whisper-medusa + tags: + - speech-to-text + - transcription + - Whisper + - Medusa capabilities: - default: "cpu-whisper-medusa-development" - nvidia: "cuda12-whisper-medusa-development" - nvidia-cuda-12: "cuda12-whisper-medusa-development" -- !!merge <<: *whisper-medusa - name: "cpu-whisper-medusa" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-whisper-medusa" + default: cpu-whisper-medusa-development + nvidia: cuda12-whisper-medusa-development + nvidia-cuda-12: cuda12-whisper-medusa-development +- name: cpu-whisper-medusa + alias: whisper-medusa + license: MIT + description: | + Whisper-Medusa accelerates Whisper transcription by predicting multiple tokens per decoding step. + The upstream checkpoints use custom Transformers generation code and accept audio clips up to 30 seconds. + urls: + - https://github.com/aiola-lab/whisper-medusa + - https://huggingface.co/collections/aiola/whisper-medusa + tags: + - speech-to-text + - transcription + - Whisper + - Medusa + capabilities: + default: cpu-whisper-medusa + nvidia: cuda12-whisper-medusa + nvidia-cuda-12: cuda12-whisper-medusa + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-whisper-medusa mirrors: - localai/localai-backends:latest-cpu-whisper-medusa -- !!merge <<: *whisper-medusa - name: "cpu-whisper-medusa-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-whisper-medusa" +- name: cpu-whisper-medusa-development + alias: whisper-medusa + license: MIT + description: | + Whisper-Medusa accelerates Whisper transcription by predicting multiple tokens per decoding step. + The upstream checkpoints use custom Transformers generation code and accept audio clips up to 30 seconds. + urls: + - https://github.com/aiola-lab/whisper-medusa + - https://huggingface.co/collections/aiola/whisper-medusa + tags: + - speech-to-text + - transcription + - Whisper + - Medusa + capabilities: + default: cpu-whisper-medusa + nvidia: cuda12-whisper-medusa + nvidia-cuda-12: cuda12-whisper-medusa + uri: quay.io/go-skynet/local-ai-backends:master-cpu-whisper-medusa mirrors: - localai/localai-backends:master-cpu-whisper-medusa -- !!merge <<: *whisper-medusa - name: "cuda12-whisper-medusa" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-whisper-medusa" +- name: cuda12-whisper-medusa + alias: whisper-medusa + license: MIT + description: | + Whisper-Medusa accelerates Whisper transcription by predicting multiple tokens per decoding step. + The upstream checkpoints use custom Transformers generation code and accept audio clips up to 30 seconds. + urls: + - https://github.com/aiola-lab/whisper-medusa + - https://huggingface.co/collections/aiola/whisper-medusa + tags: + - speech-to-text + - transcription + - Whisper + - Medusa + capabilities: + default: cpu-whisper-medusa + nvidia: cuda12-whisper-medusa + nvidia-cuda-12: cuda12-whisper-medusa + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-whisper-medusa mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-whisper-medusa -- !!merge <<: *whisper-medusa - name: "cuda12-whisper-medusa-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-whisper-medusa" +- name: cuda12-whisper-medusa-development + alias: whisper-medusa + license: MIT + description: | + Whisper-Medusa accelerates Whisper transcription by predicting multiple tokens per decoding step. + The upstream checkpoints use custom Transformers generation code and accept audio clips up to 30 seconds. + urls: + - https://github.com/aiola-lab/whisper-medusa + - https://huggingface.co/collections/aiola/whisper-medusa + tags: + - speech-to-text + - transcription + - Whisper + - Medusa + capabilities: + default: cpu-whisper-medusa + nvidia: cuda12-whisper-medusa + nvidia-cuda-12: cuda12-whisper-medusa + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-whisper-medusa mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-whisper-medusa - -## qwen-asr -- !!merge <<: *qwen-asr - name: "qwen-asr-development" +- name: qwen-asr-development + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR capabilities: - nvidia: "cuda12-qwen-asr-development" - intel: "intel-qwen-asr-development" - amd: "rocm-qwen-asr-development" - nvidia-l4t: "nvidia-l4t-qwen-asr-development" - metal: "metal-qwen-asr-development" - default: "cpu-qwen-asr-development" - nvidia-cuda-13: "cuda13-qwen-asr-development" - nvidia-cuda-12: "cuda12-qwen-asr-development" - nvidia-l4t-cuda-12: "nvidia-l4t-qwen-asr-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-qwen-asr-development" -- !!merge <<: *qwen-asr - name: "cpu-qwen-asr" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-qwen-asr" + amd: rocm-qwen-asr-development + default: cpu-qwen-asr-development + intel: intel-qwen-asr-development + metal: metal-qwen-asr-development + nvidia: cuda12-qwen-asr-development + nvidia-cuda-12: cuda12-qwen-asr-development + nvidia-cuda-13: cuda13-qwen-asr-development + nvidia-l4t: nvidia-l4t-qwen-asr-development + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr-development +- name: cpu-qwen-asr + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-qwen-asr mirrors: - localai/localai-backends:latest-cpu-qwen-asr -- !!merge <<: *qwen-asr - name: "cpu-qwen-asr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-qwen-asr" +- name: cpu-qwen-asr-development + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:master-cpu-qwen-asr mirrors: - localai/localai-backends:master-cpu-qwen-asr -- !!merge <<: *qwen-asr - name: "cuda12-qwen-asr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-qwen-asr" +- name: cuda12-qwen-asr + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-qwen-asr mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-qwen-asr -- !!merge <<: *qwen-asr - name: "cuda12-qwen-asr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-qwen-asr" +- name: cuda12-qwen-asr-development + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-qwen-asr mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-qwen-asr -- !!merge <<: *qwen-asr - name: "cuda13-qwen-asr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-qwen-asr" +- name: cuda13-qwen-asr + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-qwen-asr mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-qwen-asr -- !!merge <<: *qwen-asr - name: "cuda13-qwen-asr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-qwen-asr" +- name: cuda13-qwen-asr-development + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-qwen-asr mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-qwen-asr -- !!merge <<: *qwen-asr - name: "intel-qwen-asr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-qwen-asr" +- name: intel-qwen-asr + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-qwen-asr mirrors: - localai/localai-backends:latest-gpu-intel-qwen-asr -- !!merge <<: *qwen-asr - name: "intel-qwen-asr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-qwen-asr" +- name: intel-qwen-asr-development + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-qwen-asr mirrors: - localai/localai-backends:master-gpu-intel-qwen-asr -- !!merge <<: *qwen-asr - name: "rocm-qwen-asr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-qwen-asr" +- name: rocm-qwen-asr + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-qwen-asr mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-qwen-asr -- !!merge <<: *qwen-asr - name: "rocm-qwen-asr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-qwen-asr" +- name: rocm-qwen-asr-development + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-qwen-asr mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-qwen-asr -- !!merge <<: *qwen-asr - name: "nvidia-l4t-qwen-asr" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-qwen-asr" +- name: nvidia-l4t-qwen-asr + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-qwen-asr mirrors: - localai/localai-backends:latest-nvidia-l4t-qwen-asr -- !!merge <<: *qwen-asr - name: "nvidia-l4t-qwen-asr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-qwen-asr" +- name: nvidia-l4t-qwen-asr-development + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-qwen-asr mirrors: - localai/localai-backends:master-nvidia-l4t-qwen-asr -- !!merge <<: *qwen-asr - name: "cuda13-nvidia-l4t-arm64-qwen-asr" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-qwen-asr" +- name: cuda13-nvidia-l4t-arm64-qwen-asr + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-qwen-asr mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-qwen-asr -- !!merge <<: *qwen-asr - name: "cuda13-nvidia-l4t-arm64-qwen-asr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-qwen-asr" +- name: cuda13-nvidia-l4t-arm64-qwen-asr-development + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-qwen-asr mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-qwen-asr -- !!merge <<: *qwen-asr - name: "metal-qwen-asr" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-qwen-asr" +- name: metal-qwen-asr + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-qwen-asr mirrors: - localai/localai-backends:latest-metal-darwin-arm64-qwen-asr -- !!merge <<: *qwen-asr - name: "metal-qwen-asr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-qwen-asr" +- name: metal-qwen-asr-development + alias: qwen-asr + license: apache-2.0 + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + urls: + - https://github.com/QwenLM/Qwen3-ASR + tags: + - speech-recognition + - ASR + capabilities: + amd: rocm-qwen-asr + default: cpu-qwen-asr + intel: intel-qwen-asr + metal: metal-qwen-asr + nvidia: cuda12-qwen-asr + nvidia-cuda-12: cuda12-qwen-asr + nvidia-cuda-13: cuda13-qwen-asr + nvidia-l4t: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-12: nvidia-l4t-qwen-asr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-qwen-asr + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-qwen-asr mirrors: - localai/localai-backends:master-metal-darwin-arm64-qwen-asr -## nemo -- !!merge <<: *nemo - name: "nemo-development" +- name: nemo-development + alias: nemo + license: apache-2.0 + icon: https://www.nvidia.com/favicon.ico + description: | + NVIDIA NEMO Toolkit for ASR provides state-of-the-art automatic speech recognition models including Parakeet models for various languages and use cases. + urls: + - https://github.com/NVIDIA/NeMo + tags: + - speech-recognition + - ASR + - NVIDIA capabilities: - nvidia: "cuda12-nemo-development" - intel: "intel-nemo-development" - amd: "rocm-nemo-development" - metal: "metal-nemo-development" - default: "cpu-nemo-development" - nvidia-cuda-13: "cuda13-nemo-development" - nvidia-cuda-12: "cuda12-nemo-development" -- !!merge <<: *nemo - name: "cpu-nemo" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-nemo" + amd: rocm-nemo-development + default: cpu-nemo-development + intel: intel-nemo-development + metal: metal-nemo-development + nvidia: cuda12-nemo-development + nvidia-cuda-12: cuda12-nemo-development + nvidia-cuda-13: cuda13-nemo-development +- name: cpu-nemo + alias: nemo + license: apache-2.0 + icon: https://www.nvidia.com/favicon.ico + description: | + NVIDIA NEMO Toolkit for ASR provides state-of-the-art automatic speech recognition models including Parakeet models for various languages and use cases. + urls: + - https://github.com/NVIDIA/NeMo + tags: + - speech-recognition + - ASR + - NVIDIA + capabilities: + amd: rocm-nemo + default: cpu-nemo + intel: intel-nemo + metal: metal-nemo + nvidia: cuda12-nemo + nvidia-cuda-12: cuda12-nemo + nvidia-cuda-13: cuda13-nemo + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-nemo mirrors: - localai/localai-backends:latest-cpu-nemo -- !!merge <<: *nemo - name: "cpu-nemo-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-nemo" +- name: cpu-nemo-development + alias: nemo + license: apache-2.0 + icon: https://www.nvidia.com/favicon.ico + description: | + NVIDIA NEMO Toolkit for ASR provides state-of-the-art automatic speech recognition models including Parakeet models for various languages and use cases. + urls: + - https://github.com/NVIDIA/NeMo + tags: + - speech-recognition + - ASR + - NVIDIA + capabilities: + amd: rocm-nemo + default: cpu-nemo + intel: intel-nemo + metal: metal-nemo + nvidia: cuda12-nemo + nvidia-cuda-12: cuda12-nemo + nvidia-cuda-13: cuda13-nemo + uri: quay.io/go-skynet/local-ai-backends:master-cpu-nemo mirrors: - localai/localai-backends:master-cpu-nemo -- !!merge <<: *nemo - name: "cuda12-nemo" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-nemo" +- name: cuda12-nemo + alias: nemo + license: apache-2.0 + icon: https://www.nvidia.com/favicon.ico + description: | + NVIDIA NEMO Toolkit for ASR provides state-of-the-art automatic speech recognition models including Parakeet models for various languages and use cases. + urls: + - https://github.com/NVIDIA/NeMo + tags: + - speech-recognition + - ASR + - NVIDIA + capabilities: + amd: rocm-nemo + default: cpu-nemo + intel: intel-nemo + metal: metal-nemo + nvidia: cuda12-nemo + nvidia-cuda-12: cuda12-nemo + nvidia-cuda-13: cuda13-nemo + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-nemo mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-nemo -- !!merge <<: *nemo - name: "cuda12-nemo-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-nemo" +- name: cuda12-nemo-development + alias: nemo + license: apache-2.0 + icon: https://www.nvidia.com/favicon.ico + description: | + NVIDIA NEMO Toolkit for ASR provides state-of-the-art automatic speech recognition models including Parakeet models for various languages and use cases. + urls: + - https://github.com/NVIDIA/NeMo + tags: + - speech-recognition + - ASR + - NVIDIA + capabilities: + amd: rocm-nemo + default: cpu-nemo + intel: intel-nemo + metal: metal-nemo + nvidia: cuda12-nemo + nvidia-cuda-12: cuda12-nemo + nvidia-cuda-13: cuda13-nemo + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-nemo mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-nemo -- !!merge <<: *nemo - name: "cuda13-nemo" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-nemo" +- name: cuda13-nemo + alias: nemo + license: apache-2.0 + icon: https://www.nvidia.com/favicon.ico + description: | + NVIDIA NEMO Toolkit for ASR provides state-of-the-art automatic speech recognition models including Parakeet models for various languages and use cases. + urls: + - https://github.com/NVIDIA/NeMo + tags: + - speech-recognition + - ASR + - NVIDIA + capabilities: + amd: rocm-nemo + default: cpu-nemo + intel: intel-nemo + metal: metal-nemo + nvidia: cuda12-nemo + nvidia-cuda-12: cuda12-nemo + nvidia-cuda-13: cuda13-nemo + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-nemo mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-nemo -- !!merge <<: *nemo - name: "cuda13-nemo-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-nemo" +- name: cuda13-nemo-development + alias: nemo + license: apache-2.0 + icon: https://www.nvidia.com/favicon.ico + description: | + NVIDIA NEMO Toolkit for ASR provides state-of-the-art automatic speech recognition models including Parakeet models for various languages and use cases. + urls: + - https://github.com/NVIDIA/NeMo + tags: + - speech-recognition + - ASR + - NVIDIA + capabilities: + amd: rocm-nemo + default: cpu-nemo + intel: intel-nemo + metal: metal-nemo + nvidia: cuda12-nemo + nvidia-cuda-12: cuda12-nemo + nvidia-cuda-13: cuda13-nemo + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-nemo mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-nemo -- !!merge <<: *nemo - name: "intel-nemo" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-nemo" +- name: intel-nemo + alias: nemo + license: apache-2.0 + icon: https://www.nvidia.com/favicon.ico + description: | + NVIDIA NEMO Toolkit for ASR provides state-of-the-art automatic speech recognition models including Parakeet models for various languages and use cases. + urls: + - https://github.com/NVIDIA/NeMo + tags: + - speech-recognition + - ASR + - NVIDIA + capabilities: + amd: rocm-nemo + default: cpu-nemo + intel: intel-nemo + metal: metal-nemo + nvidia: cuda12-nemo + nvidia-cuda-12: cuda12-nemo + nvidia-cuda-13: cuda13-nemo + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-nemo mirrors: - localai/localai-backends:latest-gpu-intel-nemo -- !!merge <<: *nemo - name: "intel-nemo-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-nemo" +- name: intel-nemo-development + alias: nemo + license: apache-2.0 + icon: https://www.nvidia.com/favicon.ico + description: | + NVIDIA NEMO Toolkit for ASR provides state-of-the-art automatic speech recognition models including Parakeet models for various languages and use cases. + urls: + - https://github.com/NVIDIA/NeMo + tags: + - speech-recognition + - ASR + - NVIDIA + capabilities: + amd: rocm-nemo + default: cpu-nemo + intel: intel-nemo + metal: metal-nemo + nvidia: cuda12-nemo + nvidia-cuda-12: cuda12-nemo + nvidia-cuda-13: cuda13-nemo + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-nemo mirrors: - localai/localai-backends:master-gpu-intel-nemo -- !!merge <<: *nemo - name: "rocm-nemo" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-nemo" +- name: rocm-nemo + alias: nemo + license: apache-2.0 + icon: https://www.nvidia.com/favicon.ico + description: | + NVIDIA NEMO Toolkit for ASR provides state-of-the-art automatic speech recognition models including Parakeet models for various languages and use cases. + urls: + - https://github.com/NVIDIA/NeMo + tags: + - speech-recognition + - ASR + - NVIDIA + capabilities: + amd: rocm-nemo + default: cpu-nemo + intel: intel-nemo + metal: metal-nemo + nvidia: cuda12-nemo + nvidia-cuda-12: cuda12-nemo + nvidia-cuda-13: cuda13-nemo + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-nemo mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-nemo -- !!merge <<: *nemo - name: "rocm-nemo-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-nemo" +- name: rocm-nemo-development + alias: nemo + license: apache-2.0 + icon: https://www.nvidia.com/favicon.ico + description: | + NVIDIA NEMO Toolkit for ASR provides state-of-the-art automatic speech recognition models including Parakeet models for various languages and use cases. + urls: + - https://github.com/NVIDIA/NeMo + tags: + - speech-recognition + - ASR + - NVIDIA + capabilities: + amd: rocm-nemo + default: cpu-nemo + intel: intel-nemo + metal: metal-nemo + nvidia: cuda12-nemo + nvidia-cuda-12: cuda12-nemo + nvidia-cuda-13: cuda13-nemo + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-nemo mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-nemo -- !!merge <<: *nemo - name: "metal-nemo" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-nemo" +- name: metal-nemo + alias: nemo + license: apache-2.0 + icon: https://www.nvidia.com/favicon.ico + description: | + NVIDIA NEMO Toolkit for ASR provides state-of-the-art automatic speech recognition models including Parakeet models for various languages and use cases. + urls: + - https://github.com/NVIDIA/NeMo + tags: + - speech-recognition + - ASR + - NVIDIA + capabilities: + amd: rocm-nemo + default: cpu-nemo + intel: intel-nemo + metal: metal-nemo + nvidia: cuda12-nemo + nvidia-cuda-12: cuda12-nemo + nvidia-cuda-13: cuda13-nemo + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-nemo mirrors: - localai/localai-backends:latest-metal-darwin-arm64-nemo -- !!merge <<: *nemo - name: "metal-nemo-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-nemo" +- name: metal-nemo-development + alias: nemo + license: apache-2.0 + icon: https://www.nvidia.com/favicon.ico + description: | + NVIDIA NEMO Toolkit for ASR provides state-of-the-art automatic speech recognition models including Parakeet models for various languages and use cases. + urls: + - https://github.com/NVIDIA/NeMo + tags: + - speech-recognition + - ASR + - NVIDIA + capabilities: + amd: rocm-nemo + default: cpu-nemo + intel: intel-nemo + metal: metal-nemo + nvidia: cuda12-nemo + nvidia-cuda-12: cuda12-nemo + nvidia-cuda-13: cuda13-nemo + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-nemo mirrors: - localai/localai-backends:master-metal-darwin-arm64-nemo -## voxcpm -- !!merge <<: *voxcpm - name: "voxcpm-development" +- name: voxcpm-development + alias: voxcpm + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech. + urls: + - https://github.com/ModelBest/VoxCPM + tags: + - text-to-speech + - TTS capabilities: - nvidia: "cuda12-voxcpm-development" - intel: "intel-voxcpm-development" - amd: "rocm-voxcpm-development" - metal: "metal-voxcpm-development" - default: "cpu-voxcpm-development" - nvidia-cuda-13: "cuda13-voxcpm-development" - nvidia-cuda-12: "cuda12-voxcpm-development" -- !!merge <<: *voxcpm - name: "cpu-voxcpm" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-voxcpm" + amd: rocm-voxcpm-development + default: cpu-voxcpm-development + intel: intel-voxcpm-development + metal: metal-voxcpm-development + nvidia: cuda12-voxcpm-development + nvidia-cuda-12: cuda12-voxcpm-development + nvidia-cuda-13: cuda13-voxcpm-development +- name: cpu-voxcpm + alias: voxcpm + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech. + urls: + - https://github.com/ModelBest/VoxCPM + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-voxcpm + default: cpu-voxcpm + intel: intel-voxcpm + metal: metal-voxcpm + nvidia: cuda12-voxcpm + nvidia-cuda-12: cuda12-voxcpm + nvidia-cuda-13: cuda13-voxcpm + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-voxcpm mirrors: - localai/localai-backends:latest-cpu-voxcpm -- !!merge <<: *voxcpm - name: "cpu-voxcpm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-voxcpm" +- name: cpu-voxcpm-development + alias: voxcpm + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech. + urls: + - https://github.com/ModelBest/VoxCPM + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-voxcpm + default: cpu-voxcpm + intel: intel-voxcpm + metal: metal-voxcpm + nvidia: cuda12-voxcpm + nvidia-cuda-12: cuda12-voxcpm + nvidia-cuda-13: cuda13-voxcpm + uri: quay.io/go-skynet/local-ai-backends:master-cpu-voxcpm mirrors: - localai/localai-backends:master-cpu-voxcpm -- !!merge <<: *voxcpm - name: "cuda12-voxcpm" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-voxcpm" +- name: cuda12-voxcpm + alias: voxcpm + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech. + urls: + - https://github.com/ModelBest/VoxCPM + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-voxcpm + default: cpu-voxcpm + intel: intel-voxcpm + metal: metal-voxcpm + nvidia: cuda12-voxcpm + nvidia-cuda-12: cuda12-voxcpm + nvidia-cuda-13: cuda13-voxcpm + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-voxcpm mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-voxcpm -- !!merge <<: *voxcpm - name: "cuda12-voxcpm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-voxcpm" +- name: cuda12-voxcpm-development + alias: voxcpm + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech. + urls: + - https://github.com/ModelBest/VoxCPM + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-voxcpm + default: cpu-voxcpm + intel: intel-voxcpm + metal: metal-voxcpm + nvidia: cuda12-voxcpm + nvidia-cuda-12: cuda12-voxcpm + nvidia-cuda-13: cuda13-voxcpm + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-voxcpm mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-voxcpm -- !!merge <<: *voxcpm - name: "cuda13-voxcpm" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-voxcpm" +- name: cuda13-voxcpm + alias: voxcpm + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech. + urls: + - https://github.com/ModelBest/VoxCPM + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-voxcpm + default: cpu-voxcpm + intel: intel-voxcpm + metal: metal-voxcpm + nvidia: cuda12-voxcpm + nvidia-cuda-12: cuda12-voxcpm + nvidia-cuda-13: cuda13-voxcpm + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-voxcpm mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-voxcpm -- !!merge <<: *voxcpm - name: "cuda13-voxcpm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-voxcpm" +- name: cuda13-voxcpm-development + alias: voxcpm + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech. + urls: + - https://github.com/ModelBest/VoxCPM + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-voxcpm + default: cpu-voxcpm + intel: intel-voxcpm + metal: metal-voxcpm + nvidia: cuda12-voxcpm + nvidia-cuda-12: cuda12-voxcpm + nvidia-cuda-13: cuda13-voxcpm + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-voxcpm mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-voxcpm -- !!merge <<: *voxcpm - name: "intel-voxcpm" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-voxcpm" +- name: intel-voxcpm + alias: voxcpm + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech. + urls: + - https://github.com/ModelBest/VoxCPM + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-voxcpm + default: cpu-voxcpm + intel: intel-voxcpm + metal: metal-voxcpm + nvidia: cuda12-voxcpm + nvidia-cuda-12: cuda12-voxcpm + nvidia-cuda-13: cuda13-voxcpm + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-voxcpm mirrors: - localai/localai-backends:latest-gpu-intel-voxcpm -- !!merge <<: *voxcpm - name: "intel-voxcpm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-voxcpm" +- name: intel-voxcpm-development + alias: voxcpm + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech. + urls: + - https://github.com/ModelBest/VoxCPM + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-voxcpm + default: cpu-voxcpm + intel: intel-voxcpm + metal: metal-voxcpm + nvidia: cuda12-voxcpm + nvidia-cuda-12: cuda12-voxcpm + nvidia-cuda-13: cuda13-voxcpm + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-voxcpm mirrors: - localai/localai-backends:master-gpu-intel-voxcpm -- !!merge <<: *voxcpm - name: "rocm-voxcpm" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-voxcpm" +- name: rocm-voxcpm + alias: voxcpm + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech. + urls: + - https://github.com/ModelBest/VoxCPM + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-voxcpm + default: cpu-voxcpm + intel: intel-voxcpm + metal: metal-voxcpm + nvidia: cuda12-voxcpm + nvidia-cuda-12: cuda12-voxcpm + nvidia-cuda-13: cuda13-voxcpm + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-voxcpm mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-voxcpm -- !!merge <<: *voxcpm - name: "rocm-voxcpm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-voxcpm" +- name: rocm-voxcpm-development + alias: voxcpm + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech. + urls: + - https://github.com/ModelBest/VoxCPM + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-voxcpm + default: cpu-voxcpm + intel: intel-voxcpm + metal: metal-voxcpm + nvidia: cuda12-voxcpm + nvidia-cuda-12: cuda12-voxcpm + nvidia-cuda-13: cuda13-voxcpm + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-voxcpm mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-voxcpm -- !!merge <<: *voxcpm - name: "metal-voxcpm" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-voxcpm" +- name: metal-voxcpm + alias: voxcpm + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech. + urls: + - https://github.com/ModelBest/VoxCPM + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-voxcpm + default: cpu-voxcpm + intel: intel-voxcpm + metal: metal-voxcpm + nvidia: cuda12-voxcpm + nvidia-cuda-12: cuda12-voxcpm + nvidia-cuda-13: cuda13-voxcpm + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-voxcpm mirrors: - localai/localai-backends:latest-metal-darwin-arm64-voxcpm -- !!merge <<: *voxcpm - name: "metal-voxcpm-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-voxcpm" +- name: metal-voxcpm-development + alias: voxcpm + license: mit + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 + description: | + VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech. + urls: + - https://github.com/ModelBest/VoxCPM + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-voxcpm + default: cpu-voxcpm + intel: intel-voxcpm + metal: metal-voxcpm + nvidia: cuda12-voxcpm + nvidia-cuda-12: cuda12-voxcpm + nvidia-cuda-13: cuda13-voxcpm + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-voxcpm mirrors: - localai/localai-backends:master-metal-darwin-arm64-voxcpm -## pocket-tts -- !!merge <<: *pocket-tts - name: "pocket-tts-development" +- name: pocket-tts-development + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS capabilities: - nvidia: "cuda12-pocket-tts-development" - intel: "intel-pocket-tts-development" - amd: "rocm-pocket-tts-development" - nvidia-l4t: "nvidia-l4t-pocket-tts-development" - metal: "metal-pocket-tts-development" - default: "cpu-pocket-tts-development" - nvidia-cuda-13: "cuda13-pocket-tts-development" - nvidia-cuda-12: "cuda12-pocket-tts-development" - nvidia-l4t-cuda-12: "nvidia-l4t-pocket-tts-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-pocket-tts-development" -- !!merge <<: *pocket-tts - name: "cpu-pocket-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-pocket-tts" + amd: rocm-pocket-tts-development + default: cpu-pocket-tts-development + intel: intel-pocket-tts-development + metal: metal-pocket-tts-development + nvidia: cuda12-pocket-tts-development + nvidia-cuda-12: cuda12-pocket-tts-development + nvidia-cuda-13: cuda13-pocket-tts-development + nvidia-l4t: nvidia-l4t-pocket-tts-development + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts-development +- name: cpu-pocket-tts + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-pocket-tts mirrors: - localai/localai-backends:latest-cpu-pocket-tts -- !!merge <<: *pocket-tts - name: "cpu-pocket-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-pocket-tts" +- name: cpu-pocket-tts-development + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:master-cpu-pocket-tts mirrors: - localai/localai-backends:master-cpu-pocket-tts -- !!merge <<: *pocket-tts - name: "cuda12-pocket-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-pocket-tts" +- name: cuda12-pocket-tts + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-pocket-tts mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-pocket-tts -- !!merge <<: *pocket-tts - name: "cuda12-pocket-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-pocket-tts" +- name: cuda12-pocket-tts-development + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-pocket-tts mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-pocket-tts -- !!merge <<: *pocket-tts - name: "cuda13-pocket-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-pocket-tts" +- name: cuda13-pocket-tts + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-pocket-tts mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-pocket-tts -- !!merge <<: *pocket-tts - name: "cuda13-pocket-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-pocket-tts" +- name: cuda13-pocket-tts-development + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-pocket-tts mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-pocket-tts -- !!merge <<: *pocket-tts - name: "intel-pocket-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-pocket-tts" +- name: intel-pocket-tts + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-pocket-tts mirrors: - localai/localai-backends:latest-gpu-intel-pocket-tts -- !!merge <<: *pocket-tts - name: "intel-pocket-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-pocket-tts" +- name: intel-pocket-tts-development + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-pocket-tts mirrors: - localai/localai-backends:master-gpu-intel-pocket-tts -- !!merge <<: *pocket-tts - name: "rocm-pocket-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-pocket-tts" +- name: rocm-pocket-tts + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-pocket-tts mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-pocket-tts -- !!merge <<: *pocket-tts - name: "rocm-pocket-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-pocket-tts" +- name: rocm-pocket-tts-development + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-pocket-tts mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-pocket-tts -- !!merge <<: *pocket-tts - name: "nvidia-l4t-pocket-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-pocket-tts" +- name: nvidia-l4t-pocket-tts + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-pocket-tts mirrors: - localai/localai-backends:latest-nvidia-l4t-pocket-tts -- !!merge <<: *pocket-tts - name: "nvidia-l4t-pocket-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-pocket-tts" +- name: nvidia-l4t-pocket-tts-development + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-pocket-tts mirrors: - localai/localai-backends:master-nvidia-l4t-pocket-tts -- !!merge <<: *pocket-tts - name: "cuda13-nvidia-l4t-arm64-pocket-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-pocket-tts" +- name: cuda13-nvidia-l4t-arm64-pocket-tts + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-pocket-tts mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-pocket-tts -- !!merge <<: *pocket-tts - name: "cuda13-nvidia-l4t-arm64-pocket-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-pocket-tts" +- name: cuda13-nvidia-l4t-arm64-pocket-tts-development + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-pocket-tts mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-pocket-tts -- !!merge <<: *pocket-tts - name: "metal-pocket-tts" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-pocket-tts" +- name: metal-pocket-tts + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-pocket-tts mirrors: - localai/localai-backends:latest-metal-darwin-arm64-pocket-tts -- !!merge <<: *pocket-tts - name: "metal-pocket-tts-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-pocket-tts" +- name: metal-pocket-tts-development + alias: pocket-tts + license: mit + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + urls: + - https://github.com/kyutai-labs/pocket-tts + tags: + - text-to-speech + - TTS + capabilities: + amd: rocm-pocket-tts + default: cpu-pocket-tts + intel: intel-pocket-tts + metal: metal-pocket-tts + nvidia: cuda12-pocket-tts + nvidia-cuda-12: cuda12-pocket-tts + nvidia-cuda-13: cuda13-pocket-tts + nvidia-l4t: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-12: nvidia-l4t-pocket-tts + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-pocket-tts + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-pocket-tts mirrors: - localai/localai-backends:master-metal-darwin-arm64-pocket-tts -## voxtral -- !!merge <<: *voxtral - name: "cpu-voxtral" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-voxtral" +- name: cpu-voxtral + alias: voxtral + license: mit + description: | + Voxtral Realtime 4B Pure C speech-to-text inference engine + urls: + - https://github.com/mudler/voxtral.c + tags: + - audio-transcription + - CPU + - Metal + capabilities: + default: cpu-voxtral + metal-darwin-arm64: metal-voxtral + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-voxtral mirrors: - localai/localai-backends:latest-cpu-voxtral -- !!merge <<: *voxtral - name: "cpu-voxtral-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-voxtral" +- name: cpu-voxtral-development + alias: voxtral + license: mit + description: | + Voxtral Realtime 4B Pure C speech-to-text inference engine + urls: + - https://github.com/mudler/voxtral.c + tags: + - audio-transcription + - CPU + - Metal + capabilities: + default: cpu-voxtral + metal-darwin-arm64: metal-voxtral + uri: quay.io/go-skynet/local-ai-backends:master-cpu-voxtral mirrors: - localai/localai-backends:master-cpu-voxtral -- !!merge <<: *voxtral - name: "metal-voxtral" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-voxtral" +- name: metal-voxtral + alias: voxtral + license: mit + description: | + Voxtral Realtime 4B Pure C speech-to-text inference engine + urls: + - https://github.com/mudler/voxtral.c + tags: + - audio-transcription + - CPU + - Metal + capabilities: + default: cpu-voxtral + metal-darwin-arm64: metal-voxtral + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-voxtral mirrors: - localai/localai-backends:latest-metal-darwin-arm64-voxtral -- !!merge <<: *voxtral - name: "metal-voxtral-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-voxtral" +- name: metal-voxtral-development + alias: voxtral + license: mit + description: | + Voxtral Realtime 4B Pure C speech-to-text inference engine + urls: + - https://github.com/mudler/voxtral.c + tags: + - audio-transcription + - CPU + - Metal + capabilities: + default: cpu-voxtral + metal-darwin-arm64: metal-voxtral + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-voxtral mirrors: - localai/localai-backends:master-metal-darwin-arm64-voxtral -- &trl - name: "trl" - alias: "trl" +- name: trl + alias: trl license: apache-2.0 description: | HuggingFace TRL fine-tuning backend. Supports SFT, DPO, GRPO, RLOO, Reward, KTO, ORPO training methods. @@ -7053,56 +27332,197 @@ - GPU - CUDA capabilities: - default: "cpu-trl" - nvidia: "cuda12-trl" - nvidia-cuda-12: "cuda12-trl" - nvidia-cuda-13: "cuda13-trl" - metal: "metal-trl" -## TRL backend images -- !!merge <<: *trl - name: "cpu-trl" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-trl" + default: cpu-trl + metal: metal-trl + nvidia: cuda12-trl + nvidia-cuda-12: cuda12-trl + nvidia-cuda-13: cuda13-trl +- name: cpu-trl + alias: trl + license: apache-2.0 + description: | + HuggingFace TRL fine-tuning backend. Supports SFT, DPO, GRPO, RLOO, Reward, KTO, ORPO training methods. + Works on CPU and GPU. + urls: + - https://github.com/huggingface/trl + tags: + - fine-tuning + - LLM + - CPU + - GPU + - CUDA + capabilities: + default: cpu-trl + metal: metal-trl + nvidia: cuda12-trl + nvidia-cuda-12: cuda12-trl + nvidia-cuda-13: cuda13-trl + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-trl mirrors: - localai/localai-backends:latest-cpu-trl -- !!merge <<: *trl - name: "cpu-trl-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-trl" +- name: cpu-trl-development + alias: trl + license: apache-2.0 + description: | + HuggingFace TRL fine-tuning backend. Supports SFT, DPO, GRPO, RLOO, Reward, KTO, ORPO training methods. + Works on CPU and GPU. + urls: + - https://github.com/huggingface/trl + tags: + - fine-tuning + - LLM + - CPU + - GPU + - CUDA + capabilities: + default: cpu-trl + metal: metal-trl + nvidia: cuda12-trl + nvidia-cuda-12: cuda12-trl + nvidia-cuda-13: cuda13-trl + uri: quay.io/go-skynet/local-ai-backends:master-cpu-trl mirrors: - localai/localai-backends:master-cpu-trl -- !!merge <<: *trl - name: "cuda12-trl" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-trl" +- name: cuda12-trl + alias: trl + license: apache-2.0 + description: | + HuggingFace TRL fine-tuning backend. Supports SFT, DPO, GRPO, RLOO, Reward, KTO, ORPO training methods. + Works on CPU and GPU. + urls: + - https://github.com/huggingface/trl + tags: + - fine-tuning + - LLM + - CPU + - GPU + - CUDA + capabilities: + default: cpu-trl + metal: metal-trl + nvidia: cuda12-trl + nvidia-cuda-12: cuda12-trl + nvidia-cuda-13: cuda13-trl + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-trl mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-trl -- !!merge <<: *trl - name: "cuda12-trl-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-trl" +- name: cuda12-trl-development + alias: trl + license: apache-2.0 + description: | + HuggingFace TRL fine-tuning backend. Supports SFT, DPO, GRPO, RLOO, Reward, KTO, ORPO training methods. + Works on CPU and GPU. + urls: + - https://github.com/huggingface/trl + tags: + - fine-tuning + - LLM + - CPU + - GPU + - CUDA + capabilities: + default: cpu-trl + metal: metal-trl + nvidia: cuda12-trl + nvidia-cuda-12: cuda12-trl + nvidia-cuda-13: cuda13-trl + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-trl mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-trl -- !!merge <<: *trl - name: "cuda13-trl" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-trl" +- name: cuda13-trl + alias: trl + license: apache-2.0 + description: | + HuggingFace TRL fine-tuning backend. Supports SFT, DPO, GRPO, RLOO, Reward, KTO, ORPO training methods. + Works on CPU and GPU. + urls: + - https://github.com/huggingface/trl + tags: + - fine-tuning + - LLM + - CPU + - GPU + - CUDA + capabilities: + default: cpu-trl + metal: metal-trl + nvidia: cuda12-trl + nvidia-cuda-12: cuda12-trl + nvidia-cuda-13: cuda13-trl + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-trl mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-trl -- !!merge <<: *trl - name: "cuda13-trl-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-trl" +- name: cuda13-trl-development + alias: trl + license: apache-2.0 + description: | + HuggingFace TRL fine-tuning backend. Supports SFT, DPO, GRPO, RLOO, Reward, KTO, ORPO training methods. + Works on CPU and GPU. + urls: + - https://github.com/huggingface/trl + tags: + - fine-tuning + - LLM + - CPU + - GPU + - CUDA + capabilities: + default: cpu-trl + metal: metal-trl + nvidia: cuda12-trl + nvidia-cuda-12: cuda12-trl + nvidia-cuda-13: cuda13-trl + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-trl mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-trl -- !!merge <<: *trl - name: "metal-trl" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-trl" +- name: metal-trl + alias: trl + license: apache-2.0 + description: | + HuggingFace TRL fine-tuning backend. Supports SFT, DPO, GRPO, RLOO, Reward, KTO, ORPO training methods. + Works on CPU and GPU. + urls: + - https://github.com/huggingface/trl + tags: + - fine-tuning + - LLM + - CPU + - GPU + - CUDA + capabilities: + default: cpu-trl + metal: metal-trl + nvidia: cuda12-trl + nvidia-cuda-12: cuda12-trl + nvidia-cuda-13: cuda13-trl + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-trl mirrors: - localai/localai-backends:latest-metal-darwin-arm64-trl -- !!merge <<: *trl - name: "metal-trl-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-trl" +- name: metal-trl-development + alias: trl + license: apache-2.0 + description: | + HuggingFace TRL fine-tuning backend. Supports SFT, DPO, GRPO, RLOO, Reward, KTO, ORPO training methods. + Works on CPU and GPU. + urls: + - https://github.com/huggingface/trl + tags: + - fine-tuning + - LLM + - CPU + - GPU + - CUDA + capabilities: + default: cpu-trl + metal: metal-trl + nvidia: cuda12-trl + nvidia-cuda-12: cuda12-trl + nvidia-cuda-13: cuda13-trl + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-trl mirrors: - localai/localai-backends:master-metal-darwin-arm64-trl -## llama.cpp quantization backend -- &llama-cpp-quantization - name: "llama-cpp-quantization" - alias: "llama-cpp-quantization" +- name: llama-cpp-quantization + alias: llama-cpp-quantization license: mit icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png description: | @@ -7115,54 +27535,210 @@ - GGUF - CPU capabilities: - default: "cpu-llama-cpp-quantization" - metal: "metal-darwin-arm64-llama-cpp-quantization" -- !!merge <<: *llama-cpp-quantization - name: "cpu-llama-cpp-quantization" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-llama-cpp-quantization" + default: cpu-llama-cpp-quantization + metal: metal-darwin-arm64-llama-cpp-quantization +- name: cpu-llama-cpp-quantization + alias: llama-cpp-quantization + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + Model quantization backend using llama.cpp. Downloads HuggingFace models, converts them to GGUF format, + and quantizes them to various formats (q4_k_m, q5_k_m, q8_0, f16, etc.). + urls: + - https://github.com/ggml-org/llama.cpp + tags: + - quantization + - GGUF + - CPU + capabilities: + default: cpu-llama-cpp-quantization + metal: metal-darwin-arm64-llama-cpp-quantization + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-llama-cpp-quantization mirrors: - localai/localai-backends:latest-cpu-llama-cpp-quantization -- !!merge <<: *llama-cpp-quantization - name: "metal-darwin-arm64-llama-cpp-quantization" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-llama-cpp-quantization" +- name: metal-darwin-arm64-llama-cpp-quantization + alias: llama-cpp-quantization + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + Model quantization backend using llama.cpp. Downloads HuggingFace models, converts them to GGUF format, + and quantizes them to various formats (q4_k_m, q5_k_m, q8_0, f16, etc.). + urls: + - https://github.com/ggml-org/llama.cpp + tags: + - quantization + - GGUF + - CPU + capabilities: + default: cpu-llama-cpp-quantization + metal: metal-darwin-arm64-llama-cpp-quantization + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-llama-cpp-quantization mirrors: - localai/localai-backends:latest-metal-darwin-arm64-llama-cpp-quantization -# insightface (face recognition) — development and concrete image entries -- !!merge <<: *insightface - name: "insightface-development" +- name: insightface-development + alias: insightface + license: mixed + description: | + Face recognition backend powered by `insightface` (ONNX Runtime). + Provides face verification (/v1/face/verify), face analysis + (/v1/face/analyze), face embedding (/v1/embeddings), face + detection (/v1/detection), and 1:N identification + (/v1/face/{register,identify,forget}). + Ships two engines in a single image: one that drives the insightface + model packs (buffalo_l/s/m/sc, antelopev2 — non-commercial research + use only) and one that drives OpenCV Zoo's YuNet + SFace pair + (Apache 2.0 — commercial-safe). Select via `options: ["engine:..."]` + in your model YAML, or install one of the ready-made model-gallery + entries under the `insightface-*` prefix. + The backend image contains only code and Python deps; all model + weights are managed by LocalAI's gallery download mechanism. + urls: + - https://github.com/deepinsight/insightface + - https://github.com/opencv/opencv_zoo + tags: + - face-recognition + - face-verification + - face-embedding + - gpu + - cpu capabilities: - default: "cpu-insightface-development" - nvidia: "cuda12-insightface-development" - nvidia-cuda-12: "cuda12-insightface-development" -- !!merge <<: *insightface - name: "cpu-insightface" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-insightface" + default: cpu-insightface-development + nvidia: cuda12-insightface-development + nvidia-cuda-12: cuda12-insightface-development +- name: cpu-insightface + alias: insightface + license: mixed + description: | + Face recognition backend powered by `insightface` (ONNX Runtime). + Provides face verification (/v1/face/verify), face analysis + (/v1/face/analyze), face embedding (/v1/embeddings), face + detection (/v1/detection), and 1:N identification + (/v1/face/{register,identify,forget}). + Ships two engines in a single image: one that drives the insightface + model packs (buffalo_l/s/m/sc, antelopev2 — non-commercial research + use only) and one that drives OpenCV Zoo's YuNet + SFace pair + (Apache 2.0 — commercial-safe). Select via `options: ["engine:..."]` + in your model YAML, or install one of the ready-made model-gallery + entries under the `insightface-*` prefix. + The backend image contains only code and Python deps; all model + weights are managed by LocalAI's gallery download mechanism. + urls: + - https://github.com/deepinsight/insightface + - https://github.com/opencv/opencv_zoo + tags: + - face-recognition + - face-verification + - face-embedding + - gpu + - cpu + capabilities: + default: cpu-insightface + nvidia: cuda12-insightface + nvidia-cuda-12: cuda12-insightface + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-insightface mirrors: - localai/localai-backends:latest-cpu-insightface -- !!merge <<: *insightface - name: "cuda12-insightface" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-insightface" +- name: cuda12-insightface + alias: insightface + license: mixed + description: | + Face recognition backend powered by `insightface` (ONNX Runtime). + Provides face verification (/v1/face/verify), face analysis + (/v1/face/analyze), face embedding (/v1/embeddings), face + detection (/v1/detection), and 1:N identification + (/v1/face/{register,identify,forget}). + Ships two engines in a single image: one that drives the insightface + model packs (buffalo_l/s/m/sc, antelopev2 — non-commercial research + use only) and one that drives OpenCV Zoo's YuNet + SFace pair + (Apache 2.0 — commercial-safe). Select via `options: ["engine:..."]` + in your model YAML, or install one of the ready-made model-gallery + entries under the `insightface-*` prefix. + The backend image contains only code and Python deps; all model + weights are managed by LocalAI's gallery download mechanism. + urls: + - https://github.com/deepinsight/insightface + - https://github.com/opencv/opencv_zoo + tags: + - face-recognition + - face-verification + - face-embedding + - gpu + - cpu + capabilities: + default: cpu-insightface + nvidia: cuda12-insightface + nvidia-cuda-12: cuda12-insightface + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-insightface mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-insightface -- !!merge <<: *insightface - name: "cpu-insightface-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-insightface" +- name: cpu-insightface-development + alias: insightface + license: mixed + description: | + Face recognition backend powered by `insightface` (ONNX Runtime). + Provides face verification (/v1/face/verify), face analysis + (/v1/face/analyze), face embedding (/v1/embeddings), face + detection (/v1/detection), and 1:N identification + (/v1/face/{register,identify,forget}). + Ships two engines in a single image: one that drives the insightface + model packs (buffalo_l/s/m/sc, antelopev2 — non-commercial research + use only) and one that drives OpenCV Zoo's YuNet + SFace pair + (Apache 2.0 — commercial-safe). Select via `options: ["engine:..."]` + in your model YAML, or install one of the ready-made model-gallery + entries under the `insightface-*` prefix. + The backend image contains only code and Python deps; all model + weights are managed by LocalAI's gallery download mechanism. + urls: + - https://github.com/deepinsight/insightface + - https://github.com/opencv/opencv_zoo + tags: + - face-recognition + - face-verification + - face-embedding + - gpu + - cpu + capabilities: + default: cpu-insightface + nvidia: cuda12-insightface + nvidia-cuda-12: cuda12-insightface + uri: quay.io/go-skynet/local-ai-backends:master-cpu-insightface mirrors: - localai/localai-backends:master-cpu-insightface -- !!merge <<: *insightface - name: "cuda12-insightface-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-insightface" +- name: cuda12-insightface-development + alias: insightface + license: mixed + description: | + Face recognition backend powered by `insightface` (ONNX Runtime). + Provides face verification (/v1/face/verify), face analysis + (/v1/face/analyze), face embedding (/v1/embeddings), face + detection (/v1/detection), and 1:N identification + (/v1/face/{register,identify,forget}). + Ships two engines in a single image: one that drives the insightface + model packs (buffalo_l/s/m/sc, antelopev2 — non-commercial research + use only) and one that drives OpenCV Zoo's YuNet + SFace pair + (Apache 2.0 — commercial-safe). Select via `options: ["engine:..."]` + in your model YAML, or install one of the ready-made model-gallery + entries under the `insightface-*` prefix. + The backend image contains only code and Python deps; all model + weights are managed by LocalAI's gallery download mechanism. + urls: + - https://github.com/deepinsight/insightface + - https://github.com/opencv/opencv_zoo + tags: + - face-recognition + - face-verification + - face-embedding + - gpu + - cpu + capabilities: + default: cpu-insightface + nvidia: cuda12-insightface + nvidia-cuda-12: cuda12-insightface + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-insightface mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-insightface - -# speaker-recognition (voice/speaker biometrics) — Apache-2.0 stack -- &speakerrecognition - name: "speaker-recognition" - alias: "speaker-recognition" - # SpeechBrain is Apache-2.0. WeSpeaker / 3D-Speaker ONNX exports are - # Apache-2.0. The backend itself ships only Python deps — all model - # weights flow through LocalAI's gallery download mechanism (or - # SpeechBrain's built-in HF auto-download at first LoadModel). +- name: speaker-recognition + alias: speaker-recognition license: apache-2.0 description: | Speaker (voice) recognition backend — the audio analog to @@ -7186,303 +27762,1630 @@ - gpu - cpu capabilities: - default: "cpu-speaker-recognition" - nvidia: "cuda12-speaker-recognition" - nvidia-cuda-12: "cuda12-speaker-recognition" - metal: "metal-speaker-recognition" -- !!merge <<: *speakerrecognition - name: "speaker-recognition-development" + default: cpu-speaker-recognition + metal: metal-speaker-recognition + nvidia: cuda12-speaker-recognition + nvidia-cuda-12: cuda12-speaker-recognition +- name: speaker-recognition-development + alias: speaker-recognition + license: apache-2.0 + description: | + Speaker (voice) recognition backend — the audio analog to + insightface. Wraps SpeechBrain ECAPA-TDNN (default engine, 192-d + embeddings, ~1.9% EER on VoxCeleb) plus an OnnxDirectEngine for + pre-exported WeSpeaker / 3D-Speaker ONNX models. + + Exposes speaker verification (/v1/voice/verify), speaker embedding + (/v1/voice/embed), speaker analysis (/v1/voice/analyze), and 1:N + speaker identification (/v1/voice/{register,identify,forget}). + Registrations use LocalAI's built-in vector store — same in-memory + backing the face-recognition registry uses, separate instance. + urls: + - https://speechbrain.github.io/ + - https://github.com/wenet-e2e/wespeaker + - https://github.com/modelscope/3D-Speaker + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - gpu + - cpu capabilities: - default: "cpu-speaker-recognition-development" - nvidia: "cuda12-speaker-recognition-development" - nvidia-cuda-12: "cuda12-speaker-recognition-development" - metal: "metal-speaker-recognition-development" -- !!merge <<: *speakerrecognition - name: "cpu-speaker-recognition" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-speaker-recognition" + default: cpu-speaker-recognition-development + metal: metal-speaker-recognition-development + nvidia: cuda12-speaker-recognition-development + nvidia-cuda-12: cuda12-speaker-recognition-development +- name: cpu-speaker-recognition + alias: speaker-recognition + license: apache-2.0 + description: | + Speaker (voice) recognition backend — the audio analog to + insightface. Wraps SpeechBrain ECAPA-TDNN (default engine, 192-d + embeddings, ~1.9% EER on VoxCeleb) plus an OnnxDirectEngine for + pre-exported WeSpeaker / 3D-Speaker ONNX models. + + Exposes speaker verification (/v1/voice/verify), speaker embedding + (/v1/voice/embed), speaker analysis (/v1/voice/analyze), and 1:N + speaker identification (/v1/voice/{register,identify,forget}). + Registrations use LocalAI's built-in vector store — same in-memory + backing the face-recognition registry uses, separate instance. + urls: + - https://speechbrain.github.io/ + - https://github.com/wenet-e2e/wespeaker + - https://github.com/modelscope/3D-Speaker + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - gpu + - cpu + capabilities: + default: cpu-speaker-recognition + metal: metal-speaker-recognition + nvidia: cuda12-speaker-recognition + nvidia-cuda-12: cuda12-speaker-recognition + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-speaker-recognition mirrors: - localai/localai-backends:latest-cpu-speaker-recognition -- !!merge <<: *speakerrecognition - name: "cuda12-speaker-recognition" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-speaker-recognition" +- name: cuda12-speaker-recognition + alias: speaker-recognition + license: apache-2.0 + description: | + Speaker (voice) recognition backend — the audio analog to + insightface. Wraps SpeechBrain ECAPA-TDNN (default engine, 192-d + embeddings, ~1.9% EER on VoxCeleb) plus an OnnxDirectEngine for + pre-exported WeSpeaker / 3D-Speaker ONNX models. + + Exposes speaker verification (/v1/voice/verify), speaker embedding + (/v1/voice/embed), speaker analysis (/v1/voice/analyze), and 1:N + speaker identification (/v1/voice/{register,identify,forget}). + Registrations use LocalAI's built-in vector store — same in-memory + backing the face-recognition registry uses, separate instance. + urls: + - https://speechbrain.github.io/ + - https://github.com/wenet-e2e/wespeaker + - https://github.com/modelscope/3D-Speaker + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - gpu + - cpu + capabilities: + default: cpu-speaker-recognition + metal: metal-speaker-recognition + nvidia: cuda12-speaker-recognition + nvidia-cuda-12: cuda12-speaker-recognition + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-speaker-recognition mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-speaker-recognition -- !!merge <<: *speakerrecognition - name: "cpu-speaker-recognition-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-speaker-recognition" +- name: cpu-speaker-recognition-development + alias: speaker-recognition + license: apache-2.0 + description: | + Speaker (voice) recognition backend — the audio analog to + insightface. Wraps SpeechBrain ECAPA-TDNN (default engine, 192-d + embeddings, ~1.9% EER on VoxCeleb) plus an OnnxDirectEngine for + pre-exported WeSpeaker / 3D-Speaker ONNX models. + + Exposes speaker verification (/v1/voice/verify), speaker embedding + (/v1/voice/embed), speaker analysis (/v1/voice/analyze), and 1:N + speaker identification (/v1/voice/{register,identify,forget}). + Registrations use LocalAI's built-in vector store — same in-memory + backing the face-recognition registry uses, separate instance. + urls: + - https://speechbrain.github.io/ + - https://github.com/wenet-e2e/wespeaker + - https://github.com/modelscope/3D-Speaker + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - gpu + - cpu + capabilities: + default: cpu-speaker-recognition + metal: metal-speaker-recognition + nvidia: cuda12-speaker-recognition + nvidia-cuda-12: cuda12-speaker-recognition + uri: quay.io/go-skynet/local-ai-backends:master-cpu-speaker-recognition mirrors: - localai/localai-backends:master-cpu-speaker-recognition -- !!merge <<: *speakerrecognition - name: "cuda12-speaker-recognition-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-speaker-recognition" +- name: cuda12-speaker-recognition-development + alias: speaker-recognition + license: apache-2.0 + description: | + Speaker (voice) recognition backend — the audio analog to + insightface. Wraps SpeechBrain ECAPA-TDNN (default engine, 192-d + embeddings, ~1.9% EER on VoxCeleb) plus an OnnxDirectEngine for + pre-exported WeSpeaker / 3D-Speaker ONNX models. + + Exposes speaker verification (/v1/voice/verify), speaker embedding + (/v1/voice/embed), speaker analysis (/v1/voice/analyze), and 1:N + speaker identification (/v1/voice/{register,identify,forget}). + Registrations use LocalAI's built-in vector store — same in-memory + backing the face-recognition registry uses, separate instance. + urls: + - https://speechbrain.github.io/ + - https://github.com/wenet-e2e/wespeaker + - https://github.com/modelscope/3D-Speaker + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - gpu + - cpu + capabilities: + default: cpu-speaker-recognition + metal: metal-speaker-recognition + nvidia: cuda12-speaker-recognition + nvidia-cuda-12: cuda12-speaker-recognition + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-speaker-recognition mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-speaker-recognition -- !!merge <<: *speakerrecognition - name: "metal-speaker-recognition" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-speaker-recognition" +- name: metal-speaker-recognition + alias: speaker-recognition + license: apache-2.0 + description: | + Speaker (voice) recognition backend — the audio analog to + insightface. Wraps SpeechBrain ECAPA-TDNN (default engine, 192-d + embeddings, ~1.9% EER on VoxCeleb) plus an OnnxDirectEngine for + pre-exported WeSpeaker / 3D-Speaker ONNX models. + + Exposes speaker verification (/v1/voice/verify), speaker embedding + (/v1/voice/embed), speaker analysis (/v1/voice/analyze), and 1:N + speaker identification (/v1/voice/{register,identify,forget}). + Registrations use LocalAI's built-in vector store — same in-memory + backing the face-recognition registry uses, separate instance. + urls: + - https://speechbrain.github.io/ + - https://github.com/wenet-e2e/wespeaker + - https://github.com/modelscope/3D-Speaker + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - gpu + - cpu + capabilities: + default: cpu-speaker-recognition + metal: metal-speaker-recognition + nvidia: cuda12-speaker-recognition + nvidia-cuda-12: cuda12-speaker-recognition + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-speaker-recognition mirrors: - localai/localai-backends:latest-metal-darwin-arm64-speaker-recognition -- !!merge <<: *speakerrecognition - name: "metal-speaker-recognition-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-speaker-recognition" +- name: metal-speaker-recognition-development + alias: speaker-recognition + license: apache-2.0 + description: | + Speaker (voice) recognition backend — the audio analog to + insightface. Wraps SpeechBrain ECAPA-TDNN (default engine, 192-d + embeddings, ~1.9% EER on VoxCeleb) plus an OnnxDirectEngine for + pre-exported WeSpeaker / 3D-Speaker ONNX models. + + Exposes speaker verification (/v1/voice/verify), speaker embedding + (/v1/voice/embed), speaker analysis (/v1/voice/analyze), and 1:N + speaker identification (/v1/voice/{register,identify,forget}). + Registrations use LocalAI's built-in vector store — same in-memory + backing the face-recognition registry uses, separate instance. + urls: + - https://speechbrain.github.io/ + - https://github.com/wenet-e2e/wespeaker + - https://github.com/modelscope/3D-Speaker + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - gpu + - cpu + capabilities: + default: cpu-speaker-recognition + metal: metal-speaker-recognition + nvidia: cuda12-speaker-recognition + nvidia-cuda-12: cuda12-speaker-recognition + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-speaker-recognition mirrors: - localai/localai-backends:master-metal-darwin-arm64-speaker-recognition -## sherpa-onnx -- !!merge <<: *sherpa-onnx - name: "sherpa-onnx-development" +- name: sherpa-onnx-development + alias: sherpa-onnx + description: | + Sherpa-ONNX backend for text-to-speech (VITS, Matcha, Kokoro), speech-to-text (Whisper, Paraformer, SenseVoice, Omnilingual ASR CTC), and voice activity detection via ONNX Runtime. + Supports multi-speaker voices, 1600+ language ASR, and GPU acceleration. + urls: + - https://k2-fsa.github.io/sherpa/onnx/ + tags: + - text-to-speech + - TTS + - speech-to-text + - ASR capabilities: - default: "cpu-sherpa-onnx-development" - nvidia: "cuda12-sherpa-onnx-development" - nvidia-cuda-12: "cuda12-sherpa-onnx-development" - metal: "metal-sherpa-onnx-development" -- !!merge <<: *sherpa-onnx - name: "cpu-sherpa-onnx" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-sherpa-onnx" + default: cpu-sherpa-onnx-development + metal: metal-sherpa-onnx-development + nvidia: cuda12-sherpa-onnx-development + nvidia-cuda-12: cuda12-sherpa-onnx-development +- name: cpu-sherpa-onnx + alias: sherpa-onnx + description: | + Sherpa-ONNX backend for text-to-speech (VITS, Matcha, Kokoro), speech-to-text (Whisper, Paraformer, SenseVoice, Omnilingual ASR CTC), and voice activity detection via ONNX Runtime. + Supports multi-speaker voices, 1600+ language ASR, and GPU acceleration. + urls: + - https://k2-fsa.github.io/sherpa/onnx/ + tags: + - text-to-speech + - TTS + - speech-to-text + - ASR + capabilities: + default: cpu-sherpa-onnx + metal: metal-sherpa-onnx + nvidia: cuda12-sherpa-onnx + nvidia-cuda-12: cuda12-sherpa-onnx + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-sherpa-onnx mirrors: - localai/localai-backends:latest-cpu-sherpa-onnx -- !!merge <<: *sherpa-onnx - name: "cpu-sherpa-onnx-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-sherpa-onnx" +- name: cpu-sherpa-onnx-development + alias: sherpa-onnx + description: | + Sherpa-ONNX backend for text-to-speech (VITS, Matcha, Kokoro), speech-to-text (Whisper, Paraformer, SenseVoice, Omnilingual ASR CTC), and voice activity detection via ONNX Runtime. + Supports multi-speaker voices, 1600+ language ASR, and GPU acceleration. + urls: + - https://k2-fsa.github.io/sherpa/onnx/ + tags: + - text-to-speech + - TTS + - speech-to-text + - ASR + capabilities: + default: cpu-sherpa-onnx + metal: metal-sherpa-onnx + nvidia: cuda12-sherpa-onnx + nvidia-cuda-12: cuda12-sherpa-onnx + uri: quay.io/go-skynet/local-ai-backends:master-cpu-sherpa-onnx mirrors: - localai/localai-backends:master-cpu-sherpa-onnx -- !!merge <<: *sherpa-onnx - name: "cuda12-sherpa-onnx" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-sherpa-onnx" +- name: cuda12-sherpa-onnx + alias: sherpa-onnx + description: | + Sherpa-ONNX backend for text-to-speech (VITS, Matcha, Kokoro), speech-to-text (Whisper, Paraformer, SenseVoice, Omnilingual ASR CTC), and voice activity detection via ONNX Runtime. + Supports multi-speaker voices, 1600+ language ASR, and GPU acceleration. + urls: + - https://k2-fsa.github.io/sherpa/onnx/ + tags: + - text-to-speech + - TTS + - speech-to-text + - ASR + capabilities: + default: cpu-sherpa-onnx + metal: metal-sherpa-onnx + nvidia: cuda12-sherpa-onnx + nvidia-cuda-12: cuda12-sherpa-onnx + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-sherpa-onnx mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-sherpa-onnx -- !!merge <<: *sherpa-onnx - name: "cuda12-sherpa-onnx-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-sherpa-onnx" +- name: cuda12-sherpa-onnx-development + alias: sherpa-onnx + description: | + Sherpa-ONNX backend for text-to-speech (VITS, Matcha, Kokoro), speech-to-text (Whisper, Paraformer, SenseVoice, Omnilingual ASR CTC), and voice activity detection via ONNX Runtime. + Supports multi-speaker voices, 1600+ language ASR, and GPU acceleration. + urls: + - https://k2-fsa.github.io/sherpa/onnx/ + tags: + - text-to-speech + - TTS + - speech-to-text + - ASR + capabilities: + default: cpu-sherpa-onnx + metal: metal-sherpa-onnx + nvidia: cuda12-sherpa-onnx + nvidia-cuda-12: cuda12-sherpa-onnx + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-sherpa-onnx mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-sherpa-onnx -- !!merge <<: *sherpa-onnx - name: "metal-sherpa-onnx" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-sherpa-onnx" +- name: metal-sherpa-onnx + alias: sherpa-onnx + description: | + Sherpa-ONNX backend for text-to-speech (VITS, Matcha, Kokoro), speech-to-text (Whisper, Paraformer, SenseVoice, Omnilingual ASR CTC), and voice activity detection via ONNX Runtime. + Supports multi-speaker voices, 1600+ language ASR, and GPU acceleration. + urls: + - https://k2-fsa.github.io/sherpa/onnx/ + tags: + - text-to-speech + - TTS + - speech-to-text + - ASR + capabilities: + default: cpu-sherpa-onnx + metal: metal-sherpa-onnx + nvidia: cuda12-sherpa-onnx + nvidia-cuda-12: cuda12-sherpa-onnx + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-sherpa-onnx mirrors: - localai/localai-backends:latest-metal-darwin-arm64-sherpa-onnx -- !!merge <<: *sherpa-onnx - name: "metal-sherpa-onnx-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-sherpa-onnx" +- name: metal-sherpa-onnx-development + alias: sherpa-onnx + description: | + Sherpa-ONNX backend for text-to-speech (VITS, Matcha, Kokoro), speech-to-text (Whisper, Paraformer, SenseVoice, Omnilingual ASR CTC), and voice activity detection via ONNX Runtime. + Supports multi-speaker voices, 1600+ language ASR, and GPU acceleration. + urls: + - https://k2-fsa.github.io/sherpa/onnx/ + tags: + - text-to-speech + - TTS + - speech-to-text + - ASR + capabilities: + default: cpu-sherpa-onnx + metal: metal-sherpa-onnx + nvidia: cuda12-sherpa-onnx + nvidia-cuda-12: cuda12-sherpa-onnx + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-sherpa-onnx mirrors: - localai/localai-backends:master-metal-darwin-arm64-sherpa-onnx -## supertonic -- !!merge <<: *supertonic - name: "supertonic-development" +- name: supertonic-development + alias: supertonic + description: | + Supertonic backend: lightning-fast, on-device multilingual text-to-speech via ONNX Runtime. + Runs Supertone's flow-matching TTS model (Supertone/supertonic-3), 44.1kHz output, 31 languages, + multiple preset voice styles. No espeak-ng dependency. + urls: + - https://github.com/supertone-inc/supertonic + tags: + - text-to-speech + - TTS capabilities: - default: "cpu-supertonic-development" - metal: "metal-supertonic-development" -- !!merge <<: *supertonic - name: "cpu-supertonic" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-supertonic" + default: cpu-supertonic-development + metal: metal-supertonic-development +- name: cpu-supertonic + alias: supertonic + description: | + Supertonic backend: lightning-fast, on-device multilingual text-to-speech via ONNX Runtime. + Runs Supertone's flow-matching TTS model (Supertone/supertonic-3), 44.1kHz output, 31 languages, + multiple preset voice styles. No espeak-ng dependency. + urls: + - https://github.com/supertone-inc/supertonic + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-supertonic + metal: metal-supertonic + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-supertonic mirrors: - localai/localai-backends:latest-cpu-supertonic -- !!merge <<: *supertonic - name: "cpu-supertonic-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-supertonic" +- name: cpu-supertonic-development + alias: supertonic + description: | + Supertonic backend: lightning-fast, on-device multilingual text-to-speech via ONNX Runtime. + Runs Supertone's flow-matching TTS model (Supertone/supertonic-3), 44.1kHz output, 31 languages, + multiple preset voice styles. No espeak-ng dependency. + urls: + - https://github.com/supertone-inc/supertonic + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-supertonic + metal: metal-supertonic + uri: quay.io/go-skynet/local-ai-backends:master-cpu-supertonic mirrors: - localai/localai-backends:master-cpu-supertonic -- !!merge <<: *supertonic - name: "metal-supertonic" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-supertonic" +- name: metal-supertonic + alias: supertonic + description: | + Supertonic backend: lightning-fast, on-device multilingual text-to-speech via ONNX Runtime. + Runs Supertone's flow-matching TTS model (Supertone/supertonic-3), 44.1kHz output, 31 languages, + multiple preset voice styles. No espeak-ng dependency. + urls: + - https://github.com/supertone-inc/supertonic + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-supertonic + metal: metal-supertonic + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-supertonic mirrors: - localai/localai-backends:latest-metal-darwin-arm64-supertonic -- !!merge <<: *supertonic - name: "metal-supertonic-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-supertonic" +- name: metal-supertonic-development + alias: supertonic + description: | + Supertonic backend: lightning-fast, on-device multilingual text-to-speech via ONNX Runtime. + Runs Supertone's flow-matching TTS model (Supertone/supertonic-3), 44.1kHz output, 31 languages, + multiple preset voice styles. No espeak-ng dependency. + urls: + - https://github.com/supertone-inc/supertonic + tags: + - text-to-speech + - TTS + capabilities: + default: cpu-supertonic + metal: metal-supertonic + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-supertonic mirrors: - localai/localai-backends:master-metal-darwin-arm64-supertonic -- !!merge <<: *vllm-cpp - name: "cpu-vllm-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-vllm-cpp" +- name: cpu-vllm-cpp + alias: vllm-cpp + license: apache-2.0 + description: | + ALPHA development builds. Try it, but llama-cpp stays the recommendation for + production use. + + vllm.cpp is an Apache-2.0 C++20 inference engine maintained by the LocalAI team, + developed in its own repository and usable without LocalAI. It began as a port of + vLLM and keeps vLLM as its reference implementation, checking output against it and + benchmarking against it, while growing a featureset of its own. It implements vLLM's + V1 architecture (paged KV cache, continuous batching, prefix caching, scheduler, + sampler) on a portable tensor runtime with no Python, PyTorch or ggml at inference + time. It loads GGUF as well as Hugging Face safetensors, supports structured output + (JSON schema / regex / choice / GBNF grammar) enforced in-engine, ships speculative + decoding and KV offload, and runs on CPU, NVIDIA CUDA (Blackwell-family), Apple + Metal and Vulkan. + + The project is expected to be renamed as it diverges further from vLLM; the new + name is still to be decided. + urls: + - https://github.com/mudler/vllm.cpp + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - metal + capabilities: + default: cpu-vllm-cpp + metal: metal-vllm-cpp + nvidia: cuda13-vllm-cpp + nvidia-cuda-13: cuda13-vllm-cpp + nvidia-l4t: nvidia-l4t-arm64-vllm-cpp + nvidia-l4t-cuda-13: nvidia-l4t-arm64-vllm-cpp + vulkan: vulkan-vllm-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-vllm-cpp mirrors: - localai/localai-backends:latest-cpu-vllm-cpp -- !!merge <<: *vllm-cpp - name: "cpu-vllm-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-vllm-cpp" +- name: cpu-vllm-cpp-development + alias: vllm-cpp + license: apache-2.0 + description: | + ALPHA development builds. Try it, but llama-cpp stays the recommendation for + production use. + + vllm.cpp is an Apache-2.0 C++20 inference engine maintained by the LocalAI team, + developed in its own repository and usable without LocalAI. It began as a port of + vLLM and keeps vLLM as its reference implementation, checking output against it and + benchmarking against it, while growing a featureset of its own. It implements vLLM's + V1 architecture (paged KV cache, continuous batching, prefix caching, scheduler, + sampler) on a portable tensor runtime with no Python, PyTorch or ggml at inference + time. It loads GGUF as well as Hugging Face safetensors, supports structured output + (JSON schema / regex / choice / GBNF grammar) enforced in-engine, ships speculative + decoding and KV offload, and runs on CPU, NVIDIA CUDA (Blackwell-family), Apple + Metal and Vulkan. + + The project is expected to be renamed as it diverges further from vLLM; the new + name is still to be decided. + urls: + - https://github.com/mudler/vllm.cpp + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - metal + capabilities: + default: cpu-vllm-cpp + metal: metal-vllm-cpp + nvidia: cuda13-vllm-cpp + nvidia-cuda-13: cuda13-vllm-cpp + nvidia-l4t: nvidia-l4t-arm64-vllm-cpp + nvidia-l4t-cuda-13: nvidia-l4t-arm64-vllm-cpp + vulkan: vulkan-vllm-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-vllm-cpp mirrors: - localai/localai-backends:master-cpu-vllm-cpp -- !!merge <<: *vllm-cpp - name: "cuda13-vllm-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-vllm-cpp" +- name: cuda13-vllm-cpp + alias: vllm-cpp + license: apache-2.0 + description: | + ALPHA development builds. Try it, but llama-cpp stays the recommendation for + production use. + + vllm.cpp is an Apache-2.0 C++20 inference engine maintained by the LocalAI team, + developed in its own repository and usable without LocalAI. It began as a port of + vLLM and keeps vLLM as its reference implementation, checking output against it and + benchmarking against it, while growing a featureset of its own. It implements vLLM's + V1 architecture (paged KV cache, continuous batching, prefix caching, scheduler, + sampler) on a portable tensor runtime with no Python, PyTorch or ggml at inference + time. It loads GGUF as well as Hugging Face safetensors, supports structured output + (JSON schema / regex / choice / GBNF grammar) enforced in-engine, ships speculative + decoding and KV offload, and runs on CPU, NVIDIA CUDA (Blackwell-family), Apple + Metal and Vulkan. + + The project is expected to be renamed as it diverges further from vLLM; the new + name is still to be decided. + urls: + - https://github.com/mudler/vllm.cpp + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - metal + capabilities: + default: cpu-vllm-cpp + metal: metal-vllm-cpp + nvidia: cuda13-vllm-cpp + nvidia-cuda-13: cuda13-vllm-cpp + nvidia-l4t: nvidia-l4t-arm64-vllm-cpp + nvidia-l4t-cuda-13: nvidia-l4t-arm64-vllm-cpp + vulkan: vulkan-vllm-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-vllm-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-vllm-cpp -- !!merge <<: *vllm-cpp - name: "cuda13-vllm-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-vllm-cpp" +- name: cuda13-vllm-cpp-development + alias: vllm-cpp + license: apache-2.0 + description: | + ALPHA development builds. Try it, but llama-cpp stays the recommendation for + production use. + + vllm.cpp is an Apache-2.0 C++20 inference engine maintained by the LocalAI team, + developed in its own repository and usable without LocalAI. It began as a port of + vLLM and keeps vLLM as its reference implementation, checking output against it and + benchmarking against it, while growing a featureset of its own. It implements vLLM's + V1 architecture (paged KV cache, continuous batching, prefix caching, scheduler, + sampler) on a portable tensor runtime with no Python, PyTorch or ggml at inference + time. It loads GGUF as well as Hugging Face safetensors, supports structured output + (JSON schema / regex / choice / GBNF grammar) enforced in-engine, ships speculative + decoding and KV offload, and runs on CPU, NVIDIA CUDA (Blackwell-family), Apple + Metal and Vulkan. + + The project is expected to be renamed as it diverges further from vLLM; the new + name is still to be decided. + urls: + - https://github.com/mudler/vllm.cpp + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - metal + capabilities: + default: cpu-vllm-cpp + metal: metal-vllm-cpp + nvidia: cuda13-vllm-cpp + nvidia-cuda-13: cuda13-vllm-cpp + nvidia-l4t: nvidia-l4t-arm64-vllm-cpp + nvidia-l4t-cuda-13: nvidia-l4t-arm64-vllm-cpp + vulkan: vulkan-vllm-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-vllm-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-vllm-cpp -- !!merge <<: *vllm-cpp - name: "nvidia-l4t-arm64-vllm-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-vllm-cpp" +- name: nvidia-l4t-arm64-vllm-cpp + alias: vllm-cpp + license: apache-2.0 + description: | + ALPHA development builds. Try it, but llama-cpp stays the recommendation for + production use. + + vllm.cpp is an Apache-2.0 C++20 inference engine maintained by the LocalAI team, + developed in its own repository and usable without LocalAI. It began as a port of + vLLM and keeps vLLM as its reference implementation, checking output against it and + benchmarking against it, while growing a featureset of its own. It implements vLLM's + V1 architecture (paged KV cache, continuous batching, prefix caching, scheduler, + sampler) on a portable tensor runtime with no Python, PyTorch or ggml at inference + time. It loads GGUF as well as Hugging Face safetensors, supports structured output + (JSON schema / regex / choice / GBNF grammar) enforced in-engine, ships speculative + decoding and KV offload, and runs on CPU, NVIDIA CUDA (Blackwell-family), Apple + Metal and Vulkan. + + The project is expected to be renamed as it diverges further from vLLM; the new + name is still to be decided. + urls: + - https://github.com/mudler/vllm.cpp + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - metal + capabilities: + default: cpu-vllm-cpp + metal: metal-vllm-cpp + nvidia: cuda13-vllm-cpp + nvidia-cuda-13: cuda13-vllm-cpp + nvidia-l4t: nvidia-l4t-arm64-vllm-cpp + nvidia-l4t-cuda-13: nvidia-l4t-arm64-vllm-cpp + vulkan: vulkan-vllm-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-vllm-cpp mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-vllm-cpp -- !!merge <<: *vllm-cpp - name: "nvidia-l4t-arm64-vllm-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-vllm-cpp" +- name: nvidia-l4t-arm64-vllm-cpp-development + alias: vllm-cpp + license: apache-2.0 + description: | + ALPHA development builds. Try it, but llama-cpp stays the recommendation for + production use. + + vllm.cpp is an Apache-2.0 C++20 inference engine maintained by the LocalAI team, + developed in its own repository and usable without LocalAI. It began as a port of + vLLM and keeps vLLM as its reference implementation, checking output against it and + benchmarking against it, while growing a featureset of its own. It implements vLLM's + V1 architecture (paged KV cache, continuous batching, prefix caching, scheduler, + sampler) on a portable tensor runtime with no Python, PyTorch or ggml at inference + time. It loads GGUF as well as Hugging Face safetensors, supports structured output + (JSON schema / regex / choice / GBNF grammar) enforced in-engine, ships speculative + decoding and KV offload, and runs on CPU, NVIDIA CUDA (Blackwell-family), Apple + Metal and Vulkan. + + The project is expected to be renamed as it diverges further from vLLM; the new + name is still to be decided. + urls: + - https://github.com/mudler/vllm.cpp + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - metal + capabilities: + default: cpu-vllm-cpp + metal: metal-vllm-cpp + nvidia: cuda13-vllm-cpp + nvidia-cuda-13: cuda13-vllm-cpp + nvidia-l4t: nvidia-l4t-arm64-vllm-cpp + nvidia-l4t-cuda-13: nvidia-l4t-arm64-vllm-cpp + vulkan: vulkan-vllm-cpp + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-vllm-cpp mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-vllm-cpp -- !!merge <<: *vllm-cpp - name: "vulkan-vllm-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-vllm-cpp" +- name: vulkan-vllm-cpp + alias: vllm-cpp + license: apache-2.0 + description: | + ALPHA development builds. Try it, but llama-cpp stays the recommendation for + production use. + + vllm.cpp is an Apache-2.0 C++20 inference engine maintained by the LocalAI team, + developed in its own repository and usable without LocalAI. It began as a port of + vLLM and keeps vLLM as its reference implementation, checking output against it and + benchmarking against it, while growing a featureset of its own. It implements vLLM's + V1 architecture (paged KV cache, continuous batching, prefix caching, scheduler, + sampler) on a portable tensor runtime with no Python, PyTorch or ggml at inference + time. It loads GGUF as well as Hugging Face safetensors, supports structured output + (JSON schema / regex / choice / GBNF grammar) enforced in-engine, ships speculative + decoding and KV offload, and runs on CPU, NVIDIA CUDA (Blackwell-family), Apple + Metal and Vulkan. + + The project is expected to be renamed as it diverges further from vLLM; the new + name is still to be decided. + urls: + - https://github.com/mudler/vllm.cpp + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - metal + capabilities: + default: cpu-vllm-cpp + metal: metal-vllm-cpp + nvidia: cuda13-vllm-cpp + nvidia-cuda-13: cuda13-vllm-cpp + nvidia-l4t: nvidia-l4t-arm64-vllm-cpp + nvidia-l4t-cuda-13: nvidia-l4t-arm64-vllm-cpp + vulkan: vulkan-vllm-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-vllm-cpp mirrors: - localai/localai-backends:latest-gpu-vulkan-vllm-cpp -- !!merge <<: *vllm-cpp - name: "vulkan-vllm-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-vllm-cpp" +- name: vulkan-vllm-cpp-development + alias: vllm-cpp + license: apache-2.0 + description: | + ALPHA development builds. Try it, but llama-cpp stays the recommendation for + production use. + + vllm.cpp is an Apache-2.0 C++20 inference engine maintained by the LocalAI team, + developed in its own repository and usable without LocalAI. It began as a port of + vLLM and keeps vLLM as its reference implementation, checking output against it and + benchmarking against it, while growing a featureset of its own. It implements vLLM's + V1 architecture (paged KV cache, continuous batching, prefix caching, scheduler, + sampler) on a portable tensor runtime with no Python, PyTorch or ggml at inference + time. It loads GGUF as well as Hugging Face safetensors, supports structured output + (JSON schema / regex / choice / GBNF grammar) enforced in-engine, ships speculative + decoding and KV offload, and runs on CPU, NVIDIA CUDA (Blackwell-family), Apple + Metal and Vulkan. + + The project is expected to be renamed as it diverges further from vLLM; the new + name is still to be decided. + urls: + - https://github.com/mudler/vllm.cpp + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - metal + capabilities: + default: cpu-vllm-cpp + metal: metal-vllm-cpp + nvidia: cuda13-vllm-cpp + nvidia-cuda-13: cuda13-vllm-cpp + nvidia-l4t: nvidia-l4t-arm64-vllm-cpp + nvidia-l4t-cuda-13: nvidia-l4t-arm64-vllm-cpp + vulkan: vulkan-vllm-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-vllm-cpp mirrors: - localai/localai-backends:master-gpu-vulkan-vllm-cpp -- !!merge <<: *vllm-cpp - name: "metal-vllm-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-vllm-cpp" +- name: metal-vllm-cpp + alias: vllm-cpp + license: apache-2.0 + description: | + ALPHA development builds. Try it, but llama-cpp stays the recommendation for + production use. + + vllm.cpp is an Apache-2.0 C++20 inference engine maintained by the LocalAI team, + developed in its own repository and usable without LocalAI. It began as a port of + vLLM and keeps vLLM as its reference implementation, checking output against it and + benchmarking against it, while growing a featureset of its own. It implements vLLM's + V1 architecture (paged KV cache, continuous batching, prefix caching, scheduler, + sampler) on a portable tensor runtime with no Python, PyTorch or ggml at inference + time. It loads GGUF as well as Hugging Face safetensors, supports structured output + (JSON schema / regex / choice / GBNF grammar) enforced in-engine, ships speculative + decoding and KV offload, and runs on CPU, NVIDIA CUDA (Blackwell-family), Apple + Metal and Vulkan. + + The project is expected to be renamed as it diverges further from vLLM; the new + name is still to be decided. + urls: + - https://github.com/mudler/vllm.cpp + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - metal + capabilities: + default: cpu-vllm-cpp + metal: metal-vllm-cpp + nvidia: cuda13-vllm-cpp + nvidia-cuda-13: cuda13-vllm-cpp + nvidia-l4t: nvidia-l4t-arm64-vllm-cpp + nvidia-l4t-cuda-13: nvidia-l4t-arm64-vllm-cpp + vulkan: vulkan-vllm-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-vllm-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-vllm-cpp -- !!merge <<: *vllm-cpp - name: "metal-vllm-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-vllm-cpp" +- name: metal-vllm-cpp-development + alias: vllm-cpp + license: apache-2.0 + description: | + ALPHA development builds. Try it, but llama-cpp stays the recommendation for + production use. + + vllm.cpp is an Apache-2.0 C++20 inference engine maintained by the LocalAI team, + developed in its own repository and usable without LocalAI. It began as a port of + vLLM and keeps vLLM as its reference implementation, checking output against it and + benchmarking against it, while growing a featureset of its own. It implements vLLM's + V1 architecture (paged KV cache, continuous batching, prefix caching, scheduler, + sampler) on a portable tensor runtime with no Python, PyTorch or ggml at inference + time. It loads GGUF as well as Hugging Face safetensors, supports structured output + (JSON schema / regex / choice / GBNF grammar) enforced in-engine, ships speculative + decoding and KV offload, and runs on CPU, NVIDIA CUDA (Blackwell-family), Apple + Metal and Vulkan. + + The project is expected to be renamed as it diverges further from vLLM; the new + name is still to be decided. + urls: + - https://github.com/mudler/vllm.cpp + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - metal + capabilities: + default: cpu-vllm-cpp + metal: metal-vllm-cpp + nvidia: cuda13-vllm-cpp + nvidia-cuda-13: cuda13-vllm-cpp + nvidia-l4t: nvidia-l4t-arm64-vllm-cpp + nvidia-l4t-cuda-13: nvidia-l4t-arm64-vllm-cpp + vulkan: vulkan-vllm-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-vllm-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-vllm-cpp -## audio-cpp -- !!merge <<: *audiocpp - name: "cpu-audio-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-audio-cpp" +- name: cpu-audio-cpp + alias: audio-cpp + license: apache-2.0 + description: | + 0xShug0/audio.cpp - a ggml audio inference framework covering text to + speech, voice cloning, transcription, forced alignment, voice activity + detection, speaker diarization, source separation, voice conversion and + music generation, across 30+ model families. Consumes audio.cpp-native + GGUF packages from huggingface.co/audio-cpp/audio.cpp-gguf. + urls: + - https://github.com/0xShug0/audio.cpp + - https://huggingface.co/audio-cpp/audio.cpp-gguf + tags: + - TTS + - text-to-speech + - audio-transcription + - CPU + - CUDA + - HIP + - Metal + capabilities: + amd: rocm-audio-cpp + default: cpu-audio-cpp + metal: metal-audio-cpp + metal-darwin-arm64: metal-audio-cpp + nvidia: cuda12-audio-cpp + nvidia-cuda-12: cuda12-audio-cpp + nvidia-cuda-13: cuda13-audio-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-audio-cpp mirrors: - localai/localai-backends:latest-cpu-audio-cpp -- !!merge <<: *audiocpp - name: "cpu-audio-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-audio-cpp" +- name: cpu-audio-cpp-development + alias: audio-cpp + license: apache-2.0 + description: | + 0xShug0/audio.cpp - a ggml audio inference framework covering text to + speech, voice cloning, transcription, forced alignment, voice activity + detection, speaker diarization, source separation, voice conversion and + music generation, across 30+ model families. Consumes audio.cpp-native + GGUF packages from huggingface.co/audio-cpp/audio.cpp-gguf. + urls: + - https://github.com/0xShug0/audio.cpp + - https://huggingface.co/audio-cpp/audio.cpp-gguf + tags: + - TTS + - text-to-speech + - audio-transcription + - CPU + - CUDA + - HIP + - Metal + capabilities: + amd: rocm-audio-cpp + default: cpu-audio-cpp + metal: metal-audio-cpp + metal-darwin-arm64: metal-audio-cpp + nvidia: cuda12-audio-cpp + nvidia-cuda-12: cuda12-audio-cpp + nvidia-cuda-13: cuda13-audio-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-audio-cpp mirrors: - localai/localai-backends:master-cpu-audio-cpp -- !!merge <<: *audiocpp - name: "cuda12-audio-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-audio-cpp" +- name: cuda12-audio-cpp + alias: audio-cpp + license: apache-2.0 + description: | + 0xShug0/audio.cpp - a ggml audio inference framework covering text to + speech, voice cloning, transcription, forced alignment, voice activity + detection, speaker diarization, source separation, voice conversion and + music generation, across 30+ model families. Consumes audio.cpp-native + GGUF packages from huggingface.co/audio-cpp/audio.cpp-gguf. + urls: + - https://github.com/0xShug0/audio.cpp + - https://huggingface.co/audio-cpp/audio.cpp-gguf + tags: + - TTS + - text-to-speech + - audio-transcription + - CPU + - CUDA + - HIP + - Metal + capabilities: + amd: rocm-audio-cpp + default: cpu-audio-cpp + metal: metal-audio-cpp + metal-darwin-arm64: metal-audio-cpp + nvidia: cuda12-audio-cpp + nvidia-cuda-12: cuda12-audio-cpp + nvidia-cuda-13: cuda13-audio-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-audio-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-audio-cpp -- !!merge <<: *audiocpp - name: "cuda12-audio-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-audio-cpp" +- name: cuda12-audio-cpp-development + alias: audio-cpp + license: apache-2.0 + description: | + 0xShug0/audio.cpp - a ggml audio inference framework covering text to + speech, voice cloning, transcription, forced alignment, voice activity + detection, speaker diarization, source separation, voice conversion and + music generation, across 30+ model families. Consumes audio.cpp-native + GGUF packages from huggingface.co/audio-cpp/audio.cpp-gguf. + urls: + - https://github.com/0xShug0/audio.cpp + - https://huggingface.co/audio-cpp/audio.cpp-gguf + tags: + - TTS + - text-to-speech + - audio-transcription + - CPU + - CUDA + - HIP + - Metal + capabilities: + amd: rocm-audio-cpp + default: cpu-audio-cpp + metal: metal-audio-cpp + metal-darwin-arm64: metal-audio-cpp + nvidia: cuda12-audio-cpp + nvidia-cuda-12: cuda12-audio-cpp + nvidia-cuda-13: cuda13-audio-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-audio-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-audio-cpp -- !!merge <<: *audiocpp - name: "cuda13-audio-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-audio-cpp" +- name: cuda13-audio-cpp + alias: audio-cpp + license: apache-2.0 + description: | + 0xShug0/audio.cpp - a ggml audio inference framework covering text to + speech, voice cloning, transcription, forced alignment, voice activity + detection, speaker diarization, source separation, voice conversion and + music generation, across 30+ model families. Consumes audio.cpp-native + GGUF packages from huggingface.co/audio-cpp/audio.cpp-gguf. + urls: + - https://github.com/0xShug0/audio.cpp + - https://huggingface.co/audio-cpp/audio.cpp-gguf + tags: + - TTS + - text-to-speech + - audio-transcription + - CPU + - CUDA + - HIP + - Metal + capabilities: + amd: rocm-audio-cpp + default: cpu-audio-cpp + metal: metal-audio-cpp + metal-darwin-arm64: metal-audio-cpp + nvidia: cuda12-audio-cpp + nvidia-cuda-12: cuda12-audio-cpp + nvidia-cuda-13: cuda13-audio-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-audio-cpp mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-audio-cpp -- !!merge <<: *audiocpp - name: "cuda13-audio-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-audio-cpp" +- name: cuda13-audio-cpp-development + alias: audio-cpp + license: apache-2.0 + description: | + 0xShug0/audio.cpp - a ggml audio inference framework covering text to + speech, voice cloning, transcription, forced alignment, voice activity + detection, speaker diarization, source separation, voice conversion and + music generation, across 30+ model families. Consumes audio.cpp-native + GGUF packages from huggingface.co/audio-cpp/audio.cpp-gguf. + urls: + - https://github.com/0xShug0/audio.cpp + - https://huggingface.co/audio-cpp/audio.cpp-gguf + tags: + - TTS + - text-to-speech + - audio-transcription + - CPU + - CUDA + - HIP + - Metal + capabilities: + amd: rocm-audio-cpp + default: cpu-audio-cpp + metal: metal-audio-cpp + metal-darwin-arm64: metal-audio-cpp + nvidia: cuda12-audio-cpp + nvidia-cuda-12: cuda12-audio-cpp + nvidia-cuda-13: cuda13-audio-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-audio-cpp mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-audio-cpp -- !!merge <<: *audiocpp - name: "rocm-audio-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-audio-cpp" +- name: rocm-audio-cpp + alias: audio-cpp + license: apache-2.0 + description: | + 0xShug0/audio.cpp - a ggml audio inference framework covering text to + speech, voice cloning, transcription, forced alignment, voice activity + detection, speaker diarization, source separation, voice conversion and + music generation, across 30+ model families. Consumes audio.cpp-native + GGUF packages from huggingface.co/audio-cpp/audio.cpp-gguf. + urls: + - https://github.com/0xShug0/audio.cpp + - https://huggingface.co/audio-cpp/audio.cpp-gguf + tags: + - TTS + - text-to-speech + - audio-transcription + - CPU + - CUDA + - HIP + - Metal + capabilities: + amd: rocm-audio-cpp + default: cpu-audio-cpp + metal: metal-audio-cpp + metal-darwin-arm64: metal-audio-cpp + nvidia: cuda12-audio-cpp + nvidia-cuda-12: cuda12-audio-cpp + nvidia-cuda-13: cuda13-audio-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-audio-cpp mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-audio-cpp -- !!merge <<: *audiocpp - name: "rocm-audio-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-audio-cpp" +- name: rocm-audio-cpp-development + alias: audio-cpp + license: apache-2.0 + description: | + 0xShug0/audio.cpp - a ggml audio inference framework covering text to + speech, voice cloning, transcription, forced alignment, voice activity + detection, speaker diarization, source separation, voice conversion and + music generation, across 30+ model families. Consumes audio.cpp-native + GGUF packages from huggingface.co/audio-cpp/audio.cpp-gguf. + urls: + - https://github.com/0xShug0/audio.cpp + - https://huggingface.co/audio-cpp/audio.cpp-gguf + tags: + - TTS + - text-to-speech + - audio-transcription + - CPU + - CUDA + - HIP + - Metal + capabilities: + amd: rocm-audio-cpp + default: cpu-audio-cpp + metal: metal-audio-cpp + metal-darwin-arm64: metal-audio-cpp + nvidia: cuda12-audio-cpp + nvidia-cuda-12: cuda12-audio-cpp + nvidia-cuda-13: cuda13-audio-cpp + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-audio-cpp mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-audio-cpp -- !!merge <<: *audiocpp - name: "metal-audio-cpp" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-audio-cpp" +- name: metal-audio-cpp + alias: audio-cpp + license: apache-2.0 + description: | + 0xShug0/audio.cpp - a ggml audio inference framework covering text to + speech, voice cloning, transcription, forced alignment, voice activity + detection, speaker diarization, source separation, voice conversion and + music generation, across 30+ model families. Consumes audio.cpp-native + GGUF packages from huggingface.co/audio-cpp/audio.cpp-gguf. + urls: + - https://github.com/0xShug0/audio.cpp + - https://huggingface.co/audio-cpp/audio.cpp-gguf + tags: + - TTS + - text-to-speech + - audio-transcription + - CPU + - CUDA + - HIP + - Metal + capabilities: + amd: rocm-audio-cpp + default: cpu-audio-cpp + metal: metal-audio-cpp + metal-darwin-arm64: metal-audio-cpp + nvidia: cuda12-audio-cpp + nvidia-cuda-12: cuda12-audio-cpp + nvidia-cuda-13: cuda13-audio-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-audio-cpp mirrors: - localai/localai-backends:latest-metal-darwin-arm64-audio-cpp -- !!merge <<: *audiocpp - name: "metal-audio-cpp-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-audio-cpp" +- name: metal-audio-cpp-development + alias: audio-cpp + license: apache-2.0 + description: | + 0xShug0/audio.cpp - a ggml audio inference framework covering text to + speech, voice cloning, transcription, forced alignment, voice activity + detection, speaker diarization, source separation, voice conversion and + music generation, across 30+ model families. Consumes audio.cpp-native + GGUF packages from huggingface.co/audio-cpp/audio.cpp-gguf. + urls: + - https://github.com/0xShug0/audio.cpp + - https://huggingface.co/audio-cpp/audio.cpp-gguf + tags: + - TTS + - text-to-speech + - audio-transcription + - CPU + - CUDA + - HIP + - Metal + capabilities: + amd: rocm-audio-cpp + default: cpu-audio-cpp + metal: metal-audio-cpp + metal-darwin-arm64: metal-audio-cpp + nvidia: cuda12-audio-cpp + nvidia-cuda-12: cuda12-audio-cpp + nvidia-cuda-13: cuda13-audio-cpp + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-audio-cpp mirrors: - localai/localai-backends:master-metal-darwin-arm64-audio-cpp -## funasr -- !!merge <<: *funasr - name: "funasr-development" +- name: funasr-development + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual capabilities: - nvidia: "cuda12-funasr-development" - intel: "intel-funasr-development" - amd: "rocm-funasr-development" - nvidia-l4t: "nvidia-l4t-funasr-development" - metal: "metal-funasr-development" - default: "cpu-funasr-development" - nvidia-cuda-13: "cuda13-funasr-development" - nvidia-cuda-12: "cuda12-funasr-development" - nvidia-l4t-cuda-12: "nvidia-l4t-funasr-development" - nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-funasr-development" -- !!merge <<: *funasr - name: "cpu-funasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-funasr" + amd: rocm-funasr-development + default: cpu-funasr-development + intel: intel-funasr-development + metal: metal-funasr-development + nvidia: cuda12-funasr-development + nvidia-cuda-12: cuda12-funasr-development + nvidia-cuda-13: cuda13-funasr-development + nvidia-l4t: nvidia-l4t-funasr-development + nvidia-l4t-cuda-12: nvidia-l4t-funasr-development + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr-development +- name: cpu-funasr + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-funasr mirrors: - localai/localai-backends:latest-cpu-funasr -- !!merge <<: *funasr - name: "cpu-funasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-cpu-funasr" +- name: cpu-funasr-development + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:master-cpu-funasr mirrors: - localai/localai-backends:master-cpu-funasr -- !!merge <<: *funasr - name: "cuda12-funasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-funasr" +- name: cuda12-funasr + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-funasr mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-12-funasr -- !!merge <<: *funasr - name: "cuda12-funasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-funasr" +- name: cuda12-funasr-development + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-funasr mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-12-funasr -- !!merge <<: *funasr - name: "cuda13-funasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-funasr" +- name: cuda13-funasr + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-funasr mirrors: - localai/localai-backends:latest-gpu-nvidia-cuda-13-funasr -- !!merge <<: *funasr - name: "cuda13-funasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-funasr" +- name: cuda13-funasr-development + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-funasr mirrors: - localai/localai-backends:master-gpu-nvidia-cuda-13-funasr -- !!merge <<: *funasr - name: "intel-funasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-funasr" +- name: intel-funasr + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-funasr mirrors: - localai/localai-backends:latest-gpu-intel-funasr -- !!merge <<: *funasr - name: "intel-funasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-funasr" +- name: intel-funasr-development + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-intel-funasr mirrors: - localai/localai-backends:master-gpu-intel-funasr -- !!merge <<: *funasr - name: "rocm-funasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-funasr" +- name: rocm-funasr + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-funasr mirrors: - localai/localai-backends:latest-gpu-rocm-hipblas-funasr -- !!merge <<: *funasr - name: "rocm-funasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-funasr" +- name: rocm-funasr-development + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-funasr mirrors: - localai/localai-backends:master-gpu-rocm-hipblas-funasr -- !!merge <<: *funasr - name: "nvidia-l4t-funasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-funasr" +- name: nvidia-l4t-funasr + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-funasr mirrors: - localai/localai-backends:latest-nvidia-l4t-funasr -- !!merge <<: *funasr - name: "nvidia-l4t-funasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-funasr" +- name: nvidia-l4t-funasr-development + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-funasr mirrors: - localai/localai-backends:master-nvidia-l4t-funasr -- !!merge <<: *funasr - name: "cuda13-nvidia-l4t-arm64-funasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-funasr" +- name: cuda13-nvidia-l4t-arm64-funasr + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-funasr mirrors: - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-funasr -- !!merge <<: *funasr - name: "cuda13-nvidia-l4t-arm64-funasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-funasr" +- name: cuda13-nvidia-l4t-arm64-funasr-development + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-funasr mirrors: - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-funasr -- !!merge <<: *funasr - name: "metal-funasr" - uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-funasr" +- name: metal-funasr + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-funasr mirrors: - localai/localai-backends:latest-metal-darwin-arm64-funasr -- !!merge <<: *funasr - name: "metal-funasr-development" - uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-funasr" +- name: metal-funasr-development + alias: funasr + license: mit + icon: https://avatars.githubusercontent.com/u/109454077 + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + urls: + - https://github.com/modelscope/FunASR + tags: + - speech-recognition + - ASR + - multilingual + capabilities: + amd: rocm-funasr + default: cpu-funasr + intel: intel-funasr + metal: metal-funasr + nvidia: cuda12-funasr + nvidia-cuda-12: cuda12-funasr + nvidia-cuda-13: cuda13-funasr + nvidia-l4t: nvidia-l4t-funasr + nvidia-l4t-cuda-12: nvidia-l4t-funasr + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-funasr + uri: quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-funasr mirrors: - localai/localai-backends:master-metal-darwin-arm64-funasr diff --git a/core/application/application.go b/core/application/application.go index f8a62f181..497895993 100644 --- a/core/application/application.go +++ b/core/application/application.go @@ -16,7 +16,9 @@ import ( "github.com/mudler/LocalAI/core/config" "github.com/mudler/LocalAI/core/http/auth" mcpTools "github.com/mudler/LocalAI/core/http/endpoints/mcp" + "github.com/mudler/LocalAI/core/library" "github.com/mudler/LocalAI/core/services/addons" + "github.com/mudler/LocalAI/core/services/addons/backendlib" "github.com/mudler/LocalAI/core/services/addons/catalog" "github.com/mudler/LocalAI/core/services/addons/gateway" "github.com/mudler/LocalAI/core/services/addons/packages" @@ -80,8 +82,14 @@ type Application struct { addonGateway *gateway.Gateway addonServer *http.Server addonSources *catalog.Sources + backendLibrary *backendlib.Installer addonManager *addons.Manager addonHostOps *addonruntime.HostOps + + // libraryStore is the library sources file when no add-on owner runs here. + libraryStore *catalog.Sources + libraryStoreMu sync.Mutex + // The pin store is built once so the routes and the retention sweep share it. addonPinStoreOnce sync.Once addonPinStore pins.Store @@ -679,6 +687,9 @@ func (a *Application) start() (startErr error) { assistantClient.StatsRecorder = a.statsRecorder assistantClient.FallbackUser = a.fallbackUser assistantClient.VoiceProfiles = a.voiceProfileStore + if a.backendLibrary != nil { + assistantClient.BackendLibrary = libraryInstallNoProgress{a.backendLibrary} + } if a.distributed != nil && a.distributed.Unloader != nil { assistantClient.LoadStopper = a.distributed.Unloader } @@ -824,6 +835,10 @@ func (a *Application) StartAgentPool() { // AddonManager is nil unless the deployment explicitly enables addons. func (a *Application) AddonManager() *addons.Manager { return a.addonManager } +// BackendLibrary installs backends from the library entries of kind backend. +// It is nil unless this instance owns the add-on libraries. +func (a *Application) BackendLibrary() *backendlib.Installer { return a.backendLibrary } + // AddonSources exposes owner-only source administration and explicit live refresh. // Forwarders never load source configuration or perform catalog I/O. func (a *Application) AddonSources() *catalog.Sources { return a.addonSources } @@ -867,8 +882,16 @@ func (a *Application) startAddons() error { if err != nil { return err } + var defaults []catalog.Source if c.OfficialLibrary { - if _, err = sources.SeedDefault(catalog.OfficialLibrary()); err != nil { + defaults = append(defaults, catalog.OfficialLibrary()) + } + if c.OfficialBackendLibrary { + defaults = append(defaults, library.DefaultBackendLibrary()) + } + sources.SetOfficial(a.applicationConfig.OfficialLibraries) + if len(defaults) > 0 { + if _, err = sources.SeedDefaults(defaults...); err != nil { return err } } @@ -936,6 +959,12 @@ func (a *Application) startAddons() error { } } a.addonSources = cat.Sources + if cat.Sources != nil { + a.backendLibrary = &backendlib.Installer{ + Catalog: cat, SystemState: a.applicationConfig.SystemState, ModelLoader: a.modelLoader, + MaxBytes: c.BackendMaxBytes, RequireIntegrity: a.applicationConfig.RequireBackendIntegrity, + } + } a.addonManager = m if c.InstanceID == c.OwnerID { go a.runAddonAutoUpgrade(a.applicationConfig.Context, upgradeInitialDelay, upgradeCheckInterval) @@ -946,3 +975,11 @@ func (a *Application) startAddons() error { } return nil } + +// libraryInstallNoProgress adapts the library installer to the assistant's +// installer interface, which does not report progress. +type libraryInstallNoProgress struct{ in *backendlib.Installer } + +func (l libraryInstallNoProgress) Install(ctx context.Context, sourceID, backend, version string) error { + return l.in.Install(ctx, sourceID, backend, version, backendlib.Progress{}) +} diff --git a/core/application/library_sources.go b/core/application/library_sources.go new file mode 100644 index 000000000..4bfb07597 --- /dev/null +++ b/core/application/library_sources.go @@ -0,0 +1,77 @@ +package application + +import ( + "context" + + "github.com/mudler/LocalAI/core/config" + "github.com/mudler/LocalAI/core/gallery" + "github.com/mudler/LocalAI/core/library" + "github.com/mudler/LocalAI/core/services/addons/catalog" + "github.com/mudler/xlog" +) + +// LibrarySources returns the one store of library sources this process works +// on. When the add-on owner runs here it is the owner's store, so a change made +// through the HTTP routes and the add-on catalog cannot overwrite each other; +// otherwise the store file under the data path is opened once. It is the file +// `local-ai library` edits. +func (a *Application) LibrarySources() (*catalog.Sources, error) { + if a.addonSources != nil { + return a.addonSources, nil + } + a.libraryStoreMu.Lock() + defer a.libraryStoreMu.Unlock() + if a.libraryStore != nil { + return a.libraryStore, nil + } + s, err := catalog.OpenStore(catalog.StorePath(a.applicationConfig.DataPath)) + if err != nil { + return nil, err + } + s.SetOfficial(a.applicationConfig.OfficialLibraries) + a.libraryStore = s + return s, nil +} + +// ApplyLibraries makes the running server follow the library store: it sets +// the official-libraries switch, brings the model and backend galleries in line +// with the enabled sources and, for sources the add-on catalog reads, fetches +// those that just came back. dropped names the addresses of deleted sources. +// It is called after the HTTP routes change a +// source and after the official_libraries setting changes. +func (a *Application) ApplyLibraries(dropped ...string) error { + store, err := a.LibrarySources() + if err != nil { + return err + } + cfg := a.applicationConfig + changed := store.SetOfficial(cfg.OfficialLibraries) + prevM, prevB := cfg.Galleries, cfg.BackendGalleries + cfg.Galleries, cfg.BackendGalleries = library.Reconcile(store, cfg.Galleries, cfg.BackendGalleries, dropped...) + gallery.ResetGalleryModelCacheIfChanged(prevM, prevB, cfg) + if changed || a.addonSources != nil { + go func() { + if err := store.RefreshEnabled(context.Background()); err != nil { + xlog.Warn("could not refresh the library sources", "error", err) + } + }() + } + return nil +} + +// applyOfficialLibrariesAtStartup drops the shipped default galleries from the +// lists the server reads when the persisted setting turned the official +// libraries off. The command line default is on, so this only acts on a saved +// setting. +func applyOfficialLibrariesAtStartup(cfg *config.ApplicationConfig) { + if cfg.OfficialLibraries || cfg.DataPath == "" { + return + } + store, err := catalog.OpenStore(catalog.StorePath(cfg.DataPath)) + if err != nil { + xlog.Warn("official libraries are not turned off", "error", err) + return + } + store.SetOfficial(false) + cfg.Galleries, cfg.BackendGalleries = library.Reconcile(store, cfg.Galleries, cfg.BackendGalleries) +} diff --git a/core/application/library_sources_test.go b/core/application/library_sources_test.go new file mode 100644 index 000000000..ce7ee560e --- /dev/null +++ b/core/application/library_sources_test.go @@ -0,0 +1,74 @@ +package application + +import ( + "encoding/json" + "testing" + + "github.com/mudler/LocalAI/core/config" + "github.com/mudler/LocalAI/core/library" +) + +// shipped sets the galleries a run with the default flags starts with. +func shipped(t *testing.T, cfg *config.ApplicationConfig) { + t.Helper() + if err := json.Unmarshal([]byte(config.DefaultGalleriesJSON), &cfg.Galleries); err != nil { + t.Fatal(err) + } + if err := json.Unmarshal([]byte(config.DefaultBackendGalleriesJSON), &cfg.BackendGalleries); err != nil { + t.Fatal(err) + } +} + +func TestApplyLibrariesFollowsTheOfficialSwitchInBothStates(t *testing.T) { + dir := t.TempDir() + cfg := config.NewApplicationConfig(config.WithDataPath(dir)) + shipped(t, cfg) + library.Option(dir, true, false, true)(cfg) + wantModels, wantBackends := len(cfg.Galleries), len(cfg.BackendGalleries) + if wantModels == 0 || wantBackends == 0 { + t.Fatalf("the shipped galleries were not mapped: %d, %d", wantModels, wantBackends) + } + // A gallery of the user, so the off state has something left to read. + store, err := library.Open(dir, true, false) + if err != nil { + t.Fatal(err) + } + if _, err := library.Add(store, "model", "https://example.org/team.yaml", "team", "Team", "gallery"); err != nil { + t.Fatal(err) + } + a := &Application{applicationConfig: cfg} + + cfg.OfficialLibraries = false + if err := a.ApplyLibraries(); err != nil { + t.Fatal(err) + } + if len(cfg.Galleries) != 1 || cfg.Galleries[0].URL != "https://example.org/team.yaml" || len(cfg.BackendGalleries) != 0 { + t.Errorf("off: models %+v backends %+v", cfg.Galleries, cfg.BackendGalleries) + } + + cfg.OfficialLibraries = true + if err := a.ApplyLibraries(); err != nil { + t.Fatal(err) + } + if len(cfg.Galleries) != wantModels+1 || len(cfg.BackendGalleries) != wantBackends { + t.Errorf("on: models %+v backends %+v", cfg.Galleries, cfg.BackendGalleries) + } +} + +func TestOfficialLibrariesOffAtStartupDropsTheDefaultGalleries(t *testing.T) { + dir := t.TempDir() + cfg := config.NewApplicationConfig(config.WithDataPath(dir)) + shipped(t, cfg) + library.Option(dir, true, false, true)(cfg) + + cfg.OfficialLibraries = true + applyOfficialLibrariesAtStartup(cfg) + if len(cfg.Galleries) == 0 || len(cfg.BackendGalleries) == 0 { + t.Fatal("on: the default galleries were dropped") + } + cfg.OfficialLibraries = false + applyOfficialLibrariesAtStartup(cfg) + if len(cfg.Galleries) != 0 || len(cfg.BackendGalleries) != 0 { + t.Errorf("off: models %+v backends %+v", cfg.Galleries, cfg.BackendGalleries) + } +} diff --git a/core/application/startup.go b/core/application/startup.go index a0866d4d6..785d96a12 100644 --- a/core/application/startup.go +++ b/core/application/startup.go @@ -55,6 +55,7 @@ func New(opts ...config.AppOption) (*Application, error) { // full restart. Env/CLI values win over the file (see // ApplyRuntimeSettingsAtStartup). loadStartupSettings(options) + applyOfficialLibrariesAtStartup(options) // WithThreads no longer eagerly resolves 0 (so the settings merge can // tell "unset" from "env-set"); resolve the physical-core default now @@ -504,6 +505,13 @@ func New(opts ...config.AppOption) (*Application, error) { bmFn := func() galleryop.BackendManager { return application.GalleryService().BackendManager() } uc := NewUpgradeChecker(options, application.ModelLoader(), application.distributedDB(), bmFn) application.upgradeChecker = uc + // Library backends follow the same auto_upgrade_backends switch. + uc.SetLibraryBackends(func() libraryUpgrader { + if l := application.BackendLibrary(); l != nil { + return l + } + return nil + }) // A request that proves a backend is older than the server marks it // stale; refresh the upgrade cache so /backends/upgrades shows it. gallery.SetStaleBackendNotifier(uc.TriggerCheck) diff --git a/core/application/upgrade_checker.go b/core/application/upgrade_checker.go index 2a6046673..3360a6781 100644 --- a/core/application/upgrade_checker.go +++ b/core/application/upgrade_checker.go @@ -7,6 +7,7 @@ import ( "github.com/mudler/LocalAI/core/config" "github.com/mudler/LocalAI/core/gallery" + "github.com/mudler/LocalAI/core/services/addons/backendlib" "github.com/mudler/LocalAI/core/services/advisorylock" "github.com/mudler/LocalAI/core/services/galleryop" "github.com/mudler/LocalAI/pkg/model" @@ -41,6 +42,11 @@ type UpgradeChecker struct { // frontend filesystem — fixing the bug where upgrades never surfaced. backendManagerFn func() galleryop.BackendManager + // libraryFn returns the installer of library backends, or nil when the + // host has none. It is read on each check because the add-on owner starts + // after the checker is built. + libraryFn func() libraryUpgrader + checkInterval time.Duration stop chan struct{} done chan struct{} @@ -164,7 +170,46 @@ func (uc *UpgradeChecker) GetAvailableUpgrades() map[string]gallery.UpgradeInfo return result } +// libraryUpgrader is the part of the library backend installer the checker +// needs: the newer builds the library lists, and the install of one. +type libraryUpgrader interface { + Updates(ctx context.Context) ([]backendlib.Update, error) + Install(ctx context.Context, sourceID, backend, version string, progress backendlib.Progress) error +} + +// SetLibraryBackends makes the checker upgrade library backends too. fn may +// return nil while the host has no library. +func (uc *UpgradeChecker) SetLibraryBackends(fn func() libraryUpgrader) { uc.libraryFn = fn } + +// upgradeLibraryBackends follows the same switch as the gallery backends: +// with auto_upgrade_backends on, a library backend moves to the newer build +// the library lists; with it off nothing is installed and the Update button on +// the Backends page stays the only way. The switch is read on every check, so +// a change in the runtime settings applies at the next one. +func (uc *UpgradeChecker) upgradeLibraryBackends(ctx context.Context) { + if !uc.appConfig.AutoUpgradeBackends || uc.libraryFn == nil { + return + } + lib := uc.libraryFn() + if lib == nil { + return + } + updates, err := lib.Updates(ctx) + if err != nil { + xlog.Debug("Library backend upgrade check failed", "error", err) + return + } + for _, u := range updates { + xlog.Info("Auto-upgrading library backend", "backend", u.Name, "library", u.SourceID, + "from", u.InstalledVersion, "to", u.Version) + if err := lib.Install(ctx, u.SourceID, u.Name, u.Version, backendlib.Progress{}); err != nil { + xlog.Error("Failed to auto-upgrade library backend", "backend", u.Name, "error", err) + } + } +} + func (uc *UpgradeChecker) runCheck(ctx context.Context) { + defer uc.upgradeLibraryBackends(ctx) var ( upgrades map[string]gallery.UpgradeInfo err error diff --git a/core/application/upgrade_checker_library_test.go b/core/application/upgrade_checker_library_test.go new file mode 100644 index 000000000..2737d27ed --- /dev/null +++ b/core/application/upgrade_checker_library_test.go @@ -0,0 +1,44 @@ +package application + +import ( + "context" + "testing" + + "github.com/mudler/LocalAI/core/config" + "github.com/mudler/LocalAI/core/services/addons/backendlib" +) + +type fakeLibrary struct { + updates []backendlib.Update + installed []string +} + +func (f *fakeLibrary) Updates(context.Context) ([]backendlib.Update, error) { return f.updates, nil } +func (f *fakeLibrary) Install(_ context.Context, source, name, version string, _ backendlib.Progress) error { + f.installed = append(f.installed, source+"/"+name+"@"+version) + return nil +} + +func TestLibraryBackendsFollowAutoUpgradeSwitch(t *testing.T) { + for _, on := range []bool{true, false} { + lib := &fakeLibrary{updates: []backendlib.Update{{Name: "whisper", SourceID: "official-backends", Version: "1.2.0"}}} + uc := &UpgradeChecker{appConfig: &config.ApplicationConfig{AutoUpgradeBackends: on}} + uc.SetLibraryBackends(func() libraryUpgrader { return lib }) + uc.upgradeLibraryBackends(context.Background()) + if on && len(lib.installed) != 1 { + t.Fatalf("switch on: want one upgrade, got %v", lib.installed) + } + if on && lib.installed[0] != "official-backends/whisper@1.2.0" { + t.Fatalf("wrong install %v", lib.installed) + } + if !on && len(lib.installed) != 0 { + t.Fatalf("switch off: nothing may install, got %v", lib.installed) + } + } +} + +func TestLibraryBackendsWithoutLibrary(t *testing.T) { + uc := &UpgradeChecker{appConfig: &config.ApplicationConfig{AutoUpgradeBackends: true}} + uc.SetLibraryBackends(func() libraryUpgrader { return nil }) + uc.upgradeLibraryBackends(context.Background()) +} diff --git a/core/cli/cli.go b/core/cli/cli.go index 2b17ff96d..fa7b2dc95 100644 --- a/core/cli/cli.go +++ b/core/cli/cli.go @@ -15,6 +15,7 @@ var CLI struct { Federated FederatedCLI `cmd:"" help:"Run LocalAI in federated mode"` Models ModelsCMD `cmd:"" help:"Manage LocalAI models and definitions"` Backends BackendsCMD `cmd:"" help:"Manage LocalAI backends and definitions"` + Library LibraryCMD `cmd:"" help:"Manage the library sources LocalAI reads add-ons, backends and models from"` TTS TTSCMD `cmd:"" help:"Convert text to speech"` SoundGeneration SoundGenerationCMD `cmd:"" help:"Generates audio files from text or audio"` Transcript TranscriptCMD `cmd:"" help:"Convert audio to text"` diff --git a/core/cli/library.go b/core/cli/library.go new file mode 100644 index 000000000..a1b81f01f --- /dev/null +++ b/core/cli/library.go @@ -0,0 +1,168 @@ +package cli + +import ( + "errors" + "fmt" + "io" + "os" + "strings" + "text/tabwriter" + + cliContext "github.com/mudler/LocalAI/core/cli/context" + "github.com/mudler/LocalAI/core/library" + "github.com/mudler/LocalAI/core/services/addons/catalog" +) + +// LibraryFlags are shared by every `local-ai library` command. The sources are +// stored under the data path, in the file the server reads, so the commands +// work with the server stopped. +type LibraryFlags struct { + DataPath string `env:"LOCALAI_DATA_PATH" type:"path" default:"${basepath}/data" help:"Path for persistent data. The library sources are stored under it, in addons/sources.json, the file the server reads" group:"storage"` + AddonsOfficialLibrary bool `name:"addons-official-library" env:"LOCALAI_ADDONS_OFFICIAL_LIBRARY" default:"true" help:"List the official add-on library as a default source" group:"addons"` + AddonsBackendLibrary bool `name:"addons-backend-library" env:"LOCALAI_ADDONS_BACKEND_LIBRARY" default:"true" help:"List the backend library as a default source. Turn it off to read the backend gallery only" group:"addons"` + OfficialLibraries bool `name:"official-libraries" env:"LOCALAI_OFFICIAL_LIBRARIES" default:"true" help:"Use the official (shipped default) library sources of every kind. Off: they stay in the list, shown as off" group:"addons"` +} + +func (f LibraryFlags) open() (*catalog.Sources, error) { + store, err := library.Open(f.DataPath, f.AddonsOfficialLibrary, f.AddonsBackendLibrary) + if err != nil { + return nil, err + } + store.SetOfficial(f.OfficialLibraries) + return store, nil +} + +// LibraryCMD manages the sources LocalAI reads add-ons, backends and models from. +type LibraryCMD struct { + List LibraryList `cmd:"" default:"withargs" help:"List the library sources, with their kind, state and whether they are shipped defaults"` + Add LibraryAdd `cmd:"" help:"Add a library source of your own"` + Remove LibraryRemove `cmd:"" help:"Remove a source. A removed default stays removed at the next start"` + Enable LibraryEnable `cmd:"" help:"Turn a source on (this also brings back a removed default)"` + Disable LibraryDisable `cmd:"" help:"Turn a source off without removing it"` +} + +type LibraryList struct { + LibraryFlags `embed:""` +} + +type LibraryAdd struct { + URL string `arg:"" name:"url" help:"URL of the library index"` + Kind string `required:"" enum:"addon,backend,model" help:"What the source provides: addon, backend or model"` + ID string `help:"Source id: lowercase letters, digits and dashes. Default: derived from the name or URL"` + Name string `help:"Display name. Default: the id"` + Format string `default:"library" enum:"library,gallery" help:"library: an index in the shared library entry shape. gallery: a model or backend gallery index, as --galleries names"` + + LibraryFlags `embed:""` +} + +type LibraryRemove struct { + ID string `arg:"" name:"id" help:"Source id"` + + LibraryFlags `embed:""` +} + +type LibraryEnable struct { + ID string `arg:"" name:"id" help:"Source id"` + + LibraryFlags `embed:""` +} + +type LibraryDisable struct { + ID string `arg:"" name:"id" help:"Source id"` + + LibraryFlags `embed:""` +} + +func yesNo(b bool) string { + if b { + return "yes" + } + return "no" +} + +// writeSources prints the table `library list` shows. Removed is "yes" only for +// a default the user removed; such a record is kept as a tombstone. +func writeSources(w io.Writer, entries []catalog.Source) error { + tw := tabwriter.NewWriter(w, 2, 4, 2, ' ', 0) + fmt.Fprintln(tw, "KIND\tID\tURL\tENABLED\tDEFAULT\tREMOVED") + for _, e := range entries { + fmt.Fprintf(tw, "%s\t%s\t%s\t%s\t%s\t%s\n", e.Kind, e.ID, e.URL, yesNo(e.Enabled && !e.Suspended), yesNo(e.Default), yesNo(e.Removed)) + } + return tw.Flush() +} + +func (c *LibraryList) Run(_ *cliContext.Context) error { + store, err := c.open() + if err != nil { + return err + } + return writeSources(os.Stdout, store.Entries()) +} + +func (c *LibraryAdd) Run(_ *cliContext.Context) error { + store, err := c.open() + if err != nil { + return err + } + format := "" + if c.Format == "gallery" { + format = catalog.FormatGallery + } + src, err := library.Add(store, catalog.Kind(c.Kind), c.URL, c.ID, c.Name, format) + if err != nil { + if errors.Is(err, catalog.ErrInvalid) { + return fmt.Errorf("cannot add %q as a %s source: the id must be lowercase letters, digits and dashes and start with a letter, and a library index URL must be http or https (use --format=gallery for a gallery index)", c.URL, c.Kind) + } + return err + } + fmt.Printf("added %s source %s (%s)\n", src.Kind, src.ID, src.URL) + return nil +} + +func (c *LibraryRemove) Run(_ *cliContext.Context) error { + store, err := c.open() + if err != nil { + return err + } + wasDefault, err := library.Remove(store, c.ID) + if err != nil { + return notFound(err, c.ID) + } + if wasDefault { + fmt.Printf("removed default source %s; it stays removed at the next start (local-ai library enable %s brings it back)\n", c.ID, c.ID) + } else { + fmt.Printf("removed source %s\n", c.ID) + } + return nil +} + +func (c *LibraryEnable) Run(_ *cliContext.Context) error { + store, err := c.open() + if err != nil { + return err + } + if err := store.SetEnabled(c.ID, true); err != nil { + return notFound(err, c.ID) + } + fmt.Printf("enabled source %s\n", c.ID) + return nil +} + +func (c *LibraryDisable) Run(_ *cliContext.Context) error { + store, err := c.open() + if err != nil { + return err + } + if err := store.SetEnabled(c.ID, false); err != nil { + return notFound(err, c.ID) + } + fmt.Printf("disabled source %s\n", c.ID) + return nil +} + +func notFound(err error, id string) error { + if errors.Is(err, catalog.ErrNotFound) { + return fmt.Errorf("no source with id %q; run `local-ai library list` to see them", strings.TrimSpace(id)) + } + return err +} diff --git a/core/cli/library_test.go b/core/cli/library_test.go new file mode 100644 index 000000000..90d6efc1a --- /dev/null +++ b/core/cli/library_test.go @@ -0,0 +1,166 @@ +package cli + +import ( + "bytes" + "strings" + "testing" + + "github.com/mudler/LocalAI/core/library" + "github.com/mudler/LocalAI/core/services/addons/catalog" +) + +func libFlags(t *testing.T, dir string) LibraryFlags { + t.Helper() + return LibraryFlags{DataPath: dir, AddonsOfficialLibrary: true} +} + +func entry(t *testing.T, f LibraryFlags, id string) (catalog.Source, bool) { + t.Helper() + store, err := f.open() + if err != nil { + t.Fatal(err) + } + for _, e := range store.Entries() { + if e.ID == id { + return e, true + } + } + return catalog.Source{}, false +} + +func TestLibraryListShowsDefaultsOfEveryKind(t *testing.T) { + f := libFlags(t, t.TempDir()) + store, err := f.open() + if err != nil { + t.Fatal(err) + } + var out bytes.Buffer + if err := writeSources(&out, store.Entries()); err != nil { + t.Fatal(err) + } + got := out.String() + for _, want := range []string{"KIND", "ENABLED", "DEFAULT", "REMOVED", "addon", "official", "backend", "localai-backends", "model", "localai"} { + if !strings.Contains(got, want) { + t.Errorf("list is missing %q:\n%s", want, got) + } + } + // A master build enables the model library and ships the localai gallery + // off, so every model is listed once. + for id, enabled := range map[string]bool{"official": true, "official-models": library.UseModelLibrary(), "localai": !library.UseModelLibrary(), "localai-backends": true} { + e, ok := entry(t, f, id) + if !ok || !e.Default || e.Enabled != enabled || e.Removed { + t.Errorf("default %s = %+v, %v, want enabled=%v", id, e, ok, enabled) + } + } +} + +func TestLibraryAddKinds(t *testing.T) { + f := libFlags(t, t.TempDir()) + for _, kind := range []string{"addon", "backend", "model"} { + c := LibraryAdd{URL: "https://example.org/" + kind + ".yaml", Kind: kind, ID: "mine-" + kind, Name: "Mine " + kind, Format: "library", LibraryFlags: f} + if err := c.Run(nil); err != nil { + t.Fatalf("add %s: %v", kind, err) + } + e, ok := entry(t, f, "mine-"+kind) + if !ok || e.Default || !e.Enabled || string(e.Kind) != kind || e.Name != "Mine "+kind { + t.Errorf("%s source = %+v, %v", kind, e, ok) + } + } + // The same URL and kind twice, and a taken id, are refused. + if err := (&LibraryAdd{URL: "https://example.org/addon.yaml", Kind: "addon", ID: "other", LibraryFlags: f, Format: "library"}).Run(nil); err == nil { + t.Error("the same url was added twice") + } + if err := (&LibraryAdd{URL: "https://example.org/x.yaml", Kind: "addon", ID: "mine-addon", LibraryFlags: f, Format: "library"}).Run(nil); err == nil { + t.Error("a taken id was accepted") + } + if err := (&LibraryAdd{URL: "not a url", Kind: "addon", LibraryFlags: f, Format: "library"}).Run(nil); err == nil { + t.Error("a bad url was accepted") + } +} + +func TestLibraryAddDerivesTheID(t *testing.T) { + f := libFlags(t, t.TempDir()) + if err := (&LibraryAdd{URL: "https://example.org/lib.yaml", Kind: "model", Name: "My Models", Format: "library", LibraryFlags: f}).Run(nil); err != nil { + t.Fatal(err) + } + if e, ok := entry(t, f, "my-models"); !ok || e.Name != "My Models" { + t.Errorf("derived id: %+v, %v", e, ok) + } +} + +func TestLibraryRemoveLeavesATombstoneForADefault(t *testing.T) { + dir := t.TempDir() + f := libFlags(t, dir) + if err := (&LibraryRemove{ID: "official", LibraryFlags: f}).Run(nil); err != nil { + t.Fatal(err) + } + // A new open stands for the next start: the default must not come back. + e, ok := entry(t, f, "official") + if !ok || !e.Removed || e.Enabled || !e.Default { + t.Fatalf("after remove: %+v, %v", e, ok) + } + // Removing it again finds nothing to remove. + if err := (&LibraryRemove{ID: "official", LibraryFlags: f}).Run(nil); err == nil { + t.Error("a removed source was removed twice") + } + // Enable brings it back. + if err := (&LibraryEnable{ID: "official", LibraryFlags: f}).Run(nil); err != nil { + t.Fatal(err) + } + if e, _ := entry(t, f, "official"); e.Removed || !e.Enabled { + t.Errorf("after enable: %+v", e) + } +} + +func TestLibraryRemoveDeletesAUserSource(t *testing.T) { + f := libFlags(t, t.TempDir()) + if err := (&LibraryAdd{URL: "https://example.org/a.yaml", Kind: "addon", ID: "mine", Format: "library", LibraryFlags: f}).Run(nil); err != nil { + t.Fatal(err) + } + if err := (&LibraryRemove{ID: "mine", LibraryFlags: f}).Run(nil); err != nil { + t.Fatal(err) + } + if _, ok := entry(t, f, "mine"); ok { + t.Error("a removed user source left a record") + } +} + +func TestLibraryEnableAndDisable(t *testing.T) { + f := libFlags(t, t.TempDir()) + if err := (&LibraryDisable{ID: "localai", LibraryFlags: f}).Run(nil); err != nil { + t.Fatal(err) + } + if e, _ := entry(t, f, "localai"); e.Enabled || e.Removed { + t.Errorf("after disable: %+v", e) + } + if err := (&LibraryEnable{ID: "localai", LibraryFlags: f}).Run(nil); err != nil { + t.Fatal(err) + } + if e, _ := entry(t, f, "localai"); !e.Enabled { + t.Errorf("after enable: %+v", e) + } + if err := (&LibraryEnable{ID: "nope", LibraryFlags: f}).Run(nil); err == nil || !strings.Contains(err.Error(), "no source") { + t.Errorf("unknown id: %v", err) + } +} + +// The store file is what the server reads: a second open sees the same state. +func TestLibraryStateIsSharedThroughTheFile(t *testing.T) { + dir := t.TempDir() + f := libFlags(t, dir) + if err := (&LibraryAdd{URL: "https://example.org/a.yaml", Kind: "backend", ID: "mine", Format: "library", LibraryFlags: f}).Run(nil); err != nil { + t.Fatal(err) + } + store, err := catalog.OpenStore(catalog.StorePath(dir)) + if err != nil { + t.Fatal(err) + } + found := false + for _, e := range store.Entries() { + found = found || e.ID == "mine" + } + if !found { + t.Error("the server store does not see the source") + } + _ = library.Defaults +} diff --git a/core/cli/run.go b/core/cli/run.go index c40d30463..fabbd71d2 100644 --- a/core/cli/run.go +++ b/core/cli/run.go @@ -16,6 +16,7 @@ import ( cliContext "github.com/mudler/LocalAI/core/cli/context" "github.com/mudler/LocalAI/core/config" "github.com/mudler/LocalAI/core/http" + "github.com/mudler/LocalAI/core/library" "github.com/mudler/LocalAI/core/p2p" "github.com/mudler/LocalAI/internal" "github.com/mudler/LocalAI/pkg/diagnostics" @@ -38,6 +39,9 @@ type RunCMD struct { AddonsOwnershipMode string `name:"addons-ownership-mode" env:"LOCALAI_ADDONS_OWNERSHIP_MODE" help:"Who may use add-ons: named-user (each account has its own access; needs authentication) or local-owner (every caller shares one owner). Default: local-owner when authentication is off, named-user when it is on" group:"addons"` AutoUpgradeAddons bool `name:"auto-upgrade-addons" env:"LOCALAI_AUTO_UPGRADE_ADDONS" default:"false" help:"Upgrade installed add-ons on their own when a newer version appears in their library. Off by default; upgrades then stay manual" group:"addons"` AddonsOfficialLibrary bool `name:"addons-official-library" env:"LOCALAI_ADDONS_OFFICIAL_LIBRARY" default:"true" help:"Register the official add-on library on the first start, when the add-on owner has no sources.json yet. A library the admin removes later stays removed. Turn it off with --addons-official-library=false" group:"addons"` + AddonsBackendLibrary bool `name:"addons-backend-library" env:"LOCALAI_ADDONS_BACKEND_LIBRARY" default:"true" help:"Register the backend library on the first start, when the add-on owner has no sources.json yet. A build from master reads it as the backend source; a tagged build reads the backend gallery until the release cutover. Turn it off to read the backend gallery only" group:"addons"` + OfficialLibraries bool `name:"official-libraries" env:"LOCALAI_OFFICIAL_LIBRARIES" default:"true" help:"Use the official (shipped default) library sources of add-ons, backends and models. Off: they stay in the list, shown as off, and are not read. Sources you added are not affected. Also a runtime setting (official_libraries)" group:"addons"` + AddonsBackendMaxBytes int64 `name:"addons-backend-max-bytes" env:"LOCALAI_ADDONS_BACKEND_MAX_BYTES" default:"8589934592" help:"Largest compressed size, in bytes, of a backend image installed from a library. Add-ons keep their own limit of 512 MiB" group:"addons"` Pprof bool `name:"pprof" env:"LOCALAI_PPROF" default:"false" help:"Enable the private loopback profiling listener" group:"diagnostics"` PprofAddress string `name:"pprof-address" env:"LOCALAI_PPROF_ADDRESS" default:"127.0.0.1:6060" help:"Numeric loopback address and port for profiling" group:"diagnostics"` PprofMutexProfileFraction int `name:"pprof-mutex-profile-fraction" env:"LOCALAI_PPROF_MUTEX_PROFILE_FRACTION" default:"0" help:"Mutex sampling fraction (0 disables sampling); requires pprof" group:"diagnostics"` @@ -350,6 +354,10 @@ func (r *RunCMD) Run(ctx *cliContext.Context) (result error) { config.WithF16(r.F16), config.WithStringGalleries(r.Galleries), config.WithBackendGalleries(r.BackendGalleries), + // The galleries the flags named also become library sources, and the + // library sources decide which galleries are read. This must stay + // after the two options above. + library.Option(r.DataPath, r.AddonsOfficialLibrary, r.AddonsBackendLibrary, r.OfficialLibraries), config.WithVRAMPersistentCache(r.VRAMPersistentCache), config.WithCors(r.CORS), config.WithCorsAllowOrigins(r.CORSAllowOrigins), @@ -670,6 +678,8 @@ func (r *RunCMD) Run(ctx *cliContext.Context) (result error) { } if addonCfg.Enabled { addonCfg.OfficialLibrary = r.AddonsOfficialLibrary + addonCfg.OfficialBackendLibrary = r.AddonsBackendLibrary + addonCfg.BackendMaxBytes = r.AddonsBackendMaxBytes opts = append(opts, config.WithAddons(addonCfg)) } if authEnabled { @@ -807,6 +817,8 @@ func (r *RunCMD) Run(ctx *cliContext.Context) (result error) { opts = append(opts, config.EnableBackendGalleriesAutoload) } + opts = append(opts, config.WithOfficialLibraries(r.OfficialLibraries)) + if r.AutoUpgradeBackends { opts = append(opts, config.WithAutoUpgradeBackends(r.AutoUpgradeBackends)) } diff --git a/core/cli/run_addons_test.go b/core/cli/run_addons_test.go index d5bf3551b..679a447de 100644 --- a/core/cli/run_addons_test.go +++ b/core/cli/run_addons_test.go @@ -51,6 +51,8 @@ var _ = Describe("Add-on owner flags", Serial, func() { Expect(r.AddonsEnabled).To(BeTrue()) Expect(r.AddonsOwnershipMode).To(BeEmpty()) Expect(r.AddonsOfficialLibrary).To(BeTrue()) + // The pilot backend library is a default source too. + Expect(r.AddonsBackendLibrary).To(BeTrue()) dir := GinkgoT().TempDir() c, err := addonConfigFor(r.AddonsEnabled, r.AddonsOwnershipMode, dir, true) Expect(err).NotTo(HaveOccurred()) diff --git a/core/config/application_config.go b/core/config/application_config.go index 0291022bc..6fba0345a 100644 --- a/core/config/application_config.go +++ b/core/config/application_config.go @@ -36,6 +36,16 @@ type AddonConfig struct { // when the owner has no sources.json yet. A sources.json that exists is // never changed by it, so a library the admin removed stays removed. OfficialLibrary bool + // OfficialBackendLibrary also registers the backend library on the first + // start, under the same rule: a sources.json that exists is never changed, + // so a library the admin removed stays removed. It is on by default, but + // whether it is enabled depends on the build (core/library.BackendSource): + // a build that reads the backend gallery lists the library and leaves it + // off. + OfficialBackendLibrary bool + // BackendMaxBytes bounds the compressed size of one backend image + // installed from a library; zero is 8 GiB. Add-ons keep their own limit. + BackendMaxBytes int64 Host contract.HostCompatibility AdminCheck func(context.Context, contract.Actor) error `json:"-" yaml:"-"` // BackupKeep is how many backups of one add-on the owner keeps; zero is @@ -61,6 +71,10 @@ func WithAddons(c AddonConfig) AppOption { } type ApplicationConfig struct { + // OfficialLibraries is the switch for the shipped default library sources + // of every kind. On by default; off keeps them listed but unread. + OfficialLibraries bool + Addons AddonConfig `json:"-" yaml:"-"` // AddonHostOps maps an add-on ID to the host operation prefixes it may @@ -353,6 +367,7 @@ func NewApplicationConfig(o ...AppOption) *ApplicationConfig { UploadLimitMB: 15, Debug: true, ModelArtifactMaterializer: modelartifacts.NewDefaultManager(), + OfficialLibraries: true, ModelPreloadRenderMode: "dark", // Capture backend process stdout/stderr into the per-model // BackendLogStore by default so the UI "Backend Logs" page works out @@ -670,6 +685,10 @@ var EnableBackendGalleriesAutoload = func(o *ApplicationConfig) { o.AutoloadBackendGalleries = true } +func WithOfficialLibraries(v bool) AppOption { + return func(o *ApplicationConfig) { o.OfficialLibraries = v } +} + func WithAutoUpgradeBackends(v bool) AppOption { return func(o *ApplicationConfig) { o.AutoUpgradeBackends = v } } diff --git a/core/config/application_config_test.go b/core/config/application_config_test.go index cb88a03c8..ad51a1681 100644 --- a/core/config/application_config_test.go +++ b/core/config/application_config_test.go @@ -136,6 +136,23 @@ var _ = Describe("ApplicationConfig RuntimeSettings Conversion", func() { Expect(*rs.AutoUpgradeBackends).To(BeTrue()) }) + It("should include official_libraries in both states", func() { + for _, on := range []bool{true, false} { + rs := (&ApplicationConfig{OfficialLibraries: on}).ToRuntimeSettings() + Expect(rs.OfficialLibraries).ToNot(BeNil()) + Expect(*rs.OfficialLibraries).To(Equal(on)) + } + }) + + It("should default official_libraries to on and take it from a persisted file", func() { + Expect(NewApplicationConfig().OfficialLibraries).To(BeTrue()) + Expect(DefaultRuntimeBaseline().OfficialLibraries).To(BeTrue()) + cfg := NewApplicationConfig() + off := false + cfg.ApplyRuntimeSettingsAtStartup(&RuntimeSettings{OfficialLibraries: &off}) + Expect(cfg.OfficialLibraries).To(BeFalse()) + }) + It("should include auto_upgrade_addons, off by default", func() { Expect((&ApplicationConfig{}).AutoUpgradeAddons).To(BeFalse()) rs := (&ApplicationConfig{}).ToRuntimeSettings() @@ -523,6 +540,15 @@ var _ = Describe("ApplicationConfig RuntimeSettings Conversion", func() { Expect(appConfig.AutoUpgradeBackends).To(BeTrue()) }) + It("should apply official_libraries setting", func() { + appConfig := &ApplicationConfig{} + for _, v := range []bool{true, false} { + v := v + appConfig.ApplyRuntimeSettings(&RuntimeSettings{OfficialLibraries: &v}) + Expect(appConfig.OfficialLibraries).To(Equal(v)) + } + }) + It("should apply auto_upgrade_addons setting", func() { appConfig := &ApplicationConfig{} v := true diff --git a/core/config/gallery.go b/core/config/gallery.go index 3f6b31ab9..1251e3727 100644 --- a/core/config/gallery.go +++ b/core/config/gallery.go @@ -48,8 +48,11 @@ type Gallery struct { // always preferred, and a mirror is only consulted after the one before // it fails. Any URI the gallery loader understands works here // (https://, github:, file://, oci://). - Mirrors []string `json:"mirrors,omitempty" yaml:"mirrors,omitempty"` - Name string `json:"name" yaml:"name"` + Mirrors []string `json:"mirrors,omitempty" yaml:"mirrors,omitempty"` + Name string `json:"name" yaml:"name"` + // Library says the URL is a model library (the shared library entry + // shape), not a gallery index. + Library bool `json:"library,omitempty" yaml:"library,omitempty"` Verification *GalleryVerification `json:"verification,omitempty" yaml:"verification,omitempty"` // ArtifactVerification overrides Verification only for the gallery OCI artifact. // Backend images keep their separate Verification policy. diff --git a/core/config/runtime_settings.go b/core/config/runtime_settings.go index ee4054333..ce311fd32 100644 --- a/core/config/runtime_settings.go +++ b/core/config/runtime_settings.go @@ -20,6 +20,7 @@ type RuntimeSettings struct { // Backend management SingleBackend *bool `json:"single_backend,omitempty"` // Deprecated: use MaxActiveBackends = 1 instead MaxActiveBackends *int `json:"max_active_backends,omitempty"` // Maximum number of active backends (0 = unlimited, 1 = single backend mode) + OfficialLibraries *bool `json:"official_libraries,omitempty"` // Read the shipped default library sources of add-ons, backends and models AutoUpgradeBackends *bool `json:"auto_upgrade_backends,omitempty"` // Automatically upgrade backends when new versions are detected AutoUpgradeAddons *bool `json:"auto_upgrade_addons,omitempty"` // Automatically upgrade installed add-ons when their library lists a newer version PreferDevelopmentBackends *bool `json:"prefer_development_backends,omitempty"` // Display/download preference; installed alias resolver changes require restart diff --git a/core/config/runtime_settings_registry.go b/core/config/runtime_settings_registry.go index 482ac5f5e..d68150162 100644 --- a/core/config/runtime_settings_registry.go +++ b/core/config/runtime_settings_registry.go @@ -163,6 +163,10 @@ var runtimeSettingsFields = []fieldSpec{ return cur.MaxActiveBackends != base.MaxActiveBackends || cur.SingleBackend != base.SingleBackend }, }, + field("official_libraries", + func(s *RuntimeSettings) **bool { return &s.OfficialLibraries }, + func(o *ApplicationConfig) bool { return o.OfficialLibraries }, + func(o *ApplicationConfig, v bool) { o.OfficialLibraries = v }), field("auto_upgrade_backends", func(s *RuntimeSettings) **bool { return &s.AutoUpgradeBackends }, func(o *ApplicationConfig) bool { return o.AutoUpgradeBackends }, diff --git a/core/gallery/backend_index_source.go b/core/gallery/backend_index_source.go new file mode 100644 index 000000000..e0fd4a573 --- /dev/null +++ b/core/gallery/backend_index_source.go @@ -0,0 +1,59 @@ +// SPDX-License-Identifier: MIT +package gallery + +import ( + "fmt" + + "github.com/mudler/LocalAI/core/config" + "github.com/mudler/LocalAI/core/services/addons/catalog" + "github.com/mudler/xlog" +) + +const ( + // OfficialBackendLibraryURL is the backend library, the source of the + // backends, kept in this repository. It is a default backend source. The + // gallery index is generated from it by scripts/backends/cmd/backendcatalog. + OfficialBackendLibraryURL = catalog.OfficialBackendLibraryURL +) + +// backendLibraryFor returns the library to read for a gallery, or false when +// the gallery is read as a gallery index. A gallery is a library when its entry +// says so, which is how the backend library, shipped or added with +// `local-ai library add`, is handed to the reader. +func backendLibraryFor(g config.Gallery) (config.Gallery, bool) { + if !g.Library { + return config.Gallery{}, false + } + // The library has no mirrors of its own: the gallery's would describe + // another file. Its images are installed the way the gallery installs them, + // by the tag and the mirrors the entry names. + return config.Gallery{Name: g.Name, URL: g.URL}, true +} + +// getBackendLibraryElements reads the backends of a gallery from the backend +// library. A library that cannot be fetched or read is an error: falling back +// to the gallery would hide the setting from the owner who chose it. +func getBackendLibraryElements(g, lib config.Gallery, basePath string, requireIntegrity bool, isInstalled func(*GalleryBackend) bool) ([]*GalleryBackend, error) { + body, err := libraryBody(g, lib, basePath, requireIntegrity, "backend") + if err != nil { + return nil, err + } + res, err := catalog.ReadIndex(body, catalog.KindBackend) + if err != nil { + return nil, fmt.Errorf("failed to read the backend library: %w", err) + } + if len(res.Skipped) > 0 { + xlog.Info("backend library entries of another kind were skipped", "gallery", g.Name, "count", len(res.Skipped)) + } + backends, err := BackendsFromLibrary(res.Releases) + if err != nil { + return nil, fmt.Errorf("failed to read the backend library: %w", err) + } + // Only a library that decodes is kept, so a bad file does not stay cached. + keepLibraryBody(lib, body) + for _, b := range backends { + b.SetGallery(g) + b.SetInstalled(isInstalled(b)) + } + return backends, nil +} diff --git a/core/gallery/backend_library.go b/core/gallery/backend_library.go new file mode 100644 index 000000000..c14052fef --- /dev/null +++ b/core/gallery/backend_library.go @@ -0,0 +1,404 @@ +// SPDX-License-Identifier: MIT +package gallery + +import ( + "bytes" + "errors" + "fmt" + "reflect" + "regexp" + "sort" + "strings" + + "github.com/mudler/LocalAI/core/config" + "github.com/mudler/LocalAI/core/services/addons/catalog" + "gopkg.in/yaml.v3" +) + +// The backend library, gallery/backends/index.yaml, is the source of truth for +// the backends, the way the model library is for the models. The backend +// gallery, backend/index.yaml, is a generated copy that stays only so releases +// before the cutover keep working; scripts/backends/cmd/backendcatalog writes +// it from the library and it is never edited by hand. +// +// A library entry is a catalog.Release of kind backend. One gallery backend +// becomes one library entry per platform its image is built for, because the +// library pins the digest of the image of each platform. A meta backend +// becomes one entry with capabilities and no image. Converting library entries +// back to a gallery entry gives the entry the gallery had, field for field, +// for every field the gallery reader uses. The tests check that on every entry +// of the real library. + +const ( + // BackendChannelLatest and BackendChannelDevelopment are the channels of a + // backend entry. The tag of the image says which: latest-* is a release, + // master-* is the development build of the branch. + BackendChannelLatest = "latest" + BackendChannelDevelopment = "development" + + backendOCIPrefix = "oci://" +) + +var backendTagPattern = regexp.MustCompile(`:(latest|master)-[A-Za-z0-9._-]+$`) + +// BackendPin is the digest of the image of one platform. An empty digest means +// the image is not pinned in the library: a development image, which is pinned +// at install, or a release image the registry could not be read for. +type BackendPin struct { + OS string + Arch string + Digest string +} + +// backendChannel is the channel of a gallery backend. A concrete backend takes +// it from the tag of its image; a meta backend from its name, as the gallery +// names its development variants. +func backendChannel(b GalleryBackend) (string, error) { + if b.URI == "" { + if strings.HasSuffix(b.Name, "-"+defaultDevSuffix) { + return BackendChannelDevelopment, nil + } + return BackendChannelLatest, nil + } + m := backendTagPattern.FindStringSubmatch(b.URI) + switch { + case m == nil: + return "", fmt.Errorf("the image %q has no latest-* or master-* tag", b.URI) + case m[1] == "master": + return BackendChannelDevelopment, nil + } + return BackendChannelLatest, nil +} + +// checkExpressible refuses a gallery backend that sets a field the library +// body cannot carry, so nothing is lost without notice. The real gallery sets +// none of them. +func checkExpressible(b GalleryBackend) error { + switch { + case b.Name == "": + return errors.New("gallery entry has no name") + case b.Version != "": + return fmt.Errorf("backend %q sets version, which the library does not carry", b.Name) + case b.SHA256 != "": + return fmt.Errorf("backend %q sets sha256, which the library does not carry", b.Name) + case b.Metadata.URL != "", len(b.AdditionalFiles) > 0, b.Size != "", b.Metadata.Backend != "": + return fmt.Errorf("backend %q sets a model field (url, files, size or backend)", b.Name) + } + return nil +} + +func ociRef(uri string) (string, error) { + if uri == "" || strings.Contains(uri, "://") { + return "", fmt.Errorf("the image %q must be a plain image reference: the library adds the oci:// scheme", uri) + } + return backendOCIPrefix + uri, nil +} + +// BackendLibraryEntries converts a gallery backend to its library entries. A +// concrete backend gets one entry for each pin; a meta backend takes no pins. +// A development image is never pinned in the library, and neither is a pin +// without a digest: such an entry is mutable and the install pins it. +func BackendLibraryEntries(b GalleryBackend, pins []BackendPin) ([]catalog.Release, error) { + b = stripBackendRuntime(b) + if err := checkExpressible(b); err != nil { + return nil, err + } + channel, err := backendChannel(b) + if err != nil { + return nil, fmt.Errorf("backend %q: %w", b.Name, err) + } + base := catalog.Release{ + Kind: catalog.KindBackend, + ID: b.Name, + Name: b.Name, + Alias: b.Alias, + Description: b.Description, + Channel: channel, + SchemaVersion: catalog.SchemaVersion, + License: b.License, + URLs: cloneList(b.URLs), + Tags: cloneList(b.Tags), + Icon: b.Icon, + Capabilities: cloneMap(b.CapabilitiesMap), + } + if b.URI == "" { + if len(b.CapabilitiesMap) == 0 { + return nil, fmt.Errorf("backend %q has no image and no capabilities", b.Name) + } + if len(pins) > 0 || len(b.Mirrors) > 0 { + return nil, fmt.Errorf("meta backend %q has no image to pin or mirror", b.Name) + } + base.Version = "0.0.0-" + channel + return []catalog.Release{base}, nil + } + artifact, err := ociRef(b.URI) + if err != nil { + return nil, fmt.Errorf("backend %q: %w", b.Name, err) + } + base.Artifact = artifact + for _, m := range b.Mirrors { + ref, err := ociRef(m) + if err != nil { + return nil, fmt.Errorf("backend %q mirror: %w", b.Name, err) + } + base.Mirrors = append(base.Mirrors, ref) + } + if len(pins) == 0 { + return nil, fmt.Errorf("backend %q has no platform", b.Name) + } + sorted := append([]BackendPin(nil), pins...) + sort.SliceStable(sorted, func(i, j int) bool { + return sorted[i].OS+"/"+sorted[i].Arch < sorted[j].OS+"/"+sorted[j].Arch + }) + var out []catalog.Release + for i, p := range sorted { + if p.OS == "" || p.Arch == "" { + return nil, fmt.Errorf("backend %q: a pin has no platform", b.Name) + } + if i > 0 && p.OS == sorted[i-1].OS && p.Arch == sorted[i-1].Arch { + return nil, fmt.Errorf("backend %q: two pins for %s/%s", b.Name, p.OS, p.Arch) + } + r := base + r.OS, r.Arch = p.OS, p.Arch + switch { + case p.Digest == "": + r.Mutable = true + r.Version = "0.0.0-" + channel + case channel == BackendChannelDevelopment: + return nil, fmt.Errorf("backend %q is a development image: it is pinned at install, not in the library", b.Name) + default: + hex := strings.TrimPrefix(p.Digest, "sha256:") + if len(hex) != 64 || hex == p.Digest { + return nil, fmt.Errorf("backend %q: %q is not a sha256 digest", b.Name, p.Digest) + } + r.Digest = p.Digest + r.Version = "0.0.0-" + channel + "." + hex[:12] + } + out = append(out, r) + } + return out, nil +} + +// ToGalleryBackend converts one library entry of kind backend to the gallery +// entry the installer and the listing read. The id is the name the gallery +// knows the backend by. +func ToGalleryBackend(r catalog.Release) (GalleryBackend, error) { + if r.EntryKind() != catalog.KindBackend { + return GalleryBackend{}, fmt.Errorf("entry %q is of kind %q, not backend", r.ID, r.EntryKind()) + } + if err := catalog.ValidateEntry(r); err != nil { + return GalleryBackend{}, err + } + b := GalleryBackend{ + Metadata: Metadata{ + Name: r.ID, + Description: r.Description, + License: r.License, + URLs: cloneList(r.URLs), + Icon: r.Icon, + Tags: cloneList(r.Tags), + }, + Alias: r.Alias, + CapabilitiesMap: cloneMap(r.Capabilities), + } + if r.Artifact != "" { + b.URI = strings.TrimPrefix(r.Artifact, backendOCIPrefix) + } + for _, m := range r.Mirrors { + b.Mirrors = append(b.Mirrors, strings.TrimPrefix(m, backendOCIPrefix)) + } + return b, nil +} + +// BackendsFromLibrary converts library entries of kind backend to gallery +// backends, in the order the ids first appear. The entries of one id, one for +// each platform, must describe the same gallery backend; if they differ the +// library is refused, because the gallery cannot hold both. Entries of another +// kind are skipped. +func BackendsFromLibrary(releases []catalog.Release) ([]*GalleryBackend, error) { + var out []*GalleryBackend + index := map[string]int{} + for _, r := range releases { + if r.EntryKind() != catalog.KindBackend { + continue + } + b, err := ToGalleryBackend(r) + if err != nil { + return nil, err + } + i, seen := index[b.Name] + if !seen { + index[b.Name] = len(out) + out = append(out, &b) + continue + } + if d := firstBackendDifference(*out[i], b); d != "" { + return nil, fmt.Errorf("the library entries of backend %q disagree: %s", b.Name, d) + } + } + return out, nil +} + +// LibraryPins collects the pins of the backend entries of a library by id. +func LibraryPins(releases []catalog.Release) map[string][]BackendPin { + out := map[string][]BackendPin{} + for _, r := range releases { + if r.EntryKind() == catalog.KindBackend && r.Artifact != "" { + out[r.ID] = append(out[r.ID], BackendPin{OS: r.OS, Arch: r.Arch, Digest: r.Digest}) + } + } + return out +} + +func stripBackendRuntime(b GalleryBackend) GalleryBackend { + b.Gallery = config.Gallery{} + b.Installed = false + b.Library, b.MaxBytes, b.Stage = "", 0, nil + return b +} + +// normalizeBackend makes an empty list or map the same as an absent one, +// which is how the gallery reader sees them, and drops the runtime fields. +func normalizeBackend(b GalleryBackend) GalleryBackend { + b = stripBackendRuntime(b) + if len(b.URLs) == 0 { + b.URLs = nil + } + if len(b.Tags) == 0 { + b.Tags = nil + } + if len(b.Mirrors) == 0 { + b.Mirrors = nil + } + if len(b.CapabilitiesMap) == 0 { + b.CapabilitiesMap = nil + } + return b +} + +// SameBackend reports whether two gallery backends are equal on every field +// the gallery reader uses. +func SameBackend(a, b GalleryBackend) bool { + return reflect.DeepEqual(normalizeBackend(a), normalizeBackend(b)) +} + +// firstBackendDifference names the first field of two gallery backends that +// differ, or "" when they are the same. +func firstBackendDifference(a, b GalleryBackend) string { + a, b = normalizeBackend(a), normalizeBackend(b) + av, bv := reflect.ValueOf(a), reflect.ValueOf(b) + for i := 0; i < av.NumField(); i++ { + f := av.Type().Field(i) + if f.Name == "Metadata" { + mv, nv := reflect.ValueOf(a.Metadata), reflect.ValueOf(b.Metadata) + for j := 0; j < mv.NumField(); j++ { + if !reflect.DeepEqual(mv.Field(j).Interface(), nv.Field(j).Interface()) { + return fmt.Sprintf("%s: %#v became %#v", mv.Type().Field(j).Name, mv.Field(j).Interface(), nv.Field(j).Interface()) + } + } + continue + } + if f.Type.Kind() == reflect.Func { + continue + } + if !reflect.DeepEqual(av.Field(i).Interface(), bv.Field(i).Interface()) { + return fmt.Sprintf("%s: %#v became %#v", f.Name, av.Field(i).Interface(), bv.Field(i).Interface()) + } + } + return "" +} + +// VerifyBackendRoundTrip checks that a gallery backend survives the library: +// it is converted to library entries, written as an index, read the way a host +// reads a library, validated as a host validates it, and converted back. The +// result must equal the original on every field the gallery reader uses. It +// returns a description of the first difference. +func VerifyBackendRoundTrip(b GalleryBackend, pins []BackendPin) error { + entries, err := BackendLibraryEntries(b, pins) + if err != nil { + return err + } + raw, err := catalog.EncodeIndex(entries) + if err != nil { + return fmt.Errorf("writing the library entries: %w", err) + } + res, err := catalog.ReadIndex(raw, catalog.ReadableKinds...) + if err != nil { + return fmt.Errorf("reading the library entries: %w", err) + } + if len(res.Releases) != len(entries) { + return fmt.Errorf("%d library entries came back as %d", len(entries), len(res.Releases)) + } + got, err := BackendsFromLibrary(res.Releases) + if err != nil { + return err + } + if len(got) != 1 { + return fmt.Errorf("the library entries came back as %d gallery backends", len(got)) + } + if d := firstBackendDifference(b, *got[0]); d != "" { + return fmt.Errorf("gallery entry changed on the way through the library: %s", d) + } + return nil +} + +// backendFileEntry is a gallery backend as it is written to the gallery file: +// the fields of GalleryBackend in the order the file has always used. +type backendFileEntry struct { + Name string `yaml:"name"` + Alias string `yaml:"alias,omitempty"` + License string `yaml:"license,omitempty"` + Icon string `yaml:"icon,omitempty"` + Description string `yaml:"description,omitempty"` + URLs []string `yaml:"urls,omitempty"` + Tags []string `yaml:"tags,omitempty"` + Capabilities map[string]string `yaml:"capabilities,omitempty"` + URI string `yaml:"uri,omitempty"` + Mirrors []string `yaml:"mirrors,omitempty"` +} + +// EncodeBackendGalleryIndex writes gallery backends as the gallery file the +// host reads (backend/index.yaml). The runtime fields are not written. It +// refuses a backend that sets a field the file does not write, so the file +// reads back as the entries it was written from. +func EncodeBackendGalleryIndex(backends []GalleryBackend) ([]byte, error) { + out := make([]backendFileEntry, len(backends)) + for i, b := range backends { + b = normalizeBackend(b) + if err := checkExpressible(b); err != nil { + return nil, err + } + out[i] = backendFileEntry{ + Name: b.Name, Alias: b.Alias, License: b.License, Icon: b.Icon, Description: b.Description, + URLs: b.URLs, Tags: b.Tags, Capabilities: b.CapabilitiesMap, URI: b.URI, Mirrors: b.Mirrors, + } + } + var buf bytes.Buffer + enc := yaml.NewEncoder(&buf) + enc.SetIndent(2) + if err := enc.Encode(out); err != nil { + return nil, err + } + if err := enc.Close(); err != nil { + return nil, err + } + return buf.Bytes(), nil +} + +func cloneList(s []string) []string { + if s == nil { + return nil + } + return append([]string{}, s...) +} + +func cloneMap(m map[string]string) map[string]string { + if m == nil { + return nil + } + out := make(map[string]string, len(m)) + for k, v := range m { + out[k] = v + } + return out +} diff --git a/core/gallery/backend_library_generated_test.go b/core/gallery/backend_library_generated_test.go new file mode 100644 index 000000000..57676a6b3 --- /dev/null +++ b/core/gallery/backend_library_generated_test.go @@ -0,0 +1,165 @@ +package gallery + +import ( + "net/http" + "net/http/httptest" + "os" + "strings" + "testing" + + "github.com/mudler/LocalAI/core/config" + "github.com/mudler/LocalAI/pkg/system" + "gopkg.in/yaml.v3" +) + +// backend/index.yaml is generated and never edited. The CI check regenerates it +// and fails on a diff; this test does the same in the Go suite, so a hand edit +// is found by go test too. +func TestCheckedInBackendGalleryIsTheGeneratedCopy(t *testing.T) { + list, err := BackendsFromLibrary(loadRealBackendLibrary(t)) + if err != nil { + t.Fatal(err) + } + flat := make([]GalleryBackend, len(list)) + for i, b := range list { + flat[i] = *b + } + want, err := EncodeBackendGalleryIndex(flat) + if err != nil { + t.Fatal(err) + } + have, err := os.ReadFile("../../backend/index.yaml") + if err != nil { + t.Fatal(err) + } + body := string(have) + for strings.HasPrefix(body, "#") { + _, rest, _ := strings.Cut(body, "\n") + body = rest + } + if body != string(want) { + t.Error("backend/index.yaml is not the copy generated from gallery/backends/index.yaml. It is generated; do not edit it by hand. Regenerate: go run ./scripts/backends/cmd/backendcatalog --library gallery/backends/index.yaml --out backend/index.yaml") + } + var loaded []GalleryBackend + if err := yaml.Unmarshal(have, &loaded); err != nil { + t.Fatalf("the gallery reader on the generated gallery: %v", err) + } + if len(loaded) != len(flat) { + t.Fatalf("the generated gallery loads %d entries, the library has %d backends", len(loaded), len(flat)) + } + for i := range loaded { + if !SameBackend(loaded[i], flat[i]) { + t.Errorf("%s loads differently from the library", flat[i].Name) + } + } + t.Logf("generated gallery: %d entries read back equal to the library", len(loaded)) +} + +// A gallery marked as a library is read as a library; any other gallery is +// read as an index. The server hands the shipped backend library to the reader +// this way, so the backends it lists are the backends of the library. +func TestLibraryGalleryReadsTheBackendLibrary(t *testing.T) { + library, err := os.ReadFile(realBackendLibrary) + if err != nil { + t.Fatal(err) + } + var libraryHits, galleryHits int + srv := httptest.NewServer(http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) { + switch r.URL.Path { + case "/backends/index.yaml": + libraryHits++ + _, _ = w.Write(library) + case "/gallery/index.yaml": + galleryHits++ + _, _ = w.Write([]byte("- name: from-gallery\n uri: quay.io/acme/backends:latest-cpu-x\n")) + default: + w.WriteHeader(http.StatusNotFound) + } + })) + t.Cleanup(srv.Close) + + state, err := system.GetSystemState(system.WithBackendPath(t.TempDir())) + if err != nil { + t.Fatal(err) + } + names := func(g config.Gallery) GalleryElements[*GalleryBackend] { + t.Helper() + backends, err := AvailableBackendsUnfiltered([]config.Gallery{g}, state) + if err != nil { + t.Fatal(err) + } + return backends + } + official := config.Gallery{Name: "localai", URL: srv.URL + "/gallery/index.yaml"} + + // Default: the gallery index, and the library file is never requested. + if got := names(official); len(got) != 1 || got[0].Name != "from-gallery" { + t.Errorf("default source gave %d backends", len(got)) + } + if libraryHits != 0 { + t.Errorf("the library was read %d times with the default source", libraryHits) + } + + // Library: a gallery marked as a library is read as one. + official.Library = true + official.URL = srv.URL + "/backends/index.yaml" + backends := names(official) + if len(backends) != goldenGalleryNames { + t.Fatalf("the library gave %d backends, want %d", len(backends), goldenGalleryNames) + } + llama := backends.FindByName("llama-cpp") + if llama == nil || !llama.IsMeta() || llama.CapabilitiesMap["nvidia"] != "cuda12-llama-cpp" || llama.Alias != "llama-cpp" { + t.Fatalf("the meta backend lost its body: %+v", llama) + } + cpu := backends.FindByName("cpu-llama-cpp") + if cpu == nil || cpu.IsMeta() || !strings.HasPrefix(cpu.URI, "quay.io/go-skynet/local-ai-backends:latest-") || len(cpu.Mirrors) != 1 || cpu.License == "" || cpu.Icon == "" { + t.Fatalf("the concrete backend lost its body: %+v", cpu) + } + if g := cpu.GetGallery(); g.Name != "localai" || g.URL != official.URL || !g.Library { + t.Errorf("the entry should carry the configured gallery, got %+v", g) + } + // The backends the server lists are the backends of the generated gallery. + var generated []GalleryBackend + raw, err := os.ReadFile("../../backend/index.yaml") + if err != nil { + t.Fatal(err) + } + if err := yaml.Unmarshal(raw, &generated); err != nil { + t.Fatal(err) + } + if len(generated) != len(backends) { + t.Fatalf("the generated gallery has %d backends, the library %d", len(generated), len(backends)) + } + for i, b := range generated { + if !SameBackend(b, *backends[i]) { + t.Errorf("%s differs between the library and the generated gallery", b.Name) + } + } + // The meta backends resolve to a concrete one through the library. + if best := llama.FindBestBackendFromMeta(state, backends); best != nil && best.IsMeta() { + t.Errorf("a meta backend resolved to another meta backend: %s", best.Name) + } + + // A gallery the owner added keeps its own index. + other := config.Gallery{Name: "mine", URL: srv.URL + "/gallery/index.yaml"} + if got := names(other); len(got) != 1 || got[0].Name != "from-gallery" { + t.Errorf("another gallery gave %d backends", len(got)) + } + + // An unreachable library is an error, not a silent fall back. + official.URL = srv.URL + "/missing.yaml" + if _, err := AvailableBackendsUnfiltered([]config.Gallery{official}, state); err == nil { + t.Error("a missing library fell back to the gallery") + } + + // A library with an entry the host refuses is an error too, and is not kept. + bad := config.Gallery{Name: "bad", URL: srv.URL + "/bad.yaml", Library: true} + badSrv := httptest.NewServer(http.HandlerFunc(func(w http.ResponseWriter, _ *http.Request) { + _, _ = w.Write([]byte("- kind: backend\n id: bad\n name: bad\n version: 0.0.0-latest\n artifact: https://example.org/bad.tar\n digest: " + strings.Repeat("x", 10) + "\n os: linux\n arch: amd64\n")) + })) + t.Cleanup(badSrv.Close) + bad.URL = badSrv.URL + "/bad.yaml" + if _, err := AvailableBackendsUnfiltered([]config.Gallery{bad}, state); err == nil { + t.Error("an invalid library entry was accepted") + } +} diff --git a/core/gallery/backend_library_test.go b/core/gallery/backend_library_test.go new file mode 100644 index 000000000..e72a68cd5 --- /dev/null +++ b/core/gallery/backend_library_test.go @@ -0,0 +1,548 @@ +package gallery + +import ( + "bufio" + "crypto/sha256" + "encoding/hex" + "os" + "path/filepath" + "strings" + "testing" + + "github.com/mudler/LocalAI/core/services/addons/catalog" + "gopkg.in/yaml.v3" +) + +const ( + realBackendLibrary = "../../gallery/backends/index.yaml" + backendLibraryGolds = "testdata/backend_library" + // The gallery before the library became the source, kept as the golden + // input: 1093 entries, five of them twins of another entry's name. + goldenGalleryEntries = 1093 + goldenGalleryNames = 1088 +) + +func loadRealBackendLibrary(t *testing.T) []catalog.Release { + t.Helper() + src, err := os.ReadFile(realBackendLibrary) + if err != nil { + t.Fatal(err) + } + res, err := catalog.ReadIndex(src, catalog.ReadableKinds...) + if err != nil { + t.Fatal(err) + } + if len(res.Releases) == 0 { + t.Fatal("the real backend library has no entries") + } + return res.Releases +} + +func loadGoldenGallery(t *testing.T) []GalleryBackend { + t.Helper() + src, err := os.ReadFile(filepath.Join(backendLibraryGolds, "gallery-before.yaml")) + if err != nil { + t.Fatal(err) + } + var list []GalleryBackend + if err := yaml.Unmarshal(src, &list); err != nil { + t.Fatal(err) + } + return list +} + +func loadGoldenPins(t *testing.T) map[string][]BackendPin { + t.Helper() + f, err := os.Open(filepath.Join(backendLibraryGolds, "pins.tsv")) + if err != nil { + t.Fatal(err) + } + defer func() { _ = f.Close() }() + pins := map[string][]BackendPin{} + sc := bufio.NewScanner(f) + for sc.Scan() { + line := sc.Text() + if line == "" || strings.HasPrefix(line, "#") { + continue + } + p := strings.Split(line, "\t") + if len(p) != 4 { + t.Fatalf("malformed pin line %q", line) + } + pins[p[0]] = append(pins[p[0]], BackendPin{OS: p[1], Arch: p[2], Digest: p[3]}) + } + return pins +} + +func loadGoldenDigests(t *testing.T) map[string]string { + t.Helper() + f, err := os.Open(filepath.Join(backendLibraryGolds, "digests.tsv")) + if err != nil { + t.Fatal(err) + } + defer func() { _ = f.Close() }() + out := map[string]string{} + sc := bufio.NewScanner(f) + for sc.Scan() { + line := sc.Text() + if line == "" || strings.HasPrefix(line, "#") { + continue + } + p := strings.Split(line, "\t") + if len(p) != 2 { + t.Fatalf("malformed golden line %q", line) + } + out[p[0]] = p[1] + } + return out +} + +func backendDigest(t *testing.T, b GalleryBackend) string { + t.Helper() + raw, err := EncodeBackendGalleryIndex([]GalleryBackend{b}) + if err != nil { + t.Fatal(err) + } + sum := sha256.Sum256(raw) + return hex.EncodeToString(sum[:]) +} + +// Every entry of the real backend gallery, as it was before the library became +// the source, must survive the library: gallery -> library -> gallery gives the +// same entry on every field the gallery reader uses. The count is asserted and +// logged so a run shows how many real entries it covered. +func TestBackendLibraryRoundTripsEveryRealGalleryEntry(t *testing.T) { + entries := loadGoldenGallery(t) + if len(entries) != goldenGalleryEntries { + t.Fatalf("the golden gallery has %d entries, want %d", len(entries), goldenGalleryEntries) + } + pins := loadGoldenPins(t) + golden := loadGoldenDigests(t) + covered, meta, concrete, dev, platformsRows := 0, 0, 0, 0, 0 + first := map[string]GalleryBackend{} + var failures []string + for _, b := range entries { + if twin, ok := first[b.Name]; ok { + // A name that appears twice must be the same entry, so folding it + // loses nothing. + if !SameBackend(twin, b) { + failures = append(failures, b.Name+": the twin entry differs from the first one") + continue + } + } else { + first[b.Name] = b + } + if err := VerifyBackendRoundTrip(b, pins[b.Name]); err != nil { + failures = append(failures, b.Name+": "+err.Error()) + continue + } + // The generated gallery entry is the one the golden file recorded. + if want, ok := golden[b.Name]; !ok || backendDigest(t, b) != want { + failures = append(failures, b.Name+": the golden digest does not match the gallery entry") + continue + } + covered++ + switch { + case b.URI == "": + meta++ + case strings.Contains(b.URI, ":master-"): + concrete++ + dev++ + default: + concrete++ + } + platformsRows += len(pins[b.Name]) + } + for _, f := range failures { + t.Error(f) + } + t.Logf("backend library round trip: %d of %d gallery entries covered (%d names; %d concrete of which %d development, %d meta); the golden pins hold %d platform entries", + covered, len(entries), len(first), concrete, dev, meta, platformsRows) + if covered != goldenGalleryEntries { + t.Errorf("covered %d gallery entries, want %d", covered, goldenGalleryEntries) + } + if len(first) != goldenGalleryNames || len(golden) != goldenGalleryNames { + t.Errorf("%d names and %d golden digests, want %d", len(first), len(golden), goldenGalleryNames) + } +} + +// The library file in the repository is read by the host, so it must decode and +// every entry must pass the checks a host applies. Every backend must convert +// to a gallery backend and come back as itself, and a meta backend must name +// backends the library has. +func TestRealBackendLibraryHasTheLibraryShape(t *testing.T) { + rows := loadRealBackendLibrary(t) + ids := map[string]bool{} + concrete := map[string]bool{} + keys := map[string]bool{} + pinned, development, unpinned, meta := 0, 0, 0, 0 + for _, r := range rows { + if r.EntryKind() != catalog.KindBackend { + t.Errorf("%s is of kind %q", r.ID, r.EntryKind()) + continue + } + if err := catalog.ValidateEntry(r); err != nil { + t.Error(err) + } + key := r.ID + "/" + r.OS + "/" + r.Arch + if keys[key] { + t.Errorf("%s is listed twice", key) + } + keys[key] = true + ids[r.ID] = true + if r.SchemaVersion != catalog.SchemaVersion { + t.Errorf("%s has schemaVersion %d", r.ID, r.SchemaVersion) + } + switch { + case r.IsMeta(): + meta++ + case r.Digest != "": + pinned++ + concrete[r.ID] = true + if r.Channel != BackendChannelLatest || !strings.Contains(r.Artifact, ":latest-") { + t.Errorf("%s: a pinned entry is a release image: %s", r.ID, r.Artifact) + } + case r.Channel == BackendChannelDevelopment: + development++ + concrete[r.ID] = true + if !r.Mutable || !strings.Contains(r.Artifact, ":master-") { + t.Errorf("%s: a development entry keeps its master-* tag and is mutable: %s", r.ID, r.Artifact) + } + default: + unpinned++ + concrete[r.ID] = true + t.Logf("not pinned: %s (%s/%s)", r.ID, r.OS, r.Arch) + } + } + for _, r := range rows { + if !r.IsMeta() { + continue + } + for capability, target := range r.Capabilities { + if !concrete[target] { + t.Errorf("meta backend %s: capability %s names %s, which the library does not have as a concrete backend", r.ID, capability, target) + } + } + } + list, err := BackendsFromLibrary(rows) + if err != nil { + t.Fatal(err) + } + pins := LibraryPins(rows) + for _, b := range list { + if err := VerifyBackendRoundTrip(*b, pins[b.Name]); err != nil { + t.Errorf("%s: %v", b.Name, err) + } + } + t.Logf("backend library: %d entries for %d backends (%d meta, %d pinned by digest, %d development, %d release entries not pinned)", len(rows), len(list), meta, pinned, development, unpinned) +} + +// An entry whose gallery digest is in the golden file must still produce the +// recorded gallery entry. An entry changed or added since the golden file was +// rendered has no matching digest and is covered by the round trip only. +func TestBackendLibraryMatchesGoldenDigests(t *testing.T) { + golden := loadGoldenDigests(t) + list, err := BackendsFromLibrary(loadRealBackendLibrary(t)) + if err != nil { + t.Fatal(err) + } + checked, unchanged := 0, 0 + for _, b := range list { + want, ok := golden[b.Name] + if !ok { + continue + } + checked++ + if backendDigest(t, *b) == want { + unchanged++ + } + } + t.Logf("golden digests: %d of %d golden backends are in the library, %d unchanged", checked, len(golden), unchanged) + if checked < len(golden)*9/10 { + t.Errorf("only %d of %d golden backends are still in the library; render the golden files again", checked, len(golden)) + } + if unchanged < checked*9/10 { + t.Errorf("only %d of %d golden backends kept their gallery entry; render the golden files again if the change is intended", unchanged, checked) + } +} + +// The golden samples show what a library file holds and what the gallery copy +// holds for the same backend. +func TestBackendLibraryMatchesGoldenSamples(t *testing.T) { + libraries, err := filepath.Glob(filepath.Join(backendLibraryGolds, "samples", "*.library.yaml")) + if err != nil || len(libraries) == 0 { + t.Fatalf("no golden samples: %v", err) + } + for _, lpath := range libraries { + name := strings.TrimSuffix(filepath.Base(lpath), ".library.yaml") + t.Run(name, func(t *testing.T) { + src, err := os.ReadFile(lpath) + if err != nil { + t.Fatal(err) + } + galWant, err := os.ReadFile(strings.TrimSuffix(lpath, ".library.yaml") + ".gallery.yaml") + if err != nil { + t.Fatal(err) + } + res, err := catalog.ReadIndex(src, catalog.ReadableKinds...) + if err != nil || len(res.Releases) == 0 { + t.Fatalf("reading the sample: %v", err) + } + again, err := catalog.EncodeIndex(res.Releases) + if err != nil || string(again) != string(src) { + t.Errorf("the library sample does not encode back to itself: %v", err) + } + list, err := BackendsFromLibrary(res.Releases) + if err != nil || len(list) != 1 { + t.Fatalf("converting the sample: %v (%d backends)", err, len(list)) + } + got, err := EncodeBackendGalleryIndex([]GalleryBackend{*list[0]}) + if err != nil { + t.Fatal(err) + } + if string(got) != string(galWant) { + t.Errorf("the gallery entry differs from the golden file:\n%s", got) + } + var loaded []GalleryBackend + if err := yaml.Unmarshal(galWant, &loaded); err != nil || len(loaded) != 1 { + t.Fatalf("the gallery reader on the golden entry: %v", err) + } + if !SameBackend(loaded[0], *list[0]) { + t.Errorf("the golden gallery entry does not load as the library entry") + } + if err := VerifyBackendRoundTrip(loaded[0], LibraryPins(res.Releases)[loaded[0].Name]); err != nil { + t.Error(err) + } + }) + } +} + +func demoBackend() GalleryBackend { + return GalleryBackend{ + Metadata: Metadata{ + Name: "cpu-demo", Description: "A demo.\n", License: "mit", Icon: "https://example.com/i.png", + URLs: []string{"https://example.com/demo"}, Tags: []string{"CPU", "LLM"}, + }, + Alias: "demo", + URI: "quay.io/acme/backends:latest-cpu-demo", + Mirrors: []string{"docker.io/acme/backends:latest-cpu-demo", "ghcr.io/acme/backends:latest-cpu-demo"}, + CapabilitiesMap: map[string]string{"default": "cpu-demo", "nvidia": "cuda12-demo"}, + } +} + +const ( + pinAMD = "sha256:aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa" + pinARM = "sha256:bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb" +) + +func TestBackendLibraryEntriesExpressEveryField(t *testing.T) { + rows, err := BackendLibraryEntries(demoBackend(), []BackendPin{{"linux", "arm64", pinARM}, {"linux", "amd64", pinAMD}}) + if err != nil { + t.Fatal(err) + } + if len(rows) != 2 || rows[0].Arch != "amd64" || rows[1].Arch != "arm64" { + t.Fatalf("one entry for each platform, in a fixed order: %+v", rows) + } + r := rows[0] + if r.Kind != catalog.KindBackend || r.ID != "cpu-demo" || r.Alias != "demo" || r.License != "mit" || r.Icon != "https://example.com/i.png" || + r.Description != "A demo.\n" || r.Artifact != "oci://quay.io/acme/backends:latest-cpu-demo" || r.Digest != pinAMD || r.Mutable || + r.Channel != "latest" || r.SchemaVersion != 1 || r.Version != "0.0.0-latest.aaaaaaaaaaaa" || r.OS != "linux" { + t.Errorf("unexpected entry: %+v", r) + } + if strings.Join(r.Mirrors, " ") != "oci://docker.io/acme/backends:latest-cpu-demo oci://ghcr.io/acme/backends:latest-cpu-demo" { + t.Errorf("mirrors keep their order and get the oci scheme: %v", r.Mirrors) + } + if r.Capabilities["nvidia"] != "cuda12-demo" || len(r.URLs) != 1 || len(r.Tags) != 2 { + t.Errorf("capabilities, urls and tags: %+v", r) + } + // The entry holds copies, not the gallery's own list and map. + r.Capabilities["nvidia"] = "changed" + r.Tags[0] = "changed" + if b := demoBackend(); b.CapabilitiesMap["nvidia"] != "cuda12-demo" || b.Tags[0] != "CPU" { + t.Error("the library entry shares memory with the gallery entry") + } + for _, p := range []BackendPin{{"linux", "amd64", pinAMD}, {"linux", "arm64", pinARM}} { + if err := VerifyBackendRoundTrip(demoBackend(), []BackendPin{p}); err != nil { + t.Error(err) + } + } +} + +func TestBackendLibraryKeepsDevelopmentTagsMutable(t *testing.T) { + b := demoBackend() + b.Name, b.URI = "cpu-demo-development", "quay.io/acme/backends:master-cpu-demo" + b.Mirrors = []string{"docker.io/acme/backends:master-cpu-demo"} + rows, err := BackendLibraryEntries(b, []BackendPin{{OS: "linux", Arch: "amd64"}}) + if err != nil { + t.Fatal(err) + } + r := rows[0] + if !r.Mutable || r.Digest != "" || r.Channel != "development" || r.Version != "0.0.0-development" || r.Artifact != "oci://quay.io/acme/backends:master-cpu-demo" { + t.Errorf("a development entry keeps its tag and has no digest: %+v", r) + } + // A development image is pinned at install: a digest in the library is refused. + if _, err := BackendLibraryEntries(b, []BackendPin{{"linux", "amd64", pinAMD}}); err == nil { + t.Error("a development entry must not be pinned at render") + } + if err := VerifyBackendRoundTrip(b, []BackendPin{{OS: "linux", Arch: "amd64"}}); err != nil { + t.Error(err) + } +} + +func TestBackendLibraryMetaBackend(t *testing.T) { + meta := GalleryBackend{ + Metadata: Metadata{Name: "demo", Description: "Meta", Tags: []string{"LLM"}}, + Alias: "demo", + CapabilitiesMap: map[string]string{"default": "cpu-demo", "nvidia": "cuda12-demo"}, + } + rows, err := BackendLibraryEntries(meta, nil) + if err != nil || len(rows) != 1 { + t.Fatalf("%v %d", err, len(rows)) + } + r := rows[0] + if !r.IsMeta() || r.Artifact != "" || r.Digest != "" || r.OS != "" || r.Arch != "" || r.Channel != "latest" || r.Version != "0.0.0-latest" { + t.Errorf("a meta entry has capabilities and no image: %+v", r) + } + if err := VerifyBackendRoundTrip(meta, nil); err != nil { + t.Error(err) + } + dev := meta + dev.Name = "demo-development" + if rows, _ := BackendLibraryEntries(dev, nil); rows[0].Channel != "development" { + t.Errorf("a development meta backend is on the development channel: %+v", rows[0]) + } + if _, err := BackendLibraryEntries(meta, []BackendPin{{"linux", "amd64", pinAMD}}); err == nil { + t.Error("a meta backend has no image to pin") + } + meta.Mirrors = []string{"docker.io/acme/x:latest-y"} + if _, err := BackendLibraryEntries(meta, nil); err == nil { + t.Error("a meta backend has no image to mirror") + } + if _, err := BackendLibraryEntries(GalleryBackend{Metadata: Metadata{Name: "empty"}}, nil); err == nil { + t.Error("an entry with no image and no capabilities names nothing") + } +} + +func TestBackendLibraryRefusesWhatItCannotCarry(t *testing.T) { + pins := []BackendPin{{"linux", "amd64", pinAMD}} + for name, mod := range map[string]func(*GalleryBackend){ + "version": func(b *GalleryBackend) { b.Version = "1.0" }, + "sha256": func(b *GalleryBackend) { b.SHA256 = "abc" }, + "url": func(b *GalleryBackend) { b.Metadata.URL = "https://x" }, + "files": func(b *GalleryBackend) { b.AdditionalFiles = []File{{Filename: "f"}} }, + "size": func(b *GalleryBackend) { b.Size = "1GB" }, + "backend": func(b *GalleryBackend) { b.Metadata.Backend = "x" }, + "no name": func(b *GalleryBackend) { b.Name = "" }, + "uri scheme": func(b *GalleryBackend) { b.URI = "oci://quay.io/acme/backends:latest-cpu-demo" }, + "https uri": func(b *GalleryBackend) { b.URI = "https://example.com/backend.tar" }, + "mirror scheme": func(b *GalleryBackend) { b.Mirrors = []string{"https://example.com/b.tar"} }, + "odd tag": func(b *GalleryBackend) { b.URI = "quay.io/acme/backends:v1.2.3" }, + } { + b := demoBackend() + mod(&b) + if _, err := BackendLibraryEntries(b, pins); err == nil { + t.Errorf("%s: a field the library cannot carry must be refused, not dropped", name) + } + } + if _, err := BackendLibraryEntries(demoBackend(), nil); err == nil { + t.Error("a concrete backend needs a platform") + } + if _, err := BackendLibraryEntries(demoBackend(), []BackendPin{{"linux", "amd64", pinAMD}, {"linux", "amd64", pinARM}}); err == nil { + t.Error("two pins for one platform") + } + if _, err := BackendLibraryEntries(demoBackend(), []BackendPin{{"linux", "amd64", "latest"}}); err == nil { + t.Error("a pin must be a sha256 digest") + } + if _, err := BackendLibraryEntries(demoBackend(), []BackendPin{{"", "amd64", pinAMD}}); err == nil { + t.Error("a pin needs a platform") + } +} + +func TestBackendRoundTripTreatsEmptyAndAbsentAlike(t *testing.T) { + b := demoBackend() + b.URLs, b.Tags, b.Mirrors, b.Icon, b.License, b.Alias = []string{}, []string{}, []string{}, "", "", "" + if err := VerifyBackendRoundTrip(b, []BackendPin{{"linux", "amd64", pinAMD}}); err != nil { + t.Errorf("the gallery reader sees no difference between an empty list and an absent one: %v", err) + } +} + +func TestBackendsFromLibraryRefusesEntriesThatDisagree(t *testing.T) { + rows, err := BackendLibraryEntries(demoBackend(), []BackendPin{{"linux", "amd64", pinAMD}, {"linux", "arm64", pinARM}}) + if err != nil { + t.Fatal(err) + } + if list, err := BackendsFromLibrary(rows); err != nil || len(list) != 1 { + t.Fatalf("two platforms of one backend are one gallery backend: %v %d", err, len(list)) + } + rows[1].License = "gpl" + if _, err := BackendsFromLibrary(rows); err == nil || !strings.Contains(err.Error(), "disagree") { + t.Errorf("the entries of one backend must agree, got %v", err) + } + rows[1] = rows[0] + rows[1].Arch = "arm64" + rows[1].Artifact = "oci://quay.io/acme/backends:latest-other" + if _, err := BackendsFromLibrary(rows); err == nil { + t.Error("two images for one name cannot be one gallery backend") + } +} + +func TestBackendsFromLibrarySkipsOtherKindsAndKeepsOrder(t *testing.T) { + a, b := demoBackend(), demoBackend() + a.Name, b.Name = "z-first", "a-second" + ra, _ := BackendLibraryEntries(a, []BackendPin{{"linux", "amd64", pinAMD}}) + rb, _ := BackendLibraryEntries(b, []BackendPin{{"linux", "amd64", pinAMD}}) + other := catalog.Release{ID: "t", Name: "t", Version: "1.0.0"} + list, err := BackendsFromLibrary(append(append(ra, other), rb...)) + if err != nil { + t.Fatal(err) + } + // The add-on entry has no kind, so it is an add-on and is skipped. + if len(list) != 2 || list[0].Name != "z-first" || list[1].Name != "a-second" { + t.Errorf("library order is kept: %+v", list) + } +} + +func TestToGalleryBackendUsesTheIdAsTheName(t *testing.T) { + rows, _ := BackendLibraryEntries(demoBackend(), []BackendPin{{"linux", "amd64", pinAMD}}) + rows[0].Name = "Display name" + b, err := ToGalleryBackend(rows[0]) + if err != nil { + t.Fatal(err) + } + if b.Name != "cpu-demo" || b.URI != "quay.io/acme/backends:latest-cpu-demo" { + t.Errorf("the id is the name the gallery knows: %+v", b) + } + if _, err := ToGalleryBackend(catalog.Release{Kind: catalog.KindModel, ID: "m"}); err == nil { + t.Error("only a backend entry converts to a gallery backend") + } + rows[0].Icon = "icons/x.png" + if _, err := ToGalleryBackend(rows[0]); err == nil { + t.Error("an entry the host would refuse does not convert") + } +} + +func TestEncodeBackendGalleryIndexReadsBackAsTheEntries(t *testing.T) { + a := demoBackend() + b := GalleryBackend{Metadata: Metadata{Name: "demo", Description: "x"}, CapabilitiesMap: map[string]string{"default": "cpu-demo"}} + raw, err := EncodeBackendGalleryIndex([]GalleryBackend{a, b}) + if err != nil { + t.Fatal(err) + } + var loaded []GalleryBackend + if err := yaml.Unmarshal(raw, &loaded); err != nil || len(loaded) != 2 { + t.Fatalf("%v %d", err, len(loaded)) + } + if !SameBackend(loaded[0], a) || !SameBackend(loaded[1], b) { + t.Error("the gallery file does not read back as the entries") + } + a.Installed = true + a.Gallery.Name = "runtime" + again, err := EncodeBackendGalleryIndex([]GalleryBackend{a, b}) + if err != nil || string(again) != string(raw) { + t.Errorf("runtime fields are not written: %v", err) + } + a.Version = "1" + if _, err := EncodeBackendGalleryIndex([]GalleryBackend{a}); err == nil { + t.Error("a field the file does not write is refused") + } +} diff --git a/core/gallery/backend_types.go b/core/gallery/backend_types.go index 1f8363764..213679e9f 100644 --- a/core/gallery/backend_types.go +++ b/core/gallery/backend_types.go @@ -27,6 +27,9 @@ type BackendMetadata struct { URI string `json:"uri,omitempty"` // Digest is the OCI image digest at install time (for upgrade detection) Digest string `json:"digest,omitempty"` + // Library is the id of the library the backend was installed from. It is + // empty for a backend installed from a gallery. + Library string `json:"library,omitempty"` } type GalleryBackend struct { @@ -39,8 +42,22 @@ type GalleryBackend struct { // SHA256 is the expected sha256 of the backend tarball at URI / Mirrors. // Empty disables the integrity check; OCI URIs carry their own digest. SHA256 string `json:"sha256,omitempty" yaml:"sha256,omitempty"` + + // Library and MaxBytes are set by the install from a library, never read + // from a gallery file. Library records the origin in the metadata of the + // installed backend; MaxBytes bounds the compressed size of the image. + Library string `json:"-" yaml:"-"` + MaxBytes int64 `json:"-" yaml:"-"` + // Stage, when set, receives the name of each install stage as it starts: + // the downloader stages (verifying, size, fetching) and StageWriting. A + // caller that shows progress sets it; the gallery never does. + Stage func(stage string) `json:"-" yaml:"-"` } +// StageWriting is the install stage that writes the metadata of the backend +// and swaps it into place. It follows the download stages. +const StageWriting = "writing" + func (backend *GalleryBackend) FindBestBackendFromMeta(systemState *system.SystemState, backends GalleryElements[*GalleryBackend]) *GalleryBackend { if systemState == nil { return nil diff --git a/core/gallery/backends.go b/core/gallery/backends.go index cc360bb8e..a6340de13 100644 --- a/core/gallery/backends.go +++ b/core/gallery/backends.go @@ -383,6 +383,12 @@ func InstallBackend(ctx context.Context, systemState *system.SystemState, modelL return fmt.Errorf("backend %q: %w", config.Name, optsErr) } downloadOpts = append(downloadOpts, downloader.WithStagingDir(systemState.StagingPath)) + if config.MaxBytes > 0 { + downloadOpts = append(downloadOpts, downloader.WithMaxBytes(config.MaxBytes)) + } + if config.Stage != nil { + downloadOpts = append(downloadOpts, downloader.WithStageReporter(config.Stage)) + } // PreferDevelopmentBackends installs the development image as the primary URI, // keeping the released image reachable as the first fallback — instead of only @@ -481,6 +487,10 @@ func InstallBackend(ctx context.Context, systemState *system.SystemState, modelL return fmt.Errorf("not a valid backend: run file not found %q", stagedRunFile) } + if config.Stage != nil { + config.Stage(StageWriting) + } + // Create metadata for the backend (written into the staged dir so the // atomic swap brings a complete, self-describing backend into place). metadata := &BackendMetadata{ @@ -489,6 +499,7 @@ func InstallBackend(ctx context.Context, systemState *system.SystemState, modelL InstalledAt: time.Now().Format(time.RFC3339), Version: config.Version, URI: string(uri), + Library: config.Library, } // Record the OCI digest for upgrade detection (non-fatal on failure) diff --git a/core/gallery/gallery.go b/core/gallery/gallery.go index d0c0f43e0..a0c70c0c1 100644 --- a/core/gallery/gallery.go +++ b/core/gallery/gallery.go @@ -660,6 +660,27 @@ func getGalleryElements[T GalleryElement](gallery config.Gallery, basePath strin } } + // The model and backend libraries replace the index of the official gallery + // when the owner selects them. + if lib, ok := modelLibraryFor(gallery); ok { + if installed, isModel := any(isInstalledCallback).(func(*GalleryModel) bool); isModel { + found, err := getModelLibraryElements(gallery, lib, basePath, requireIntegrity, installed) + if err != nil { + return models, err + } + return any(found).([]T), nil + } + } + if lib, ok := backendLibraryFor(gallery); ok { + if installed, isBackend := any(isInstalledCallback).(func(*GalleryBackend) bool); isBackend { + found, err := getBackendLibraryElements(gallery, lib, basePath, requireIntegrity, installed) + if err != nil { + return models, err + } + return any(found).([]T), nil + } + } + cacheKey := galleryIndexCacheKey(gallery) if galleryCache.Exists(cacheKey) { entry := galleryCache.Get(cacheKey) diff --git a/core/gallery/model_index_source.go b/core/gallery/model_index_source.go new file mode 100644 index 000000000..9f718683e --- /dev/null +++ b/core/gallery/model_index_source.go @@ -0,0 +1,88 @@ +// SPDX-License-Identifier: MIT +package gallery + +import ( + "context" + "fmt" + "time" + + "github.com/mudler/LocalAI/core/config" + "github.com/mudler/LocalAI/core/services/addons/catalog" + "github.com/mudler/xlog" +) + +const ( + // OfficialModelGalleryName is the name of the default model gallery. + OfficialModelGalleryName = "localai" + // OfficialModelLibraryURL is the model library, the source of the models, + // kept in this repository. It is a default model source. The gallery + // index is generated from it by scripts/models/cmd/modelcatalog. + OfficialModelLibraryURL = catalog.OfficialModelLibraryURL +) + +// modelLibraryFor returns the library to read for a gallery, or false when the +// gallery is read as a gallery index. A gallery is a library when its entry +// says so, which is how a model source added with `local-ai library add` is +// handed to the reader. +func modelLibraryFor(g config.Gallery) (config.Gallery, bool) { + if !g.Library { + return config.Gallery{}, false + } + // The library has no mirrors and no artifact policy of its own: the + // gallery's would describe another file. + return config.Gallery{Name: g.Name, URL: g.URL}, true +} + +// getModelLibraryElements reads the models of a gallery from the model +// library. A library that cannot be fetched or read is an error: falling back +// to the gallery would hide the setting from the owner who chose it. +func getModelLibraryElements(g, lib config.Gallery, basePath string, requireIntegrity bool, isInstalled func(*GalleryModel) bool) ([]*GalleryModel, error) { + body, err := libraryBody(g, lib, basePath, requireIntegrity, "model") + if err != nil { + return nil, err + } + res, err := DecodeModelIndex(body) + if err != nil { + return nil, fmt.Errorf("failed to read the model library: %w", err) + } + if len(res.Skipped) > 0 { + xlog.Info("model library entries of another kind were skipped", "gallery", g.Name, "count", len(res.Skipped)) + } + models, err := ModelsFromLibrary(res.Entries) + if err != nil { + return nil, fmt.Errorf("failed to read the model library: %w", err) + } + // Only a library that decodes is kept, so a bad file does not stay cached. + keepLibraryBody(lib, body) + for _, m := range models { + m.SetGallery(g) + m.SetInstalled(isInstalled(m)) + } + return models, nil +} + +// libraryBody returns the text of a library: the cached copy while it is fresh, +// else a fetch that follows the mirrors, the cooldown and the last known good +// copy of any gallery. what names the kind in the error. +func libraryBody(g, lib config.Gallery, basePath string, requireIntegrity bool, what string) ([]byte, error) { + cacheKey := galleryIndexCacheKey(lib) + if galleryCache.Exists(cacheKey) { + if entry := galleryCache.Get(cacheKey); !entry.hasExpired() { + return entry.yamlEntry, nil + } + galleryCache.Delete(cacheKey) + } + fetched, servedBy, err := fetchGalleryIndex(context.Background(), lib, basePath, requireIntegrity) + if err != nil { + return nil, fmt.Errorf("failed to read the %s library: %w", what, err) + } + if servedBy != lib.URL { + xlog.Info(what+" library served by a fallback source", "gallery", g.Name, "source", servedBy) + } + return fetched, nil +} + +// keepLibraryBody caches the text of a library that has been read. +func keepLibraryBody(lib config.Gallery, body []byte) { + galleryCache.Set(galleryIndexCacheKey(lib), galleryCacheEntry{yamlEntry: body, lastUpdated: time.Now()}) +} diff --git a/core/gallery/model_library.go b/core/gallery/model_library.go new file mode 100644 index 000000000..bedd2d58d --- /dev/null +++ b/core/gallery/model_library.go @@ -0,0 +1,515 @@ +// SPDX-License-Identifier: MIT +package gallery + +import ( + "bytes" + "crypto/sha256" + "encoding/hex" + "errors" + "fmt" + "io" + "math" + "reflect" + "strconv" + "strings" + + "github.com/mudler/LocalAI/core/services/addons/catalog" + "gopkg.in/yaml.v3" +) + +// The model library, gallery/models/index.yaml, is the source of truth for +// the models. Edits go there. The gallery index, gallery/index.yaml, is a +// generated copy that stays only so releases before the cutover keep +// working; scripts/models/cmd/modelcatalog writes it from the library and it +// is never edited by hand. +// +// An entry is the shared library envelope (catalog.Envelope) plus a body that +// holds what a gallery entry holds beyond the header. Converting a library +// entry to a gallery entry and back gives the same entry, apart from the +// header fields a gallery entry has no place for (see GalleryHeaderLoss). The +// tests check that on every entry of the real library. + +const ( + // MaxModelIndexBytes and MaxModelIndexEntries bound one model library + // document. The model gallery is much larger than an add-on index. + MaxModelIndexBytes = 32 << 20 + MaxModelIndexEntries = 20000 + // modelLibraryChannel is the channel the generated entries are on. + modelLibraryChannel = "gallery" +) + +// ModelBody is the kind-specific part of a model library entry. +type ModelBody struct { + // URL is the config file the model installs from, as in the gallery. + URL string `json:"url,omitempty" yaml:"url,omitempty"` + // Backend is the resolved backend engine, when the entry says it. + Backend string `json:"backend,omitempty" yaml:"backend,omitempty"` + // Size is an optional size string such as "14.5GB". + Size string `json:"size,omitempty" yaml:"size,omitempty"` + Files []File `json:"files,omitempty" yaml:"files,omitempty"` + // ConfigFile is the base config of an entry that has no URL. + ConfigFile map[string]any `json:"configFile,omitempty" yaml:"configFile,omitempty"` + // Overrides override the config the URL names. + Overrides map[string]any `json:"overrides,omitempty" yaml:"overrides,omitempty"` + // Variants name other entries that are alternative builds of this one. + Variants variantList `json:"variants,omitempty" yaml:"variants,omitempty"` + // PromptTemplates are the prompt templates of the base config. The gallery + // carries them inside config_file as prompt_templates; the library lifts + // them out so a reader can show them without reading the whole config. + PromptTemplates []PromptTemplate `json:"promptTemplates,omitempty" yaml:"promptTemplates,omitempty"` +} + +// variantList keeps an empty list apart from an absent one: 194 gallery entries +// write "variants: []", and the entry must come back as it was written. +type variantList []Variant + +// IsZero makes omitempty drop only a list that is absent. +func (v variantList) IsZero() bool { return v == nil } + +// ModelLibraryEntry is one entry of the model index. +type ModelLibraryEntry struct { + catalog.Envelope `json:",inline" yaml:",inline"` + Model ModelBody `json:"model" yaml:"model"` +} + +const promptTemplatesKey = "prompt_templates" + +// ModelLibraryEntryFromGallery converts a gallery entry to a library entry. +// The runtime fields of the gallery entry, the gallery it came from and its +// installed flag, are not part of the entry and are dropped. +func ModelLibraryEntryFromGallery(m GalleryModel) (ModelLibraryEntry, error) { + if m.Name == "" { + return ModelLibraryEntry{}, errors.New("gallery entry has no name") + } + m = stripRuntime(m) + digest, err := galleryEntryDigest(m) + if err != nil { + return ModelLibraryEntry{}, err + } + body := ModelBody{ + URL: m.URL, + Backend: m.Backend, + Size: m.Size, + Files: m.AdditionalFiles, + ConfigFile: m.ConfigFile, + Overrides: m.Overrides, + Variants: variantList(m.Variants), + } + body.ConfigFile, body.PromptTemplates = liftPromptTemplates(m.ConfigFile) + return ModelLibraryEntry{ + Envelope: catalog.Envelope{ + Kind: catalog.KindModel, + ID: m.Name, + Name: m.Name, + Version: "0.0.0-gallery." + digest[:12], + Description: m.Description, + License: m.License, + URLs: m.URLs, + Tags: m.Tags, + Icon: m.Icon, + Channel: modelLibraryChannel, + SchemaVersion: catalog.SchemaVersion, + }, + Model: body, + }, nil +} + +// ToGallery converts a library entry to the gallery entry the installer +// reads. The id of the entry is the name the gallery knows the model by; the +// header name is for display and is not read back. +func (e ModelLibraryEntry) ToGallery() (GalleryModel, error) { + if err := e.validate(); err != nil { + return GalleryModel{}, err + } + b := e.Model + return GalleryModel{ + Metadata: Metadata{ + URL: b.URL, + Name: e.ID, + Description: e.Description, + License: e.License, + URLs: e.URLs, + Icon: e.Icon, + Tags: e.Tags, + AdditionalFiles: b.Files, + Size: b.Size, + Backend: b.Backend, + }, + ConfigFile: restorePromptTemplates(b.ConfigFile, b.PromptTemplates), + Overrides: b.Overrides, + Variants: []Variant(b.Variants), + }, nil +} + +func (e ModelLibraryEntry) validate() error { + if e.Kind != catalog.KindModel { + return fmt.Errorf("entry %q is of kind %q, not model", e.ID, e.Kind) + } + if e.ID == "" || len(e.ID) > 256 || strings.ContainsAny(e.ID, "\r\n\x00") { + return fmt.Errorf("model entry has a malformed id %q", e.ID) + } + if e.SchemaVersion < 1 || e.SchemaVersion > catalog.SchemaVersion { + return fmt.Errorf("model entry %q has schemaVersion %d; this host reads up to %d", e.ID, e.SchemaVersion, catalog.SchemaVersion) + } + return nil +} + +func stripRuntime(m GalleryModel) GalleryModel { + m.Gallery = GalleryModel{}.Gallery + m.Installed = false + return m +} + +// galleryEntryDigest identifies the content of a gallery entry. Maps are +// written with sorted keys, so the digest does not depend on their order. +func galleryEntryDigest(m GalleryModel) (string, error) { + b, err := yaml.Marshal(m) + if err != nil { + return "", err + } + sum := sha256.Sum256(b) + return hex.EncodeToString(sum[:]), nil +} + +// liftPromptTemplates moves prompt_templates out of a base config when every +// template is a plain name and content pair. A config that holds anything else +// under that key is left as it is, so nothing is reshaped on the way. +func liftPromptTemplates(cfg map[string]any) (map[string]any, []PromptTemplate) { + raw, ok := cfg[promptTemplatesKey] + if !ok { + return cfg, nil + } + list, ok := raw.([]any) + if !ok || len(list) == 0 { + return cfg, nil + } + out := make([]PromptTemplate, 0, len(list)) + for _, item := range list { + m, ok := item.(map[string]any) + if !ok || len(m) != 2 { + return cfg, nil + } + name, okName := m["name"].(string) + content, okContent := m["content"].(string) + if !okName || !okContent { + return cfg, nil + } + out = append(out, PromptTemplate{Name: name, Content: content}) + } + rest := make(map[string]any, len(cfg)-1) + for k, v := range cfg { + if k != promptTemplatesKey { + rest[k] = v + } + } + if len(rest) == 0 { + rest = nil + } + return rest, out +} + +func restorePromptTemplates(cfg map[string]any, templates []PromptTemplate) map[string]any { + if len(templates) == 0 { + return cfg + } + out := make(map[string]any, len(cfg)+1) + for k, v := range cfg { + out[k] = v + } + list := make([]any, 0, len(templates)) + for _, t := range templates { + list = append(list, map[string]any{"name": t.Name, "content": t.Content}) + } + out[promptTemplatesKey] = list + return out +} + +// ModelIndexResult is what a reader made of a model index: the entries it +// understands and a record of those it skipped. +type ModelIndexResult struct { + Entries []ModelLibraryEntry + Skipped []catalog.SkippedEntry +} + +// DecodeModelIndex reads a model index: one YAML block list of entries. It is +// as strict as the add-on reader: an unknown field, a second document, a +// duplicate key or id, a value of the wrong type or a document over the size +// bounds is refused. An entry of a kind other than model is skipped without +// being read further and is reported in the result, so a shared file can hold +// other kinds later. +func DecodeModelIndex(data []byte) (ModelIndexResult, error) { + if len(data) > MaxModelIndexBytes { + return ModelIndexResult{}, errors.New("model index is too large") + } + dec := yaml.NewDecoder(bytes.NewReader(data)) + var doc yaml.Node + if err := dec.Decode(&doc); err != nil { + return ModelIndexResult{}, err + } + if err := dec.Decode(new(yaml.Node)); err != io.EOF { + return ModelIndexResult{}, errors.New("model index holds more than one document") + } + if doc.Kind != yaml.DocumentNode || len(doc.Content) != 1 || doc.Content[0].Kind != yaml.SequenceNode { + return ModelIndexResult{}, errors.New("model index must be a list of entries") + } + list := doc.Content[0] + if list.Style&yaml.FlowStyle != 0 && len(list.Content) > 0 { + return ModelIndexResult{}, errors.New("model index must be a YAML block list, not JSON") + } + if len(list.Content) > MaxModelIndexEntries { + return ModelIndexResult{}, errors.New("model index has too many entries") + } + res := ModelIndexResult{} + seen := make(map[string]struct{}, len(list.Content)) + for i, node := range list.Content { + if node.Kind != yaml.MappingNode { + return ModelIndexResult{}, errors.New("model index entry must be a mapping") + } + kind, id, err := peekKind(node) + if err != nil { + return ModelIndexResult{}, err + } + if kind != catalog.KindModel { + res.Skipped = append(res.Skipped, catalog.SkippedEntry{Position: i, Kind: string(kind), ID: id}) + continue + } + raw, err := yaml.Marshal(node) + if err != nil { + return ModelIndexResult{}, err + } + strict := yaml.NewDecoder(bytes.NewReader(raw)) + strict.KnownFields(true) + var entry ModelLibraryEntry + if err := strict.Decode(&entry); err != nil { + return ModelIndexResult{}, fmt.Errorf("model index entry %d: %w", i, err) + } + if err := entry.validate(); err != nil { + return ModelIndexResult{}, err + } + if _, dup := seen[entry.ID]; dup { + return ModelIndexResult{}, fmt.Errorf("model index lists %q twice", entry.ID) + } + seen[entry.ID] = struct{}{} + res.Entries = append(res.Entries, entry) + } + return res, nil +} + +// peekKind reads the kind of an entry without reading the rest. An entry +// without a kind is an add-on, as in the add-on reader. +func peekKind(node *yaml.Node) (catalog.Kind, string, error) { + kind, id := catalog.KindAddon, "" + for i := 0; i+1 < len(node.Content); i += 2 { + key, val := node.Content[i], node.Content[i+1] + switch key.Value { + case "kind": + if val.Kind != yaml.ScalarNode || val.Tag != "!!str" || !catalog.ValidKindName(val.Value) { + return "", "", errors.New("model index entry has a malformed kind") + } + kind = catalog.Kind(val.Value) + case "id": + if val.Kind == yaml.ScalarNode && val.Tag == "!!str" { + id = val.Value + } + } + } + return kind, id, nil +} + +// floatValue writes a float so that it reads back as a float. The YAML encoder +// writes 1.0 as 1, which reads back as an integer and would change the type of +// a number in an override. +type floatValue float64 + +func (f floatValue) MarshalYAML() (any, error) { + v := float64(f) + if math.IsNaN(v) || math.IsInf(v, 0) { + return v, nil + } + s := strconv.FormatFloat(v, 'g', -1, 64) + if !strings.ContainsAny(s, ".eE") { + s += ".0" + } + return &yaml.Node{Kind: yaml.ScalarNode, Tag: "!!float", Value: s}, nil +} + +// markFloats copies a config value and wraps its floats in floatValue. +func markFloats(v any) any { + switch t := v.(type) { + case float64: + return floatValue(t) + case map[string]any: + if t == nil { + return t + } + out := make(map[string]any, len(t)) + for k, x := range t { + out[k] = markFloats(x) + } + return out + case map[any]any: + if t == nil { + return t + } + out := make(map[any]any, len(t)) + for k, x := range t { + out[k] = markFloats(x) + } + return out + case []any: + if t == nil { + return t + } + out := make([]any, len(t)) + for i, x := range t { + out[i] = markFloats(x) + } + return out + } + return v +} + +func markFloatMap(m map[string]any) map[string]any { + if m == nil { + return nil + } + return markFloats(m).(map[string]any) +} + +// EncodeModelIndex writes entries as a model index. +func EncodeModelIndex(entries []ModelLibraryEntry) ([]byte, error) { + marked := make([]ModelLibraryEntry, len(entries)) + for i, e := range entries { + e.Model.ConfigFile = markFloatMap(e.Model.ConfigFile) + e.Model.Overrides = markFloatMap(e.Model.Overrides) + marked[i] = e + } + var buf bytes.Buffer + enc := yaml.NewEncoder(&buf) + enc.SetIndent(2) + if err := enc.Encode(marked); err != nil { + return nil, err + } + if err := enc.Close(); err != nil { + return nil, err + } + return buf.Bytes(), nil +} + +// galleryFileEntry is a gallery entry as it is written to the gallery file. +// It has the fields and the order of GalleryModel, but keeps an empty variants +// list apart from an absent one, as the gallery file did. +type galleryFileEntry struct { + Metadata `yaml:",inline"` + ConfigFile map[string]any `yaml:"config_file,omitempty"` + Overrides map[string]any `yaml:"overrides,omitempty"` + Variants variantList `yaml:"variants,omitempty"` +} + +// EncodeGalleryIndex writes gallery entries as the gallery file the host +// reads (gallery/index.yaml). The runtime fields of an entry are not written +// and a float keeps its form, so the file reads back as the entries it was +// written from. +func EncodeGalleryIndex(models []GalleryModel) ([]byte, error) { + out := make([]galleryFileEntry, len(models)) + for i, m := range models { + m = stripRuntime(m) + out[i] = galleryFileEntry{ + Metadata: m.Metadata, + ConfigFile: markFloatMap(m.ConfigFile), + Overrides: markFloatMap(m.Overrides), + Variants: variantList(m.Variants), + } + } + var buf bytes.Buffer + enc := yaml.NewEncoder(&buf) + enc.SetIndent(2) + if err := enc.Encode(out); err != nil { + return nil, err + } + if err := enc.Close(); err != nil { + return nil, err + } + return buf.Bytes(), nil +} + +// GalleryHeaderLoss names the header fields of a library entry that the +// gallery copy cannot carry and that the entry sets on purpose: a display name +// that differs from the id, and a signature policy. The version, the channel +// and the schema version are never carried; the host does not read any of +// them from a gallery. +func GalleryHeaderLoss(e ModelLibraryEntry) []string { + var lost []string + if e.Name != "" && e.Name != e.ID { + lost = append(lost, "name") + } + if !reflect.DeepEqual(e.Policy, catalog.VerificationPolicy{}) { + lost = append(lost, "policy") + } + return lost +} + +// ModelsFromLibrary converts the entries of a model index to gallery entries, +// in index order. +func ModelsFromLibrary(entries []ModelLibraryEntry) ([]*GalleryModel, error) { + out := make([]*GalleryModel, 0, len(entries)) + for _, e := range entries { + m, err := e.ToGallery() + if err != nil { + return nil, err + } + out = append(out, &m) + } + return out, nil +} + +// VerifyModelRoundTrip checks that a gallery entry survives the library: it is +// converted to a library entry, written as an index, read back and converted +// to a gallery entry again, and the result must equal the original. It returns +// a description of the first difference. +func VerifyModelRoundTrip(m GalleryModel) error { + want := stripRuntime(m) + entry, err := ModelLibraryEntryFromGallery(m) + if err != nil { + return err + } + raw, err := EncodeModelIndex([]ModelLibraryEntry{entry}) + if err != nil { + return fmt.Errorf("writing the library entry: %w", err) + } + res, err := DecodeModelIndex(raw) + if err != nil { + return fmt.Errorf("reading the library entry: %w", err) + } + if len(res.Entries) != 1 { + return fmt.Errorf("the library entry came back as %d entries", len(res.Entries)) + } + got, err := res.Entries[0].ToGallery() + if err != nil { + return err + } + if reflect.DeepEqual(got, want) { + return nil + } + return fmt.Errorf("gallery entry changed on the way through the library: %s", firstDifference(want, got)) +} + +// firstDifference names the first top-level field of two gallery entries that +// differ. +func firstDifference(a, b GalleryModel) string { + av, bv := reflect.ValueOf(a.Metadata), reflect.ValueOf(b.Metadata) + for i := 0; i < av.NumField(); i++ { + if !reflect.DeepEqual(av.Field(i).Interface(), bv.Field(i).Interface()) { + return fmt.Sprintf("%s: %#v became %#v", av.Type().Field(i).Name, av.Field(i).Interface(), bv.Field(i).Interface()) + } + } + switch { + case !reflect.DeepEqual(a.ConfigFile, b.ConfigFile): + return fmt.Sprintf("ConfigFile: %#v became %#v", a.ConfigFile, b.ConfigFile) + case !reflect.DeepEqual(a.Overrides, b.Overrides): + return fmt.Sprintf("Overrides: %#v became %#v", a.Overrides, b.Overrides) + case !reflect.DeepEqual(a.Variants, b.Variants): + return fmt.Sprintf("Variants: %#v became %#v", a.Variants, b.Variants) + } + return "unknown field" +} diff --git a/core/gallery/model_library_digest.go b/core/gallery/model_library_digest.go new file mode 100644 index 000000000..c5fe99229 --- /dev/null +++ b/core/gallery/model_library_digest.go @@ -0,0 +1,28 @@ +// SPDX-License-Identifier: MIT +package gallery + +import ( + "crypto/sha256" + "encoding/hex" +) + +// ModelLibraryDigests returns short digests of a library entry and of the +// gallery entry generated from it. They identify the content for the golden +// file: when the library digest of an entry has not changed, its generated +// gallery digest must not change either. +func ModelLibraryDigests(e ModelLibraryEntry) (libraryDigest, galleryDigest string, err error) { + m, err := e.ToGallery() + if err != nil { + return "", "", err + } + g, err := galleryEntryDigest(stripRuntime(m)) + if err != nil { + return "", "", err + } + raw, err := EncodeModelIndex([]ModelLibraryEntry{e}) + if err != nil { + return "", "", err + } + sum := sha256.Sum256(raw) + return hex.EncodeToString(sum[:])[:16], g[:16], nil +} diff --git a/core/gallery/model_library_test.go b/core/gallery/model_library_test.go new file mode 100644 index 000000000..363054817 --- /dev/null +++ b/core/gallery/model_library_test.go @@ -0,0 +1,549 @@ +package gallery + +import ( + "bufio" + "net/http" + "net/http/httptest" + "os" + "path/filepath" + "reflect" + "strings" + "testing" + + "github.com/mudler/LocalAI/core/config" + "github.com/mudler/LocalAI/core/services/addons/catalog" + "github.com/mudler/LocalAI/pkg/system" + "gopkg.in/yaml.v3" +) + +const ( + realGalleryIndex = "../../gallery/index.yaml" + realModelLibrary = "../../gallery/models/index.yaml" + modelLibraryGolds = "testdata/model_library" +) + +// loadRealLibrary reads the library file, the source of the models, the way +// the host reads a library. +func loadRealLibrary(t *testing.T) []ModelLibraryEntry { + t.Helper() + src, err := os.ReadFile(realModelLibrary) + if err != nil { + t.Fatal(err) + } + res, err := DecodeModelIndex(src) + if err != nil { + t.Fatal(err) + } + if len(res.Entries) == 0 { + t.Fatal("the real model library has no entries") + } + return res.Entries +} + +// sameModelEntry compares two library entries apart from the generator-owned +// header fields the gallery has no place for: the version, which is derived +// from the content, and the channel. +func sameModelEntry(t *testing.T, a, b ModelLibraryEntry) bool { + t.Helper() + a.Version, b.Version = "", "" + a.Channel, b.Channel = "", "" + x, err := EncodeModelIndex([]ModelLibraryEntry{a}) + if err != nil { + t.Fatal(err) + } + y, err := EncodeModelIndex([]ModelLibraryEntry{b}) + if err != nil { + t.Fatal(err) + } + return string(x) == string(y) +} + +// Every entry of the real library must survive the gallery copy unchanged: +// library -> gallery -> library is the same entry, and gallery -> library -> +// gallery is the same gallery entry. The count is logged so a run shows how +// many real entries it covered. +func TestModelLibraryRoundTripsEveryRealEntry(t *testing.T) { + entries := loadRealLibrary(t) + failed := 0 + for _, e := range entries { + m, err := e.ToGallery() + if err != nil { + failed++ + t.Errorf("%s: %v", e.ID, err) + continue + } + if err := VerifyModelRoundTrip(m); err != nil { + failed++ + t.Errorf("%s: %v", e.ID, err) + continue + } + back, err := ModelLibraryEntryFromGallery(m) + if err != nil { + failed++ + t.Errorf("%s: %v", e.ID, err) + continue + } + if !sameModelEntry(t, e, back) { + failed++ + t.Errorf("%s: library -> gallery -> library changed the entry", e.ID) + } + } + t.Logf("round trip: %d of %d real library entries are equal after library -> gallery -> library", len(entries)-failed, len(entries)) +} + +// The gallery generated from the library is read by the gallery reader, and +// the reader sees the same entries: the names, the file uris and the digests. +func TestGeneratedGalleryLoadsWithTheSameEntries(t *testing.T) { + entries := loadRealLibrary(t) + models, err := ModelsFromLibrary(entries) + if err != nil { + t.Fatal(err) + } + flat := make([]GalleryModel, len(models)) + for i, m := range models { + flat[i] = *m + } + body, err := EncodeGalleryIndex(flat) + if err != nil { + t.Fatal(err) + } + // The host reads the gallery file into a list of pointers. + var loaded []*GalleryModel + if err := yaml.Unmarshal(body, &loaded); err != nil { + t.Fatal(err) + } + if len(loaded) != len(entries) { + t.Fatalf("the gallery has %d entries, the library %d", len(loaded), len(entries)) + } + files := 0 + for i, e := range entries { + g := loaded[i] + if g.Name != e.ID { + t.Fatalf("entry %d is %q in the gallery and %q in the library", i, g.Name, e.ID) + } + if len(g.AdditionalFiles) != len(e.Model.Files) { + t.Errorf("%s: %d files in the gallery, %d in the library", e.ID, len(g.AdditionalFiles), len(e.Model.Files)) + continue + } + for j, f := range e.Model.Files { + files++ + if g.AdditionalFiles[j].URI != f.URI || g.AdditionalFiles[j].SHA256 != f.SHA256 || g.AdditionalFiles[j].Filename != f.Filename { + t.Errorf("%s: file %d differs: %+v and %+v", e.ID, j, g.AdditionalFiles[j], f) + } + } + if !reflect.DeepEqual(*g, *models[i]) { + t.Errorf("%s: the gallery reader sees a different entry than the library gives", e.ID) + } + gd, _ := galleryEntryDigest(*g) + wd, _ := galleryEntryDigest(*models[i]) + if gd != wd { + t.Errorf("%s: gallery digest %s, library digest %s", e.ID, gd[:12], wd[:12]) + } + } + t.Logf("generated gallery: %d entries and %d files read back equal to the library", len(loaded), files) +} + +// gallery/index.yaml is generated and never edited. The CI check regenerates it +// and fails on a diff; this test does the same in the Go suite, so a hand edit +// is found by go test too. +func TestCheckedInGalleryIsTheGeneratedCopy(t *testing.T) { + models, err := ModelsFromLibrary(loadRealLibrary(t)) + if err != nil { + t.Fatal(err) + } + flat := make([]GalleryModel, len(models)) + for i, m := range models { + flat[i] = *m + } + want, err := EncodeGalleryIndex(flat) + if err != nil { + t.Fatal(err) + } + have, err := os.ReadFile(realGalleryIndex) + if err != nil { + t.Fatal(err) + } + // The generator puts a comment header in front of the body. + body := string(have) + for strings.HasPrefix(body, "#") { + _, rest, _ := strings.Cut(body, "\n") + body = rest + } + if body != string(want) { + t.Error("gallery/index.yaml is not the copy generated from gallery/models/index.yaml. It is generated; do not edit it by hand. Regenerate: go run ./scripts/models/cmd/modelcatalog --library gallery/models/index.yaml --out gallery/index.yaml") + } +} + +// An entry whose library digest is in the golden file must still produce the +// recorded gallery entry. An entry changed or added since the golden file was +// rendered has no recorded digest and is covered by the round trip only. +func TestModelLibraryMatchesGoldenDigests(t *testing.T) { + f, err := os.Open(filepath.Join(modelLibraryGolds, "digests.tsv")) + if err != nil { + t.Fatal(err) + } + defer f.Close() + type pair struct{ library, gallery string } + golden := map[string]pair{} + sc := bufio.NewScanner(f) + for sc.Scan() { + line := sc.Text() + if line == "" || strings.HasPrefix(line, "#") { + continue + } + parts := strings.Split(line, "\t") + if len(parts) != 3 { + t.Fatalf("malformed golden line %q", line) + } + golden[parts[0]] = pair{parts[1], parts[2]} + } + if err := sc.Err(); err != nil { + t.Fatal(err) + } + if len(golden) < 2000 { + t.Fatalf("the golden file lists %d entries; it should list the real library", len(golden)) + } + + checked, unchanged := 0, 0 + for _, e := range loadRealLibrary(t) { + want, ok := golden[e.ID] + if !ok { + continue + } + l, g, err := ModelLibraryDigests(e) + if err != nil { + t.Fatalf("%s: %v", e.ID, err) + } + checked++ + if l != want.library { + continue // the entry changed after the golden file was rendered + } + unchanged++ + if g != want.gallery { + t.Errorf("%s: the generated gallery entry changed (digest %s, golden %s); render the golden files again only if the change is intended", e.ID, g, want.gallery) + } + } + t.Logf("golden digests: %d of %d golden entries are in the library, %d unchanged and compared", checked, len(golden), unchanged) + // Most entries are stable between renders. If almost none match, the digest + // of the library side has changed meaning and the check proves nothing. + if unchanged*2 < checked { + t.Errorf("only %d of %d golden entries kept their library digest; render the golden files again", unchanged, checked) + } +} + +// The readable samples are written both ways: the library entry as it stands +// in the library and the gallery entry generated from it. +func TestModelLibraryMatchesGoldenSamples(t *testing.T) { + libraries, err := filepath.Glob(filepath.Join(modelLibraryGolds, "samples", "*.library.yaml")) + if err != nil || len(libraries) == 0 { + t.Fatalf("no golden samples: %v", err) + } + for _, lpath := range libraries { + name := strings.TrimSuffix(filepath.Base(lpath), ".library.yaml") + t.Run(name, func(t *testing.T) { + src, err := os.ReadFile(lpath) + if err != nil { + t.Fatal(err) + } + galWant, err := os.ReadFile(strings.TrimSuffix(lpath, ".library.yaml") + ".gallery.yaml") + if err != nil { + t.Fatal(err) + } + res, err := DecodeModelIndex(src) + if err != nil || len(res.Entries) != 1 { + t.Fatalf("reading the sample: %v (%d entries)", err, len(res.Entries)) + } + // The library sample is what a library file holds. + again, err := EncodeModelIndex(res.Entries) + if err != nil || string(again) != string(src) { + t.Errorf("the library sample does not encode back to itself: %v", err) + } + m, err := res.Entries[0].ToGallery() + if err != nil { + t.Fatal(err) + } + got, err := EncodeGalleryIndex([]GalleryModel{m}) + if err != nil { + t.Fatal(err) + } + if string(got) != string(galWant) { + t.Errorf("the gallery entry differs from the golden file:\n%s", got) + } + + var loaded []GalleryModel + if err := yaml.Unmarshal(galWant, &loaded); err != nil || len(loaded) != 1 { + t.Fatalf("the gallery reader on the golden entry: %v", err) + } + if d := firstDifference(stripRuntime(m), loaded[0]); d != "unknown field" { + t.Errorf("the golden gallery entry does not load as the library entry: %s", d) + } + if err := VerifyModelRoundTrip(loaded[0]); err != nil { + t.Error(err) + } + }) + } +} + +// The library file in the repository is the source and is read by the host, +// so it must decode, and every entry must have the library shape: it converts +// to a gallery entry and comes back as itself. Edited entries keep their own +// version; only the content is compared. +func TestRealModelLibraryHasTheLibraryShape(t *testing.T) { + src, err := os.ReadFile(realModelLibrary) + if err != nil { + t.Fatal(err) + } + res, err := DecodeModelIndex(src) + if err != nil { + t.Fatal(err) + } + if len(res.Skipped) != 0 { + t.Errorf("the model library skipped %d entries", len(res.Skipped)) + } + for _, e := range res.Entries { + if e.Name != e.ID { + t.Errorf("%s: the name %q differs from the id; the gallery copy cannot carry it", e.ID, e.Name) + } + m, err := e.ToGallery() + if err != nil { + t.Fatalf("%s: %v", e.ID, err) + } + again, err := ModelLibraryEntryFromGallery(m) + if err != nil { + t.Fatalf("%s: %v", e.ID, err) + } + if !sameModelEntry(t, e, again) { + t.Errorf("%s: the entry changes on the way through the gallery copy; it has a field the gallery cannot carry", e.ID) + } + } + t.Logf("model library: %d entries have the library shape", len(res.Entries)) +} + +func libraryEntry(extra string) string { + return "- kind: model\n id: m1\n name: m1\n version: 0.0.0-test\n policy:\n requireSignature: false\n schemaVersion: 1\n" + extra +} + +func TestDecodeModelIndexIsStrict(t *testing.T) { + cases := map[string]string{ + "unknown header field": libraryEntry(" surprise: 1\n"), + "unknown body field": libraryEntry(" model:\n surprise: 1\n"), + "duplicate key": libraryEntry(" tags: [a]\n tags: [b]\n"), + "duplicate id": libraryEntry("") + libraryEntry(""), + "future schema": strings.Replace(libraryEntry(""), "schemaVersion: 1", "schemaVersion: 2", 1), + "no schema": strings.Replace(libraryEntry(""), "schemaVersion: 1", "schemaVersion: 0", 1), + "empty id": strings.Replace(libraryEntry(""), "id: m1", "id: \"\"", 1), + "malformed kind": "- kind: 5\n id: x\n", + "bad kind name": "- kind: Model!\n id: x\n", + "flow list": "[{kind: model, id: m1}]\n", + "two documents": libraryEntry("") + "---\n" + libraryEntry(""), + "not a list": "kind: model\n", + "entry not a mapping": "- 3\n", + "wrong type": libraryEntry(" model:\n files: yes\n"), + } + for name, doc := range cases { + t.Run(name, func(t *testing.T) { + if _, err := DecodeModelIndex([]byte(doc)); err == nil { + t.Errorf("the reader accepted %q", doc) + } + }) + } + t.Run("too large", func(t *testing.T) { + if _, err := DecodeModelIndex(make([]byte, MaxModelIndexBytes+1)); err == nil { + t.Error("the reader accepted an oversized document") + } + }) +} + +func TestDecodeModelIndexSkipsOtherKinds(t *testing.T) { + doc := "- kind: backend\n id: b1\n anything: goes\n" + + "- id: legacy-addon\n addonId: legacy-addon\n" + + "- kind: future-kind\n id: f1\n" + + libraryEntry("") + res, err := DecodeModelIndex([]byte(doc)) + if err != nil { + t.Fatal(err) + } + if len(res.Entries) != 1 || res.Entries[0].ID != "m1" { + t.Errorf("entries = %+v", res.Entries) + } + var kinds []string + for _, s := range res.Skipped { + kinds = append(kinds, s.Kind+":"+s.ID) + } + want := "backend:b1 addon:legacy-addon future-kind:f1" + if strings.Join(kinds, " ") != want { + t.Errorf("skipped = %v, want %s", kinds, want) + } +} + +func TestModelLibraryKeepsAnAddonReaderWorking(t *testing.T) { + // The add-on reader skips model entries, so one file can later hold both. + doc, err := EncodeModelIndex([]ModelLibraryEntry{{ + Envelope: catalog.Envelope{Kind: catalog.KindModel, ID: "m1", Name: "m1", Version: "1", SchemaVersion: 1}, + }}) + if err != nil { + t.Fatal(err) + } + res, err := catalog.ReadIndex(doc, catalog.ReadableKinds...) + if err != nil { + t.Fatal(err) + } + if len(res.Releases) != 0 || len(res.Skipped) != 1 || res.Skipped[0].Kind != "model" { + t.Errorf("the add-on reader made %+v", res) + } +} + +func TestPromptTemplatesAreLiftedAndRestored(t *testing.T) { + m := GalleryModel{ + Metadata: Metadata{Name: "templated"}, + ConfigFile: map[string]any{ + "backend": "llama", + "prompt_templates": []any{ + map[string]any{"name": "chat", "content": "{{.Input}}"}, + }, + }, + } + e, err := ModelLibraryEntryFromGallery(m) + if err != nil { + t.Fatal(err) + } + if len(e.Model.PromptTemplates) != 1 || e.Model.PromptTemplates[0].Name != "chat" { + t.Errorf("promptTemplates = %+v", e.Model.PromptTemplates) + } + if _, still := e.Model.ConfigFile["prompt_templates"]; still { + t.Error("prompt_templates was left in configFile") + } + if err := VerifyModelRoundTrip(m); err != nil { + t.Error(err) + } + + // Only templates are in the config: nothing is left behind and it still + // round trips. + only := GalleryModel{ + Metadata: Metadata{Name: "only"}, + ConfigFile: map[string]any{"prompt_templates": []any{map[string]any{"name": "a", "content": "b"}}}, + } + if err := VerifyModelRoundTrip(only); err != nil { + t.Error(err) + } + + // A template with another key is not reshaped. + odd := GalleryModel{ + Metadata: Metadata{Name: "odd"}, + ConfigFile: map[string]any{"prompt_templates": []any{map[string]any{"name": "a", "content": "b", "extra": 1}}}, + } + oe, _ := ModelLibraryEntryFromGallery(odd) + if len(oe.Model.PromptTemplates) != 0 { + t.Error("a template with an extra key was lifted") + } + if err := VerifyModelRoundTrip(odd); err != nil { + t.Error(err) + } +} + +func TestRoundTripKeepsNumberTypesAndEmptyLists(t *testing.T) { + m := GalleryModel{ + Metadata: Metadata{Name: "numbers", Tags: []string{"1.0", "yes", "null"}}, + Overrides: map[string]any{ + "temperature": 1.0, + "top_k": 20, + "min_p": 0.0, + "big": 1e21, + "nested": map[string]any{"list": []any{1.0, 2, "3"}}, + "flag": true, + "nothing": nil, + }, + Variants: []Variant{}, + } + if err := VerifyModelRoundTrip(m); err != nil { + t.Error(err) + } + if err := VerifyModelRoundTrip(GalleryModel{}); err == nil { + t.Error("an entry without a name was accepted") + } +} + +func TestRuntimeFieldsAreNotPartOfTheEntry(t *testing.T) { + m := GalleryModel{Metadata: Metadata{Name: "runtime", Installed: true, Gallery: config.Gallery{Name: "x", URL: "y"}}} + e, err := ModelLibraryEntryFromGallery(m) + if err != nil { + t.Fatal(err) + } + raw, _ := EncodeModelIndex([]ModelLibraryEntry{e}) + if strings.Contains(string(raw), "installed") || strings.Contains(string(raw), "gallery") && strings.Contains(string(raw), "url: y") { + t.Errorf("runtime fields reached the library:\n%s", raw) + } + if err := VerifyModelRoundTrip(m); err != nil { + t.Error(err) + } +} + +// A gallery marked as a library is read as a library; any other gallery is read as an index. +func TestLibraryGalleryReadsTheLibrary(t *testing.T) { + library := libraryEntry(" model:\n files:\n - filename: m1.gguf\n sha256: abc\n uri: https://example.invalid/m1.gguf\n overrides:\n backend: llama-cpp\n") + var libraryHits, galleryHits int + srv := httptest.NewServer(http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) { + switch r.URL.Path { + case "/models/index.yaml": + libraryHits++ + _, _ = w.Write([]byte(library)) + case "/gallery/index.yaml": + galleryHits++ + _, _ = w.Write([]byte("- name: from-gallery\n overrides:\n backend: llama-cpp\n")) + default: + w.WriteHeader(http.StatusNotFound) + } + })) + t.Cleanup(srv.Close) + + systemState, err := system.GetSystemState(system.WithModelPath(t.TempDir())) + if err != nil { + t.Fatal(err) + } + names := func(g config.Gallery) []string { + t.Helper() + models, err := AvailableGalleryModels([]config.Gallery{g}, systemState) + if err != nil { + t.Fatal(err) + } + return galleryModelNames(models) + } + official := config.Gallery{Name: OfficialModelGalleryName, URL: srv.URL + "/gallery/index.yaml"} + + // Default: the gallery index, and the library file is never requested. + if got := names(official); len(got) != 1 || got[0] != "from-gallery" { + t.Errorf("default source gave %v", got) + } + if libraryHits != 0 { + t.Errorf("the library was read %d times with the default source", libraryHits) + } + + // Library: a gallery marked as a library is read as one. + official.Library = true + official.URL = srv.URL + "/models/index.yaml" + models, err := AvailableGalleryModels([]config.Gallery{official}, systemState) + if err != nil { + t.Fatal(err) + } + if got := galleryModelNames(models); len(got) != 1 || got[0] != "m1" { + t.Errorf("library source gave %v", got) + } + if models[0].GetGallery().Name != OfficialModelGalleryName || models[0].GetGallery().URL != official.URL || !models[0].GetGallery().Library { + t.Errorf("the entry should carry the configured gallery, got %+v", models[0].GetGallery()) + } + if len(models[0].AdditionalFiles) != 1 || models[0].Overrides["backend"] != "llama-cpp" { + t.Errorf("the entry lost its body: %+v", models[0]) + } + + // A gallery the owner added keeps its own index. + other := config.Gallery{Name: "mine", URL: srv.URL + "/gallery/index.yaml"} + if got := names(other); len(got) != 1 || got[0] != "from-gallery" { + t.Errorf("another gallery gave %v", got) + } + + // An unreachable library is an error, not a silent fall back. + official.URL = srv.URL + "/missing.yaml" + if _, err := AvailableGalleryModels([]config.Gallery{official}, systemState); err == nil { + t.Error("a missing library fell back to the gallery") + } +} diff --git a/core/gallery/models.go b/core/gallery/models.go index 055186e0d..143c6050d 100644 --- a/core/gallery/models.go +++ b/core/gallery/models.go @@ -79,8 +79,8 @@ type File struct { } type PromptTemplate struct { - Name string `yaml:"name"` - Content string `yaml:"content"` + Name string `yaml:"name" json:"name"` + Content string `yaml:"content" json:"content"` } // variantOptions turns an entry's declared variants into selectable options, diff --git a/core/gallery/testdata/backend_library/digests.tsv b/core/gallery/testdata/backend_library/digests.tsv new file mode 100644 index 000000000..1e5c26910 --- /dev/null +++ b/core/gallery/testdata/backend_library/digests.tsv @@ -0,0 +1,1090 @@ +# id, digest of the gallery entry generated from the library entries +# Written by scripts/backends/cmd/backendcatalog --golden; do not edit by hand. +ace-step 05aac785ff083c73fffc7f88d243eafe97eb84207ee9cb2b6de193838a94bd26 +ace-step-development 1696e2bbd7df7fbc413a11dbdf9105ad3804fd825fd9d6550aaa439e5e06fe50 +acestep-cpp cfe60790cbb270c4fdfcd44577ba8b48dfa83e6c9dd6dab995e9dd15785e98f8 +audio-cpp ee72220d68396d29eb765571c8a2b4edf9dd78add63d23593319a03e2610208a +audio-cpp-development 6bf4cda5202c61a7b0da6d483fe885342d2973580bbad4a394a5cd40560a9db9 +bonsai ddcc9c1dcb29db1e10be2d824676566fb5045b30fa4882b9b72e9f0aaad227c5 +bonsai-development 89ff9ddd66555b0ccbf96b7afed9de3e9c54f57175945b4687bb322fd6568367 +ced 3ca35f21af31b8affe1dcd79e3766eac703941cf9573803fe793feb9eb987969 +ced-development 9f9bb80aaa64ddc29315badd0dc5051edd55fde09ed4781473ba98842f95aa65 +chatterbox 1642dac8d7f2d87b87fc9f29473536bc16dba172ec0b1c35de875fe8dfa68ee8 +chatterbox-development a88f610711844d57d38e0d7f11d81699ddd8febe48758ad06ce0268d14bcf0d9 +cloud-proxy 4843b3e3c061ebfb26d8c3771b91265e21c610fa711c89ac6ec06c8e463c03f8 +cloud-proxy-development 3bb2a5f2d8a9979dc154259ad339b4a58e32db8d5b0be0bb8668df809ce5a010 +coqui 1570a066aa23978e9205bc1e0db1b21290b1204d776e6725d78254415d40b1a1 +coqui-development d541633a08ae0aa30f9d7acf660f2530d70d0c221c4171120b80d810a5fab924 +cpu-ace-step 1ae64014f70ba7c422cd2c3735baf3f6549ddf9a4b64fe74e12abc8ab4985185 +cpu-ace-step-development 9005c8ea341744302fbbc0b538a8c7037feaa4b92487340ca9404697c1a1b965 +cpu-acestep-cpp d4f9c78073a6b1b146e2b144fadbab557f9f27f17e232667d24a862e7aa9cecb +cpu-acestep-cpp-development b519fc185d67da8d0a677114e167564f68dbff903b7ec8fce3e4bad937fdddbf +cpu-audio-cpp fae5ed600aa6e9c24cda1166b1c0f87caef64228c953405a865afb51227d61e8 +cpu-audio-cpp-development 5021b1195ae96d1f8d2da187457ba90dd089b05c96791709a4651c9b154c9bd4 +cpu-bonsai beb84175a0cdefd68c1e4a47a3de2e693e258ea2a6e89bea4117e9ea98b63e30 +cpu-bonsai-development 9fdf6a25243cafb2e04627191196f100395c891a78c12a5b670c68c0b2615307 +cpu-ced 0500ed993e99166d8a17c70683cfc73b73e0f505c84b3b859f6b7d2b2b7dfb80 +cpu-ced-development b914afe924a353409e945ee7c0bd09fc5e534a37e08c916711560f96563c195c +cpu-chatterbox 20c4dcee00eb4407e466f9522f347609f8a944f2a21ae4d63effb0651708c837 +cpu-chatterbox-development 8d8deadaa80fcb98cd1660326a3896083d1e5c7c2887c20ef71ec78f3e05c33d +cpu-cloud-proxy e0fd824d97e610206b8969468fb9e1080e4ea2d61306770a4e0c0349513f9c6c +cpu-cloud-proxy-development a5b678f133fac33830f1bde1e2aa6f46b5ab9f8a0a244d292d01770b469bd272 +cpu-crispasr 9b8a58603e3d6914b63de035db5004767d3d53f9596f0baf67dc3fbe527c7cdd +cpu-crispasr-development fbeae116613a7772b117e413164877bd1778d7957cf137dee0b75ea74b59efe6 +cpu-darwin-arm64-gemxcpp 67595958fe5a4a979c8d8e6f2224a07b3e244738acc14716196e8fa60d3317f0 +cpu-darwin-arm64-gemxcpp-development 5bc0fcaa48abf3b6108d5ce423448ab440bde440e6bdbbac0a4c401067292ac6 +cpu-darwin-arm64-kimodocpp 1c6c300a0b3d64024ba4879c5956434748561ece3847e7ebdd33a9cfff8e2b05 +cpu-darwin-arm64-kimodocpp-development 7c3f11932e92a160a520e38fac1ad768f77824e5c86db1212c99b213ff36fd70 +cpu-depth-anything-cpp c4be137985c6e94d140d1047d73117273b618ae8dc0995f2d1a042d93f9a8a16 +cpu-depth-anything-cpp-development 87167a8a5fd8b51cbfaa928fdd87894632537b392eecbcb2161c13a3438ed724 +cpu-diffusers 3bfadad6450561613e0f9f90a9fc0dc22fd318c7ec8ca0234f8604a3c149db2e +cpu-diffusers-development 07bf21126f52778e526d542c2c41a3af15b0f23b8c29b90ae968a7462d9c08de +cpu-ds4 08b16cee6cd340876c17fa3a37c3f02d8ef188f15f1d024eec0c2eac00555066 +cpu-ds4-development b1fe97d678de5d7d07857ec874a7311da521021194ced3cfb5e1d0864dcf8ae7 +cpu-face-detect e8ddc626580ac9b9b70d8153e6e25f698c02fe32bccd40b34b0803b0a4d45dd4 +cpu-face-detect-development e44c1d38a7416bfa60d1f588ec5984134750011962bf3b34345af4a426a8a3b4 +cpu-faster-whisper 530cf81a797e0c3dd504e06c3f27c8871943c1c3bdaaf27edeb2201e5df3f8d3 +cpu-faster-whisper-development 6a0775e37f34fb5b52318bd00e665d72e07ca29a2b552669e10f97c457c20773 +cpu-fish-speech 5e98abce5c29b9d0d4f000478dbfaac8b23de007014a74202720d8a76e3ff441 +cpu-fish-speech-development 6936ff917e49e5f10a072399aee60dd498a6f930ef2054d719e56c027390c904 +cpu-funasr f1cb99b2f9591b0f58afab864e66a4b78fff3fd28fd7e6755c310724ccd013ff +cpu-funasr-development 3788d6e707aecc5a3a78500224d71e108c9152115d7556886ec565c5aefb91ef +cpu-gemxcpp 453c86fa79762fe0b52e290a14ca199f29eb61a30a922f360d769f4bf24315d1 +cpu-gemxcpp-development a4abde847697fdb79c2af673e3762533ba173d67c8b048ff2b9754e099b3beaf +cpu-ik-llama-cpp 23a96060252fd07bfb16ae2ea32580fc3ed8685ffe89083af6ee2dd6eac61947 +cpu-ik-llama-cpp-development 1520b5c113d4832376f8e196d87d570e3d6cf6a319947071fcb35d0d00d24e55 +cpu-insightface b8619003c209e7cd3ece4de5c4e6bc1cbecfb9347749ab76d9374e897d4bf17e +cpu-insightface-development 87eb8e12d2f0f11aebeef13ab5c15ff58851a42d7b8613b5e8d48853a28d03ce +cpu-kimodocpp efd7d90b9dd3900ba1413334624cd6c4236df2f032f9654bbe14129c77531af1 +cpu-kimodocpp-development 1c1f5ff4426c9c42e7d8057f2db0fc8e667189ceaaaa1e83882e2c3e667cb069 +cpu-kitten-tts 9ee8656cc53bbadfd8c5e387115bf4e7f33f2631781cdbdf49fc6bb75ab33f41 +cpu-kitten-tts-development caa39aebb53500f50a122ad1eb6edda6add7995b0bb5dc7cefb39a5a487826a3 +cpu-kokoro 869db7ec4fd3f79d5dc63aff55138db9b044876ada65084873b2e077c8682c8f +cpu-kokoro-development dae85b0a4d475937f461ebb8a46432539206f761a089bf9635b78ddb8f21ab40 +cpu-kokoros 68b9d5982243625b8c6e8230357785bfaeb87ad2b0133b1d974efef7741febdb +cpu-kokoros-development 2564819a1a0575408c8fa9c99603a0d442a3c74c35cf4b079fea3a15d97ffc86 +cpu-liquid-audio 7931b099ed7e059ad68948dac71bd82dd58009f50c19ce84bba265cfaf40089b +cpu-liquid-audio-development a3ad83385a16be50062de843780db73a0dadde71a6d8fccc7f41975c5c2e056f +cpu-llama-cpp 089fce4f9c5b4caa9d1b53924f00362ea339ab7f477d16fe3c14dce6d97a7f7f +cpu-llama-cpp-development 32f1f041c97e729409c11527fa085efd7884eb737ee0360187020807ed1239c7 +cpu-llama-cpp-quantization 1984b8cc00b96f14bd2c85b45e9542ace0db0e4a75f5937da684eaddfe383d09 +cpu-local-store aa694b53dadcfa2629e5fb740799fcac4caabfb3d3488402ef23681f750fbb60 +cpu-local-store-development 471212eb694c8061162af5f5e7caedd0121355f4209aad16de70f781dd85d06f +cpu-localai-proxy 6e3c57bc9704da5829ff9bb581962f08f900ed1453a16663f64bcd55b843d216 +cpu-localai-proxy-development feca878a41b07fbde877ed0bc65f1055ab67e22301b9f9ad13547903b0cd57bd +cpu-localvqe 0e8cb837f29fad4c9a48a6c91c0a03895d9b83642e5128a0b3958cbadceb7949 +cpu-localvqe-development 775b8040be49ea7681d1937e4395f4d3431dd3b47ed4fa6feec1f56add048ac7 +cpu-locate-anything-cpp c9f89c019380fbffa94a8e48174bf2d939395826e24855b5417be1e053fd29cc +cpu-locate-anything-cpp-development 3833561c84f51a69ecb4cbbef81acdfa2e8f822df95bd9a48fe4903e48bfe2a1 +cpu-magpie-tts-cpp f2ea89242240236d3ab9f1dc0666c4d4e09fcbd929a2c54dd4985adac38815fe +cpu-magpie-tts-cpp-development dec30fcbaf3acd038261b089144a113c17914270f9097dde0035e78e841293ba +cpu-mlx f69f57bd90aef5b5d0a8ae160f9e23e74f3ffc8aebb397b23cb2d095ccc68ab1 +cpu-mlx-audio 8b6dae32170f7ed8762aa92a14db371b6c463dcf9dbf21b779d56257b3439421 +cpu-mlx-audio-development 8ae8acc9a211a6162deb945243383ea126f0ebd6e192a09d7dd7ffc1a8b06778 +cpu-mlx-development ef07f9e158ea8445e8c31227f3594bea617d481855efb55161f568a4f6be141b +cpu-mlx-distributed 76005931480e1e412517034e11f85595ecd2a622c58d07fdbd824e16338914d1 +cpu-mlx-distributed-development 385af1f8df2b22c40da8c5da35c3395779dff170b874dfcb7892423e8539764f +cpu-mlx-vlm 082256d507e1fbe8d7a4247f9209343cb9d838e70c93326407f711e0ba80f921 +cpu-mlx-vlm-development d16fb2ad6602fac0f12c2bdbf12ab552ea3413abc19960e8a3dbd5a99d3fe569 +cpu-moonshine 4cd52fd05f8bf4459924b352f5e628bca1703473937171d0730b93b464a338cb +cpu-moonshine-development c1036b583880fd4d0940b6767ad6b91e7a3b9cb0da613b8885938aa07a88cba2 +cpu-moss-transcribe-cpp 29ffa1e08740a9c307cc96be63b010b3335ebfaf5d104243364b6245902376ea +cpu-moss-transcribe-cpp-development 6e25ee2f9dde00155e7aa053709d37a034cb150e928ade08e6e74ec1f6c043da +cpu-moss-tts-cpp f3521ed2072ef86ed1732dc01aaf16dd985d5f6890074cd1048a26a6f2081df8 +cpu-moss-tts-cpp-development ebbd72ecd31b935ad941683fa9d95edd015ae771f16a704e9e23284f2ab12e7d +cpu-nemo 7c80b9726f2f22832369f3f5223e09c4e789cc4eaa6fda80901da8bd0cd14237 +cpu-nemo-development 1ac247ae896887407c417470284a36ba993a4fe500079d2f44ed20886e7bc13a +cpu-nemo-speech-cpp 57d398442f66d978d72fb00ee43ba48afac303b00182be1b36202345ec8efc84 +cpu-nemo-speech-cpp-development 2389b733fa25e5c117628c13beece767ffeecde5bd00c11552ab8ee46fe96dde +cpu-neutts ee593c252d3c2ccb252a525aad96af7b998332e2deed1a226b4f87bafb103752 +cpu-neutts-development 2aebecd0c2d144694259475663b14d16be0db01c74e9b4d49cb6465d07b5174d +cpu-omnivoice-cpp f810cd941f019901557207d33a1759aa68f8eda0c841146762b5e516dc772cf7 +cpu-omnivoice-cpp-development 3225cceb02d706052c4bf7a190a79fe151e475206fbdf8007e4ea9d034cd39a0 +cpu-opus 80ea6d89235d30b8f5462349e693ab517bcca836e4c784e12f318427a35ca769 +cpu-opus-development d3d9a9d1cde270fb64d964e8bd3043dca03a3a0a7cfd5045e4fa5182814163d4 +cpu-outetts b64b4b7d1a5375a7e51d506ec5323401d83b3e9d346e0cf5e70d449b5be32ef4 +cpu-outetts-development 93becfef056188e594633ec2b60be12b3ca41e7810512e3c119e1cb60082ee19 +cpu-parakeet-cpp ef06c8a6889eccc62e0d6cd892b5f67ecdbc35b95fb88ee712202f2ddbebbf07 +cpu-parakeet-cpp-development 8e6481f98e6fb257ebf56fa9bbf725cfb4bfaaf94b24da41d0436a422922df6a +cpu-piper 532d4e1bac53653c64f0a1070731eff71fe4d650fe8e0c7dad8feda056441602 +cpu-piper-development af8326f35e85c8060047171626822cd34a24e52e9789c3aa800895ddefe97519 +cpu-pocket-tts 73c0f1b4eb686974191b8d595a5833cbec1fff70a03e08de862e332f69611893 +cpu-pocket-tts-development bf12f0d6c72e0b0cda141f46f8455c7552b6dd7ddadc575218b5e58cab8fbef7 +cpu-privacy-filter 96dd212380dd16ff340a5e2b9206c9082aa26e0b9e093274517749ae77dabdd4 +cpu-privacy-filter-development cad2ab223b72738a3af47117073888f5ac4bda90dc2b65b1c0a293855f402734 +cpu-qdrant-store 88bcc7feacaf9eef216ebfa6b7d2a926a347dbcff2db5ded8a81f9d19438f215 +cpu-qdrant-store-development 49e38f36743a573d15b4fd4ce59f8a756523c483908a5e05778ec640600eff4b +cpu-qwen-asr 91e29663aab40500e4e8ec44c900b0ce8484c99b9f9e4eccdf48540fb2ccaeed +cpu-qwen-asr-development c1405bb0868ba36ef6ad76b66ce1554ecc3bef874a68a512631bd67f0286dd45 +cpu-qwen-tts 13b1e62d6ab5afd13d418f65e84f3baf4f52e803f18c6d9a4fce9d68b33388ef +cpu-qwen-tts-development 1542e39b53e506a0b40dd6d9df3bfffa92cd7fdbec46f782804fcf0c67a0aa54 +cpu-qwen3-tts-cpp 89861e738fca9570c3b3ec46722a7b6354ae9f90663243d20b96f252daa343a4 +cpu-qwen3-tts-cpp-development 5558890c4c8dc6959daa54e59e72b18363b5d389b5c5c07c730f0702ed7795e5 +cpu-rfdetr 55c73dc3d10a0f7e0c122053b2ef3fdd363d4512e6d40de23af23dfb4fd37e15 +cpu-rfdetr-cpp 6dd74ce00d090989b98cae75e9069ef0baaddb5581c34862c79a9d536d41fe74 +cpu-rfdetr-cpp-development 5ffa6a20ff44f793e350f1628e5f3f9ff92574c917026542bb9149d25766c58d +cpu-rfdetr-development 3869c438a9a79e2d3ad89d85887361e5e322f40626f7d18513cc234403e5641a +cpu-sam3-cpp 04534385b1e8d53f91bc868394d576057184ef3b202d4e392de70318fe5ae403 +cpu-sam3-cpp-development b8b5a5763d9a1b5606f4eaf415b7d26ad6130f323c3d50a7e26480ad2b8a9b74 +cpu-sglang f5d1a4b2856a3204ac1dee50d54016d85974bc429db6bc6fc0c2039c3db7f08d +cpu-sglang-development 10fb0fad29c2996ce4a6820ed88fd9a75442b0fe1e5d2e1cc2d86aa7b5e1c3f3 +cpu-sherpa-onnx 1f0983722d8c3e8c039240da5ef9dba550a514646421a09279028f77acdb19b3 +cpu-sherpa-onnx-development c5a92a1773deff7d94b7c32eccf1abd4419891f6059f5eda90ed56189b36a053 +cpu-silero-vad cb09e14c4c2053f2e7b2aa0592e3f84fce897b7d46257df9d459b2c7f34fe736 +cpu-silero-vad-development 749854bcab29e419efe85562042f7b069d99e7463520bacfb78451fe455d4d5e +cpu-speaker-recognition 5c2ea0fc38e14479a2e342adba9eb77bd765bae84ec5d2aedf4a4c6febd44fa8 +cpu-speaker-recognition-development 470f82ef3f39c441bf8bf9c0c4082d6e9222b1e7d6f2dc4d6f0f250b92d8fb35 +cpu-stablediffusion-ggml f25126d7c06407d852b6746d56a3ccffa249db2ff1b9e555a40b75a9cb019bbf +cpu-stablediffusion-ggml-development b9953ae4483bb028b78e0dac926bd9637fdaedb98cf87a19411d57c5f8567fea +cpu-supertonic 4197a65ea0afd01897d0114204d44bd476d6fe25f5f3a79e8bc8dced62f7b3b1 +cpu-supertonic-development ccd2432aca8008c5cff3f5f0a75c5e1b59350ff9ee7576e95290424321b72786 +cpu-trellis2cpp 374300e9fe139137dba63c9508a10ade96ccd1f522e37ff6cae1249d89be22fd +cpu-trellis2cpp-development 771f01a45c1e4ee04ee53abc3bed4e40f037591efabee9e7e3720ee2fbb77b57 +cpu-trl 33d16f9be4239778cc044df3bd3b1342a346167fc4568eab69c5b1cc8b140ae0 +cpu-trl-development 880338ee566dc9ebcdf7780f2642807f223424d639c939910246d1b21efdb385 +cpu-turboquant 92ef40772b8b03cd524510c4e636db038c79f07b5b26834cb331013dabe38aef +cpu-turboquant-development 79beb314dee6a09a70231e227d43121f077f0bde884269b9012b97a5f2e29e3d +cpu-valkey-store bf85f8684dd350bf5b97607711d9119fc6356536cd4cfc6149427d2ad59511d6 +cpu-valkey-store-development ef051a5cde35a8b6cef59c1dd0ff0bf9355e4a66f5beeaa2d81b2fa3501ef80e +cpu-vibevoice 73620384ecc295be4d746bee986c1b59f9be24b12599aa2f3af81c595df19f69 +cpu-vibevoice-cpp 5e784463fe2eb6382fa7316e8f7c0f58fe7598aa6b221b5316718c05969cd476 +cpu-vibevoice-cpp-development 144fbf7d53ebb01c066f736828f89cd85416f714d78181a75b4ac5ae920cc77e +cpu-vibevoice-development d94f44403287449fa87a8aa214605ab4308c293bd7649dda88210be5c75b50be +cpu-vllm 654e0564e87b3af2e11d4a0107717d2c6eec757ebda6a09681793a3a774c5cc7 +cpu-vllm-cpp d155507720668a494cb9c076f1f8d6e2a3d6fe378e652e7cf74938c2e41f44ef +cpu-vllm-cpp-development be5e0991c2fa8f97c5fac23d0cdd553aec1ab4203c2ea92fcbac03cca4b3d51c +cpu-vllm-development 3912254b91c0b714b296ad55fdc69d41933f1a981d02eed9438964b4dcadbf59 +cpu-voice-detect 3ccc62511b5aeae20cb7ab7e7f487f2773f810c0c4d0cf9cddabf97e26954299 +cpu-voice-detect-development af7b1484238d298104b77a3524578c2018dd378b8c71f89a0229db9184baad7e +cpu-voxcpm 403016a4c69114cd30a286a85b2b72871d26fd1bbb429dea273d6db144fb675e +cpu-voxcpm-development 082fd53928be1951a673ab8cf48ec83cb423dd58dc11b16c9ec198e7bbbfa0b3 +cpu-voxtral fe11c8a5340800ace3bde41e346b459e327e515627784a8febeeeb48674bbe6a +cpu-voxtral-development 1ec74f66db7bacedadda66aa85e3373d88255f2711ef167f511448f1d479ad4f +cpu-whisper 2e0f7c6f7ca7a820525cbf11051e93773adaba63bc1b5be423b76000af1de3fb +cpu-whisper-development 2212156eef6c10f235677c94114bcf6e1aa758c8a4257fa8dce709d43120824c +cpu-whisper-medusa 06f2557c9041a5632076759b1ca66002aecbc9773a18a53e794615a43ad086c4 +cpu-whisper-medusa-development 9f5dc9807327e093d298bf15ff4b60e9752c7de0874476c4adb608a40a028f52 +cpu-whisperx 91a163da9fcde609ff4fcd148034002903ef7e374df24a84a16639a17a8b54da +cpu-whisperx-development 638f88eef5b80f5f100c401d10fbe2e5014ca640a293f95a67a92fbed0b39c4d +crispasr 20c0367422c7e3628676728c521b289d71dd8d63a4d37a838c3a9f4e7e2f3864 +crispasr-development 4691f0fff63132d195c0ea221433a704b46de9248c9aeed81f465ff2cdae07a0 +cuda12-ace-step ace2c1f3f9effcd90f81d9fa07895fec3389aac41920d90bc43edbe4842e076c +cuda12-ace-step-development 7f18f4e43dcc4985a4e86f1a8d6f01a69181d4ad615f5d72d102188dd23a647d +cuda12-acestep-cpp 23d43a5331a42766fd45606e3a17095646ec19fc8851fedf294d0a25c7b50a73 +cuda12-acestep-cpp-development 5c7bfebf6eb4464ad8165baa202bbee4bdfc5b07b523c69a1b82541ea78ed423 +cuda12-audio-cpp be3fa2b0e8f498d02ef27f89ed811de60b0d2c18449131265df42433c53e1a75 +cuda12-audio-cpp-development 3452876e1a965e9cd43e71d0b18614c57e8326b880f772c2daed6fa769ff9f04 +cuda12-bonsai b68282c9e081e39bd885a3bfaeb50140986265ac6789fdd5451ca3964bd8b75f +cuda12-bonsai-development 9187130c80b374c92ad8ebadb2d0564e2b68fc28dc44342679d5f13c35478b65 +cuda12-ced 5bf4226126616911c43f0db4f7ae50a728a8bc4e0063ee376e9129284182e994 +cuda12-ced-development e9543b4ffb2cfb2d5e2b26fc6600f874ba22d4cd8c55319b2c612ec513043cda +cuda12-chatterbox 499e96effc5728fb383916dc1160d14a2f0492c5548390035c85fe177aa9b9c2 +cuda12-chatterbox-development 0a6a9e1b60fe8ce754b7fc9e38a2363ba42960fdefee647bdccff3a52f552c60 +cuda12-coqui 79e162bfbb4fa7c584ab7668d8dbbb5adee8ae739a76b8fe97f4ab8cf47c9eff +cuda12-coqui-development fef260eeda049aa2ee5150e3f4c35ee36883f2173dfe281b2b87e4104842e3e1 +cuda12-crispasr 0d09942307b6d45609a737c7a5d543bd6fe6f1518b30a2042f671527c66600dd +cuda12-crispasr-development 39fbe3ea9b406c589992047743ab36c6b1287241a9f1c5e6a71a1c49e2e15493 +cuda12-depth-anything-cpp 5cff29b88ed1abe277f34375f489a761e0548d2dcd5e0f54a493d3db5ad15585 +cuda12-depth-anything-cpp-development baf0481799ad897fd8248c4ea1103f444e7564dd0c79ded8f6f19b082db2e178 +cuda12-diffusers a7ecc95195afd5586730a3d7142b9a681ad2bb805e48d39711f918666c697eea +cuda12-diffusers-development b232c0dcba670048cec14dae94ae933809a49ca9508d55d61d30221d3f116ce5 +cuda12-face-detect 17d45fb61a8617c320f2cf3c12193168c51a34fdebcbb9752a8d3f74cfba1b10 +cuda12-face-detect-development 15b77a0153c443e0cdf11c2cfe7fa920596ec08a011775d82bca8a407adc607d +cuda12-faster-qwen3-tts 3ba666b5f5f58b46df331ceb599524990c20bfe13b6b567a5c018f0e87f9041e +cuda12-faster-qwen3-tts-development b369d814f584479ebf5a0b4595f2e7861416195ae067249e78b5dfcdaf5a53d4 +cuda12-faster-whisper 11e025c3a06d8811959dad2b271fc71945115ecdaa4bcd756d6b7f4e0ea40193 +cuda12-faster-whisper-development 9383e2ec4136eccd69edd3ac8444b2edf5f3ac18d805e4668ed08e87e845cd33 +cuda12-fish-speech cff6d6ea058b8b7c1502c98f8f7b6c5c1af768f4632895df7ac13a9289799739 +cuda12-fish-speech-development ff97168f546be003d94564f03eee729fe144426792f683e832cada3627781c6d +cuda12-funasr 46fee0ca4850cefab67abba74263e89cfaee37c81479174cd4567f8d8e9effa1 +cuda12-funasr-development b2503cd17c1babe59282583260a1fe4b6a3559d9f68fb34aefa0805dab879a1e +cuda12-insightface df52e82414d0702e1d76983ea4413b67b769754169fad6eb910b3514da189bc4 +cuda12-insightface-development e44107b648d8ca5908a49c7be0cdc5bd418c1297904afab99876fcc6d485ed3b +cuda12-kokoro 027f82c0fc30faacb73100795801d021adc0b933b8f1725a798730061acd4ec0 +cuda12-kokoro-development 7436124820215d576105b0dd54af86b2afc93f6b8f675881aacf97c4cf8c4a47 +cuda12-liquid-audio 4f5d533c9264994c0a3c3954bca7e0f962d9426bf3a2a1761e2f93dbfadeef22 +cuda12-liquid-audio-development a767514072a8209a70bd051ef96838c185e9f9daf2c974c31aaf7a3d0dd4b6c5 +cuda12-llama-cpp 723f951db4648282d5389203cc1112b80f970a164084a50f02969f74e6e7a178 +cuda12-llama-cpp-development 4f1875e28f019dd5c700823ced32875e591f04f2d35a996d99946dd56c088d88 +cuda12-locate-anything-cpp 734d0cd9f4b52df96f76b2763b48bbacdd85cf8e8f6b2e033cc984f6af8c74f2 +cuda12-locate-anything-cpp-development f08732e35ebad6f87956f9f79a07dfa4f53843495051cb192d9ad507d22d3c2d +cuda12-longcat-video 7bdfbb21a24c3eeac80d39dc679493bc53b668f68d9f20ed737c5cd70750af19 +cuda12-longcat-video-development 4f4bda58ac2ff7aa345ef316d178bf830f6ae6aeea967a3e9e127e5833eb5e9d +cuda12-magpie-tts-cpp a591a866287876d8b657240ffd0ddf3cf752ff92dd18e3e0818533a7e0b692bb +cuda12-magpie-tts-cpp-development 1b29d3ae47bbdd64c49588a7f1d9d626ce521a3abf66932eb2401fc68bc81660 +cuda12-mlx ac6aa20a8a0695232acbc90f977b2f17365692d48351a5d7fc6e9130b2a63873 +cuda12-mlx-audio 0df7a68ed9cc2f30891435934238c00d36f8134b31fabeeab99f8615ef840c82 +cuda12-mlx-audio-development bc6a9494d869325c800ebc14c08e7811ae7f60e649a59a13f20e53dd291d852a +cuda12-mlx-development 64279144562eef993a8b9b4d0d4cbdd083be306672fc27f7dc8e016a440277dd +cuda12-mlx-distributed 76579afbccef8574e7a7d0e18507901f306e3aadc6ee1874da5a466b9401ca58 +cuda12-mlx-distributed-development 43947f06bb175024fd93ded657c6d5d12a6761b2de7549755dfbac9ffa0bca32 +cuda12-mlx-vlm 19023db797fa1ad6e0ab25f5436cbe038e4d2c270154df424c229c21bc531448 +cuda12-mlx-vlm-development 421caf2c3da41a039721e85b6c9fe1fda3d944debb1ba8f2a1c6891a3fb44e85 +cuda12-moonshine 6e53be425a6802c2e8ddfb575d1cd4bb9a27a9f684bc3644871f796b5db1e539 +cuda12-moonshine-development 9c7a28f29845b7910ece0fcfb322c4ec30fe6e77723405536083b7e3e24a70dd +cuda12-moss-transcribe-cpp 609b46a3fd92a1804dd378a66d7e8380cc4a5be9afd49750a0bab9a47917799c +cuda12-moss-transcribe-cpp-development d7df95e456ffcc4257e9782af7dbe1a28230e601b06b089dc3f61bac71525323 +cuda12-moss-tts-cpp 55c1be3f4a9a7c035a21e75b76029545741ab595552c1c5c1bbc2208d6aaa065 +cuda12-moss-tts-cpp-development bb6cae74fa4301f112bd37e730db782352a5ed48fe28e1db86b22a6c316965f0 +cuda12-nemo c0e43433d446fd6471f2609c21881c5ea3301181c61b8edc133cb976e8c1e514 +cuda12-nemo-development 4769ff5c6133e411354fe716050433e7c1f8ac1540785a4a55c02a518e95067d +cuda12-nemo-speech-cpp 1c960b6b9bdb8637cac7aa448d3ba619912a6eb73009c98d2850cb010a83046b +cuda12-nemo-speech-cpp-development 9d7295186734735264f4899b62d32f7a835fef3850a473894833eba97d92d173 +cuda12-neutts 5001c930bfa5630599ecfad9a079fa8fd0fb0e6c9f5a9e00c9a849f96e6521f6 +cuda12-neutts-development 13df5c344f705f094258031bec27a2643b436e13c90ee1d96013aec889165648 +cuda12-omnivoice-cpp 780b11c0bd6fedecb1cba059ca2048ee55167cc93c3a718f1ee15890ce012f08 +cuda12-omnivoice-cpp-development f0f606982aba5b0b9b53e1b80f6a73ec27dfab75c3135d0f1bafedeaac69ea9f +cuda12-outetts f6ca178074d57652c3069d3d91c4fb1a7350060616d529b81df717d59a9eb1e3 +cuda12-outetts-development 9648e2f490f0e1ce4e8f3e9256e09e8c0f77e1a15403528243d588c95e131f51 +cuda12-parakeet-cpp ae123d80af6be8fce8011c61717dc0f1db69d018ac9897dd6f5cd732dc58fc0b +cuda12-parakeet-cpp-development dac8e4c48c11deb936f5df3ff90ccd7491a717d85bc2e8dbb0ac48923c2fba46 +cuda12-pocket-tts 2442e85d88e51222e756e6a5051ff77f3cad2b5c27432ac98ff959bdde52d5b8 +cuda12-pocket-tts-development bb652fd2366c1de73051991b0c6f08dbdcc8f6e580119690ee57e3e447d7584a +cuda12-qwen-asr af53f571448b81cdaf217a828800907f11ded0a81e78f977b4bce5be670a4fe4 +cuda12-qwen-asr-development b3f9070d7a6a1a575f72d49f4ad5a62854d21671c0044198f99eb205c325f499 +cuda12-qwen-tts b5ed044c9ff3ca5062c1e9eac4d522fc5fc8e7aa06e26573a36f807b063cac7e +cuda12-qwen-tts-development ce81e3e374bb0b3df2bb948cd6c873e7ec22e651c2ece45e0f7ae672fd96c082 +cuda12-qwen3-tts-cpp d9b3f61206f866681028488f681b8518b09f70065f56de9de43be7571480b74b +cuda12-qwen3-tts-cpp-development 8378b0802cb58eae0ea819acb6244aea3f857c146662c6761b827ec26d4b75e1 +cuda12-rerankers 70f123a9cb2c6945a96d3537bf32cb6d5df5ee8872da1d9223c40b76d08928e7 +cuda12-rerankers-development 8f6c70609b7dd27b226755643d57bc5670c94c0cd7900c2830c2d7f4a67aac30 +cuda12-rfdetr fa42bd9ce6cc821d2a28fdf070cda8274525f8c13a14ea7e17a23c73084e3e9b +cuda12-rfdetr-cpp 9701be621109acebc255f16b04756cfad1cc17e73dd82def65d43d01d0dd2e77 +cuda12-rfdetr-cpp-development d1601e110af3da7cc7757cda85a9a4b40e9b18bcf967859984be2f7438a838bb +cuda12-rfdetr-development f9f98714c07ffd7a9580f86bfe935cc9e0eb2ad2ca9ca3cdb3e497bb2342d319 +cuda12-sam3-cpp 309b8beacefd512d4eca8c8791b4ca3199a70d8c4ed3fb941baf33ec9091fb49 +cuda12-sam3-cpp-development 44588cc01ca5d086317dd403878a99b4b7205cba0213a5ab2b0c59991f67a895 +cuda12-sglang e466e27535e4135cf0d1977c287ad7c52f613dce8994181d6deed9152c4dee96 +cuda12-sglang-development e3ee98ae26b5cb29775ed60dd68934d873759583bd31467a92ff99e144bdcca9 +cuda12-sherpa-onnx c4db0a2c6ed14d8d56cdad432ffd13251f23fc853785e6e913e19850337846f4 +cuda12-sherpa-onnx-development 4f842c9c0e1e586de76b3ab053a465d8150fc3ffeb5a361f4743d71adcca7a97 +cuda12-speaker-recognition caeb4cdea501bdfc012702d627f0cd87643c66dfb1a42e0469b30bb6aa4eaf76 +cuda12-speaker-recognition-development 5ea45c63a233df6402fa29b4d5ac769c03956fe6bfb996dcd663aa9721912ab6 +cuda12-stablediffusion-ggml 0a39a184ac7e80f9973160abb203535e86ee043052eb13e39db7e1d1366590d5 +cuda12-stablediffusion-ggml-development a10ec07eaba00c603dd08a26e6398a0cd93d9cbf684fdfa012eec1a72bbd16f5 +cuda12-transformers 2b58740bffe994c2928a4cc4dcde4f96a4c8e667fac834028ee32ac5677effd3 +cuda12-transformers-development ee3f5495529b9c2864f5b402a4a889cdf706b857089af036d96dd58da94dd4f0 +cuda12-trellis2cpp 41d300b67e8e79db21e4955eecb5a4bbfc30fb8a92c103627ff2495d2d584376 +cuda12-trellis2cpp-development 0446b25ffe2e26856f9cf9aa5ddfd4be77d55983882349b59579d6dde0e2f993 +cuda12-trl f46883f48042b855afae128fbbbca64b5dc0c1700bae815951fce47bfb7ac979 +cuda12-trl-development 3ab8d9d96546920e134a8ddeafc4233580779490836db6f624ce7646373c3c8f +cuda12-turboquant cc44ca904d0c7f7bf2fa69df0bf76419988decec9ce232415b977aadd1da02f4 +cuda12-turboquant-development 7f6d763acad9bf214e5fe56066fb0ffb18821789ab98444895ce57b8b8409b12 +cuda12-vibevoice 9a2038446efeafc8957e276ab583f97537d90eb5fa3da17cf6e1478d6aaa78dc +cuda12-vibevoice-cpp 002ec5f79f204d61920a4d8e8b6c52623c859f0e02c9442a441b824429547dbb +cuda12-vibevoice-cpp-development 3d61f7f201f8b903c979a70b411d99d0b48afc6bb6ed5791d021e2d5a054e339 +cuda12-vibevoice-development ae4efc5b36c65d086ac22947eb863a4a04d09e2b5100310afc242db3cae4e9c8 +cuda12-vllm 9536ae142ea794f53686e36a481e581904339db22431d73238a339710206ae24 +cuda12-vllm-development cc5843776e5d8454779be2406a42cbb9966cdcd8ba313826b9249a20e842af74 +cuda12-vllm-omni 64f43ebecaaa55fc1fecba498b8c4da947c422f8491ff0f6996bd1859c979b4b +cuda12-vllm-omni-development 8fdade5f58f6755d54245b813598c0aaf388ac6f9b26d211ab13fcedbb367ffd +cuda12-voice-detect de7fb070aa45db182d221229dac384bf5eeb188e04da1a051255b94c549296bb +cuda12-voice-detect-development 8caf6d2f25411ec6a6d3a2878cbcba6bdea1c270df0a882bae09eeedfe79cdc1 +cuda12-voxcpm 35f38ad7a8277d2447f4149ba10856a30b00e19043ce3e5b870e9e3d0fe9910c +cuda12-voxcpm-development 555d41d1aeb466c53a067b04605661a2bb1e7c2b67ef6f902008b1abc2ba9f40 +cuda12-whisper 84837344c2d9c4baa868a9b59134810bbeecdfef70f65ecc33be87506ce66074 +cuda12-whisper-development bff11e0818d1449451cac86832cef3f5d55533b51de3944596fbcfcd4ab15027 +cuda12-whisper-medusa e1d2ed416e569e58b240ecf7963f2c3d94d22d527a770a132d0819231bed06d2 +cuda12-whisper-medusa-development 8ed0850ba986e6b19bfe9019575a01885ff1ed159fe42f39e8439d4430555b7b +cuda12-whisperx 00a6bbccddc0cc65a8d6800e27d3369e448027769f7ae1e5e5a913b6ea6ca5c8 +cuda12-whisperx-development a55f5546bcb7ecc043a6317e9eeb4ce698dc6c63c33e30dc63d949d735427453 +cuda13-ace-step 99e1c0f619632f10de4a808d605dff0221c4b3fa6749619d41d163b90e59b124 +cuda13-ace-step-development 2cdc10bcb878de9305453f1e0c5bca75b58309bdc49b7d4d2e9e32e2a53552f6 +cuda13-acestep-cpp 9851047f2f8b7afdbca06dea116429b6accf9a669f475b4190c04c855ba496ce +cuda13-acestep-cpp-development 6016351847b6bd4471893b17e4a61c5cc854c103c06d29cf301a95995de09862 +cuda13-audio-cpp 0be8181e76a5eee503998daf9753b92a748fa14df5b69b66fd030935a75e6f10 +cuda13-audio-cpp-development 01770ebf7dd3f182a40a4321c2895b75918e914f60e27b94556b463c7b4371de +cuda13-bonsai 0b0d6ab6bc09f8ac3e5f704d95bc21ff2b9c8a49de1b3039a1d54b93b07a8851 +cuda13-bonsai-development 61336a134e4b213d50d10339af08e9ddf393d409c5c525393d8b36c99ac4c776 +cuda13-ced 0ac92e37ef5a40506b074d56dbde76733caf3eb4b7f59e3ded3a475d07600e6a +cuda13-ced-development 6b5fcd46293b76a9dac822125bcff9997122d0d0187afd6798d73e158a76a650 +cuda13-chatterbox 3611ff9dc63329fcaad180f58aec67ba4aaa94b7992b5bee942883457c58a570 +cuda13-chatterbox-development 8f42a28311d89b139da250e4296f792f27d49a6dd7a75ef4eecc5a7636c62d30 +cuda13-crispasr 0c90cd0bc9884beb530264c21254f0304c8dce9c2efc2ca682c6abac732ca5cd +cuda13-crispasr-development ca9020264e6ca1fb3f0291923b777545fc17415f8ad1311cd5a7848bb22ce1a1 +cuda13-depth-anything-cpp 0874e4834aa6786f6a81333d21e35129accf54073f2ceccaebdd264d5a01481c +cuda13-depth-anything-cpp-development 6ac837e57002684b14f4aeb085b1575d03ff9fdab0b713f45419b8a4c2481967 +cuda13-diffusers ba1749e7b7f76060fc04190becd3204b4ff3dd06b76d260fd0105b6c9235022a +cuda13-diffusers-development efa2eac5e3ee8eca91f20d062c34bdda02ca74731c075ef8adedf8c7d6221e26 +cuda13-ds4 dd5cb7bf7dd458c67093fe6159362e7e8bb03e493ad69ec2ccf8b4a88955c8c9 +cuda13-ds4-development c0dd4e354b5e156c907f12ef05a58c8200b75791ebed3418a356173e4ad26b09 +cuda13-face-detect f731deb7b96057f1ef5480b57361663ca491b18e1b8589a025d07257e646c7d3 +cuda13-face-detect-development 00a1ee1051f9dfad212ad443c726420aab8f7685e3ea6ae16ec63fb7a177279b +cuda13-faster-qwen3-tts d0dabb2ff459c0545130b94ee23bf720df3326e054b2373a430ccaade49be470 +cuda13-faster-qwen3-tts-development 54b772b60e9f740af15c4ecf6c06e02d9051746495ca39a6adc552126a9161f0 +cuda13-faster-whisper 9e5244a22c792a29c93b4a5cce45aba0c1a672aadbb303f8a1bdb4a58d06cbfc +cuda13-faster-whisper-development 2c16b84ea7395545416549be14b404cb851b1ebd16dc7464c03ef83c6286d5b0 +cuda13-fish-speech 3dfbb3d075e9d2a2367eddc623bc22992076da2e91e45ef87845e6c7bd8da405 +cuda13-fish-speech-development ec9b14b55fff591d0fb52e569f8c7a7123d865f4f9667979506262bae28674e7 +cuda13-funasr 3b3482bd737c962be108e5f8a216227695b5289f7056234261080a12e694bb28 +cuda13-funasr-development 3911500e0189f7101c7f0e1fe40727a752967df91bbf879d49344561f7b7558d +cuda13-kokoro 5f49b78d6a8f583e7f727451d226318a92d5e092354caf1c1702c7f667a439ec +cuda13-kokoro-development 37a0bc04c32560ecbd0774721b5e6e0b69faae6889cf85829600fe2ed370aa42 +cuda13-liquid-audio ed946797b019ba791b9ca9899b3d7c7af62b8064176435ac4144f0f10799585b +cuda13-liquid-audio-development 1ee6e65806fe1f6229ba24b09d265fef6939194702031adceca4a2a53ed02361 +cuda13-llama-cpp 0d8350986e2105d6fb837f1e2a812281f8c70f393730bdec91ce341ea7b15984 +cuda13-llama-cpp-development e71146b09527c80cd817591ad57e762abbb734591f6b22d7a20d4638324593b4 +cuda13-locate-anything-cpp 69ebd49c7f6d60757987c70f01229c6e3851e34b3c56d995fb50abe9ab3e0102 +cuda13-locate-anything-cpp-development aa643f8d32a137db8acbb24ac0f64fa89fb004243e4e38fb1d7efe6c7d3d489a +cuda13-longcat-video 7837c48af7d5e96997412266390ca2332f8bcc22dd77fc9e0fdf7e305d99200b +cuda13-longcat-video-development 16ac0483822e283d2cd34856889f63fe2bc71c5d80376e4d3b69d4a63865568d +cuda13-magpie-tts-cpp 3689917ba61b2fa66ae82208caf6898489436733c5092677d9adcf576b59a60b +cuda13-magpie-tts-cpp-development 44dbe6043b864fdf2f4e107094a5cb731c46026edf0e813b19a6bf2269f37686 +cuda13-mlx f1851a7397b88e44ff129f6738e2faf3000ca3d4ddfa4b5b7c48341db14308f3 +cuda13-mlx-audio 11ad7bc9d51ef707047d89deea488fc3ddecbd887ca90bb8bf969c1202256dfc +cuda13-mlx-audio-development 4ab687c73287c6c21c170626a5b3b22c91cf65c39d112eaef5ee1e9a8c2cb1c8 +cuda13-mlx-development a9de04a68ff75f52bf34c72542da2145f558251a86e9bae429ad87a6f403e618 +cuda13-mlx-distributed 2618ffc861754fac108932e6b7a740ffa9afe713efbb77b3134e45380a4e2bdc +cuda13-mlx-distributed-development 6efbd486b0ca4a1da11d4b1907740dcd68ff401b7d4eec8ea4baebb90a646c21 +cuda13-mlx-vlm 9d143d9ae07077d709da16f43d62888fa474b63880004deff98c1c36ee09cbe4 +cuda13-mlx-vlm-development 6bb9faa9bad4fe18a9cbeee2238375c638cc81e428478dea3029a7aaaebf4cce +cuda13-moonshine 026c3d8c10cafe876190286471969950489421aaf4ef91365e7c8e3c7665e763 +cuda13-moonshine-development 86a8b2bb9c95b32fafc6335b144753e3f613d2a5f4fafdd6aa8c533188e370c1 +cuda13-moss-transcribe-cpp 6093f3e2af274312f50e37d34a902eb2b77f8295814677fe7af26152b1c617c8 +cuda13-moss-transcribe-cpp-development 5c50a8c258e4ec921195882e2385ea4f2ec0ad46da66d0e67357de7521867f9f +cuda13-moss-tts-cpp 6a3315c1f2382d8891768e256223c6f439050cc444a383ec9a9c4c1f43ced52c +cuda13-moss-tts-cpp-development f2c39be52a37aae51f2f9c1bec3dcfc15528667972ec31de3d47d6eccf882cf5 +cuda13-nemo f9b432d43aa5432ebaabb40f4e67434f71cb9b058398fd31d870aa870c9c9ffa +cuda13-nemo-development aab34d05d92ce415eafb6ed4620532aca9e13fa217abee3a6836332ff7269582 +cuda13-nemo-speech-cpp d4e97043881fbb6e6632f45e170d31a09759b15e16704f0aa18bd8f7f4eefaae +cuda13-nemo-speech-cpp-development b38abb159cdf292ab5bc2ea9529d243a0353a1df02628f9b24467af461ed5083 +cuda13-nvidia-l4t-arm64-acestep-cpp af22f4d6b049cb41e8b7bf283f32a5dd919d03ec16fba3b7c8a64fb7b68fd9a0 +cuda13-nvidia-l4t-arm64-acestep-cpp-development 65968f137ef42c5aab86da4403caa970a7591d4f2fc1f0774ce053c29310c985 +cuda13-nvidia-l4t-arm64-bonsai 664ff546bf523767b856560ef2b1076d0214b99cad52d41b9b0e72ce600467c4 +cuda13-nvidia-l4t-arm64-bonsai-development 48a5f9f000313b863e42e770efd1834bc77766bca54bc20dcbc9d2f17f067e32 +cuda13-nvidia-l4t-arm64-ced 5ac8d1bbe4d5adbcd5fe049cea150cfb5f5a2371713e077778b742c5111bc641 +cuda13-nvidia-l4t-arm64-ced-development f4a1ae920357a32d17f71231b9f2ccd45e0222f10ee6e0c440b42d03963bc44c +cuda13-nvidia-l4t-arm64-chatterbox b4f02c728cf05df5bc250dd18a19946c018e6355e127d3ccb4d15d122028502a +cuda13-nvidia-l4t-arm64-chatterbox-development 17300c4e93be4d4f7bd9610a1a99802244b76725501589c83517a5919cdfb344 +cuda13-nvidia-l4t-arm64-crispasr b5e72da51cb24a15f2b4d12f081ee5e849af8ece60561e608c3fc5db97e1a368 +cuda13-nvidia-l4t-arm64-crispasr-development 826afe87d22f8ede4209f19b63567f9790bbe57391fae47b9f8d8acdb8e1a761 +cuda13-nvidia-l4t-arm64-depth-anything-cpp c59693d46a9a1a3c0cd548d8832d37b4cce80e1a157e7c685a79e757ebba57e8 +cuda13-nvidia-l4t-arm64-depth-anything-cpp-development e6c6e211c1f1f7bf11fc8a9d4b5dfe71bd19aa616514f6e913909bdf558c6b74 +cuda13-nvidia-l4t-arm64-diffusers 4f270ce017f5702d77b1e776dc7313d9f99ec6d68ca89367cb827402f63b8d51 +cuda13-nvidia-l4t-arm64-diffusers-development 19b0bdfc4561edf3aceb81af56bb17f35fa39ac75193296659aa12f3671d175c +cuda13-nvidia-l4t-arm64-ds4 61166d711878e0c6b0f122720b69306ca3e0f6995a2484d0fdb5d63b78521aa4 +cuda13-nvidia-l4t-arm64-ds4-development 0b25fe74b58871380c40141fc250133aad930417e2ab584af1e34a5352bb25cd +cuda13-nvidia-l4t-arm64-face-detect 127813f4071ce4bc3a5120c9144179d27a18a5e8d8955efeb9306bdda2d1ec1b +cuda13-nvidia-l4t-arm64-face-detect-development 4968785374fa2086a5a8dbb86d95a6cbaf80a428995bde735fdf5e53cb3f02c4 +cuda13-nvidia-l4t-arm64-faster-qwen3-tts 2397d0cc509d9445dc440ede5ed6921cd615631bca1ddea67ab0f7f609f7d5f7 +cuda13-nvidia-l4t-arm64-faster-qwen3-tts-development b6f83bb9381ffafc7a4e9c4877a99455b5a668192e0f624b6b976a288d5a96db +cuda13-nvidia-l4t-arm64-fish-speech aa82c87424f6750e2b67e9574769ed2e81f878037b1193a86f016e67086763d6 +cuda13-nvidia-l4t-arm64-fish-speech-development 5bb6c84055222b2913455bfe941620c7bdacd238bfbfd40e2538d37eac4068b2 +cuda13-nvidia-l4t-arm64-funasr c34d5120bd774eb2d9b86d363a81da20482c94c35f6e74ff64bacba054374f29 +cuda13-nvidia-l4t-arm64-funasr-development 2d34783712cc9697762bb94f233787db4ecded6e1b5fcc151e81b341e08dbec9 +cuda13-nvidia-l4t-arm64-liquid-audio 151e6795486e76c00ef117a85ab8ed83fc03bd56cf14531cd74999bbf119d8cb +cuda13-nvidia-l4t-arm64-liquid-audio-development cc252ec4ea3a0a89d0dbd8de0b3dbd7a25f6086488a9741697ce304c74b67b9b +cuda13-nvidia-l4t-arm64-llama-cpp 98bbbb68cdc416e6656898ae16096eb52ff3f948f12f3d191f04345a570909e8 +cuda13-nvidia-l4t-arm64-llama-cpp-development 0b05ba7fc075464cd4788135917495805c42929e64afc3be55358a3145c8fe7b +cuda13-nvidia-l4t-arm64-locate-anything-cpp dffb7c19175541348914c3af43da986950925b1aabcea0a5c529383e4367c149 +cuda13-nvidia-l4t-arm64-locate-anything-cpp-development ff6684316a82b16dc5281043a3cf81c4055015e3214b44b78bcc6604c6ef2d29 +cuda13-nvidia-l4t-arm64-longcat-video a4bb71f81a548685da3ebb1e07d8bca59fb4a1d289f17254b37e6af0166bd616 +cuda13-nvidia-l4t-arm64-longcat-video-development 5755be39ce4f9c938162ffe50ff1b0af2a6b2121b320ce1866a49723a8c76f41 +cuda13-nvidia-l4t-arm64-magpie-tts-cpp f8eb9b8bbd0e00018a97e97277a0b794c8828b4f96b9a836a8650f984863e942 +cuda13-nvidia-l4t-arm64-magpie-tts-cpp-development 3cd3600d662e883783d78b4570d1751a783c12d99a2313870dd24fa90532bc28 +cuda13-nvidia-l4t-arm64-mlx 49d8a9de99d31b6ed9616738d7f84b3cddfa6bc62ab665c8ae9405525031f9d4 +cuda13-nvidia-l4t-arm64-mlx-audio d5b6bebdf64407e8f6f7e0310ce575d0c5392d5770b5e4ed55d1942851cb162c +cuda13-nvidia-l4t-arm64-mlx-audio-development a525ee4b576bca0e45a118b93a112c1177b68be6442ffe67239d0c0abdc64fff +cuda13-nvidia-l4t-arm64-mlx-development f5315d8781fbce09bfa648967f5b67a7239ea63bd177865ad395fa677634713e +cuda13-nvidia-l4t-arm64-mlx-distributed e3c1824b3dd7389f13601d639d6418de4e222877d233e684d85e5a4bc3c40cc9 +cuda13-nvidia-l4t-arm64-mlx-distributed-development 9e744a2d9137b6c025bbd2a32a273dd4a59cab385e48472648f72c035e75b29b +cuda13-nvidia-l4t-arm64-mlx-vlm 121bdccfc93df38bac69ca81f204a644ec9ff4226a0be49006fb3c796efde518 +cuda13-nvidia-l4t-arm64-mlx-vlm-development 06fe617b04853998bf52d4a54712e2821ca0c39ce316a51492093f1cad3a63eb +cuda13-nvidia-l4t-arm64-moss-transcribe-cpp a58ace6c4c67486fed58929c8cfd8fcff6fd795a2dd5e64fb275874dc332108e +cuda13-nvidia-l4t-arm64-moss-transcribe-cpp-development b4f5dc2b26b590421c02f3772d367b7bc8b6b08dd6ca925274db187a3f190998 +cuda13-nvidia-l4t-arm64-moss-tts-cpp aa9784593328ae8875a588cf7782144c950b5aa6a534ed843c9cdc4bb915e70e +cuda13-nvidia-l4t-arm64-moss-tts-cpp-development f50ec166e7b81a5fa6f9de2cc4b92815ce669dabd225b9f6223b0e697934cd17 +cuda13-nvidia-l4t-arm64-nemo-speech-cpp 2676cf7cde1bdb408868d904bda5727f0c71994f062e16a50dc3a4277c01e7a4 +cuda13-nvidia-l4t-arm64-nemo-speech-cpp-development 740f93d9b289e3868968312bbc259db353756534e9fcf447aa4613e9cf7a828d +cuda13-nvidia-l4t-arm64-omnivoice-cpp 7ee8091c9667c6b665cb3d588d4dcbe3bc3e177fe5ceb9f2a779af80e80cd45b +cuda13-nvidia-l4t-arm64-omnivoice-cpp-development d762ef19b1a9b1be4421ebdb3405b7343227f462aebfc50595538adf6d2bf845 +cuda13-nvidia-l4t-arm64-parakeet-cpp 2a6f9c85935022cb8abbf07c54a24ac5c6af06e5817aceafa13ae85291dfa584 +cuda13-nvidia-l4t-arm64-parakeet-cpp-development f3a31de350108fcf466bfd3d561c0b25de19b5bfd64653202f3dac8ce6b39f06 +cuda13-nvidia-l4t-arm64-pocket-tts 302d6975568684bda004674282dfead2efd1268534d7153a76769eb439207f08 +cuda13-nvidia-l4t-arm64-pocket-tts-development 6048897c2581ee047e577d3af248b88757385eac7903b9564f9e1b206ed156a5 +cuda13-nvidia-l4t-arm64-qwen-asr 0c000facfdcaa13c0cac14ca9e73ad815e0a2278c9afb7cdbbed47792030ef04 +cuda13-nvidia-l4t-arm64-qwen-asr-development 576659533d0d21eec8aaa049fd342ec3d0597680a8520a4359865ed251c9b620 +cuda13-nvidia-l4t-arm64-qwen-tts dad25512f0f803777cfe95754e0da1c0b9fca982d246902a79025a97d640f4a5 +cuda13-nvidia-l4t-arm64-qwen-tts-development b2af6213c4b0ac4fe132090af7b1382f79a9a190bde47ad20ecaad540c80a9a1 +cuda13-nvidia-l4t-arm64-qwen3-tts-cpp 1138df8772e3d84777c1614b332a4fa0628fc2cf6807d337a432f72bbfe2ebd1 +cuda13-nvidia-l4t-arm64-qwen3-tts-cpp-development 999c245023950ebf764b753111f73f466ed9b67090ce9c2d81d664a4fb345a4a +cuda13-nvidia-l4t-arm64-rfdetr-cpp c415287187940ecf2160495c6ecadd32d9b06624b1a59a5952f632ac7ea8bcad +cuda13-nvidia-l4t-arm64-rfdetr-cpp-development c21d5b9950073e130053ea6171bafae37bea4cfd974bd8d1bd095fa11ae2cdd6 +cuda13-nvidia-l4t-arm64-sam3-cpp bc6746f0e850151931d105909563c1ffb1e70c788dbfdc562847240f71e8a3ac +cuda13-nvidia-l4t-arm64-sam3-cpp-development 8b72ad5f3922cc845b223df236c981a3eaad7641ed2552b3327c8b811c60a4dc +cuda13-nvidia-l4t-arm64-sglang 732a678ddbbceba165f7df7e36359a465ed837bccf878ebaa1475813608e34de +cuda13-nvidia-l4t-arm64-sglang-development f303d86ce185f5b147441923ac48bfca0431410a930ac9eb914ab80ee09db39c +cuda13-nvidia-l4t-arm64-stablediffusion-ggml e20bbe642d908c40a6a6f4079317bbfa8edbd5a2aefd336400b19861e95bdb2e +cuda13-nvidia-l4t-arm64-stablediffusion-ggml-development 27ab19648fb22492fd8a2892f17f351d12328a4fc9c2c3d0c576eb2639e35908 +cuda13-nvidia-l4t-arm64-trellis2cpp 10b50bdf5c6188807ed4c20624a53deff74812b39477e1b882af5dcf51d9f5da +cuda13-nvidia-l4t-arm64-trellis2cpp-development b0a451fb32ba0b01137cecd3d2ecd0bf3f3686fc13d7a7f3afc96f4fe6c6e636 +cuda13-nvidia-l4t-arm64-turboquant 5b5031e40a9a18ffded72256503b8e0830152a3e0fb13db309b50dcc0178dd4d +cuda13-nvidia-l4t-arm64-turboquant-development 7ddb5c603fa90b1d15808fe62b0a22f4917abb25a30ac27f367454971a0bf8fc +cuda13-nvidia-l4t-arm64-vibevoice 6ee810ab005886a25a273cb5cb1b18387540789bf0a6bf6c42ec00f31d7f82ed +cuda13-nvidia-l4t-arm64-vibevoice-cpp d7e22a3f55c97333246bd0ce204eafb3a26a23eba4f13737c1b2d539b9cd5227 +cuda13-nvidia-l4t-arm64-vibevoice-cpp-development bfbb5d8041ee05e4701dc8405e5c9a04da09a8a895067b5c936d175ce3a257a0 +cuda13-nvidia-l4t-arm64-vibevoice-development 177c6cedb5f0e4d9bf539781b6d709148e9aacb0652878fe17acb05527959707 +cuda13-nvidia-l4t-arm64-vllm 3d26d512bada38cd72a8956d8bf3990e7348340681078af091730b4bbdc50c98 +cuda13-nvidia-l4t-arm64-vllm-development f17191c0140b9fc8417b8b36c16463540f72308bdd879c41dd9e99a4ce2b435f +cuda13-nvidia-l4t-arm64-vllm-omni 68ec75122b9412585ea0053fb7f5016f6155592a599a150eadfced61e9c995ac +cuda13-nvidia-l4t-arm64-vllm-omni-development 7ba33055f01ef77a092cf86a36bf12e3e726a2065281e29cc96cdf3c26579110 +cuda13-nvidia-l4t-arm64-voice-detect 8be5bdc710e2317087e6f73eda8ad260a1d5c44b248e7bf31dadf228863a8e2f +cuda13-nvidia-l4t-arm64-voice-detect-development 2c2b8129d371599df76ba68c36caa3e663fb3f0f7957eead0afc1542bcc7882f +cuda13-nvidia-l4t-arm64-whisper bdbc5518dfc0ad43de8e9e3351fe2431e92b1fd111448f6fa62544e008fe6469 +cuda13-nvidia-l4t-arm64-whisper-development 767bf21a2fd9c570d1ba9825b7c84db58e3cb07b7389addfd49ba49a6d9563cb +cuda13-omnivoice-cpp 068f185b987dfddbcb825a063ff4242bbd59ae9f51f9d132ad94bb55807278f5 +cuda13-omnivoice-cpp-development 7926336e51c264140a61529d59170482971d23df240d726c11299d35a138ebc7 +cuda13-parakeet-cpp f8c13c77440bb814c4127e163ac095bbfda5ee7d0614260945dc484db54a72b3 +cuda13-parakeet-cpp-development 41f21451565b639991873476bcdb17ad216d9b50ae00305333d6e038e5357d0d +cuda13-pocket-tts 75ae84dd4a862b4414ff5a9a9b54400ceaebbfdcd8a2787e72d56f23c19f6160 +cuda13-pocket-tts-development 15152aa3d312b5c15e353e7b15f9b677ed1fbc8a36a16e6e5757b73a93f28db5 +cuda13-privacy-filter 8562a495020c90baa11fee9ed6b11dfe7b8c2279db697981e1902844ded13a7b +cuda13-privacy-filter-development fa29968260e14a6cf8f668e77bb915cf26c1442954b9d345c4ca92ad7404e979 +cuda13-qwen-asr 5f439db1424603fe3e59aed2f47405322d31e80c219ea3d77e5f8e91bc5dd7aa +cuda13-qwen-asr-development 94c6881da46349825e6e8682e1de712c0a973e2b7f205701c02e209fc939aca3 +cuda13-qwen-tts fa80924d7de6c38815b0dfc72405cb4cd348d69ceeed4d7a5c3761431e024f03 +cuda13-qwen-tts-development 5574efca5639f6417b2190e7dc8e4d5c182965333faaca6ddbf41556e93728af +cuda13-qwen3-tts-cpp a4547b0e14c0cdcf3db4404e631f2fb7a8f89671c75cc626ac5ec39f71386039 +cuda13-qwen3-tts-cpp-development 54e63425d4a194a55542a37ec2870d5303eeda9eb7ebce82d02cdb6f10738e6d +cuda13-rerankers 369933a7913732463cf1084a4452fee5e07f7e0e5f0497f1b9703519f7f32f62 +cuda13-rerankers-development cbaa786f4c6c687db449797824a0a7f86f5d30b73835000abfcb9c21fafa33bc +cuda13-rfdetr 8785ba7ed0873189681572c41bcd66d7d632c96b28b2a0513d6a01758b30307a +cuda13-rfdetr-cpp 0e9a1d4db0ffd48b51e960e221c4882194a116c98f9933a6bf1e2ca9db585d77 +cuda13-rfdetr-cpp-development c84d4638d6e7d95536c287989eef0130f20a895e6277a97452d347237109380a +cuda13-rfdetr-development f585fb2a2e3e0aa73abe94fdfbe5fa07ff93026663a47f81221b81209ba3bd80 +cuda13-sam3-cpp 71f8395ea87037ae34739065e244961f3423775633ff89606bb183299d99c6a5 +cuda13-sam3-cpp-development 3cdf880015ac6111a85921a33fba4fe9f6455e16da92c42b498d522eec636c10 +cuda13-sglang 1b7108954eb5202b11902739c770bc81635106d5731f6905ad2b4e377c18f4b7 +cuda13-sglang-development 02dd6be561e25b71610d32855a2f2f64dd18eae1c4da86be7124c2dff43beeff +cuda13-stablediffusion-ggml d97ad363a552a61be963e9be475a0216aa3a8b8fb5d8c7d6a004336c781f26f1 +cuda13-stablediffusion-ggml-development 2e45387897df0095a0f5963682efb0a8b98fee09af3d7ecfa0a8cca967baeb7b +cuda13-transformers 69c2728fa588c5e418b42ca33564da6e0d83584789e490f624d42e90dab5bb1a +cuda13-transformers-development ce685f9dc8167ed94a6ab03ffeba238bec73e0f25dc5623e3e96c83b441411f0 +cuda13-trellis2cpp 6186e82d1e27180a0c01e585161ffb0a8eb4f1d16fb4d58d94b24c9659184401 +cuda13-trellis2cpp-development a89dcc88c021cdc61d19350897b1c8b3136e3547c38c60997cd5484152af73d0 +cuda13-trl dd28386ef9394dba37e1365d1411f91ee05689135337ef1b298968c3573fb05a +cuda13-trl-development 7ff53fb42a85f18e907ce42647cccdc7f63080ead66f02705802b596407e81d4 +cuda13-turboquant f7fb061931d4d66ace9e7e30f9919334c585bcf2a5b0060157609fc3bc47f234 +cuda13-turboquant-development 3e17d014d12a618a93902fbb8023164c253497e03c9fa72e466cbe1b915c2928 +cuda13-vibevoice 9030f3b4417bbcca60369c8d3de06c97b06cfbc3abe6337d3ec49a05a3621efa +cuda13-vibevoice-cpp 4d0f4edf184e9a0fc186d281aec5b1cc3b7cfd380d35f165c6e120ae482b5f82 +cuda13-vibevoice-cpp-development d663bce3be0add2b8782308ccd99b50770fd063acfd3b777a33865de15dc4a2a +cuda13-vibevoice-development 4cd79e24d5d832cf1434961e9502f7cc43698b748cd6fba26c3599be98014dbf +cuda13-vllm 801008cee773064492a1968ba477d3557f7d8ef9b4a34c3c710106d5c791b999 +cuda13-vllm-cpp 5ffb683db4ee5aa52d3d34d52f2faa5816661a6192f39b08d547227332d7f191 +cuda13-vllm-cpp-development 3c305af037f95b22d6609c0c010fcd957975189e275e77bc67161b4c30a0974e +cuda13-vllm-development 051fcd0586a7dd67e0241b40c138f2ec558fda685bf195004572dce022a0cc4c +cuda13-vllm-omni 4909ec847bcc6575b0860b8f2565d3b77b58251efd1bde1c1ccc35ac39a4053e +cuda13-vllm-omni-development 68c8a6026b936f9fceeacffef305c2d9782468b6c730356e896208532bfcf5af +cuda13-voice-detect 57695c1f3bad24e277fc00132906e2337a0c4e02af446b6f4ffb0a73ad73221f +cuda13-voice-detect-development bfcf9870e40a4a9d116ef9481847d2b0c3d53338b634b1071588b4e3b3bd970e +cuda13-voxcpm e4001aff4d0507ba6ed83fe437d52b805cefa9b0748b05bf6d664080a37a447f +cuda13-voxcpm-development 24bba5aa7f3f7b8f98a86c22643003510e8da15b4a1a353dca8c17ff7aa7da8c +cuda13-whisper 71162750148e944ffc636e69c357b5879cea64aec9b1ace4428bf151a2def598 +cuda13-whisper-development d98e2857c8381ea19f4f87b81225e55c655a3600009ed8517d4b1e650da64a48 +cuda13-whisperx 32ea9890152148c29acf2f0fc70b4184e36f498a1a3c78da27b385a970922b10 +cuda13-whisperx-development fe99d1de42fb05f850fe77af5ae06aa034ebfdba90a559349a3e3b3f7f20e08b +depth-anything ee0aa3488ea499a2d7f9acc4c9305fa5b3b4fa1278631add53d8138e7660e982 +depth-anything-development c463d3bf368bd5e1b101ffc6465d91dba68dcdb103d3bacd5861c66fd9418f77 +diffusers 950d1f8d1a0553cc85c056bf8b17b7c7197be9078397dd2a7f144ffeea9442c5 +diffusers-development 642b20330685029ce4be332cd542b3c224f3ee8896656834120ccbf27edc2f3a +ds4 3e7629e8349dd9ca5aa19138e39ed2dee39c3b80f4678478c2c2d4ca57d2f5bf +ds4-development 5d2e16754ddc4647b723c91d6b01dcc7d33279a810ede95fe6106dff6053d6d3 +face-detect a672e8ea766a8f3cb9258c0ce92ab2f76937c2bc8afdc565cca3568222bc5cf0 +face-detect-development 97725c137d3eea4350160b3fc2af90ca4fe638f0f5d51ef6a3a0aeb18ef9b12f +faster-qwen3-tts 97ace572f24e21ea28a94cb3fbb65ff65b79b2f7cc575f9129e7b5460bc7db61 +faster-qwen3-tts-development 39baf18c74254d76933d7d3cafbf1509c270e496d191d0b27bff43be54a60dee +faster-whisper 20fa4edbba5a0ff7067e55ec9610c025fa52f3deb23ef898a32f0d0403ca193a +faster-whisper-development 4e5473e7c522f8f5c4db013f1f6d79813a2ce94e25f76fb287c2082b3ab70a29 +fish-speech 06be596a419a0c87db0af34811cc020ba368fd04916b0686e6af1b3fdc5a477f +fish-speech-development bed1dbc4b17e5ea6f46c380af1b31ccfd69bbcb71fc8f5183a47c608158ac6a9 +funasr 07dae833abd60d804bf50143a3a4ea158f58616c97bb3db75c3c06762f98d9aa +funasr-development 621038072112c5e02419e237a74c8538f9bc18fb417bd5686cb8ab6416679141 +gemxcpp c438b9b50a76038c18888a8df93fc4c878dcdfa3b558771ee4f77aa709889fa8 +gemxcpp-development b69398af208c5981d07bbd5c98df55103d3ce4c050b57de762abd0c26f2356f5 +ik-llama-cpp f3cb7a77f87b9394d6e7c80ba346e34383b209f84302f8d8035b5e61f534bb04 +ik-llama-cpp-development 6e53fbc76300c203c83244871054dd1d198f1f898a4f4316471d90eeb8201a17 +insightface 1692706f21c4881e71fb0f095d793828951ddb26bdcbefe2f1941c5577c8e66a +insightface-development 4812ff68cf5541991aea11479a1cbb63a2641b2f2b4e3a06d4fa9972bb6dedd3 +intel-ace-step 62ce6792f6219c6fb913f815e589375b9f880f80e110d270fa321f20e255ae24 +intel-ace-step-development 5e2882a6a03f5f869a260a22e04ebd69314fb108d452485d3b1e38fb4e59a688 +intel-coqui 83fb223fa6de7aaa1a9576b558989892bc14942a322cfc479b1fa3b3192d0353 +intel-coqui-development e654de0340e4181b6e19ef4ec1ebdbea0cef48d6adfe2be3c7d357a70a361814 +intel-diffusers bdcc69b954985424aa9eb36b860d5312442ae330aa25b625359b66d079f9c20a +intel-diffusers-development a5a8c94eb98b38633a82677950c612cf4b95d0f80c7d2b76be4d897c8ca59949 +intel-faster-whisper 262b5808beaa05b025017cec82a203fcfffb038e0c1dd26762645a60c9580f78 +intel-faster-whisper-development 8a49a07ac0976ca2571d4ca657af7256f18763c0ff7de3bc958912be7743136b +intel-fish-speech ec7cc0a3461aa19db3f8d654c44e63cc84b765793a86c550ad86382e113a8b61 +intel-fish-speech-development 1835c311bbf7a207347a64244b6eef015d779577b5deb72121cde45c0b6f4ab3 +intel-funasr d687a1cce470fe1b2184d362ed7ed15f4c5b49080c5a40113b673ffa41733cd1 +intel-funasr-development c44626a8a8c4cc1ea575376338d31304ca9b96f0e54cbc7b6eb755998d93a1f3 +intel-kokoro 29a5b437b8587d95c41e4dd6e1d960ef227540c8124fdfc9eb1de586ae448c65 +intel-kokoro-development f30a3c5589959b72abfd9524453536c094dac2f05d190f20d8c59c92c0043f80 +intel-liquid-audio f4a98da010372594cf5531bbcaf09d39858c311a56ff62847756b514e0a08608 +intel-liquid-audio-development 7b5adc7a64c2330af5dd374f7d12a3a167b3352709d3ec3ea1f2178d6e866eed +intel-nemo ad7faba8a39703035ef45e86bd3af5f31e4f24a92a11ec7d5b9ccaeb6b142fc7 +intel-nemo-development 923f0f2cdafc2619bf5f41f506bca3165f608ac820c9b57c8e202208c3fe7b49 +intel-pocket-tts d9f77d793ff7b8e5ed7f912431650bd0faaf7fa4e293ade7d181b6838dbdac35 +intel-pocket-tts-development 10c7f2e6b8dbb93dc27241030d0cfbdf02f47d5e12aa9c83f8a4f2efbf1f41a9 +intel-qwen-asr 15d3982199afb6e7ff4c43cf47afb07ca66d6a28687c4dbae5354169da4b5076 +intel-qwen-asr-development 15f1d51bd9d11b7cae1288544b780c00cccae43d66455db81e6159e4dbaeaf9c +intel-qwen-tts 63b1bb2b670c741bc0e0876ed5c74d8c50e99a71bf547d619a3865b080082bb9 +intel-qwen-tts-development e9a1fa2b3231edf17ad6f930c8eb525aee73b1b85a3cb5c967af5b872ccef0b6 +intel-rerankers 45ddf8cecb628318fd89dfbce1fe28076d4c2481872eedaa0c2241bad5e72382 +intel-rerankers-development cf0fcd7c2dbee8eb35c0c5e56adeaeee0b898f713043ceb5de94650cadca4688 +intel-rfdetr 90b89d90c515b29e9133e8f1d6df09a2801bed8be52b4339f15edf9505257869 +intel-rfdetr-development f8937c2749fc82b97abc3968a4e8148366778a555917990f783671b86a9b8e79 +intel-sglang db9918ca0ec56afc1d87e26ca556bb98c3378303e071f383fb53c9d68f084c21 +intel-sglang-development 2af4ce0205c7520204790db5613fd83c96caf6510495ac43f0a65b9d05814a88 +intel-sycl-f16-acestep-cpp 51c79580162c30db6873f2ee584b80a829a4d0119cdd187b3e519f6f188fe66a +intel-sycl-f16-acestep-cpp-development a20ca5313345783c3c40120448dcbf4cacda726753f6456940ed5d46de553962 +intel-sycl-f16-bonsai d87e665164164b085e936b70ab35871272379880680b552e35c98f1564fb30ae +intel-sycl-f16-bonsai-development 3feb718d5e32403e488261573010fc2b56c460000203ee0d0df3ad9a2899de74 +intel-sycl-f16-ced 54fc98b5719b5f3e94067e5e796c248463c19e753f48e7fd59bd2d01a69922b7 +intel-sycl-f16-ced-development c70cd052603eaa66d87bddf67be134310cf1dd279178aa277c5ddbd60ad7cea9 +intel-sycl-f16-crispasr f97a74824f7f382cd1ab6aa228ca447891c19f9e01001b4e87ef3161e639f9f6 +intel-sycl-f16-crispasr-development 265c98f239235507d237c7258bbef3b7540dc769792e9f53e6966e367bb9ad69 +intel-sycl-f16-depth-anything-cpp 30171b5d8fe779846183a3261cbeb03fe94a5ca1bf07ff68545142deeac48368 +intel-sycl-f16-depth-anything-cpp-development 6f90a310159a4dedf5c20f4d16a58b30babbd17e5581156de0d6792168bf2fb6 +intel-sycl-f16-face-detect cd11cbba4ff87158121dba1fa96007f0a220b77a559ee4af7523c0c8690c29c0 +intel-sycl-f16-face-detect-development e9b4098639fcfa7e0a5fcbfc933839e01590ff5bea3bb518ca79895e917f0cde +intel-sycl-f16-llama-cpp 2536dd83ee83963a4f699e8bb1f8aa104188612180115eaabdd85775ceb69038 +intel-sycl-f16-llama-cpp-development c1e245c3ea6b9425f2b929fe0fc9b76f72348ff8c9005e11cc120b82c3ae141c +intel-sycl-f16-locate-anything-cpp 175e903e24cdaaa35ff124233333546b0ed0ca16ba859e130c7d432879de6995 +intel-sycl-f16-locate-anything-cpp-development 79c47b274a829370cf7d1082f478fd30ad1d67c1bd92d90de65ed37035cf6139 +intel-sycl-f16-magpie-tts-cpp a38fc3d3be72d3d488d44a40e41584c3abd494e3984adedac9844a82806a634e +intel-sycl-f16-magpie-tts-cpp-development 53cd53fb841893b22791264d9318279e4c3bd967628bb4cd9234aa8f58fe7d8c +intel-sycl-f16-moss-transcribe-cpp dd782d861b81f395b7e4a651ac46a7467b0b626417506940e50ffb7b82015469 +intel-sycl-f16-moss-transcribe-cpp-development 89aa753ba67a449d9985a30d41f817c78386cbe4ca2f5a58dc9f433e8c3f4f2a +intel-sycl-f16-moss-tts-cpp 07bf4f119f9c09e8124e62764a7e723cbc9f05ba51d96bb214799a992d39995a +intel-sycl-f16-moss-tts-cpp-development 34690ecd42ba64a3ba496d5c6a02b405f47fc037ad37700575478a366eea359b +intel-sycl-f16-omnivoice-cpp a74ca5ecf6dbac68d089f5740df1befe304a5effb0f839c4fa9ff0f89743fc43 +intel-sycl-f16-omnivoice-cpp-development 505bf211634754399ff8fb78d6afa81f04d358ef9c6483545b0d09995e82fa19 +intel-sycl-f16-parakeet-cpp 9b87a77368ba19d92cc21a41d2d45b965a735458a6a58dc76cd2f949a1495acb +intel-sycl-f16-parakeet-cpp-development 1370bf28da2b27c7df6f10187a2dfd882c414292030b94420cd9386ccdb36541 +intel-sycl-f16-qwen3-tts-cpp 69bb9e3b0f6551918886da9901b426b5789c8b951d1698ea74a33c4d19d68e5c +intel-sycl-f16-qwen3-tts-cpp-development 4a1c9bfe09b995ba291f0194d57cc38da152e7316ffa3d44d4ca99689bb13766 +intel-sycl-f16-rfdetr-cpp d7f3738c4eeaca5f12a3645701570d5bd0a03a70b13e9653b1ec9dc63c98e5b5 +intel-sycl-f16-rfdetr-cpp-development d2deaeb63293a106e3d32a4e3899505ff093101d9d062214c8387c39cc56d35a +intel-sycl-f16-stablediffusion-ggml 95fe1732f7bbe309a47968323912c2808a0adce59888ef35069383f98ff56530 +intel-sycl-f16-stablediffusion-ggml-development f4b559fc22de5556193a461193595fadf2360f865f6fcb67de0870a9692e8c0f +intel-sycl-f16-turboquant be52038621fa84650a39f06b4023ca5099d3de71008c09e8d58c23c08d3ef16a +intel-sycl-f16-turboquant-development 6fab0d61dc6db9a635a01a9fd97c2960ad4f5661a7f3e9d67eb1c6622dee8eee +intel-sycl-f16-vibevoice-cpp 801671d95dff100cf729e4eee7e9d2bac256560f26b4529c62e5ecdfc24b0aaa +intel-sycl-f16-vibevoice-cpp-development 90d0f35898de99368fd8e1f67fe35265561291f96115a695a7a99f718287ea07 +intel-sycl-f16-voice-detect d43554de96868038c633e8da1240fb66ed8f0583b725064d54e0ec8af84c79e2 +intel-sycl-f16-voice-detect-development 3a9f3535c0632c9e52d948b4503955473fc74e4ac842d89d0b08fb0a281886c8 +intel-sycl-f16-whisper 5c9bafab78fc9d43336e5cec0cbea3e03b485e538409520b15fbbdfc5e4edd62 +intel-sycl-f16-whisper-development d9b3616b9e3574520c1f5fc49a0d46da6a70cee173ae096b5bd23d9ed50d5cc7 +intel-sycl-f32-acestep-cpp 827322f1d02fe32aaaba3171eebb0b8c2fc9cb62a4c4c793d23035fcec666776 +intel-sycl-f32-acestep-cpp-development 8b9ef554f3e25f1cd3a5512bd54d035a9d747ed0c362cb4dffe525ce21b4f939 +intel-sycl-f32-bonsai 66322879eee6d0d1922d20fa0a7821b846ae3215c2111d2d02c965cc45458f82 +intel-sycl-f32-bonsai-development eee507a1944594033deeab71ca31fd7ea5edb402be61ced656415ef5e49469af +intel-sycl-f32-ced feea3b2756a6ffa3dc3d5f5b8881829d29d5c4b5b04105d2096270d92f8a7c3f +intel-sycl-f32-ced-development 3e85215e85fc85a88773ef4ffc46bfc2a013b966f6b845c32dc157920693d8e8 +intel-sycl-f32-crispasr 4747750e11d9d3954ea6a5a68ba53b62027db26be0f85a12c211ae0b6b121f42 +intel-sycl-f32-crispasr-development 17230acaac26c568d814f8db7007b645d2ae21c15dfeed019b07ce2657241138 +intel-sycl-f32-depth-anything-cpp e9de2c9fb8101ccb87ac1b9c1d899496eea29a24d54afc75e0aab1099ba5fbfa +intel-sycl-f32-depth-anything-cpp-development 9ca9d628dd5df15ee9660506ef8cbe51a7552ab94775efa2a060c983242c97d3 +intel-sycl-f32-face-detect 2982b1ca044e243fc5024748bf7834da5e663cd677734e900d08c5dc401235e4 +intel-sycl-f32-face-detect-development ec0f60d9e147cf75c956889101ff9352dd7b54643d898ef310001ea514ef5e74 +intel-sycl-f32-llama-cpp c1dc6392e91f1a87685774d9a5a5a872ecaffd4e0ffea5ffc6e77f195943efd2 +intel-sycl-f32-llama-cpp-development abc6bc2c2a470e49e1aed3ad8aabc62038a0ad955498b6cdf2d306e36c413e75 +intel-sycl-f32-locate-anything-cpp 8fbeb07fc123f094bc026178e32827a114376b2b8e9362fba29329f191590ac3 +intel-sycl-f32-locate-anything-cpp-development 1a81511142a83c6632792cbebbab51032cc208aafa7ab34bfb00600bf511466a +intel-sycl-f32-magpie-tts-cpp 6d02e6a54ede5231881c4e832ff876062c77c579315b069c606e08abc6ce7ff4 +intel-sycl-f32-magpie-tts-cpp-development 612c7813eb156c1a7b23b20f50ea60ec549c4734bd153e1ab69ffe7295cb6bec +intel-sycl-f32-moss-transcribe-cpp b1ab70ffcd0e4d4177a7397b90afe6c90592126f2a4c9f1a8e31040611a5fc2d +intel-sycl-f32-moss-transcribe-cpp-development 9eacd7d36c6a50adb35f41404b787e954589bb54160d157c7cb118d87e9d96ef +intel-sycl-f32-moss-tts-cpp 9845dfec4859b3ee8fafaa38ea32bfa2cbf9cb22807285d90389b191efb23521 +intel-sycl-f32-moss-tts-cpp-development 3288921500e80d091e042884a103ffbd1deaca0ae38ea8c37519a74f5c279cf7 +intel-sycl-f32-omnivoice-cpp b6af059ccfabe8aee924b439ff108e848aff393f34c497e7731601aa8056e8d7 +intel-sycl-f32-omnivoice-cpp-development 1ccc9f99e623c2638244d6e7c56482cc294ae1a34c72510da9079565cee6f9da +intel-sycl-f32-parakeet-cpp 13e84647f3b7522a98f0b73fb7fd58ba450f6b1f588a6125458c7e08aca98b6a +intel-sycl-f32-parakeet-cpp-development c665439685df07dc412fab97bbae8c58b1351031ca0aaa103b5da6ee5d2f5571 +intel-sycl-f32-qwen3-tts-cpp 9883611803a0f4bc171a6b83fe09cf207eab26bd10aec3396a9c29600dd0d44a +intel-sycl-f32-qwen3-tts-cpp-development 7b12f945a7ae02f03643960886946d1b0faf05e7dd81ccf12ccf1f3bd48e9e1e +intel-sycl-f32-rfdetr-cpp 34d5027a1c2b518231768ed98b27b91488e5cefd54467b271d6ac673626507e2 +intel-sycl-f32-rfdetr-cpp-development 7026f7ff281d659f7c351980f7cdee6af5c471ecfa596d3a75c04a4adfc9731d +intel-sycl-f32-sam3-cpp 86bcab9e9fa6fe8c36446634fafad3f2ac448fa00805b373935f77445dd8db89 +intel-sycl-f32-sam3-cpp-development e93565d5c985bb69558820f98e77dc2440458153e1dc1d0e746c7ba37c19d50b +intel-sycl-f32-stablediffusion-ggml fe4e5c6d288315789d5c854d0d444500087e5e33621a81e73682608b089df049 +intel-sycl-f32-stablediffusion-ggml-development 05e74e7c86ef7cffba2eca24cf8ee99cbfbca243ff5eb9d3fb7476e4c77c7139 +intel-sycl-f32-turboquant c999f9b3928303563627ce45fab8713e2137f49837797b04e48a44caac2b4d1c +intel-sycl-f32-turboquant-development ced567a27345dc472654505c340795a24e9c24a7e732c4ff674a438d11e03e5a +intel-sycl-f32-vibevoice-cpp cf8954dc62faccc73460e392ce605456e601a5576ed0f7f0362178dc1c125301 +intel-sycl-f32-vibevoice-cpp-development d7bbc24e69fd0dec25ceee2f818835da96983b0e59d3ed4a481abb555f1a2905 +intel-sycl-f32-voice-detect 2a594ede7189f9ce5b3b04319dc25e116207e29e1a7162150caf16ed07aff481 +intel-sycl-f32-voice-detect-development f300c28226160730671bf54185a4232590bd95fa5a15e855fd63fd14244130ef +intel-sycl-f32-whisper 19fe41a3ea8f6a70f861624949fb749906e6d2f8321d21da23590dca4d3f574e +intel-sycl-f32-whisper-development 23bd720f2a20cba6b4d24e1578df1b0cb2c70417ecccb73d93490de3b085ba72 +intel-transformers f9e9e864a06517c9f3052026f533939cc324996a4cefb0184cb96913989146b7 +intel-transformers-development a57c5ae4618929501cea450d4592320c70e6b1e22de0a40345ce7751b9bf294b +intel-vibevoice 370d7bf85197978e2eccbd90d888b523eec91e9b16a6b6a948e32b0e6d1cef87 +intel-vibevoice-development 679990a21d5c78ebbd05ea47a7a89cdfc135d6353c81348b706927b88505c7ac +intel-vllm d54db0ccb5be270de6b68039404efb9f64c3f173db4f7a4e50477ae1391a9576 +intel-vllm-development c621856ea7db0df716ff9b1d2a2600fe3c8a892a62c3fc3b96136d2fcea6a8e5 +intel-voxcpm 41870d0e98eee687dd27c6acb3c87305b41251bae274d63a698ceca912dcfc90 +intel-voxcpm-development 18510987d498863d6805389dc6e6976950299f19af97447fbb58ec1d1644a059 +kimodocpp b47aa90c25587479a89b2a01013be28bba46c31fe9bf832188e46f907341453a +kimodocpp-development de02c7f934b608e56c1d93834e2632d8832203fc9dc9a16b6262b8468038f4b2 +kitten-tts d7dff6c3adb26208887dfdb8cb408a3e2984cebc8538296c28a21064cd6bfc0a +kitten-tts-development cb30c88cfd9e353254a37b35935f9b4d73013b85f57ed0a9867ea3d3004bab20 +kokoro e82d6204152d0a193ce1237f018d9db36aee161f9c7c0264941c6b8f51b7c6bc +kokoro-development 30a26928839ef921a069d055f5c0f750434dada3ab5c0023e2511adaafd03ee1 +kokoros 5048779785215bef21bc41ad8d2104522ea9e8a7fe9899e91a5a8f07a6820a88 +kokoros-development b36a4c3876f03944cb629a521cc81eb70f836275ae47b2bdbe6a2d819a43e379 +liquid-audio 5aa50adb758b99f4ab4490c7fabaa31a6501927cfc981f92b17f3830e0a9efb4 +liquid-audio-development 09aeb9af2cec89c51596c7053d4dde680bdc0a9e3d0224632e8e65015a52b119 +llama-cpp c9a915aa113f55ded561a6de42248cce09f8feb4187e87bcdbdb98c4dfaa62ca +llama-cpp-development 3d0b607024d0b3923e272fab513dec0ed567441f136b19fd8918c67fb245ec0d +llama-cpp-quantization 0e4ae5fb2a71b700e6f9166b2ef0e5d110f8c4602c940fa1c57d3acdf84205f1 +local-store 36d7c772c7e2defc8340b3ef930ade2a2fd6a5103fe45661c0c73f0612112ff2 +local-store-development ea6221a29b56d48c935d7962e33155c4475173a023d562ef5283004b29324668 +localai-proxy 9955134c04b50060fba0c66c89b7b0da4813f81f867aa8c46f12710732db4f7a +localai-proxy-development fbb9efa2c1aeee7278104c297388ab6229ce0c0c9738a24bebfa5881b50653ba +localvqe b40e7fd7bf1887d7c9d67b4c4c4819dbf70cbcc31212fc24a329f3c31ef454d4 +locate-anything c8d36267b1317d1d3243735798424feb5e7847cf9c8efe4ba9d825a5611ae3ee +locate-anything-development ebbd5b6a208c1841c31d065961a6079feb3e1fc91202ff8c17f050ed343e71b4 +longcat-video 24f1c7560d1dacdef85d448e9c73d4564a57ca1d9282e3749451baac036c4153 +longcat-video-development fbc858618eb5b7435e5ee7518edc634a0003426648bf9d7e6a360b0c023fc250 +magpie-tts-cpp 382007cb00f2b7bd557ab71a487129992b2752a46a93b948bb1e299c7c2a39e6 +magpie-tts-cpp-development 3ace4793340721e39d2d869b36c8a9d8c470cfd83cc62b319509a423eac1d087 +metal-ace-step 2574a8cb9222d7f4fa84118b1dd34a4e746e6e990e4572618578e2d8070c7ebe +metal-ace-step-development 31b9e1eb5254f1b79a7a3dd6b91b921953ef23b9835d456baa28e4259343dce0 +metal-acestep-cpp e0f6cc119d50ab0aeb56f7c8c456dde43b2f97a3fb48750bc5fce4f756cf9ef3 +metal-acestep-cpp-development fa4c44b5c6e4d4c408b57ee314618dfc77dbeb40376dd71235f7a03408d1cff1 +metal-audio-cpp 6b80664aa311afcb0b109fcf26eab30230a654acd490c467d6fd4bdd1931ac2e +metal-audio-cpp-development 20dfd29b4b320e7f1ff05db59ff59e560e5b28f2fc34f87bbdde0bfd021d84cb +metal-ced e34af3c8f2027b170671feae606fc2921a1e1b3e03e17c9cefcc6826012d9fd9 +metal-ced-development bd3a267290413f2e6ee1e8fc1c44c7d996c12557e8e84b893a247265a188bde3 +metal-chatterbox 87e6f5a9e59a6b13d40676e4d46296590238318133e728c6247efcb9898eae9a +metal-chatterbox-development 2ed4b7c8aaae9007971211ff4c3aff4176cb7374abf444ef5aa817f47e251e04 +metal-cloud-proxy 7c18985365ec75e1bc803c67fbb445c85d3493a5429074e9f60c2631d4d9f999 +metal-cloud-proxy-development 496d9eb85c30df46e0141094d1f51d828228bc18fe2684010b1da8f317f3eb45 +metal-coqui 9099f974b35e8e224141cc6573eb9270f0604c38fd0be685b58842e4345c056a +metal-coqui-development dd293d0bffc34487fafa5ab7e3128feaba57363e98bf882a5f3bfc3465d3d5d4 +metal-crispasr be29a453dbc4a16e861a8d1765c8b9d15b75e0ea88cf3fb7b282245f3f146cea +metal-crispasr-development 38222e72133f58a2bb66063c02605f1774548e93da6c6c187c0fb5c4338edf35 +metal-darwin-arm64-llama-cpp-quantization 28016d43b86fd10e00af70a331f9556341ebebb167ac35b7daab2ddd2a1bfd70 +metal-depth-anything-cpp 73348de4a006ef857c7b20b7cc2a52c2b71410ccca4188e4627323e7be53e76c +metal-depth-anything-cpp-development 99e8605f5bf1a4d744d95cc21012829986ec6e14caca21b01895c00e913d85bf +metal-diffusers 3deb4b32ad2fd4f03e0c430bbb95fd47b171b8a961ae4953f3da3841721fafc8 +metal-diffusers-development 36f24f036800eea9c21e749ebd1157291a70c6fc3d2d0fceb56f6ef70e3b8e90 +metal-ds4 896e471c320548a1c5741acc9a2b402acac74a67309c466e526e24ad6c51bafa +metal-ds4-development 401d7a75d2b9c6f77faabcf376f14eeda5e13869acb001b456e7670eed5eaddd +metal-face-detect bee7b05c43070b7db7bfc6967aa70857e2332c9e0dbb76dff4e2cccbde60aeaa +metal-face-detect-development cd521000322223341d60cb4db2e2235cd2ab467a937996d5b652321517b53e75 +metal-faster-whisper baaa1b22a41a350bebb3af5333c1fb6dee0c565c2cd783fc23cf498ebbd6d352 +metal-faster-whisper-development 962152fec37ea3a4266b268923d9c8ae5f4c9e239614d520ca31d17441328281 +metal-funasr 068dc7deb81fa8816c243d56eff976c7ea2575fba8af9dcbc5767ba8e0f8dc98 +metal-funasr-development 33e8cf6169da1ce3f9c5528910a69e51a140aedaa7c0ff54f56af4929e8a73ca +metal-kitten-tts e5d17f7639a43564a410ed74ad1d440eb3762d2e4727d2943f2b01a26d13f61a +metal-kitten-tts-development 74d796c23d7edeb7b37f3ea3128d56d19c28d60349a804cdba7fcff39dfa061e +metal-kokoro 98a94376583c1273a0290a943fd43f7b14b6e3682b2b329c044d7b004724fb5e +metal-kokoro-development d24022b136abf0d9c690cd0de0965f84617d11e1802442522ec044135f38fb41 +metal-liquid-audio 98c135cfdc7a2b23426a61e49a0c87d265d542bccd99dc5e0c128d41fecade18 +metal-liquid-audio-development bfb9ab63d562a4d2b05c0b9a6b7f904bc551d0280f4b00e39059cc6add537b80 +metal-llama-cpp 57bcce78e31ab622f8ed26094372fdd638e5c1593f009016b0565865367eea49 +metal-llama-cpp-development cc157d7c83f7c8a9aeae5fd1c23370b16e762793de861a98d9f45d144dad94b7 +metal-local-store 64ea22cbdd27026a2ae16ee5f79e4dec42b47dde7360be5e4f9c2d4cb8c79c2c +metal-local-store-development fb3ce4d8b149aca59ad5639bf16f11b5a7e755d9a3751bcb193d295fc41d9dd7 +metal-localai-proxy 5eef5e30832bd25a3012ad7953998a017d8abd3c8c77f1bf4033694728f02e96 +metal-localai-proxy-development cd8c73e4b351b89399c22f606a2c88055697096aa89fce992c7df9904c71f3c3 +metal-localvqe 448a6919e288f9bb9e0e2052fa12472cc78494583581c9807963c799672cff3b +metal-localvqe-development 4cf0cc30f130345b47f9395b4b24ceaf3e1f2359363dd42c3c8ff0ed170d9ded +metal-locate-anything-cpp 4c00b50f0cd88dd1476b8d620e9d84392bc7b5afa829645d664a40e7be691553 +metal-locate-anything-cpp-development b4d50bcc3043739e4c31f9d250bd15a1aeedad0429c9fa9ec09316264407f90f +metal-magpie-tts-cpp 35cc86ee63a667183cb833eea65f8b895b3f16b4a9adfa0c164841dd685fa400 +metal-magpie-tts-cpp-development cd630c7ee09048473dc0f8e6aba1fbd450ebc4b386d86bfb8cad34c3d69975eb +metal-mlx 477c341ce559bec0f3149fd3730aca96dfae10490e07b1ad7a943d0ada85a764 +metal-mlx-audio 597800542ac8d23f4d94427c2a7e0c7875d2bc54a9015994bbe6560f0d852b60 +metal-mlx-audio-development 84fc01cac2e955dd03f4453cd318d6763cb5a1d42aebaeb3d5cdab6576249d46 +metal-mlx-development af003126228d65abb5b89c2f6161ce50a2a674e377d382afe9990d4441104be4 +metal-mlx-distributed 91d84f43eb68b4216a9ed0cb8f4791f4d2848ee48af99a2e9663c1eac1f382cc +metal-mlx-distributed-development e6aa3d8bb91ad4ec260dc191783161dd76a273faa552522d4a596f3d0a6c44ad +metal-mlx-video 125801fb853feea00f84981248c72ce1ba343625b70aa500fb0c3c3df59e3b4a +metal-mlx-video-development fe7323494ae1fd0a77c6b75d30128edadcec4b700a181e8c8780d1f7ce9f69ca +metal-mlx-vlm 085cb497b0b5c0915effe2d28d8225aa2858add78f5a8091cb1b05ee2f66ca65 +metal-mlx-vlm-development 85ae6c580b290c40ff4381c8f23d7c968584a5fbf1fa057365ba3edba9e6257f +metal-moonshine 084fd29bbee7d07d6611f68f168e6843b0405f3045e436e4baea878fd49e8c46 +metal-moonshine-development efa059ddbd3becf19b6d0f4d3c3705bf5b7586333642e4429c358f3b43ec599f +metal-moss-transcribe-cpp 80843e13bbf48a1b043dedef89e2e6f7d95663344594b65a40db1ef591a02b17 +metal-moss-transcribe-cpp-development c03730cc6c258e328401b54f4838b523d5f5419ef57c8440bd193f668ebd458b +metal-moss-tts-cpp 411968f9d8e7470e6b2088637fed8d2307e8d50120ac933e4e864bc9fd960ea0 +metal-moss-tts-cpp-development 96ad5c9c2b2665aad5ab9d354144ef49b1a20c6d2c678cb2e5d9db08944b7d9d +metal-nemo 29980c4a92059578b7f66a0dd9281fcbf88299d63b7df08d84b688db55e115a5 +metal-nemo-development 2aefdc36b74893cf0b5528965aaf86bc4909517922b2dcfa0e631b20ca7db834 +metal-nemo-speech-cpp 835d5db4198dc54482f4fa57c8bc8246754806afb95ea6d3b1c6d858b4945e42 +metal-nemo-speech-cpp-development 4a7c0bb528ae641a8e19b8b3901b44bb2f4497fd8f45a581451461e9a5ebfe1d +metal-omnivoice-cpp 606a83b57f2d3ca20783c393dc84da379aec3e2204cb0451a2b8d697a76a553a +metal-omnivoice-cpp-development c1a51c70091a4ef9bcc3fd4a16e404c9e3eace69908ccc5864c7ca1927649634 +metal-opus a6373c125d02546983455b366ce1b7fb9128d9bc0df3b255b04ee4234340b81b +metal-opus-development 0c8249619e557c6ceb4383d670aa3152c1dc80c4087bc4b9f2d9422504c0dd8c +metal-parakeet-cpp ac1f42b7625b74e6a26154af5465eb4c688ae4741784c686690d3cd09d6b722a +metal-parakeet-cpp-development 10971fa55114b75909ee6f302de00e5969800604495f0883d31a274b9bb37e36 +metal-piper a7a00a73bb509f574a05d436bb74ded84e14787c7c8ebaba2cc753f10692e03c +metal-piper-development b42fbbb923dd25daf7297e09c261119a7341c35e316e5818290a6f8669068f1c +metal-pocket-tts 844e1c182f06973d265c11abb1bd9d5ca07929e2331e02e2d22ee587bb33f077 +metal-pocket-tts-development a58e49e97879afa9a0cb8896b30e570a733ee5f172e5944a8d7024d96c84834d +metal-privacy-filter 56355330ffb1a4d040dcff4da94dafbdec0a98893bfd2a587057a7810ba22075 +metal-privacy-filter-development 80426a38b3ab42441b1cf76500b430d50c02f0c46f75a8f6fdee6fc8b75b7f17 +metal-qdrant-store 3b96e6e94b1149e17ecb90211f3bccb06efc1bc307caea82561d9a3f864d7a9b +metal-qdrant-store-development d464cf2a2be1c649f035718a7783f401e47fab2828986c35c8f6f872dc0ed091 +metal-qwen-asr 870416678c067afb95b1143026914ee6b66135cf6f916180a4093c463b468deb +metal-qwen-asr-development 31a7da0062f5ee2206e899dc299dc15e16202253588956768bcd23d29bd8c75d +metal-qwen-tts 40f1f1db37c9fefcda387f065f4cf37bedb67f36373516b9fd492aa60144c12f +metal-qwen-tts-development 65d1fd2202bd2bd2e307b38577ef3c6077bf3a58773880cae55ccd6e8850548d +metal-qwen3-tts-cpp d933544bc6b428d540a413c81a13b3a955c910374c5d1b3f5884fe69de16a6c1 +metal-qwen3-tts-cpp-development 9ebce917d69b85e60e07ca85d791ceae08442cd71768eae858e80f4e0fd803c6 +metal-rerankers ed06c03ee53fe697d2cbac4c2541f14e7dfc69c902a5095a57da6f1611357b21 +metal-rerankers-development 578072bf956e7d54cdcad4ee9eb5d92e9151ea23c36f4c8c82c648102e0ea6d6 +metal-rfdetr 6f6bdc5b07366afbf34bc13873dadcbf06bd61ad12f36798498254e286aea835 +metal-rfdetr-cpp 7f4e6bf90ff7b5753c8c308383991024cfaf80e54a42176e6674f003857575e7 +metal-rfdetr-cpp-development 84925a4ff6df041096a0196ecb075c76f5af8beff48a5d707311de498886e7dd +metal-rfdetr-development 7833ef705b127f237fc06420db192801a5fef2c4536465b8e63f845bffa52cf6 +metal-sam3-cpp 7a4a5920c9852b3ab1a56f79985a83a2d2fe8845e3f62c7b6f1ad95c47215cf8 +metal-sam3-cpp-development 07e0e113851fda43bc88af1b9602c970d4db646b197bb0f9087fe351449a3fe2 +metal-sherpa-onnx 199f670f478b0d1262fe9c36637dacea4ea661504c1636a47a32ff24c7fc0caf +metal-sherpa-onnx-development 2c7e593075b7f196cece4536e5f888f8c2b341b0753253dc2e937d4d6ea0f72c +metal-silero-vad 6b84a6e4e0c9ee1d8f625930fd93ea64907b2d00a49ac5f7560e5b3215abc88d +metal-silero-vad-development a1df86fc8ce265ad3d58a4ce9717eddce125e8f0aca09d6328ff9f3b48859ce3 +metal-speaker-recognition 1dfc19fd437f65892866344bcf64e27de1f6070afd02cb00afc0d4ebe0e243f3 +metal-speaker-recognition-development f5c196c99ed3b126000bb9a1a4a63196e82573866e77e5b6ce18bb97cd49cae2 +metal-stablediffusion-ggml 9c8e39fd6bbc3ed44403885e344f19d304db91c394abbf110ece564cd92ec06c +metal-stablediffusion-ggml-development 4732b6d6f5f804fd29faac0e88f2ee15ba74a99d2564e117bc7410684e8ba1ba +metal-supertonic 0078e73a57be0100a7851cffb66e549cd0054666cc30039161b8efc2a1e64838 +metal-supertonic-development d95b077af353d6bcae458cf4a6c4e058905ad272d6bab3b6dcbb98df5b0f4913 +metal-transformers de5c8b987becfd45257b3d5d3c2130217aa86c355f4bd8459468da08c3a9a9a5 +metal-transformers-development 40a5a83066d0d71045d3658ff2eca7e4bca4757827b59524d3d2c1fa3c3b6e2a +metal-trellis2cpp 5209f126880bb999876cfb52c7d67d7af21a2a41fc82b15e6216d71e249832da +metal-trellis2cpp-development f9ef25e7a8103a18dce8497a8400ad7d39bc85a94f5adaa8bba1d2b152b21abd +metal-trl 6774df2bf421d906054466e3b823a95c5ebf261a7256f27e320b6196c86caae8 +metal-trl-development 3c8a8126c30501bdee8cf6f5f611c913bd4fd4e9afe7a1098eb02fce3a89f26b +metal-valkey-store f7dd0a936d43d0358cf403d90d827b9e9c3462e3164929e1e375c6ea29dca549 +metal-valkey-store-development d39f77fa213291d9604ec2a7618a3964e822f1b707375016c7c1157d45ad60e1 +metal-vibevoice 373fcc0f4f8eb04646c074c0cad43ee00366d75317b28ecc5605bd1161222558 +metal-vibevoice-cpp d25a9028f45f17c9467701b60d1eed147d476fed92c51a3d96e407fd9fc1db9d +metal-vibevoice-cpp-development 8d96091e607d1b90f0e3ede04cf3ffdb6520265c5c6aa5990228f0006ef7ad21 +metal-vibevoice-development cc0c2881790270ecd72874abe7a7c20909edfe6db8c53960bddc2944eb2ba681 +metal-vllm 30a7a22d57e3ccf6ba0ab1fd493aceae2415875cefbfff451164f5de9850b10f +metal-vllm-cpp ccda2849bd029e9c899e23fc2ad6a3868692b2c4320f0507ae10620235ce91ec +metal-vllm-cpp-development 791cf66c107cc5980ac8181139fc6e37231ab6fea40104373b212a0fdb6e24cd +metal-vllm-development a89a25113ac0e5bd8f08e23c59046c525983f630b2ce41b18d4be859ed02f9ce +metal-voice-detect 0a4c2b9c446ac7ed95be589f1b844f77deb60edd686778d7b56192dbbca3a6fe +metal-voice-detect-development 0c230d6ad063167f204cfb130cfa3b252e4c99f2fb039c28afdba2a778a5094a +metal-voxcpm 0fd3db7cbda75ab6a73878615bc7a57387d0fb02bdf8eb2db37063d7fe266090 +metal-voxcpm-development 52a20100f1dbfc3ee350a5c93efe00e5be46c9290ca50c86bbb2b65ed61a4a36 +metal-voxtral 29024a00685b17a11876449b3975ba68b0d27b06538db060078bbb248e920908 +metal-voxtral-development e1b1a19fb099c846014456a1d9b13bf4d8bffc68121340341bca3f0ad981cfba +metal-whisper 653e3eba5625d283f0e19396567e62af285a677c4658e890fdfb306d1309a210 +metal-whisper-development d79575e13ce2b7a8ddf26d52005821e920f1c5097810f783af5b7ca15398f795 +metal-whisperx af919f8fae84216a67bed9541de674eb6f99ee65ca7eb76fb1028ddc464c2ef7 +metal-whisperx-development 7bc7aaa7a84cd2a0dae9fdcde334a088e5a61ea2a7bdaad905e421d08c8a813d +mlx da7bc8abff3d8c01fc12a1b044924e6a62981ae371e79fbcdaed9f3478769262 +mlx-audio bf4a3eee4c058f74c9328aa718313bc24735409cf1e091abe0644f267926344d +mlx-audio-development f58b7aa7e05830bd7cf987d2705535169a4b091fd1e5373cecfe899f31dfe177 +mlx-development 0f67808fef0522a1c4c0773a1259382f7ce858ad6300211522353d097d8755c6 +mlx-distributed 968eb0212b609949305e61654eab2f37ac9a075b93372e4c53fc549ef95b7dbe +mlx-distributed-development 2fb991595f2fd64abe8a3f27af2e2a752ea3ad92f15be79ee9db41721bc7cfdf +mlx-video e52a8b64c7612d698fed84213291fbe58b11a4b021b4fafd280eb23830a5a4ea +mlx-video-development a7ffd3db4644841f39c2acd79617f5bc0a36277953068fbab4e16b827b550a63 +mlx-vlm f5c3662b4ce5a16b12a611a65d610161baf8173c6561c846062c92f231637d2d +mlx-vlm-development 22f158abf7dad812978e1b9c936d476f024e455e51454ba83fe47114f3614b3b +moonshine 99dd18c40216ddd6a2cae67291e9aef95a789c7c7c4444e87cfa07d1e7b2dd13 +moonshine-development daf42a08b2f1b269518a521f35d468eed59f9b3a7936699f3786db762ef0244f +moss-transcribe-cpp 75483aba2b6fe8f4b490469b24d332c57b6c5d2346a8f6fb9b35cef73675efc0 +moss-transcribe-cpp-development 65b57f52aae3c946339013226cf1eef46233aa40de031f7dcdbf175e1268a6db +moss-tts-cpp 6c084b2cd560c34be863b1377dddae24b942814e4c6e7d9fa454c842fa7cc24a +moss-tts-cpp-development d2bdb42ad9f5937983b7c6a1e4368bc785726a09367fd95ec9c46384066d9522 +nemo 8daa5f110eee96650d380ae4a243dd1e77ccdedc5c82f07c8e583b87b707ff09 +nemo-development a1c5a2cecdb8100d261804994ebe7a878a1f1bee82824cd31e68e21f764fdd37 +nemo-speech-cpp 195e9e3efb16afb542c5741751595ea7de16c9b7ad6f26d795441e23d94580b7 +nemo-speech-cpp-development 4282a4e6452e993f68a68c775aef260ed04f5de7dbe15f91c0007812dfcd7ff5 +neutts d6e473f6691d3ad40376c5018fd08027cea432cf0f69f91a867725470bee90c9 +neutts-development 4751e8ec8c473b316adfbb9e226f8ce7cdc1c2fdb894bd46ba940025ed0e579a +nvidia-l4t-arm64-acestep-cpp 1bfa335b06b4fc5b59bd6ac59de9921db31d70126152050011743a91c337ecb8 +nvidia-l4t-arm64-acestep-cpp-development 708343701fc16b58e0d9b9807d94ccc252b0cb7323c7b601c59e332299239d0a +nvidia-l4t-arm64-bonsai e6f0be72ac4e0976c83db9d017f990b7436f4f02635288579e3969d32dcbb56f +nvidia-l4t-arm64-bonsai-development ee44fd4dbfedd3fda0d0a135e9012f8d81f951df4bad1e4506b043c5636bacbb +nvidia-l4t-arm64-ced 970ce02e4f7f905420d0afef645065af3161c948ec6d6e478bb3ba15edcd6066 +nvidia-l4t-arm64-ced-development e6ca3a508f3873b5f60482f874eead1042fc11d661bccbe3fec74c5ecbf057cd +nvidia-l4t-arm64-chatterbox e80986e42d64c26eb1690d72346db99f93a1b0763bf452ed629298fede373ef2 +nvidia-l4t-arm64-chatterbox-development 0995c7339b090cb85ff87b3031a2c99ef56fff48dfd6d1a3dfe7a303e2348a3f +nvidia-l4t-arm64-crispasr f21584d5e94fe852c7ec6818e785f521b3bfe480a32a597fa23b850704fe8215 +nvidia-l4t-arm64-crispasr-development 1596d3e356bfc570d4cee40df1c59e77508dd9353e0fdaa0c5f6ba7c0ecaf077 +nvidia-l4t-arm64-depth-anything-cpp 27bea4883cb241422cc275f5b4e517ccb47fbfefe1fce127828fd60b2c7f0d92 +nvidia-l4t-arm64-depth-anything-cpp-development ce323e2bf179959144886f3ee93aa23c12bf7b99015c8aa8cae3b7023fae28c0 +nvidia-l4t-arm64-face-detect 3d95a9fb65c25dd7e888e139cf44def5c7b3ac0a8b1fa036abc6a3d0e8953f95 +nvidia-l4t-arm64-face-detect-development 893d7ff0fbbca5beb35c55a41bc56e91589188fda0b7b7f7da11cacf871132ad +nvidia-l4t-arm64-faster-whisper a80a1eea7c21193d78add1d2262495e69d5e54b04152f9e677ca3ee7af079adc +nvidia-l4t-arm64-faster-whisper-development 2b191e5e99551a660f1e191a43724500b365ab31f98a6920b8e2bbd2952ff661 +nvidia-l4t-arm64-llama-cpp c80a35af275ee5d184d233ec9c7924b122a96a5daee56e3570ba3841c07a1b21 +nvidia-l4t-arm64-llama-cpp-development 449728b0fa4361b4674fec7a5376cbbd56385d7fdf83d693ffcbf676882df5c8 +nvidia-l4t-arm64-locate-anything-cpp ae3251d75622b19ac155caa47152ec21aed9f00d4be7fbc478a5b371616366ae +nvidia-l4t-arm64-locate-anything-cpp-development fce041c2ac8c54f92bbbe8584d6bfed1850ede5bb09bc8650745e0a372aa8b13 +nvidia-l4t-arm64-magpie-tts-cpp a4af53343c39205d60186d7bc913ce1164f7c1f637299e60196a43dc57e1ecdc +nvidia-l4t-arm64-magpie-tts-cpp-development dee17a2f0c9efe25b51f68aee5b6787962c5aefd6812fb135318ddf69191a51e +nvidia-l4t-arm64-moss-transcribe-cpp aa7e19264973b72f50194a8aeecf0e87b3e70879144ca7d8a308f0e69b870bda +nvidia-l4t-arm64-moss-transcribe-cpp-development abd2e658b650525a16b59112318b43e6a4cc9488da38a6a281461dd50be1d1d2 +nvidia-l4t-arm64-moss-tts-cpp c120cbe849f585453a1a6753a7a38c7bb6740caf41191d92a3b1e09ba8372899 +nvidia-l4t-arm64-moss-tts-cpp-development 3efb5f1b57722ec380b3ed86897d3c6fc7e004336c70719d38cc3e44892b685e +nvidia-l4t-arm64-nemo-speech-cpp af3b23665c5cf06438fb1b5a2fc4eb1f16606e1e780d79c909102d6bd87719b8 +nvidia-l4t-arm64-nemo-speech-cpp-development e43ba525d090ee238ba980431240713a482af6814b5bfc5c225aa7a3493a16db +nvidia-l4t-arm64-omnivoice-cpp 04209e8cfa0c2a86df0206d6c76d1b0a7c31a92292b79b56666e3d966e5bbb02 +nvidia-l4t-arm64-omnivoice-cpp-development e15dbe2014c82ba8e8ab3d975404603d14ed04c2c8dbf8444ff76faeea1acb05 +nvidia-l4t-arm64-parakeet-cpp 3a2b1193417730219006573cc7e0871c286a1936394ef58531ddd0fd2bdbbc73 +nvidia-l4t-arm64-parakeet-cpp-development 27a3344a2ac86404b53757a303d68d621543825ec253ac04a66ddb0654344439 +nvidia-l4t-arm64-qwen3-tts-cpp 80f2cda9bfd77cc79b36b7d90bc864ea9c9451264129dfbeb1a1460e9e4c30c9 +nvidia-l4t-arm64-qwen3-tts-cpp-development b00cd5a3c8f7ce132d7ba6eb5741993a2d334c8832d902c7b1db3dc321a686f7 +nvidia-l4t-arm64-rfdetr 50753af9054bc33ad44750a358a8035863ecde7ddc77ac26e402476eb37c7785 +nvidia-l4t-arm64-rfdetr-cpp 83f9d561aaa737c630621024532b4cdfce5047288d8fa7237000db73fad55d4c +nvidia-l4t-arm64-rfdetr-cpp-development f7af5e73026b95536c0c1f2b8d6045c15fc59d7ff19dff522b809221478d1b0a +nvidia-l4t-arm64-rfdetr-development 2cda456c5f202856788b55d0326b7e1cba8c4472e0e6f2cf74feafe2611743a4 +nvidia-l4t-arm64-sam3-cpp fcfeff07d24030d89bfe3c45aceb6e38835b0e8f3d86389d902f68f79ca2dad5 +nvidia-l4t-arm64-sam3-cpp-development 4ecc3752a1101050d3835bddcae68778eec300ca5c7accbab47b8f0ae88ee7bc +nvidia-l4t-arm64-stablediffusion-ggml 3be1d9470a83ee1a979fb30b6dba53ad9b090dd834306df6dd1591a4b861d054 +nvidia-l4t-arm64-stablediffusion-ggml-development 6cb23d23ac1db64df907664a11ada01e03cb2bfb5f1c0c05cb001ac52159213c +nvidia-l4t-arm64-trellis2cpp fefc4659fbb6aad7aefd8a046b5d6ef5f1c035cc5199facc9e8533c0ac70322f +nvidia-l4t-arm64-trellis2cpp-development af1d0361b300dbc5ef5e673a092344adffb42e5d6c88878c8d72209bfebd246b +nvidia-l4t-arm64-turboquant 7efe0f43d03197d061494306c134a030ea54d11a7845d886776c98890dfe2b44 +nvidia-l4t-arm64-turboquant-development fd1f4cc889281309658430483ab7cc4c2878b47ac52ec9d48dad2bdb5bbc65a0 +nvidia-l4t-arm64-vibevoice-cpp 0c2ea79aa554f7ce3d053e05378bc5ead00331ee983c460f66daf57e04aa0526 +nvidia-l4t-arm64-vibevoice-cpp-development e30ba8f8abda2bc081ba39d733a200950d4aa77bd6dc5d708c9b5fafa6e2ea05 +nvidia-l4t-arm64-vllm-cpp de5b89fb3e923b6dd003e421eae84d65c2e12bbe146f517f10afc40decbec0d6 +nvidia-l4t-arm64-vllm-cpp-development 61c4d2d4946158c293f1ed9b59c347b90c5fcdc8a6dda5b5b1f6652dee38184e +nvidia-l4t-arm64-voice-detect 3b585f2a9cf066e67e386cf3fe13e727b8ad5617b34c24c30c49db8425263461 +nvidia-l4t-arm64-voice-detect-development 9166dcfa01d2b3d38b66d7dc1156ae55100ec6ec444e4ef7e067ad8dc383363b +nvidia-l4t-arm64-whisper d1b6ff2d45f5d1cbc593f1b3e986aec738d573ada303b80bc4337ee166efb8d6 +nvidia-l4t-arm64-whisper-development e5411a0ceafc81fa906d745ebbfac3face8f122b6f627820626dd5fa696b2cb5 +nvidia-l4t-arm64-whisperx 8cd0f215e4f5f10560f96e2e9055a8488ed4cc951c36afccb37d997ab4cf5066 +nvidia-l4t-arm64-whisperx-development 195dedbe9212a0992cd47d5a595adc40a4a22a04454dc600e8b25834781115fa +nvidia-l4t-diffusers d64388148b84cb8f30a34d16183cabbc67c96e0c05eaeb58b2522b1ed18599fe +nvidia-l4t-diffusers-development 41d560dcba7dc858d3916c9c0e3325096070a2d98070063041d44ae984ac85c5 +nvidia-l4t-faster-qwen3-tts 08d464b38dd86c3e4f49c46b3bf993a79f1d23a5bc4f9f9da80e2922f8143497 +nvidia-l4t-faster-qwen3-tts-development b65b3ec05eec2dde3a7dc95fbc12a6d5b92d8eb777ac7b356be6a5f85dde6571 +nvidia-l4t-fish-speech 5bcc0896a1d9893a7052fd6f39d64d35ca3cd67534de80946084e1f1a27af85a +nvidia-l4t-fish-speech-development cdcee264c3e1837bfc1787c2e8cb299695b6ef1deac3f939bebe397eab830ae7 +nvidia-l4t-funasr 833c6adbf773d4fa73e326d236497a437e8c3d59ba1c525c52dd12317d5960c3 +nvidia-l4t-funasr-development 8579dbcc3ff8687f362716db0f890e430c9139172b7d11cce7e099fff8cbd1b2 +nvidia-l4t-kokoro 29154d5bb22084797de3b4f284b62dce5f154ab114cb2d233383497153188a41 +nvidia-l4t-kokoro-development 2264e028d5cf6137a0c9445bf9ba2d381083399d141dc2878dbf9a92dcf799ed +nvidia-l4t-mlx cbaa483a71e69e71b5e1bf3c9ddb949e5b76b2ee5fa47b2ba388bcc83797e427 +nvidia-l4t-mlx-audio aa9f3071ae900b330d974e5099330a283594b8239818051fb1ea495f3d2e6794 +nvidia-l4t-mlx-audio-development bb3eeb35bdcfceca15a70bd1b7e48d46315ef771ccc6a3d7c280e4f0db61913e +nvidia-l4t-mlx-development 1aed72fb52ec71e1644bbcebf49beed2cdf9e86812385dbcff91c54dd70123d4 +nvidia-l4t-mlx-distributed 764d5e151f1830ede9afebe6d675638b20ae9b94f688b7dc1b272c76180cea9b +nvidia-l4t-mlx-distributed-development 90decaf9e079c76779c69bc1d5d499b3d7053434b4b7e8406ea9462e9e901201 +nvidia-l4t-mlx-vlm fe85ae03218ab8857215681ea3e8b8e06bc0dfa25f65ca57e4f10681cc0b931a +nvidia-l4t-mlx-vlm-development 0fc205bf47ab628775b675b8199e34fc8e670336bf63f2331e0583e69ad79b51 +nvidia-l4t-pocket-tts c2e3e24ac7b17a60bf36adedd785194fcc1babfa42ce1da2271ecd061103c071 +nvidia-l4t-pocket-tts-development 2152313dd3e8034df372166a7efb4dd1b77acd409e5b062505d2744cf0a51a46 +nvidia-l4t-qwen-asr dbece0af4e1912b284b80b2c7953fa5c9acd681f6c61a911b1fa11a0a02471af +nvidia-l4t-qwen-asr-development b3b27f7d6457ec8209217e5c95a8f53a99bb335366e6cfbefbb87c32af359bfa +nvidia-l4t-qwen-tts e2ce7fe0c7202db7bccab9105f0d3cb97c1c90e88494eb2959e5de1e10cc5368 +nvidia-l4t-qwen-tts-development 4869d31d764a04408024046da3036d0c6b357e036964e6cf4dd0dfe94690141f +nvidia-l4t-vibevoice a1c8b33dcddccce22008aae242199c26458211a65aaf7a032da53e6c59bfd439 +nvidia-l4t-vibevoice-development 14ad01921bf928b2e4749565a0f84dd5474b1b5f5e3a6693e1217d9e0e3bb9a9 +omnivoice-cpp 25911bddf14021a1c19c84e441c3d80e02b82c553e57b4116c0b36dde926eef7 +omnivoice-cpp-development 842d39d48238e12d59644a509d761c09de235584eca96a6d48970c2453b65711 +opus cb9e47d246b00c430ffbc634fcea0b13afcbbfdebfdadfed3925a2dbe42ecc48 +opus-development 8bce2fe1b3f0ca23d2c458ab5627996fe79360db48bab837d069c0e27c7054d9 +outetts a8cdac80a84572494c187c24e19816d8bdfe0e966d6bb43c02fdac3dc63cf29a +outetts-development 0864343351b3730ad86eac91467e9070a8b7afb7913936bedef80deeb2576fcb +parakeet-cpp ec52ee85aa96c06185ee65b0ad3bdb50bb5264ac21c627975fe3737833a5d68e +parakeet-cpp-development 064f77d2c522568f2bb900324b0ab3e01a220ae86bc10e4110a06b4a1a9c91ac +piper 42f81d532738a397f2591f986c4087948f7728c625d42173790d4e8e49660e5e +piper-development 440ac3294782de8e97040ae289b48dcaaa4ddac1120fcbf638af734dda527380 +pocket-tts d09139c67f400b9dd74084eec130492156b3e2528625120939ea92e06c08fec3 +pocket-tts-development 7a8ee7a33adc8be376e23cf6b00e4f7f79a767e4179144ee72019d21235ba3f7 +privacy-filter 16a8e840d073e6c912b12193cea56cd693fe7eec184a9f468983751845b5da39 +qdrant-store 1223aa897ed0a9347cae542597c5236d086d991bc86f0d41b380be710e5e34b1 +qdrant-store-development 2aeeec2f13491bfbb7200070ccaeb4865104f11232e8b744ce003ae0c4c3f48c +qwen-asr 560530a1dcfc758e26452bfeca7cd35414f1befa3d50d65f54634087ebd94032 +qwen-asr-development 2b247c9db6d30c4cd1f4a86b599cfa3193cee232c03ea6af75280baba3e61323 +qwen-tts 7aabb0882f9fe3f1772e0c8aaa36946479bc61ff9e520929f660bbb1b18361b2 +qwen-tts-development c31b67ca01c52dc664bd3d02cd02a9096133acacee6bfe119ac650f83e2258d9 +qwen3-tts-cpp fa69aa861da9e86ac4f6e1801746a6aab06cebfec8cf812fdf6aba28ef26fb32 +rerankers 396012f0b1b63a7f04a366c72b6d77d90b87bc1485929f7a78ec95319da93fa3 +rerankers-development 3661edbbd2662eb38a313f04ec6ea3414d948b0f63c39fd112e9ecff1d470127 +rfdetr 4212ab3eee69ee8f07841b0132bc6cd6eecbb73dc5362038170c6358938064eb +rfdetr-cpp b7c72e1710d8bec6f1dfc240abb6274495a9842bde086e3a7c088a09cba0279b +rfdetr-cpp-development bfe3f7222c330dd36291dcfba3046dbd305d7d52fbb572ac65db85924a5ccc35 +rfdetr-development fd74567376f1b14ca919edecb1787f7e8c49e9ca857746a7719cdf4acafba013 +rocm-ace-step fac6e836ca5d38551775f5d6883e107d3766a40683544a5582e9cd9efc099304 +rocm-ace-step-development c6bb784e8e5550b7caadf5515a588e01c7e20ae986d83d207e297c9da70539d6 +rocm-acestep-cpp 634ed1a19752a3319bd66be9b2044cc7a8a964182df0ab1de532c73f62169cfd +rocm-acestep-cpp-development 64d04aa0c0f7cdb668fe237a9bd4270af91c3e942b0bccb3247c0d3925a880e8 +rocm-audio-cpp c8a197558e3717c07d7def6777dadf264bf431e313bd206e91cc010a22f2c282 +rocm-audio-cpp-development 7cdf2299b6de3e3c9672aa4cddf94c742ff5508d42ef99157d6a10bda4b8b48d +rocm-bonsai 2e78a3eff4faf7ed0eba6fb53c17ee7762dab9f6f489530a9dcfa1bb7b398532 +rocm-bonsai-development 9bd9962bc8f75cade6422f0847251c01be0d3ae71bcf16aec6366d96ec2bf4d1 +rocm-ced 927a7c3f5a3c26824b011f7b369193f067ce7ecc021893fd9ee2222e86133959 +rocm-ced-development 050c2cc871f1108764edcf49e6efdd8f7c23d6c545980ca9202f634004a2912e +rocm-coqui f6203513b46526567ed945d180ae807e2c3b947379cbb7ad7c264f6783364fb9 +rocm-coqui-development e71c5ecc2fab5ce9e6c3a20739d4542f73172e19f3664f1966083090af07ff3c +rocm-crispasr 6c5d5b2e22cd596b85e38cb97496c408782bbd8b0cd90d6ab16f02f766c858d9 +rocm-crispasr-development dca8a53f3aef91937077eee782e69710ac874cfea5e6a18b91ba6ce7dc32c5d3 +rocm-diffusers 29a6cca31167148cdb2a6cffd5258111334fc03f7e9780478dd99a41b8082359 +rocm-diffusers-development d39f8749eb552a6851e2d757e133cae2569c1db9bfd8341517b7452ba1096e6c +rocm-face-detect 0647e3a8442a7d81d156c08e9b1800066a316641ed667c5245b7672cfda11ac9 +rocm-face-detect-development 13a05b170ea832d5dc888574c244ec3b67b19a62dd0e440270209bdbd73baa1c +rocm-faster-whisper 0379fd6f1de24c0dbc4f8ca09153b045cac36e88dc044916ad864e331a526842 +rocm-faster-whisper-development 692d65eabbb746aad8b4bc4828461ad5d3281168f9ab58f7f8b1dbc80e415561 +rocm-fish-speech 105015569e15be57b1e2a6682e55f94c2928dfcdb86f3896816974f070df8c42 +rocm-fish-speech-development 7b3d84f3daea0980f2e7c074059c02c1a9dbd9a9c8be7319bf5d76fa5411f7ab +rocm-funasr 33a464dc6f8d8ff9c7bd8d2b9614d66e9f8f4b5eb88ec026400ed218be0a920c +rocm-funasr-development 56f59a140ce06446ee6c2e2c1ee320df3fa1318ee515a847b628f92d94e7d3aa +rocm-kokoro e6938fcdf2b7bb7f5656d3fa0ad0241d4775ae0f994eb89d07c1799e09a408e7 +rocm-kokoro-development 01d809272335fdc06f687feae8725ab2a2b080453b6263b2e11f854fd76ff660 +rocm-liquid-audio 6a43532475e2d8bb27a069a15e5207db550e00e8624573b1627116ce3b40593b +rocm-liquid-audio-development b3e02e6331d54c8d28da0d9d88eda46655712d65be1785e801f324a05be1c824 +rocm-llama-cpp 3769a76cf777fbec39497a70ebb71b21427d9b0e2a461b102378688eca142210 +rocm-llama-cpp-development 5779f8d22bfff14cf0ba914b6e94bd16d731e8d0c3be878e3dedb7d0a3b8bb8a +rocm-magpie-tts-cpp 867b637ba9e90f0d5f5af2cd57a6473462f064c74559b9217d039c28775ae2a9 +rocm-magpie-tts-cpp-development 11861569700709512cddd3f88c72eb06a9bdf083cf96803c3eae019fdf899c39 +rocm-moss-transcribe-cpp fe0d5526d7ab987de907ba6a0abf66d7649233f920ea756a4f9243fd9f1b325b +rocm-moss-transcribe-cpp-development e7aa1d5b0db0c4c35a7be38932ba019165e021019ca3987968646f5624330bbe +rocm-moss-tts-cpp 65da62a07ac74ade89059859380839c24418628dda61e0175711eceb581520fe +rocm-moss-tts-cpp-development 0b211278993f323869df2780b44724cc33c7a10ea750f903e153cf8dce4ccc50 +rocm-nemo 0053157cd34c098e25c61911c8ad7e670d2279f1258fb28a74a3c0c7e11fb797 +rocm-nemo-development 1bd005409ceb16c727db342bbffef236f5b89ce4c925b01acffb1f3ed80d82a1 +rocm-neutts 9a1fcd21ae3300044f170e0fbce85412f0287f23ea7f328ec3a69dd62906086b +rocm-neutts-development 1f1f4437567732feb039f8fb16ca1de8fa24c333c62ff5c823a3bf634e258fed +rocm-omnivoice-cpp 3d75ba1dee84e4d600dbd0bf00051e448b27db2763fa802d3f2aa449995c395e +rocm-omnivoice-cpp-development a330e08c07941e19f46b717aacc391435664dbf4d60cad57ceb53c015c4eddfc +rocm-parakeet-cpp 3abf84f877ce7bd1fb581d98fe685475438044095197e4a5d4c0923be1f3696b +rocm-parakeet-cpp-development db10d32f01fa6c372bd7415ec3a2a72964283fba6a2afd932c752908ef5b1d61 +rocm-pocket-tts 4bab1cb5c0b5036e9c334480e2ff88ec5947b1203e5afe8ce4ac91e3cc0c24cc +rocm-pocket-tts-development cdde7a92ef743690ce640a26842d2ca3543e1905df141a97e470db19d6041a58 +rocm-qwen-asr 9764a0aad4f050ee3c2116c61863cf350310dc26a297aad9173a43ac782d6386 +rocm-qwen-asr-development 2a629712f71333c36b1f44a24d74c1f21373321c2c6e9105f33d91af0d0ef115 +rocm-qwen-tts 86404699a73d3b09ecd77e560f6751974464682e2993eeaec53f5cd28778e52f +rocm-qwen-tts-development 853f8621a5266ee28f91eccf47ce387efbee7ad85c0c4815bff04e7ca1d45120 +rocm-qwen3-tts-cpp da50e7af4f593fdef9c87ef609faed5995c8aff0894d70a3851c2bebb8eba9c6 +rocm-qwen3-tts-cpp-development 51af09ac8d0dfdf397a849153f6a099254818e5a513346163865c5a1f92b5ba1 +rocm-rerankers cc493e9ead71dfae46ac8a0997bd0fa2ad0759a6c4e014b9b39450f4f86ea8b8 +rocm-rerankers-development 5b882b09a31037c60de1316e619dcc39b9272e481933f47f3aaff6579d200b48 +rocm-sglang a1cb9bb17e979d911728c86a1c4629dd8cbf9074af75ada4f39c58361a125f31 +rocm-sglang-development 35da3f095197ab273f96ff96c439c8c9048aea54e8522cb33e71de3b00bd6b4b +rocm-stablediffusion-ggml 55e3c0a35f94677f9f12e4568167cd1449c2a05a99f05f506758c027d169f880 +rocm-stablediffusion-ggml-development c92dec28ade42195aa656d4319a04973307c38a5473373d694ff06903cdae25d +rocm-transformers 89ab00fa5c981ede21c5a14b235ac86e3d256c772b64bef4a75418489fb3827b +rocm-transformers-development 8ee12381e52b732725a45a8f811696b484acebf94bcb1cfc69669c59b016d13a +rocm-turboquant 927eb0ccfa7d79f337da24bcd8b34f95ec3ae33359cb39c50f46a19e59ac6e7e +rocm-turboquant-development 72170b2096e360c999b2f431917600776ad8f3e76182b512689da9be3d3ff43c +rocm-vibevoice f15c7d9d837cc4a54ce81ef4db7bc031d2a5e1b7dec0ea9828aa71b4d9fc24f5 +rocm-vibevoice-cpp 874692c8cfc2b5ff41f0978754a33081fa40e75a7f720ca75297cc9ea774330b +rocm-vibevoice-cpp-development 666a8d0f81191e2a0468b2ad78c7d8208a1cbe52d98b4de9b64c9bcd47f37df5 +rocm-vibevoice-development e4ce7e8d0542a39af9454871333bfa8d7f7116a371fb16b1b172c866752c23ca +rocm-vllm 59d1ab1b07569aadcc49df8d689074ab4ed179dc5431b8c4c721abfec6846227 +rocm-vllm-development 8bc85d7eb642544eb399b1d6b80720df4afb00ac3fe391c3ab8b9e9540aaecbe +rocm-vllm-omni 06bb4d6de09d42606e1f383b914a68d4c6f57527eeab0c1c195195290a292efc +rocm-vllm-omni-development e5ffcbdd23f766821a8d46df51caae67178691f28c2b72dfbb88243d2859bda0 +rocm-voice-detect ccd822e20d72c0cbb5d518bec2cd75212ce8252cdc812f9c88ffb608d674c0b3 +rocm-voice-detect-development 419cafbd7183d81ede55595022fe833c98b46abc2e8c82345a85956eb2b50f52 +rocm-voxcpm 15b372178eabbe10d9768c93af298940042795d715476be7cc65493e822de822 +rocm-voxcpm-development 3f280bef336045ecfce2585d9f792e044db40bfa4d2768b60361ab799f83e097 +rocm-whisper 45155690777e03b4611a5c80842a8df1cd8ecdb77c54f7c634960b959197580a +rocm-whisper-development 246a4d108e172296dc0642853185ce5789f44852f290ae25b1e59ea5b9f16dd2 +sam3-cpp bf343ccffe925ca453d35185c3921bd5e9e0d070445f8c63d10400d6c87bc608 +sam3-cpp-development fb828809ac726296398c40195c95e6053bf939a6f35cb5dcce236eba32122f76 +sglang af692f67dd2e3713f0912ccd3c531b660a07fd51f54d04c2d411b10ebff172c2 +sglang-development 1128b9a101c931edac29a559fde1e62ace0f8b175b8d912e136ca243ea70ea88 +sherpa-onnx 467981e1060bface43cd21877bebd4784e46de4672f8ee51eb5ac44bbd6296d0 +sherpa-onnx-development 0f0e5271b9f8819bfbf4144bc63f8003b3f93b54bb7d41684a45b32502f9a6a0 +silero-vad 407b4ed0a4fe4d4598ddc240049d94715f35a76a01642d3fc157381029455c13 +silero-vad-development ce5fcf965036ba7518361aa1dafbd49f7b0b7d5a00fe78b5f45feea9568138c4 +speaker-recognition 7b4ca650ebdb49a599e4d513a2894cddb15777a61d82800d7bc14270fa82dd8c +speaker-recognition-development c672ec02e5aeab3054ad1568453c3abb300e3ee647716d381836b7ee1d60aef0 +stablediffusion-ggml 205a78dd10ef2bd196c627ce06687cdbac68fe8e3b640865799b60903273ac56 +stablediffusion-ggml-development 58bd3710b1cd63065d14f92dff752450196618bc6b412152a817a8266a8b3363 +supertonic cc2fcb793f0ed2a90c8d333941305f404a138d333000e2358926a4eb0f810992 +supertonic-development 9ab90f677700e763021588b3ad6cccdd54874ab487ac45208d6284ed2e84fb32 +tinygrad a2149395bc3c5de3fe430ba6e2b41453247b30766e4fee44d2b885558536eee7 +tinygrad-development b44d094eeae01bec01d0aa8345127ebdce50d9720e6a91b27f96313e83361079 +transformers 3a3fd2b5203a9d196df071fd1bef287c994c555fa1da27e736b3d335fdc9a8fe +transformers-development 65307dc36e35c36c556d8c8d6a13576e8626f2846acb10b1a8c2a5f1656465a7 +trellis2cpp f348a950d130d415863017f06eebb6d6b6a91773951f410b63011d6318016a6b +trellis2cpp-development 4e2ff771be65ee050651b113d2d257a93df06d563c7edbd093dd75c4460b6895 +trl 43b59e2b9f2af929ea489d5a48e13ee16b4c7357f3a29c8d921427b9c9e3dfa7 +turboquant 94d66a3fe13e5f7e48a3b93b1ff46a508907cf48125a5c0a7d6a111934ec09cb +turboquant-development 62fcc7ac2653a44616e13109212fe2cb291ec1550f03ca81da08f264fbdb02d3 +valkey-store d8c2571a17632c8fdf2c7f4decb08fb9eb3466c59bc37563499e8b1681e84a04 +valkey-store-development cf48961504ece41a2cbae8578726dba0835e25e653c0d815998985de23abc95a +vibevoice 658254651c82be21455d1e958b94466b5201472d4d2bb5245bf4c10f15b16e24 +vibevoice-cpp 98c6890ca09c0000df59829771d9266f3323e20c0f2b926b88336e1ab26122ea +vibevoice-development c13b8022a5c4a6b1154c74aacdc2c32c915eb80a9473061af58a1d02e1e02d38 +vllm 8996b4b138a1bc3dd9e310de01a65c15444f1017c977773c222da324a678856c +vllm-cpp 9a7f218fd3fc733913fca9ea0055e59a3e2b2c8c2ee8e4abc85f576e6fe7914e +vllm-cpp-development 671ec5adad6806a7b80126313f711c3d022b49ecd56b593dcf931d57469b49cd +vllm-development d983aea38d5a2a6ac9a171024324744ff7471555146ab69a75cb852fa99caa62 +vllm-omni a8ca127399b34527a4057a24bc6b2a8f44d3b79273a9bc79feb453ee8b6eef5d +vllm-omni-development d967dc2358a2cb5b08af718d313575490575dc494e7bb37e69975762b1946c1b +voice-detect 542fe2b2ae00c06451e5b249d9d366d177a921c6514a4514baa5932196468e9f +voice-detect-development e2f78e2bddd858fdb2e05fd844bbc94b9873d23a4e45fc79c40e08856f54e304 +voxcpm 3eced03ae2dfee41f93fee61907c8364632e54bad21277110ae8cf1aaf5337ca +voxcpm-development 5fd07758179d9a740dcebb8a433787305fc0ffc6109a6ea1bb3a5e8ec76aa795 +voxtral 61aed7e5cee1046d76b7d0b4195dc6a99cfed6cfdfd757c80791c87ccf83e79c +vulkan-acestep-cpp b8eaa5db4dc18550cecb52af1d568a0a21c241cb780acc3a0931e21d346f18af +vulkan-acestep-cpp-development 701bd9fdd1a5456099f8de434828576321baf34207bd827cf29a85645cbf78b5 +vulkan-bonsai bbcdf3220446a9eb0637d709cd74f3150f19ca099ef0381c02595c5d8c1c919e +vulkan-bonsai-development 8c987464de2cc32068f738a9570d278f5a25e664aebb4981c0cec9c379f766a9 +vulkan-ced 6966b8cc17bf8b6f8651a537cda7f28bee047211b3e15ab37fffa71c24d57c4f +vulkan-ced-development fa503e3eb5791c6bd4da057fa4ff9518b9226e10ae29d562299c992e4be0671d +vulkan-crispasr 10b69320e4b3a2cf645a64111134b6e85d921a8e8eb3601cabeea6ee52f4340f +vulkan-crispasr-development ed374c38cb3eb905be0ecebc1cacc1178cab77eb0421710610c5ee2ff5fc93f2 +vulkan-depth-anything-cpp 6953863aaace2e3207ca20d529f16c650989a3ac2c31231a8a71e230721aab0f +vulkan-depth-anything-cpp-development e38ccd7a15a31304b9e1666a4180db76e962136d1e6da4d9d215d4451771893f +vulkan-face-detect 7ef4777d58869ba13c06abed5f7ab6cfd9d603eb7bef6fb7d1a96049570eb498 +vulkan-face-detect-development 46f080c7595bfb7959e758b49996f48651c2d2d7fb3cd6d2b534a4d4b530b314 +vulkan-gemxcpp cc72fa5c112c998fc11b95b8339a52fb3b5d94993009929579d432572d147fd5 +vulkan-gemxcpp-development 271ddb097208e959e92811ed409b70c8dfedc4c49419ee56acaab421277b72c8 +vulkan-kimodocpp ecf3fefbaa27cae0e335674b141911c08ae6ad81683ff89d287f68e1715e4013 +vulkan-kimodocpp-development b7d13430a3c70b90373778c5b3897bb46e13205d581b8e7334149cb7c5290f29 +vulkan-llama-cpp 90208f0b3a4d9f581ba2089074d8264b5ff6dab610c24b8880c08e1aa4ca8aa7 +vulkan-llama-cpp-development 84621334d00577c8d22020293aae937555b917c3b7f5390571dd920e84bd377e +vulkan-localvqe c633fab3bcd722f78bbbc091917093df516ca43fbc5df3f65c243f5e31bc70ef +vulkan-localvqe-development 287af8175be9a8737c566fb87874fcba822c5c1e486d782c277cbd8b23b251d6 +vulkan-locate-anything-cpp 56843eb7719cc54559d3947ceadf1722bb91e60f01e223fe133e483c7f4071ae +vulkan-locate-anything-cpp-development 56ba874ba1fcb3bc4d9a805eb24d0ea2b446f84d0ca117002371113c99e36e58 +vulkan-magpie-tts-cpp 1f9af76963ca6bf45f0ba46f78e751ebd6472ac853cd1f4e1bdb68d3061420b2 +vulkan-magpie-tts-cpp-development 57cca5fb4ab712eb1371e7a267b0757c82e4c1bf9d0dc5150f9630500ded26f0 +vulkan-moss-transcribe-cpp ddd1dd5f89d32d879a96156893643c927be9bd69334ecac662d8ec343bf81ea5 +vulkan-moss-transcribe-cpp-development f157fbf46c232e6ab1feb6dd1cc3ebc8c4b86a3c3e26f5468d9720f6f2c927b3 +vulkan-moss-tts-cpp 5d28f8c5d48b14016730426263916cdbaeb9d7038bd6ffe8bac854106df1579a +vulkan-moss-tts-cpp-development 9e454c163620894cfeb48581b62799de64f913f290e1c7b47fdf9fd5012ef9f6 +vulkan-nemo-speech-cpp b0f2e64e2c34c2365b3b6bad982058b1f991b0adb442bd0c1fab8c9d42b4ef2c +vulkan-nemo-speech-cpp-development d9fb5dabc9faee7d71ff98d8e0f99ce92663281a6d1fdc0d7fc5aff43bd5619c +vulkan-omnivoice-cpp d495b8138eb868b207b6d38ae51451ffe5001bd3711cc92b22775c8a9c401a09 +vulkan-omnivoice-cpp-development 69450574f6734948567d26a89b2147d8523a0c509a18b1a435c48d9615db1079 +vulkan-parakeet-cpp f82a5feb3cedc8cfe893a33459a5088503dee82708651fe434268fd36bcf5948 +vulkan-parakeet-cpp-development 49132cb4f87204307ad883c9fe3be8aa47a2d7fb1877c466330cbc4437cee11e +vulkan-privacy-filter 8c1408601e62ee5920d4aebc6fcb4da364d3110641e79b3e42060ebedda97c52 +vulkan-privacy-filter-development f3a8efb63b3d3d7e778a871e455a5745f87e5b50b4a3671d5902175ad9fb5bcd +vulkan-qwen3-tts-cpp 375513b531702229732df5d4cb46537b1e534ca3638e546343590d3c89e386b2 +vulkan-qwen3-tts-cpp-development b9ce109416df52130ac19df9d65bc24e2293f19675c429f60dc53600fb9913d1 +vulkan-rfdetr-cpp dbe8d90bd9d69be30b5ba056013b6812fc9d00f6ee8dce111e6c544017505ccd +vulkan-rfdetr-cpp-development ebe531e34f7720872a4b697ce58c02820efaf81c42040f8a2e528747757f3f56 +vulkan-sam3-cpp 0cfab6b85b27ba5645b8207a8a74c5152229253ca95bbe200f44bc32c1b6af54 +vulkan-sam3-cpp-development 5863d3ea762c2d6c1c4c461a7299e7ab3cf83dc2d179791dd454f70d699d918a +vulkan-stablediffusion-ggml 11bb3db733669a7ff9d01bb49e75e02a5e93991cf075798c81b3566645b27c0a +vulkan-stablediffusion-ggml-development f491b08e54241709137b3fa535990c625421875e745fa486ba917a8ff4bb27a5 +vulkan-trellis2cpp c5ca33c1fb2a8781a86d3a8e93414091ac8983d75ab07c0bd946fa70235bc20c +vulkan-trellis2cpp-development cb0c559507c1fc7248e3db8a333c2f5310b585c864c2561bc7563a31ff22ce05 +vulkan-turboquant 2c5ffa932d8c2a652bc290e1e6d633935a426e97cbc0662a5e56cc7e8ea2dc35 +vulkan-turboquant-development 3c4b0c6dd02f24f3a3b4bc242f8b4fd414ed838e8e974e7490095d7bc85ae2dd +vulkan-vibevoice-cpp e2c878fec7079cf161cf70cde780e0a7903ef683e50db53b81341e72c1d555db +vulkan-vibevoice-cpp-development e19397ca23a81130008faada77d4272e1be1d8b5eb6dc509d00720c3bb67edca +vulkan-vllm-cpp be03f9598abb98cc11ee35e90c4d4402a8f3fda141515eae47ac9d4410621748 +vulkan-vllm-cpp-development 8360f9231c6442d875c31bff7f659665d2f8577394ba554b7f1d93ae93b68fd7 +vulkan-voice-detect 3fc7b0ad225f8cc4065a8f5ea7e23a6764450c4b2cdf0c742ef0459504b4bac6 +vulkan-voice-detect-development 5ba4be3a83fab869886499437ccf5165a7f4fab791aa636f043375f185cd9a78 +vulkan-whisper e9c7f87d660965c8cb6cc01a7c515989643a36725cd90badfa96b848b3a647cc +vulkan-whisper-development b57d018064aaf35583bb8236b79baaba8db5a53aa5c9dbda9f48dcef05fe780c +whisper 714797cea8df3ef6769d698043caca307cecb7ba46709dd24514f96aa0a58a95 +whisper-development 4283de40a101863711164bde41ae3cf27fa40ebcbc31c34717f25ec3e76c06ed +whisper-medusa 698f2abd2f0ca5b88a50e6c58001dbf408c616551dc6ea07f5ce905d657389ff +whisper-medusa-development 59e1cb5b44797541e7a74b5a23b5bf76569d690ef01a2dda75aa53d87468e7b5 +whisperx 31b4ff79d633bc3af42be4325d79df8250bd883c4d9e42cb6745c1312236d6b1 +whisperx-development 2d673b5ac6bfdcab5c2aa0775c0dd5fbf177b3a947ca1941722f33bb9554d3c7 diff --git a/core/gallery/testdata/backend_library/gallery-before.yaml b/core/gallery/testdata/backend_library/gallery-before.yaml new file mode 100644 index 000000000..d9e75c73c --- /dev/null +++ b/core/gallery/testdata/backend_library/gallery-before.yaml @@ -0,0 +1,7488 @@ +--- +## metas +- &llamacpp + name: "llama-cpp" + alias: "llama-cpp" + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + default: "cpu-llama-cpp" + nvidia: "cuda12-llama-cpp" + intel: "intel-sycl-f16-llama-cpp" + amd: "rocm-llama-cpp" + metal: "metal-llama-cpp" + vulkan: "vulkan-llama-cpp" + nvidia-l4t: "nvidia-l4t-arm64-llama-cpp" + nvidia-cuda-13: "cuda13-llama-cpp" + nvidia-cuda-12: "cuda12-llama-cpp" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-llama-cpp" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-llama-cpp" +- &ikllamacpp + name: "ik-llama-cpp" + alias: "ik-llama-cpp" + license: mit + description: | + Fork of llama.cpp optimized for CPU performance by ikawrakow + urls: + - https://github.com/ikawrakow/ik_llama.cpp + tags: + - text-to-text + - LLM + - CPU + capabilities: + default: "cpu-ik-llama-cpp" +- &turboquant + name: "turboquant" + alias: "turboquant" + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + default: "cpu-turboquant" + nvidia: "cuda12-turboquant" + intel: "intel-sycl-f16-turboquant" + amd: "rocm-turboquant" + vulkan: "vulkan-turboquant" + nvidia-l4t: "nvidia-l4t-arm64-turboquant" + nvidia-cuda-13: "cuda13-turboquant" + nvidia-cuda-12: "cuda12-turboquant" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-turboquant" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-turboquant" +- &bonsai + name: "bonsai" + alias: "bonsai" + license: apache-2.0 + description: | + Fork of llama.cpp (PrismML) adding the Q1_0 (1-bit) and Q2_0 (ternary, 1.58-bit) + weight-quantization kernels used by the Bonsai and Ternary-Bonsai models. Reuses + the LocalAI llama.cpp gRPC server sources against the fork's libllama, so it drives + these sub-2-bit models with the same OpenAI-compatible API as the stock llama.cpp + backend. + urls: + - https://github.com/PrismML-Eng/llama.cpp + - https://huggingface.co/prism-ml + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - bonsai + - 1-bit + - ternary + capabilities: + default: "cpu-bonsai" + nvidia: "cuda12-bonsai" + intel: "intel-sycl-f16-bonsai" + amd: "rocm-bonsai" + vulkan: "vulkan-bonsai" + nvidia-l4t: "nvidia-l4t-arm64-bonsai" + nvidia-cuda-13: "cuda13-bonsai" + nvidia-cuda-12: "cuda12-bonsai" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-bonsai" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-bonsai" +- &ds4 + name: "ds4" + alias: "ds4" + license: mit + description: | + antirez/ds4 - DeepSeek V4 Flash inference engine. Single-model, + optimized for Metal (Darwin) and CUDA (Linux). Requires the GGUFs + published at huggingface.co/antirez/deepseek-v4-gguf. + urls: + - https://github.com/antirez/ds4 + tags: + - text-to-text + - LLM + - CPU + - CUDA + - Metal + capabilities: + default: "cpu-ds4" + nvidia: "cuda13-ds4" + nvidia-cuda-13: "cuda13-ds4" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-ds4" + metal: "metal-ds4" + metal-darwin-arm64: "metal-ds4" +- &audiocpp + name: "audio-cpp" + alias: "audio-cpp" + license: apache-2.0 + description: | + 0xShug0/audio.cpp - a ggml audio inference framework covering text to + speech, voice cloning, transcription, forced alignment, voice activity + detection, speaker diarization, source separation, voice conversion and + music generation, across 30+ model families. Consumes audio.cpp-native + GGUF packages from huggingface.co/audio-cpp/audio.cpp-gguf. + urls: + - https://github.com/0xShug0/audio.cpp + - https://huggingface.co/audio-cpp/audio.cpp-gguf + tags: + - TTS + - text-to-speech + - audio-transcription + - CPU + - CUDA + - HIP + - Metal + # No vulkan key: the vulkan image would carry a Vulkan loader with no Mesa ICD + # (see the audio-cpp block in .github/backend-matrix.yml). Pointing a + # capability at a tag CI never builds hands the user a pull failure; leaving it + # out lets SystemState.Capability() fall through to `default` and the CPU + # image. + capabilities: + default: "cpu-audio-cpp" + nvidia: "cuda12-audio-cpp" + nvidia-cuda-12: "cuda12-audio-cpp" + nvidia-cuda-13: "cuda13-audio-cpp" + amd: "rocm-audio-cpp" + metal: "metal-audio-cpp" + metal-darwin-arm64: "metal-audio-cpp" +- &whispercpp + name: "whisper" + alias: "whisper" + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + Port of OpenAI's Whisper model in C/C++ + urls: + - https://github.com/ggml-org/whisper.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + default: "cpu-whisper" + nvidia: "cuda12-whisper" + intel: "intel-sycl-f16-whisper" + metal: "metal-whisper" + amd: "rocm-whisper" + vulkan: "vulkan-whisper" + nvidia-l4t: "nvidia-l4t-arm64-whisper" + nvidia-cuda-13: "cuda13-whisper" + nvidia-cuda-12: "cuda12-whisper" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-whisper" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-whisper" +- &vllm-cpp + name: "vllm-cpp" + alias: "vllm-cpp" + license: apache-2.0 + description: | + ALPHA development builds. Try it, but llama-cpp stays the recommendation for + production use. + + vllm.cpp is an Apache-2.0 C++20 inference engine maintained by the LocalAI team, + developed in its own repository and usable without LocalAI. It began as a port of + vLLM and keeps vLLM as its reference implementation, checking output against it and + benchmarking against it, while growing a featureset of its own. It implements vLLM's + V1 architecture (paged KV cache, continuous batching, prefix caching, scheduler, + sampler) on a portable tensor runtime with no Python, PyTorch or ggml at inference + time. It loads GGUF as well as Hugging Face safetensors, supports structured output + (JSON schema / regex / choice / GBNF grammar) enforced in-engine, ships speculative + decoding and KV offload, and runs on CPU, NVIDIA CUDA (Blackwell-family), Apple + Metal and Vulkan. + + The project is expected to be renamed as it diverges further from vLLM; the new + name is still to be decided. + urls: + - https://github.com/mudler/vllm.cpp + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - metal + capabilities: + default: "cpu-vllm-cpp" + nvidia: "cuda13-vllm-cpp" + metal: "metal-vllm-cpp" + vulkan: "vulkan-vllm-cpp" + nvidia-cuda-13: "cuda13-vllm-cpp" + nvidia-l4t: "nvidia-l4t-arm64-vllm-cpp" + nvidia-l4t-cuda-13: "nvidia-l4t-arm64-vllm-cpp" +- !!merge <<: *vllm-cpp + name: "vllm-cpp-development" + capabilities: + default: "cpu-vllm-cpp-development" + nvidia: "cuda13-vllm-cpp-development" + metal: "metal-vllm-cpp-development" + vulkan: "vulkan-vllm-cpp-development" + nvidia-cuda-13: "cuda13-vllm-cpp-development" + nvidia-l4t: "nvidia-l4t-arm64-vllm-cpp-development" + nvidia-l4t-cuda-13: "nvidia-l4t-arm64-vllm-cpp-development" +- &crispasr + name: "crispasr" + alias: "crispasr" + license: mit + icon: https://user-images.githubusercontent.com/1991296/235238348-05d0f6a4-da44-4900-a1de-d0707e75b763.jpeg + description: | + CrispASR unified speech engine (whisper.cpp fork on ggml) supporting many ASR architectures (Parakeet, Canary, Voxtral, Qwen3-ASR, Granite, Wav2Vec2, Moonshine, OmniASR, FireRedASR, and more). + urls: + - https://github.com/CrispStrobe/CrispASR + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + default: "cpu-crispasr" + nvidia: "cuda12-crispasr" + intel: "intel-sycl-f16-crispasr" + metal: "metal-crispasr" + amd: "rocm-crispasr" + vulkan: "vulkan-crispasr" + nvidia-l4t: "nvidia-l4t-arm64-crispasr" + nvidia-cuda-13: "cuda13-crispasr" + nvidia-cuda-12: "cuda12-crispasr" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-crispasr" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-crispasr" +- ¶keetcpp + name: "parakeet-cpp" + alias: "parakeet-cpp" + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + parakeet.cpp is a C++/ggml port of NVIDIA NeMo Parakeet automatic speech recognition (ASR) models. + It supports the tdt, ctc, rnnt and hybrid decoder families as well as cache-aware streaming transcription, + and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/parakeet.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + default: "cpu-parakeet-cpp" + nvidia: "cuda12-parakeet-cpp" + intel: "intel-sycl-f16-parakeet-cpp" + metal: "metal-parakeet-cpp" + amd: "rocm-parakeet-cpp" + vulkan: "vulkan-parakeet-cpp" + nvidia-l4t: "nvidia-l4t-arm64-parakeet-cpp" + nvidia-cuda-13: "cuda13-parakeet-cpp" + nvidia-cuda-12: "cuda12-parakeet-cpp" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-parakeet-cpp" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-parakeet-cpp" +- &nemospeechcpp + name: "nemo-speech-cpp" + alias: "nemo-speech-cpp" + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/1728152?s=200&v=4 + description: | + NVIDIA NeMo-Speech.cpp, a C++/ggml runtime for NVIDIA Nemotron Speech models. + One backend serves four model families, selected automatically from the GGUF + general.architecture key: automatic speech recognition (offline, cache-aware + streaming and live transcription, with optional Silero VAD, punctuation, + inverse text normalization and Sortformer speaker diarization attached), + standalone Sortformer diarization, MagpieTTS text-to-speech over NanoCodec, + and Riva-Translate text translation. Runs on CPU, NVIDIA CUDA, Vulkan, + NVIDIA Jetson (L4T) and Apple Metal. + urls: + - https://github.com/NVIDIA/NeMo-Speech.cpp + tags: + - audio-transcription + - text-to-speech + - diarization + - text-to-text + - CPU + - GPU + - CUDA + - Metal + # No amd and no intel key on purpose: upstream NeMo-Speech.cpp has no ROCm/HIP + # and no SYCL backend, so there is nothing to point those at. A host reporting + # either capability falls through to "default" (SystemState.Capability) and + # gets the CPU build, which is the honest answer rather than a broken tag. + # + # Listing only nvidia-l4t would be a silent downgrade: a Jetson that reports a + # CUDA-refined capability would miss the map and fall back to the CPU build. + # + # The two nvidia-l4t-cuda-* keys point at DIFFERENT images on purpose. The + # JetPack r36.4.0 base links ggml against CUDA 12, so serving it to a host that + # reports nvidia-l4t-cuda-13 would fail at dlopen on a missing libcudart.so.12. + # That is worse than no key at all, since a missing key falls back to a working + # CPU build. Hence the separate cuda13 L4T image, as parakeet-cpp and + # moss-transcribe-cpp both do. + capabilities: + default: "cpu-nemo-speech-cpp" + nvidia: "cuda12-nemo-speech-cpp" + metal: "metal-nemo-speech-cpp" + vulkan: "vulkan-nemo-speech-cpp" + nvidia-l4t: "nvidia-l4t-arm64-nemo-speech-cpp" + nvidia-cuda-13: "cuda13-nemo-speech-cpp" + nvidia-cuda-12: "cuda12-nemo-speech-cpp" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-nemo-speech-cpp" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-nemo-speech-cpp" +- &mosstranscribecpp + name: "moss-transcribe-cpp" + alias: "moss-transcribe-cpp" + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + moss-transcribe.cpp is a C++/ggml port of OpenMOSS MOSS-Transcribe-Diarize, an end-to-end audio understanding model. + It does joint long-form transcription, speaker diarization and timestamping in a single pass, emitting a speaker-labelled, + time-aligned transcript, and runs on CPU, NVIDIA CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan, Apple Metal and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/moss-transcribe.cpp + tags: + - audio-transcription + - CPU + - GPU + - CUDA + - HIP + capabilities: + default: "cpu-moss-transcribe-cpp" + nvidia: "cuda12-moss-transcribe-cpp" + intel: "intel-sycl-f16-moss-transcribe-cpp" + metal: "metal-moss-transcribe-cpp" + amd: "rocm-moss-transcribe-cpp" + vulkan: "vulkan-moss-transcribe-cpp" + nvidia-l4t: "nvidia-l4t-arm64-moss-transcribe-cpp" + nvidia-cuda-13: "cuda13-moss-transcribe-cpp" + nvidia-cuda-12: "cuda12-moss-transcribe-cpp" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-moss-transcribe-cpp" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-moss-transcribe-cpp" +- &ced + name: "ced" + alias: "ced" + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + CED sound-event classification / audio tagging (527-class AudioSet). + ced.cpp is a C++/ggml port that performs audio tagging over the AudioSet + taxonomy, exposed through the SoundDetection gRPC rpc and the + /v1/audio/classification REST endpoint. It runs on CPU, NVIDIA CUDA, + AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/ced.cpp + tags: + - audio-classification + - CPU + - GPU + - CUDA + - HIP + capabilities: + default: "cpu-ced" + nvidia: "cuda12-ced" + intel: "intel-sycl-f16-ced" + metal: "metal-ced" + amd: "rocm-ced" + vulkan: "vulkan-ced" + nvidia-l4t: "nvidia-l4t-arm64-ced" + nvidia-cuda-13: "cuda13-ced" + nvidia-cuda-12: "cuda12-ced" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-ced" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-ced" +- &voicedetect + name: "voice-detect" + alias: "voice-detect" + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + voice-detect speaker recognition and voice analysis. + voice-detect.cpp is a C++/ggml engine that produces L2-normalised + speaker embeddings (ECAPA-TDNN, WeSpeaker ResNet34, 3D-Speaker + ERes2Net, CAM++) for voice verification and 1:N identification, plus + a wav2vec2 age / gender / emotion analysis head. It replaces the + Python speaker-recognition backend and is exposed through the Voice* + gRPC rpcs and the /v1/voice/* REST endpoints. It runs on CPU, NVIDIA + CUDA, AMD ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/localai-org/voice-detect.cpp + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + default: "cpu-voice-detect" + nvidia: "cuda12-voice-detect" + intel: "intel-sycl-f16-voice-detect" + metal: "metal-voice-detect" + amd: "rocm-voice-detect" + vulkan: "vulkan-voice-detect" + nvidia-l4t: "nvidia-l4t-arm64-voice-detect" + nvidia-cuda-13: "cuda13-voice-detect" + nvidia-cuda-12: "cuda12-voice-detect" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-voice-detect" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-voice-detect" +- &facedetect + name: "face-detect" + alias: "face-detect" + license: mit + icon: https://avatars.githubusercontent.com/u/95302084 + description: | + face-detect face detection, embedding, verification and analysis. + face-detect.cpp is a C++/ggml engine that runs SCRFD / YuNet face + detection and ArcFace / SFace 512-d (or 128-d) L2-normalised face + embeddings for verification and 1:N identification, plus a landmark / + age / gender analysis head. It replaces the Python insightface backend + and is exposed through the Embedding, Detect and Face* gRPC rpcs and + the /v1/face/* REST endpoints. It runs on CPU, NVIDIA CUDA, AMD + ROCm/HIP, Intel SYCL, Vulkan and NVIDIA Jetson (L4T) targets. + urls: + - https://github.com/mudler/face-detect.cpp + tags: + - face-recognition + - face-verification + - face-embedding + - CPU + - GPU + - CUDA + - HIP + capabilities: + default: "cpu-face-detect" + nvidia: "cuda12-face-detect" + intel: "intel-sycl-f16-face-detect" + metal: "metal-face-detect" + amd: "rocm-face-detect" + vulkan: "vulkan-face-detect" + nvidia-l4t: "nvidia-l4t-arm64-face-detect" + nvidia-cuda-13: "cuda13-face-detect" + nvidia-cuda-12: "cuda12-face-detect" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-face-detect" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-face-detect" +- &voxtral + name: "voxtral" + alias: "voxtral" + license: mit + description: | + Voxtral Realtime 4B Pure C speech-to-text inference engine + urls: + - https://github.com/mudler/voxtral.c + tags: + - audio-transcription + - CPU + - Metal + capabilities: + default: "cpu-voxtral" + metal-darwin-arm64: "metal-voxtral" +- &stablediffusionggml + name: "stablediffusion-ggml" + alias: "stablediffusion-ggml" + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + default: "cpu-stablediffusion-ggml" + nvidia: "cuda12-stablediffusion-ggml" + intel: "intel-sycl-f16-stablediffusion-ggml" + amd: "rocm-stablediffusion-ggml" + vulkan: "vulkan-stablediffusion-ggml" + nvidia-l4t: "nvidia-l4t-arm64-stablediffusion-ggml" + metal: "metal-stablediffusion-ggml" + nvidia-cuda-13: "cuda13-stablediffusion-ggml" + nvidia-cuda-12: "cuda12-stablediffusion-ggml" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-stablediffusion-ggml" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-stablediffusion-ggml" +- &kimodocpp + name: "kimodocpp" + alias: "kimodocpp" + license: apache-2.0 + description: | + kimodo.cpp text-to-motion: animated skeleton GLB on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/kimodo.cpp + tags: [3d-animation, text-to-motion, CPU, Vulkan] + capabilities: + default: "cpu-kimodocpp" + vulkan: "vulkan-kimodocpp" + nvidia: "vulkan-kimodocpp" + nvidia-cuda-12: "vulkan-kimodocpp" + nvidia-cuda-13: "vulkan-kimodocpp" + amd: "vulkan-kimodocpp" + intel: "vulkan-kimodocpp" + metal: "cpu-darwin-arm64-kimodocpp" +- &gemxcpp + name: "gemxcpp" + alias: "gemxcpp" + license: apache-2.0 + description: | + gem-x.cpp live human motion: SOMA and SMPL pose streams on CPU and Vulkan. + Apple Silicon uses the CPU runtime. + urls: + - https://github.com/localai-org/gem-x.cpp + tags: [motion, pose-estimation, CPU, Vulkan] + capabilities: + default: "cpu-gemxcpp" + vulkan: "vulkan-gemxcpp" + nvidia: "vulkan-gemxcpp" + nvidia-cuda-12: "vulkan-gemxcpp" + nvidia-cuda-13: "vulkan-gemxcpp" + amd: "vulkan-gemxcpp" + intel: "vulkan-gemxcpp" + metal: "cpu-darwin-arm64-gemxcpp" +- &trellis2cpp + name: "trellis2cpp" + alias: "trellis2cpp" + license: mit + description: | + TRELLIS.2 image-to-3D generation (GLB meshes with PBR textures) in C++/ggml + urls: + - https://github.com/localai-org/trellis2cpp + - https://github.com/microsoft/TRELLIS.2 + tags: + - image-to-3d + - 3d-generation + - CPU + - GPU + - CUDA + - Metal + capabilities: + default: "cpu-trellis2cpp" + nvidia: "cuda12-trellis2cpp" + vulkan: "vulkan-trellis2cpp" + nvidia-l4t: "nvidia-l4t-arm64-trellis2cpp" + metal: "metal-trellis2cpp" + nvidia-cuda-13: "cuda13-trellis2cpp" + nvidia-cuda-12: "cuda12-trellis2cpp" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-trellis2cpp" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-trellis2cpp" +- &rfdetr + name: "rfdetr" + alias: "rfdetr" + license: apache-2.0 + icon: https://avatars.githubusercontent.com/u/53104118?s=200&v=4 + description: | + RF-DETR is a real-time, transformer-based object detection model architecture developed by Roboflow and released under the Apache 2.0 license. + RF-DETR is the first real-time model to exceed 60 AP on the Microsoft COCO benchmark alongside competitive performance at base sizes. It also achieves state-of-the-art performance on RF100-VL, an object detection benchmark that measures model domain adaptability to real world problems. RF-DETR is fastest and most accurate for its size when compared current real-time objection models. + RF-DETR is small enough to run on the edge using Inference, making it an ideal model for deployments that need both strong accuracy and real-time performance. + urls: + - https://github.com/roboflow/rf-detr + tags: + - object-detection + - rfdetr + - gpu + - cpu + capabilities: + nvidia: "cuda12-rfdetr" + intel: "intel-rfdetr" + #amd: "rocm-rfdetr" + nvidia-l4t: "nvidia-l4t-arm64-rfdetr" + metal: "metal-rfdetr" + default: "cpu-rfdetr" + nvidia-cuda-13: "cuda13-rfdetr" + nvidia-cuda-12: "cuda12-rfdetr" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-rfdetr" +- &insightface + name: "insightface" + alias: "insightface" + # Upstream insightface library is MIT. The pretrained model packs + # (buffalo_l, buffalo_s, antelopev2) are released for NON-COMMERCIAL + # research use only. The backend image also pre-bakes OpenCV Zoo + # YuNet + SFace (Apache 2.0) for commercial use. Pick the engine + # via model-gallery entries (insightface-buffalo-l / insightface-opencv + # / insightface-buffalo-s) or set `options` in your model YAML. + license: "mixed" + description: | + Face recognition backend powered by `insightface` (ONNX Runtime). + Provides face verification (/v1/face/verify), face analysis + (/v1/face/analyze), face embedding (/v1/embeddings), face + detection (/v1/detection), and 1:N identification + (/v1/face/{register,identify,forget}). + Ships two engines in a single image: one that drives the insightface + model packs (buffalo_l/s/m/sc, antelopev2 — non-commercial research + use only) and one that drives OpenCV Zoo's YuNet + SFace pair + (Apache 2.0 — commercial-safe). Select via `options: ["engine:..."]` + in your model YAML, or install one of the ready-made model-gallery + entries under the `insightface-*` prefix. + The backend image contains only code and Python deps; all model + weights are managed by LocalAI's gallery download mechanism. + urls: + - https://github.com/deepinsight/insightface + - https://github.com/opencv/opencv_zoo + tags: + - face-recognition + - face-verification + - face-embedding + - gpu + - cpu + capabilities: + default: "cpu-insightface" + nvidia: "cuda12-insightface" + nvidia-cuda-12: "cuda12-insightface" +- &sam3cpp + name: "sam3-cpp" + alias: "sam3-cpp" + license: mit + description: | + Segment Anything Model (SAM 3/2/EdgeTAM) in C/C++ using GGML. + Supports text-prompted and point/box-prompted image segmentation. + urls: + - https://github.com/PABannier/sam3.cpp + tags: + - image-segmentation + - object-detection + - sam3 + - gpu + - cpu + capabilities: + default: "cpu-sam3-cpp" + nvidia: "cuda12-sam3-cpp" + nvidia-cuda-12: "cuda12-sam3-cpp" + nvidia-cuda-13: "cuda13-sam3-cpp" + nvidia-l4t: "nvidia-l4t-arm64-sam3-cpp" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-sam3-cpp" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-sam3-cpp" + intel: "intel-sycl-f32-sam3-cpp" + vulkan: "vulkan-sam3-cpp" + metal: "metal-sam3-cpp" +- &rfdetrcpp + name: "rfdetr-cpp" + alias: "rfdetr-cpp" + license: apache-2.0 + description: | + Native RF-DETR object detection and instance segmentation in C/C++ + using GGML. Loads pre-built GGUF weights from the mudler/rfdetr-cpp-* + family (Nano/Small/Base/Medium/Large + SegNano/SegSmall/SegMedium) + and returns bounding boxes, class labels, confidence scores, and + (for segmentation variants) PNG-encoded per-detection masks. + urls: + - https://github.com/localai-org/rf-detr.cpp + tags: + - object-detection + - image-segmentation + - rfdetr + - gpu + - cpu + capabilities: + default: "cpu-rfdetr-cpp" + nvidia: "cuda12-rfdetr-cpp" + nvidia-cuda-12: "cuda12-rfdetr-cpp" + nvidia-cuda-13: "cuda13-rfdetr-cpp" + nvidia-l4t: "nvidia-l4t-arm64-rfdetr-cpp" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-rfdetr-cpp" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-rfdetr-cpp" + intel: "intel-sycl-f32-rfdetr-cpp" + vulkan: "vulkan-rfdetr-cpp" + metal: "metal-rfdetr-cpp" +- &locateanything + name: "locate-anything" + alias: "locate-anything" + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: "cpu-locate-anything-cpp" + nvidia: "cuda12-locate-anything-cpp" + nvidia-cuda-12: "cuda12-locate-anything-cpp" + nvidia-cuda-13: "cuda13-locate-anything-cpp" + nvidia-l4t: "nvidia-l4t-arm64-locate-anything-cpp" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-locate-anything-cpp" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-locate-anything-cpp" + intel: "intel-sycl-f32-locate-anything-cpp" + vulkan: "vulkan-locate-anything-cpp" + metal: "metal-locate-anything-cpp" +- !!merge <<: *locateanything + name: "locate-anything-development" + capabilities: + default: "cpu-locate-anything-cpp-development" + nvidia: "cuda12-locate-anything-cpp-development" + nvidia-cuda-12: "cuda12-locate-anything-cpp-development" + nvidia-cuda-13: "cuda13-locate-anything-cpp-development" + nvidia-l4t: "nvidia-l4t-arm64-locate-anything-cpp-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-locate-anything-cpp-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-locate-anything-cpp-development" + intel: "intel-sycl-f32-locate-anything-cpp-development" + vulkan: "vulkan-locate-anything-cpp-development" + metal: "metal-locate-anything-cpp-development" +- !!merge <<: *locateanything + name: "cpu-locate-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-locate-anything-cpp" + mirrors: + - localai/localai-backends:latest-cpu-locate-anything-cpp +- !!merge <<: *locateanything + name: "cpu-locate-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-locate-anything-cpp" + mirrors: + - localai/localai-backends:master-cpu-locate-anything-cpp +- !!merge <<: *locateanything + name: "metal-locate-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-locate-anything-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-locate-anything-cpp +- !!merge <<: *locateanything + name: "metal-locate-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-locate-anything-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-locate-anything-cpp +- !!merge <<: *locateanything + name: "cuda12-locate-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-locate-anything-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-locate-anything-cpp +- !!merge <<: *locateanything + name: "cuda12-locate-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-locate-anything-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-locate-anything-cpp +- !!merge <<: *locateanything + name: "cuda13-locate-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-locate-anything-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-locate-anything-cpp +- !!merge <<: *locateanything + name: "cuda13-locate-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-locate-anything-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-locate-anything-cpp +- !!merge <<: *locateanything + name: "nvidia-l4t-arm64-locate-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-locate-anything-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-locate-anything-cpp +- !!merge <<: *locateanything + name: "nvidia-l4t-arm64-locate-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-locate-anything-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-locate-anything-cpp +- !!merge <<: *locateanything + name: "cuda13-nvidia-l4t-arm64-locate-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-locate-anything-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-locate-anything-cpp +- !!merge <<: *locateanything + name: "cuda13-nvidia-l4t-arm64-locate-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-locate-anything-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-locate-anything-cpp +- !!merge <<: *locateanything + name: "intel-sycl-f32-locate-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-locate-anything-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-locate-anything-cpp +- !!merge <<: *locateanything + name: "intel-sycl-f32-locate-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-locate-anything-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-locate-anything-cpp +- !!merge <<: *locateanything + name: "intel-sycl-f16-locate-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-locate-anything-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-locate-anything-cpp +- !!merge <<: *locateanything + name: "intel-sycl-f16-locate-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-locate-anything-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-locate-anything-cpp +- !!merge <<: *locateanything + name: "vulkan-locate-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-locate-anything-cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-locate-anything-cpp +- !!merge <<: *locateanything + name: "vulkan-locate-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-locate-anything-cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-locate-anything-cpp +- &depthanything + name: "depth-anything" + alias: "depth-anything" + license: apache-2.0 + description: | + Depth Anything 3 monocular metric depth + camera pose estimation in C/C++ + using GGML. Loads pre-built GGUF weights and, given an image, returns a + dense depth map plus the recovered camera extrinsics (3x4) and intrinsics + (3x3). No Python at inference (purego, cgo-less). + urls: + - https://github.com/mudler/depth-anything.cpp + - https://huggingface.co/depth-anything/Depth-Anything-V3 + tags: + - depth-estimation + - camera-pose + - depth-anything + - gpu + - cpu + capabilities: + default: "cpu-depth-anything-cpp" + nvidia: "cuda12-depth-anything-cpp" + nvidia-cuda-12: "cuda12-depth-anything-cpp" + nvidia-cuda-13: "cuda13-depth-anything-cpp" + nvidia-l4t: "nvidia-l4t-arm64-depth-anything-cpp" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-depth-anything-cpp" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-depth-anything-cpp" + intel: "intel-sycl-f32-depth-anything-cpp" + vulkan: "vulkan-depth-anything-cpp" + metal: "metal-depth-anything-cpp" +- !!merge <<: *depthanything + name: "depth-anything-development" + capabilities: + default: "cpu-depth-anything-cpp-development" + nvidia: "cuda12-depth-anything-cpp-development" + nvidia-cuda-12: "cuda12-depth-anything-cpp-development" + nvidia-cuda-13: "cuda13-depth-anything-cpp-development" + nvidia-l4t: "nvidia-l4t-arm64-depth-anything-cpp-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-depth-anything-cpp-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-depth-anything-cpp-development" + intel: "intel-sycl-f32-depth-anything-cpp-development" + vulkan: "vulkan-depth-anything-cpp-development" + metal: "metal-depth-anything-cpp-development" +- !!merge <<: *depthanything + name: "cpu-depth-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-depth-anything-cpp" + mirrors: + - localai/localai-backends:latest-cpu-depth-anything-cpp +- !!merge <<: *depthanything + name: "cpu-depth-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-depth-anything-cpp" + mirrors: + - localai/localai-backends:master-cpu-depth-anything-cpp +- !!merge <<: *depthanything + name: "metal-depth-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-depth-anything-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-depth-anything-cpp +- !!merge <<: *depthanything + name: "metal-depth-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-depth-anything-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-depth-anything-cpp +- !!merge <<: *depthanything + name: "cuda12-depth-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-depth-anything-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-depth-anything-cpp +- !!merge <<: *depthanything + name: "cuda12-depth-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-depth-anything-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-depth-anything-cpp +- !!merge <<: *depthanything + name: "cuda13-depth-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-depth-anything-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-depth-anything-cpp +- !!merge <<: *depthanything + name: "cuda13-depth-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-depth-anything-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-depth-anything-cpp +- !!merge <<: *depthanything + name: "nvidia-l4t-arm64-depth-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-depth-anything-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-depth-anything-cpp +- !!merge <<: *depthanything + name: "nvidia-l4t-arm64-depth-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-depth-anything-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-depth-anything-cpp +- !!merge <<: *depthanything + name: "cuda13-nvidia-l4t-arm64-depth-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-depth-anything-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-depth-anything-cpp +- !!merge <<: *depthanything + name: "cuda13-nvidia-l4t-arm64-depth-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-depth-anything-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-depth-anything-cpp +- !!merge <<: *depthanything + name: "intel-sycl-f32-depth-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-depth-anything-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-depth-anything-cpp +- !!merge <<: *depthanything + name: "intel-sycl-f32-depth-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-depth-anything-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-depth-anything-cpp +- !!merge <<: *depthanything + name: "intel-sycl-f16-depth-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-depth-anything-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-depth-anything-cpp +- !!merge <<: *depthanything + name: "intel-sycl-f16-depth-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-depth-anything-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-depth-anything-cpp +- !!merge <<: *depthanything + name: "vulkan-depth-anything-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-depth-anything-cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-depth-anything-cpp +- !!merge <<: *depthanything + name: "vulkan-depth-anything-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-depth-anything-cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-depth-anything-cpp +- &vllm + name: "vllm" + license: apache-2.0 + urls: + - https://github.com/vllm-project/vllm + tags: + - text-to-text + - multimodal + - GPTQ + - AWQ + - AutoRound + - INT4 + - INT8 + - FP8 + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM is a fast and easy-to-use library for LLM inference and serving. + Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has evolved into a community-driven project with contributions from both academia and industry. + vLLM is fast with: + State-of-the-art serving throughput + Efficient management of attention key and value memory with PagedAttention + Continuous batching of incoming requests + Fast model execution with CUDA/HIP graph + Quantizations: GPTQ, AWQ, AutoRound, INT4, INT8, and FP8 + Optimized CUDA kernels, including integration with FlashAttention and FlashInfer + Speculative decoding + Chunked prefill + alias: "vllm" + capabilities: + nvidia: "cuda12-vllm" + amd: "rocm-vllm" + intel: "intel-vllm" + nvidia-cuda-12: "cuda12-vllm" + nvidia-cuda-13: "cuda13-vllm" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-vllm" + cpu: "cpu-vllm" + metal: "metal-vllm" +- &sglang + name: "sglang" + license: apache-2.0 + urls: + - https://github.com/sgl-project/sglang + tags: + - text-to-text + - multimodal + icon: https://raw.githubusercontent.com/sgl-project/sglang/main/assets/logo.png + description: | + SGLang is a fast serving framework for large language models and vision language models. + It co-designs the backend runtime (RadixAttention, continuous batching, structured + decoding) and the frontend language to make interaction with models faster and more + controllable. Features include fast backend runtime, flexible frontend language, + extensive model support, and an active community. + alias: "sglang" + capabilities: + nvidia: "cuda12-sglang" + amd: "rocm-sglang" + intel: "intel-sglang" + nvidia-cuda-12: "cuda12-sglang" + nvidia-cuda-13: "cuda13-sglang" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-sglang" + cpu: "cpu-sglang" +- &vllm-omni + name: "vllm-omni" + license: apache-2.0 + urls: + - https://github.com/vllm-project/vllm-omni + tags: + - text-to-image + - image-generation + - text-to-video + - video-generation + - text-to-speech + - TTS + - multimodal + - LLM + icon: https://raw.githubusercontent.com/vllm-project/vllm/main/docs/assets/logos/vllm-logo-text-dark.png + description: | + vLLM-Omni is a unified interface for multimodal generation with vLLM. + It supports image generation (text-to-image, image editing), video generation + (text-to-video, image-to-video), text generation with multimodal inputs, and + text-to-speech generation. Only supports NVIDIA (CUDA) and ROCm platforms. + alias: "vllm-omni" + capabilities: + nvidia: "cuda12-vllm-omni" + amd: "rocm-vllm-omni" + nvidia-cuda-12: "cuda12-vllm-omni" + nvidia-cuda-13: "cuda13-vllm-omni" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-vllm-omni" +- &longcat-video + name: "longcat-video" + alias: "longcat-video" + license: mit + urls: + - https://github.com/meituan-longcat/LongCat-Video + tags: + - text-to-video + - image-to-video + - audio-to-video + - avatar-generation + - video-generation + - CUDA + icon: https://raw.githubusercontent.com/meituan-longcat/LongCat-Video/main/assets/longcat-video_logo.svg + description: | + LongCat-Video generation for text, image, and audio-conditioned avatars. + Supports LongCat-Video and LongCat-Video-Avatar-1.5, including multi-segment + talking-head continuation and an SDPA path for NVIDIA Blackwell ARM64 systems. + Requires Linux with an NVIDIA CUDA GPU; CPU, ROCm, and macOS are unsupported. + capabilities: + nvidia: "cuda12-longcat-video" + nvidia-cuda-12: "cuda12-longcat-video" + nvidia-cuda-13: "cuda13-longcat-video" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-longcat-video" +- &mlx + name: "mlx" + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + urls: + - https://github.com/ml-explore/mlx-lm + license: MIT + description: | + Run LLMs with MLX + tags: + - text-to-text + - LLM + - MLX + capabilities: + default: "cpu-mlx" + nvidia: "cuda12-mlx" + metal: "metal-mlx" + nvidia-cuda-12: "cuda12-mlx" + nvidia-cuda-13: "cuda13-mlx" + nvidia-l4t: "nvidia-l4t-mlx" + nvidia-l4t-cuda-12: "nvidia-l4t-mlx" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx" +- &mlx-video + name: "mlx-video" + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + urls: + - https://github.com/Blaizzy/mlx-video + license: MIT + description: | + Generate videos with LTX-2 and converted Wan2.1/Wan2.2 checkpoints using + MLX on Apple Silicon. + tags: + - text-to-video + - image-to-video + - MLX + capabilities: + metal: "metal-mlx-video" +- &mlx-vlm + name: "mlx-vlm" + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + urls: + - https://github.com/Blaizzy/mlx-vlm + license: MIT + description: | + Run Vision-Language Models with MLX + tags: + - text-to-text + - multimodal + - vision-language + - LLM + - MLX + capabilities: + default: "cpu-mlx-vlm" + nvidia: "cuda12-mlx-vlm" + metal: "metal-mlx-vlm" + nvidia-cuda-12: "cuda12-mlx-vlm" + nvidia-cuda-13: "cuda13-mlx-vlm" + nvidia-l4t: "nvidia-l4t-mlx-vlm" + nvidia-l4t-cuda-12: "nvidia-l4t-mlx-vlm" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx-vlm" +- &mlx-audio + name: "mlx-audio" + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + urls: + - https://github.com/Blaizzy/mlx-audio + license: MIT + description: | + Run Audio Models with MLX + tags: + - audio-to-text + - audio-generation + - text-to-audio + - LLM + - MLX + capabilities: + default: "cpu-mlx-audio" + nvidia: "cuda12-mlx-audio" + metal: "metal-mlx-audio" + nvidia-cuda-12: "cuda12-mlx-audio" + nvidia-cuda-13: "cuda13-mlx-audio" + nvidia-l4t: "nvidia-l4t-mlx-audio" + nvidia-l4t-cuda-12: "nvidia-l4t-mlx-audio" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx-audio" +- &mlx-distributed + name: "mlx-distributed" + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + urls: + - https://github.com/ml-explore/mlx-lm + license: MIT + description: | + Run distributed LLM inference with MLX across multiple Apple Silicon Macs + tags: + - text-to-text + - LLM + - MLX + - distributed + capabilities: + default: "cpu-mlx-distributed" + nvidia: "cuda12-mlx-distributed" + metal: "metal-mlx-distributed" + nvidia-cuda-12: "cuda12-mlx-distributed" + nvidia-cuda-13: "cuda13-mlx-distributed" + nvidia-l4t: "nvidia-l4t-mlx-distributed" + nvidia-l4t-cuda-12: "nvidia-l4t-mlx-distributed" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx-distributed" +- &rerankers + name: "rerankers" + alias: "rerankers" + capabilities: + nvidia: "cuda12-rerankers" + intel: "intel-rerankers" + amd: "rocm-rerankers" + metal: "metal-rerankers" +- &tinygrad + name: "tinygrad" + alias: "tinygrad" + license: MIT + description: | + tinygrad is a minimalist deep-learning framework with zero runtime + dependencies that targets CUDA, ROCm, Metal, WebGPU and CPU (CLANG). + The LocalAI tinygrad backend exposes a single multimodal runtime that + covers LLM text generation (Llama / Qwen / Mistral via safetensors or + GGUF) with native tool-call extraction, BERT-family embeddings, + Stable Diffusion 1.x / 2 / XL image generation, and Whisper speech-to-text. + + Single image: tinygrad generates its own GPU kernels and dlopens the + host driver libraries at runtime, so there is no per-toolkit build + split. The same image runs CPU-only or accelerates against + CUDA / ROCm / Metal when the host driver is visible. + urls: + - https://github.com/tinygrad/tinygrad + uri: "quay.io/go-skynet/local-ai-backends:latest-tinygrad" + mirrors: + - localai/localai-backends:latest-tinygrad + tags: + - text-to-text + - LLM + - embeddings + - image-generation + - transcription + - multimodal +- &transformers + name: "transformers" + icon: https://avatars.githubusercontent.com/u/25720743?s=200&v=4 + alias: "transformers" + license: apache-2.0 + description: | + Transformers acts as the model-definition framework for state-of-the-art machine learning models in text, computer vision, audio, video, and multimodal model, for both inference and training. + It centralizes the model definition so that this definition is agreed upon across the ecosystem. transformers is the pivot across frameworks: if a model definition is supported, it will be compatible with the majority of training frameworks (Axolotl, Unsloth, DeepSpeed, FSDP, PyTorch-Lightning, ...), inference engines (vLLM, SGLang, TGI, ...), and adjacent modeling libraries (llama.cpp, mlx, ...) which leverage the model definition from transformers. + urls: + - https://github.com/huggingface/transformers + tags: + - text-to-text + - multimodal + capabilities: + nvidia: "cuda12-transformers" + intel: "intel-transformers" + amd: "rocm-transformers" + metal: "metal-transformers" + nvidia-cuda-13: "cuda13-transformers" + nvidia-cuda-12: "cuda12-transformers" +- &diffusers + name: "diffusers" + icon: https://raw.githubusercontent.com/huggingface/diffusers/main/docs/source/en/imgs/diffusers_library.jpg + description: | + 🤗 Diffusers is the go-to library for state-of-the-art pretrained diffusion models for generating images, audio, and even 3D structures of molecules. Whether you're looking for a simple inference solution or training your own diffusion models, 🤗 Diffusers is a modular toolbox that supports both. + urls: + - https://github.com/huggingface/diffusers + tags: + - image-generation + - video-generation + - sound-generation + - diffusion-models + license: apache-2.0 + alias: "diffusers" + capabilities: + nvidia: "cuda12-diffusers" + intel: "intel-diffusers" + amd: "rocm-diffusers" + nvidia-l4t: "nvidia-l4t-diffusers" + metal: "metal-diffusers" + default: "cpu-diffusers" + nvidia-cuda-13: "cuda13-diffusers" + nvidia-cuda-12: "cuda12-diffusers" + nvidia-l4t-cuda-12: "nvidia-l4t-diffusers" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-diffusers" +- &ace-step + name: "ace-step" + description: | + ACE-Step 1.5 is an open-source music generation model. It supports simple mode (natural language description) and advanced mode (caption, lyrics, think, bpm, keyscale, etc.). Uses in-process acestep (LLMHandler for metadata, DiT for audio). + urls: + - https://github.com/ace-step/ACE-Step-1.5 + tags: + - music-generation + - sound-generation + alias: "ace-step" + capabilities: + nvidia: "cuda12-ace-step" + intel: "intel-ace-step" + amd: "rocm-ace-step" + metal: "metal-ace-step" + default: "cpu-ace-step" + nvidia-cuda-13: "cuda13-ace-step" + nvidia-cuda-12: "cuda12-ace-step" +- !!merge <<: *ace-step + name: "ace-step-development" + capabilities: + nvidia: "cuda12-ace-step-development" + intel: "intel-ace-step-development" + amd: "rocm-ace-step-development" + metal: "metal-ace-step-development" + default: "cpu-ace-step-development" + nvidia-cuda-13: "cuda13-ace-step-development" + nvidia-cuda-12: "cuda12-ace-step-development" +- &acestepcpp + name: "acestep-cpp" + description: | + ACE-Step 1.5 C++ backend using GGML. Native C++ implementation of ACE-Step music generation with GPU support through GGML backends. + Generates stereo 48kHz audio from text descriptions and optional lyrics via a two-stage pipeline: text-to-code (ace-qwen3 LLM) + code-to-audio (DiT-VAE). + urls: + - https://github.com/ace-step/acestep.cpp + tags: + - music-generation + - sound-generation + alias: "acestep-cpp" + capabilities: + default: "cpu-acestep-cpp" + nvidia: "cuda12-acestep-cpp" + nvidia-cuda-13: "cuda13-acestep-cpp" + nvidia-cuda-12: "cuda12-acestep-cpp" + intel: "intel-sycl-f16-acestep-cpp" + metal: "metal-acestep-cpp" + amd: "rocm-acestep-cpp" + vulkan: "vulkan-acestep-cpp" + nvidia-l4t: "nvidia-l4t-arm64-acestep-cpp" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-acestep-cpp" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-acestep-cpp" +- &qwen3ttscpp + name: "qwen3-tts-cpp" + description: | + Qwen3-TTS C++ backend using GGML (qwentts.cpp). Native C++ text-to-speech + with streaming output, named speakers, voice design, and zero-shot voice + cloning. 24kHz mono, 11 languages with Mandarin dialects. 0.6B and 1.7B + models in Q8_0 / Q4_K_M. + urls: + - https://github.com/ServeurpersoCom/qwentts.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - streaming + alias: "qwen3-tts-cpp" + capabilities: + default: "cpu-qwen3-tts-cpp" + nvidia: "cuda12-qwen3-tts-cpp" + nvidia-cuda-13: "cuda13-qwen3-tts-cpp" + nvidia-cuda-12: "cuda12-qwen3-tts-cpp" + intel: "intel-sycl-f16-qwen3-tts-cpp" + metal: "metal-qwen3-tts-cpp" + amd: "rocm-qwen3-tts-cpp" + vulkan: "vulkan-qwen3-tts-cpp" + nvidia-l4t: "nvidia-l4t-arm64-qwen3-tts-cpp" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-qwen3-tts-cpp" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-qwen3-tts-cpp" +- &mossttscpp + name: "moss-tts-cpp" + description: | + MOSS-TTS C++ backend using GGML (moss-tts.cpp). Native C++ text-to-speech + for the OpenMOSS MOSS-TTS-Local Transformer v1.5 model (a GPT-J local + transformer + MOSS-Audio-Tokenizer-v2 neural codec), running from a + self-contained GGUF with no Python at inference time. 48kHz stereo output + with reference-audio voice cloning. + urls: + - https://github.com/mudler/moss-tts.cpp + - https://huggingface.co/mudler/MOSS-TTS-Local-Transformer-v1.5-GGUF + tags: + - text-to-speech + - tts + - voice-cloning + alias: "moss-tts-cpp" + capabilities: + default: "cpu-moss-tts-cpp" + nvidia: "cuda12-moss-tts-cpp" + nvidia-cuda-13: "cuda13-moss-tts-cpp" + nvidia-cuda-12: "cuda12-moss-tts-cpp" + intel: "intel-sycl-f16-moss-tts-cpp" + metal: "metal-moss-tts-cpp" + amd: "rocm-moss-tts-cpp" + vulkan: "vulkan-moss-tts-cpp" + nvidia-l4t: "nvidia-l4t-arm64-moss-tts-cpp" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-moss-tts-cpp" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-moss-tts-cpp" +- !!merge <<: *mossttscpp + name: "moss-tts-cpp-development" + capabilities: + default: "cpu-moss-tts-cpp-development" + nvidia: "cuda12-moss-tts-cpp-development" + nvidia-cuda-13: "cuda13-moss-tts-cpp-development" + nvidia-cuda-12: "cuda12-moss-tts-cpp-development" + intel: "intel-sycl-f16-moss-tts-cpp-development" + metal: "metal-moss-tts-cpp-development" + amd: "rocm-moss-tts-cpp-development" + vulkan: "vulkan-moss-tts-cpp-development" + nvidia-l4t: "nvidia-l4t-arm64-moss-tts-cpp-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-moss-tts-cpp-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-moss-tts-cpp-development" +- &magpiettscpp + name: "magpie-tts-cpp" + description: | + Magpie TTS C++ backend using GGML (magpie-tts.cpp). Native C++ + text-to-speech for NVIDIA's Magpie TTS Multilingual 357M model (encoder + + autoregressive decoder over NanoCodec tokens), running from a single + self-contained GGUF (model, codec, tokenizer, G2P dictionaries) with no + Python at inference time. 22.05kHz mono output, 5 baked voices (Aria, + Jason, John, Leo, Sofia), 9+ languages. + urls: + - https://github.com/mudler/magpie-tts.cpp + - https://huggingface.co/mudler/magpie-tts.cpp-gguf + tags: + - text-to-speech + - tts + alias: "magpie-tts-cpp" + capabilities: + default: "cpu-magpie-tts-cpp" + nvidia: "cuda12-magpie-tts-cpp" + nvidia-cuda-13: "cuda13-magpie-tts-cpp" + nvidia-cuda-12: "cuda12-magpie-tts-cpp" + intel: "intel-sycl-f16-magpie-tts-cpp" + metal: "metal-magpie-tts-cpp" + amd: "rocm-magpie-tts-cpp" + vulkan: "vulkan-magpie-tts-cpp" + nvidia-l4t: "nvidia-l4t-arm64-magpie-tts-cpp" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-magpie-tts-cpp" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-magpie-tts-cpp" +- !!merge <<: *magpiettscpp + name: "magpie-tts-cpp-development" + capabilities: + default: "cpu-magpie-tts-cpp-development" + nvidia: "cuda12-magpie-tts-cpp-development" + nvidia-cuda-13: "cuda13-magpie-tts-cpp-development" + nvidia-cuda-12: "cuda12-magpie-tts-cpp-development" + intel: "intel-sycl-f16-magpie-tts-cpp-development" + metal: "metal-magpie-tts-cpp-development" + amd: "rocm-magpie-tts-cpp-development" + vulkan: "vulkan-magpie-tts-cpp-development" + nvidia-l4t: "nvidia-l4t-arm64-magpie-tts-cpp-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-magpie-tts-cpp-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-magpie-tts-cpp-development" +- &omnivoicecpp + name: "omnivoice-cpp" + description: | + OmniVoice C++ backend using GGML. Native text-to-speech with voice cloning + (reference audio + transcript) and voice design (attribute keywords: gender, + age, pitch, style, volume, emotion). 24kHz mono output, 646 languages. + Supports streaming synthesis. + urls: + - https://github.com/ServeurpersoCom/omnivoice.cpp + tags: + - text-to-speech + - tts + - voice-cloning + - voice-design + alias: "omnivoice-cpp" + capabilities: + default: "cpu-omnivoice-cpp" + nvidia: "cuda12-omnivoice-cpp" + nvidia-cuda-13: "cuda13-omnivoice-cpp" + nvidia-cuda-12: "cuda12-omnivoice-cpp" + intel: "intel-sycl-f16-omnivoice-cpp" + metal: "metal-omnivoice-cpp" + amd: "rocm-omnivoice-cpp" + vulkan: "vulkan-omnivoice-cpp" + nvidia-l4t: "nvidia-l4t-arm64-omnivoice-cpp" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-omnivoice-cpp" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-omnivoice-cpp" +- &vibevoicecpp + name: "vibevoice-cpp" + description: | + vibevoice.cpp C++ backend using GGML. Native C++ port of Microsoft VibeVoice for both + text-to-speech (with voice cloning via voice prompt GGUFs) and long-form ASR with + speaker diarization. Outputs 24kHz mono WAV; ASR returns per-speaker JSON segments. + urls: + - https://github.com/mudler/vibevoice.cpp + tags: + - text-to-speech + - tts + - speech-to-text + - asr + - voice-cloning + - diarization + alias: "vibevoice-cpp" + capabilities: + default: "cpu-vibevoice-cpp" + nvidia: "cuda12-vibevoice-cpp" + nvidia-cuda-13: "cuda13-vibevoice-cpp" + nvidia-cuda-12: "cuda12-vibevoice-cpp" + intel: "intel-sycl-f16-vibevoice-cpp" + metal: "metal-vibevoice-cpp" + amd: "rocm-vibevoice-cpp" + vulkan: "vulkan-vibevoice-cpp" + nvidia-l4t: "nvidia-l4t-arm64-vibevoice-cpp" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-vibevoice-cpp" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-vibevoice-cpp" +- &localvqecpp + name: "localvqe" + description: | + LocalVQE C++ backend using GGML — joint acoustic echo cancellation, noise + suppression, and dereverberation (DeepVQE-style architecture). 16 kHz mono + in / out, supports both batch and low-latency streaming. Implements the + audio-transform capability. + urls: + - https://github.com/localai-org/LocalVQE + tags: + - audio-transform + - aec + - acoustic-echo-cancellation + - noise-suppression + - dereverberation + license: apache2 + alias: "localvqe" + # Upstream LocalVQE only supports CPU and Vulkan; no CUDA/ROCm/SYCL/Metal + # builds. GPU-class hardware that exposes a Vulkan ICD (NVIDIA, AMD, Intel + # discrete + iGPU, Tegra) routes to the Vulkan image; everything else + # falls back to the CPU build, which is already ~9× realtime on a desktop. + capabilities: + default: "cpu-localvqe" + nvidia: "vulkan-localvqe" + nvidia-cuda-12: "vulkan-localvqe" + nvidia-cuda-13: "vulkan-localvqe" + intel: "vulkan-localvqe" + amd: "vulkan-localvqe" + vulkan: "vulkan-localvqe" + nvidia-l4t: "vulkan-localvqe" + nvidia-l4t-cuda-12: "vulkan-localvqe" + nvidia-l4t-cuda-13: "vulkan-localvqe" + # Apple Silicon: CPU build (LocalVQE has no Metal path); still arm64-native. + metal: "metal-localvqe" +- &privacyfilter + name: "privacy-filter" + alias: "privacy-filter" + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/5fd5e18a90b6dc4633f6d292/QPiv8pt4JNxr0FdGnpFef.png + description: | + Standalone GGML engine (privacy-filter.cpp) for the OpenMed privacy-filter + PII/NER token-classification model family. It runs the openai-privacy-filter + architecture (a gpt-oss-style sparse-MoE bidirectional token classifier) on + stock upstream GGML — no llama.cpp coupling and no Python — and serves the + TokenClassify RPC (constrained BIOES Viterbi decode into UTF-8 byte-offset + entity spans) used by LocalAI's NER PII redaction tier. + urls: + - https://github.com/localai-org/privacy-filter.cpp + tags: + - token-classification + - ner + - pii + - privacy + - CPU + - GPU + license: apache-2.0 + # Builds: CPU (amd64+arm64 manifest), Vulkan (amd64) and CUDA 13 (amd64). + # Only a host that actually reports CUDA 13 gets the CUDA image (it bundles + # the CUDA 13 runtime and needs a recent driver); every other GPU — including + # NVIDIA without a CUDA-13 toolkit, AMD and Intel — routes to the Vulkan + # image, which only needs a Vulkan ICD. Everything else (incl. arm64/Jetson, + # where Vulkan/CUDA images are a future add) falls back to the CPU build, + # already fast for this ~50M-active-param model. + capabilities: + default: "cpu-privacy-filter" + nvidia: "vulkan-privacy-filter" + nvidia-cuda-12: "vulkan-privacy-filter" + nvidia-cuda-13: "cuda13-privacy-filter" + amd: "vulkan-privacy-filter" + intel: "vulkan-privacy-filter" + vulkan: "vulkan-privacy-filter" + metal: "metal-privacy-filter" +- &faster-whisper + icon: https://avatars.githubusercontent.com/u/1520500?s=200&v=4 + description: | + faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is a fast inference engine for Transformer models. + This implementation is up to 4 times faster than openai/whisper for the same accuracy while using less memory. The efficiency can be further improved with 8-bit quantization on both CPU and GPU. + urls: + - https://github.com/SYSTRAN/faster-whisper + tags: + - speech-to-text + - Whisper + license: MIT + name: "faster-whisper" + capabilities: + default: "cpu-faster-whisper" + nvidia: "cuda12-faster-whisper" + intel: "intel-faster-whisper" + amd: "rocm-faster-whisper" + metal: "metal-faster-whisper" + nvidia-cuda-13: "cuda13-faster-whisper" + nvidia-cuda-12: "cuda12-faster-whisper" + nvidia-l4t: "nvidia-l4t-arm64-faster-whisper" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-faster-whisper" +- &whisper-medusa + description: | + Whisper-Medusa accelerates Whisper transcription by predicting multiple tokens per decoding step. + The upstream checkpoints use custom Transformers generation code and accept audio clips up to 30 seconds. + urls: + - https://github.com/aiola-lab/whisper-medusa + - https://huggingface.co/collections/aiola/whisper-medusa + tags: + - speech-to-text + - transcription + - Whisper + - Medusa + license: MIT + name: "whisper-medusa" + alias: "whisper-medusa" + capabilities: + default: "cpu-whisper-medusa" + nvidia: "cuda12-whisper-medusa" + nvidia-cuda-12: "cuda12-whisper-medusa" +- &moonshine + description: | + Moonshine is a fast, accurate, and efficient speech-to-text transcription model using ONNX Runtime. + It provides real-time transcription capabilities with support for multiple model sizes and GPU acceleration. + urls: + - https://github.com/moonshine-ai/moonshine + tags: + - speech-to-text + - transcription + - ONNX + license: MIT + name: "moonshine" + alias: "moonshine" + capabilities: + nvidia: "cuda12-moonshine" + metal: "metal-moonshine" + default: "cpu-moonshine" + nvidia-cuda-13: "cuda13-moonshine" + nvidia-cuda-12: "cuda12-moonshine" +- &whisperx + description: | + WhisperX provides fast automatic speech recognition with word-level timestamps, speaker diarization, + and forced alignment. Built on faster-whisper and pyannote-audio for high-accuracy transcription + with speaker identification. + urls: + - https://github.com/m-bain/whisperX + tags: + - speech-to-text + - diarization + - whisperx + license: BSD-4-Clause + name: "whisperx" + alias: "whisperx" + capabilities: + nvidia: "cuda12-whisperx" + metal: "metal-whisperx" + default: "cpu-whisperx" + nvidia-cuda-13: "cuda13-whisperx" + nvidia-cuda-12: "cuda12-whisperx" + nvidia-l4t: "nvidia-l4t-arm64-whisperx" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-whisperx" +- &kokoro + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoro is an open-weight TTS model with 82 million parameters. Despite its lightweight architecture, it delivers comparable quality to larger models while being significantly faster and more cost-efficient. With Apache-licensed weights, Kokoro can be deployed anywhere from production environments to personal projects. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/hexgrad/kokoro + tags: + - text-to-speech + - TTS + - LLM + license: apache-2.0 + alias: "kokoro" + name: "kokoro" + capabilities: + default: "cpu-kokoro" + nvidia: "cuda12-kokoro" + intel: "intel-kokoro" + amd: "rocm-kokoro" + nvidia-l4t: "nvidia-l4t-kokoro" + metal: "metal-kokoro" + nvidia-cuda-13: "cuda13-kokoro" + nvidia-cuda-12: "cuda12-kokoro" + nvidia-l4t-cuda-12: "nvidia-l4t-kokoro" +- &kokoros + icon: https://avatars.githubusercontent.com/u/166769057?v=4 + description: | + Kokoros is a pure Rust TTS backend using the Kokoro ONNX model (82M parameters). + It provides fast, high-quality text-to-speech with streaming support, built on + ONNX Runtime for efficient CPU inference. Supports English, Japanese, Mandarin + Chinese, and German. + urls: + - https://huggingface.co/hexgrad/Kokoro-82M + - https://github.com/lucasjinreal/Kokoros + tags: + - text-to-speech + - TTS + - Rust + - ONNX + license: apache-2.0 + alias: "kokoros" + name: "kokoros" + capabilities: + default: "cpu-kokoros" +- &coqui + urls: + - https://github.com/idiap/coqui-ai-TTS + description: | + 🐸 Coqui TTS is a library for advanced Text-to-Speech generation. + + 🚀 Pretrained models in +1100 languages. + + 🛠️ Tools for training new models and fine-tuning existing models in any language. + + 📚 Utilities for dataset analysis and curation. + tags: + - text-to-speech + - TTS + license: mpl-2.0 + name: "coqui" + alias: "coqui" + capabilities: + nvidia: "cuda12-coqui" + intel: "intel-coqui" + amd: "rocm-coqui" + metal: "metal-coqui" + nvidia-cuda-12: "cuda12-coqui" + icon: https://avatars.githubusercontent.com/u/1338804?s=200&v=4 +- &outetts + urls: + - https://github.com/OuteAI/outetts + description: | + OuteTTS is an open-weight text-to-speech model from OuteAI (OuteAI/OuteTTS-0.3-1B). + Supports custom speaker voices via audio path or default speakers. + tags: + - text-to-speech + - TTS + license: apache-2.0 + name: "outetts" + alias: "outetts" + capabilities: + default: "cpu-outetts" + nvidia-cuda-12: "cuda12-outetts" +- &chatterbox + urls: + - https://github.com/resemble-ai/chatterbox + description: | + Resemble AI's first production-grade open source TTS model. Licensed under MIT, Chatterbox has been benchmarked against leading closed-source systems like ElevenLabs, and is consistently preferred in side-by-side evaluations. + Whether you're working on memes, videos, games, or AI agents, Chatterbox brings your content to life. It's also the first open source TTS model to support emotion exaggeration control, a powerful feature that makes your voices stand out. + tags: + - text-to-speech + - TTS + license: MIT + icon: https://avatars.githubusercontent.com/u/49844015?s=200&v=4 + name: "chatterbox" + alias: "chatterbox" + capabilities: + nvidia: "cuda12-chatterbox" + metal: "metal-chatterbox" + default: "cpu-chatterbox" + nvidia-l4t: "nvidia-l4t-arm64-chatterbox" + nvidia-cuda-13: "cuda13-chatterbox" + nvidia-cuda-12: "cuda12-chatterbox" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-chatterbox" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-chatterbox" +- &vibevoice + urls: + - https://github.com/microsoft/VibeVoice + description: | + VibeVoice-Realtime is a real-time text-to-speech model that generates natural-sounding speech. + tags: + - text-to-speech + - TTS + license: mit + name: "vibevoice" + alias: "vibevoice" + capabilities: + nvidia: "cuda12-vibevoice" + intel: "intel-vibevoice" + amd: "rocm-vibevoice" + nvidia-l4t: "nvidia-l4t-vibevoice" + metal: "metal-vibevoice" + default: "cpu-vibevoice" + nvidia-cuda-13: "cuda13-vibevoice" + nvidia-cuda-12: "cuda12-vibevoice" + nvidia-l4t-cuda-12: "nvidia-l4t-vibevoice" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-vibevoice" + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 +- &liquid-audio + urls: + - https://github.com/Liquid4All/liquid-audio + - https://huggingface.co/LiquidAI/LFM2.5-Audio-1.5B + description: | + LiquidAI LFM2 / LFM2.5 Audio Python backend. End-to-end speech-to-speech, ASR, + TTS (4 baked voices), and text chat from a single 1.5B model. Wraps the + upstream `liquid-audio` package; supports fine-tuning via LocalAI's + /v1/fine-tuning/jobs endpoint. + tags: + - speech-to-speech + - any-to-any + - text-to-speech + - speech-to-text + - TTS + - ASR + - realtime + license: LFM-Open-License-v1.0 + name: "liquid-audio" + alias: "liquid-audio" + capabilities: + nvidia: "cuda12-liquid-audio" + intel: "intel-liquid-audio" + amd: "rocm-liquid-audio" + default: "cpu-liquid-audio" + nvidia-cuda-13: "cuda13-liquid-audio" + nvidia-cuda-12: "cuda12-liquid-audio" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-liquid-audio" + metal: "metal-liquid-audio" + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/61b8e2ba285851687028d395/7_6D7rWrLxp2hb6OHSV1p.png +- &qwen-tts + urls: + - https://github.com/QwenLM/Qwen3-TTS + description: | + Qwen3-TTS is a high-quality text-to-speech model supporting custom voice, voice design, and voice cloning. + tags: + - text-to-speech + - TTS + license: apache-2.0 + name: "qwen-tts" + alias: "qwen-tts" + capabilities: + nvidia: "cuda12-qwen-tts" + intel: "intel-qwen-tts" + amd: "rocm-qwen-tts" + nvidia-l4t: "nvidia-l4t-qwen-tts" + metal: "metal-qwen-tts" + default: "cpu-qwen-tts" + nvidia-cuda-13: "cuda13-qwen-tts" + nvidia-cuda-12: "cuda12-qwen-tts" + nvidia-l4t-cuda-12: "nvidia-l4t-qwen-tts" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-qwen-tts" + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png +- &fish-speech + urls: + - https://github.com/fishaudio/fish-speech + description: | + Fish Speech is a high-quality text-to-speech model supporting voice cloning via reference audio. + tags: + - text-to-speech + - TTS + - voice-cloning + license: apache-2.0 + name: "fish-speech" + alias: "fish-speech" + capabilities: + nvidia: "cuda12-fish-speech" + intel: "intel-fish-speech" + amd: "rocm-fish-speech" + nvidia-l4t: "nvidia-l4t-fish-speech" + default: "cpu-fish-speech" + nvidia-cuda-13: "cuda13-fish-speech" + nvidia-cuda-12: "cuda12-fish-speech" + nvidia-l4t-cuda-12: "nvidia-l4t-fish-speech" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-fish-speech" + icon: https://avatars.githubusercontent.com/u/148526220?s=200&v=4 +- &faster-qwen3-tts + urls: + - https://github.com/andimarafioti/faster-qwen3-tts + - https://pypi.org/project/faster-qwen3-tts/ + description: | + Real-time Qwen3-TTS inference using CUDA graph capture. Voice clone only; requires NVIDIA GPU with CUDA. + tags: + - text-to-speech + - TTS + - voice-clone + license: apache-2.0 + name: "faster-qwen3-tts" + alias: "faster-qwen3-tts" + capabilities: + nvidia: "cuda12-faster-qwen3-tts" + default: "cuda12-faster-qwen3-tts" + nvidia-cuda-13: "cuda13-faster-qwen3-tts" + nvidia-cuda-12: "cuda12-faster-qwen3-tts" + nvidia-l4t: "nvidia-l4t-faster-qwen3-tts" + nvidia-l4t-cuda-12: "nvidia-l4t-faster-qwen3-tts" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-faster-qwen3-tts" + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png +- &funasr + urls: + - https://github.com/modelscope/FunASR + description: | + FunASR is an industrial-grade speech recognition toolkit supporting 50+ languages. + Includes SenseVoice (170x realtime, emotion detection), Paraformer (highest Chinese + accuracy), and built-in VAD, punctuation restoration, and speaker diarization. + tags: + - speech-recognition + - ASR + - multilingual + license: mit + name: "funasr" + alias: "funasr" + capabilities: + nvidia: "cuda12-funasr" + intel: "intel-funasr" + amd: "rocm-funasr" + metal: "metal-funasr" + default: "cpu-funasr" + nvidia-cuda-13: "cuda13-funasr" + nvidia-cuda-12: "cuda12-funasr" + nvidia-l4t: "nvidia-l4t-funasr" + nvidia-l4t-cuda-12: "nvidia-l4t-funasr" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-funasr" + icon: https://avatars.githubusercontent.com/u/109454077 +- &qwen-asr + urls: + - https://github.com/QwenLM/Qwen3-ASR + description: | + Qwen3-ASR is an automatic speech recognition model supporting multiple languages and batch inference. + tags: + - speech-recognition + - ASR + license: apache-2.0 + name: "qwen-asr" + alias: "qwen-asr" + capabilities: + nvidia: "cuda12-qwen-asr" + intel: "intel-qwen-asr" + amd: "rocm-qwen-asr" + nvidia-l4t: "nvidia-l4t-qwen-asr" + metal: "metal-qwen-asr" + default: "cpu-qwen-asr" + nvidia-cuda-13: "cuda13-qwen-asr" + nvidia-cuda-12: "cuda12-qwen-asr" + nvidia-l4t-cuda-12: "nvidia-l4t-qwen-asr" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-qwen-asr" + icon: https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/-s1gyJfvbE1RgO5iBeNOi.png +- &nemo + urls: + - https://github.com/NVIDIA/NeMo + description: | + NVIDIA NEMO Toolkit for ASR provides state-of-the-art automatic speech recognition models including Parakeet models for various languages and use cases. + tags: + - speech-recognition + - ASR + - NVIDIA + license: apache-2.0 + name: "nemo" + alias: "nemo" + capabilities: + nvidia: "cuda12-nemo" + intel: "intel-nemo" + amd: "rocm-nemo" + metal: "metal-nemo" + default: "cpu-nemo" + nvidia-cuda-13: "cuda13-nemo" + nvidia-cuda-12: "cuda12-nemo" + icon: https://www.nvidia.com/favicon.ico +- &voxcpm + urls: + - https://github.com/ModelBest/VoxCPM + description: | + VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech. + tags: + - text-to-speech + - TTS + license: mit + name: "voxcpm" + alias: "voxcpm" + capabilities: + nvidia: "cuda12-voxcpm" + intel: "intel-voxcpm" + amd: "rocm-voxcpm" + metal: "metal-voxcpm" + default: "cpu-voxcpm" + nvidia-cuda-13: "cuda13-voxcpm" + nvidia-cuda-12: "cuda12-voxcpm" + icon: https://avatars.githubusercontent.com/u/6154722?s=200&v=4 +- &pocket-tts + urls: + - https://github.com/kyutai-labs/pocket-tts + description: | + Pocket TTS is a lightweight text-to-speech model designed to run efficiently on CPUs. + tags: + - text-to-speech + - TTS + license: mit + name: "pocket-tts" + alias: "pocket-tts" + capabilities: + nvidia: "cuda12-pocket-tts" + intel: "intel-pocket-tts" + amd: "rocm-pocket-tts" + nvidia-l4t: "nvidia-l4t-pocket-tts" + metal: "metal-pocket-tts" + default: "cpu-pocket-tts" + nvidia-cuda-13: "cuda13-pocket-tts" + nvidia-cuda-12: "cuda12-pocket-tts" + nvidia-l4t-cuda-12: "nvidia-l4t-pocket-tts" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-pocket-tts" + icon: https://avatars.githubusercontent.com/u/151010778?s=200&v=4 +- &piper + name: "piper" + icon: https://github.com/OHF-Voice/piper1-gpl/raw/main/etc/logo.png + urls: + - https://github.com/rhasspy/piper + - https://github.com/mudler/go-piper + license: MIT + description: | + A fast, local neural text to speech system + tags: + - text-to-speech + - TTS + capabilities: + default: "cpu-piper" + metal: "metal-piper" +- &opus + name: "opus" + alias: "opus" + capabilities: + default: "cpu-opus" + metal: "metal-opus" + urls: + - https://opus-codec.org/ + license: BSD-3-Clause + description: | + Opus audio codec backend for encoding and decoding audio. + Required for WebRTC transport in the Realtime API. + tags: + - audio-codec + - opus + - WebRTC + - realtime +- !!merge <<: *opus + name: "opus-development" + capabilities: + default: "cpu-opus-development" + metal: "metal-opus-development" +- &silero-vad + name: "silero-vad" + icon: https://user-images.githubusercontent.com/12515440/89997349-b3523080-dc94-11ea-9906-ca2e8bc50535.png + urls: + - https://github.com/snakers4/silero-vad + capabilities: + default: "cpu-silero-vad" + metal: "metal-silero-vad" + description: | + Silero VAD: pre-trained enterprise-grade Voice Activity Detector. + Silero VAD is a voice activity detection model that can be used to detect whether a given audio contains speech or not. + tags: + - voice-activity-detection + - VAD + - silero-vad + - CPU +- &local-store + name: "local-store" + urls: + - https://github.com/mudler/LocalAI + description: | + Local Store is a local-first, self-hosted, and open-source vector database. + tags: + - vector-database + - local-first + - open-source + - CPU + license: MIT + capabilities: + default: "cpu-local-store" + metal: "metal-local-store" +- &cloud-proxy + name: "cloud-proxy" + alias: "cloud-proxy" + urls: + - https://github.com/mudler/LocalAI/tree/master/backend/go/cloud-proxy + description: | + Forward OpenAI-compatible and Anthropic chat requests to external providers. + tags: + - text-to-text + - cloud + - proxy + - CPU + license: MIT + capabilities: + default: "cpu-cloud-proxy" + metal: "metal-cloud-proxy" +- &localai-proxy + name: "localai-proxy" + alias: "localai-proxy" + urls: + - https://github.com/mudler/LocalAI/tree/master/backend/go/localai-proxy + description: | + Serve a model from another LocalAI instance: text, embeddings, rerank, audio, image and video requests are forwarded to its REST API. + tags: + - text-to-text + - proxy + - CPU + license: MIT + capabilities: + default: "cpu-localai-proxy" + metal: "metal-localai-proxy" +- &valkey-store + name: "valkey-store" + urls: + - https://github.com/mudler/LocalAI + description: | + Valkey Store is a Valkey Search (FT.*) backed vector store for LocalAI. It + persists vectors across restarts and supports opt-in HNSW indexing. Requires + a reachable Valkey Search server (valkey/valkey-bundle). + tags: + - vector-database + - valkey + - open-source + - CPU + license: MIT + capabilities: + default: "cpu-valkey-store" + metal: "metal-valkey-store" +- &qdrant-store + name: "qdrant-store" + urls: + - https://github.com/mudler/LocalAI + - https://github.com/qdrant/qdrant + description: | + Qdrant Store is a Qdrant-backed vector store for LocalAI. It persists + vectors across restarts in HNSW-indexed collections and works with + self-hosted Qdrant (single node or cluster) and Qdrant Cloud. Requires a + reachable Qdrant server (gRPC port, 6334 by default). + tags: + - vector-database + - qdrant + - open-source + - CPU + license: MIT + capabilities: + default: "cpu-qdrant-store" + metal: "metal-qdrant-store" +- &kitten-tts + name: "kitten-tts" + urls: + - https://github.com/KittenML/KittenTTS + description: | + Kitten TTS is a text-to-speech model that can generate speech from text. + tags: + - text-to-speech + - TTS + license: apache-2.0 + capabilities: + default: "cpu-kitten-tts" + metal: "metal-kitten-tts" +- &neutts + name: "neutts" + urls: + - https://github.com/neuphonic/neutts-air + description: | + NeuTTS Air is the world’s first super-realistic, on-device, TTS speech language model with instant voice cloning. Built off a 0.5B LLM backbone, NeuTTS Air brings natural-sounding speech, real-time performance, built-in security and speaker cloning to your local device - unlocking a new category of embedded voice agents, assistants, toys, and compliance-safe apps. + tags: + - text-to-speech + - TTS + license: apache-2.0 + capabilities: + default: "cpu-neutts" + nvidia: "cuda12-neutts" + amd: "rocm-neutts" + nvidia-cuda-12: "cuda12-neutts" +- &sherpa-onnx + name: "sherpa-onnx" + alias: "sherpa-onnx" + urls: + - https://k2-fsa.github.io/sherpa/onnx/ + description: | + Sherpa-ONNX backend for text-to-speech (VITS, Matcha, Kokoro), speech-to-text (Whisper, Paraformer, SenseVoice, Omnilingual ASR CTC), and voice activity detection via ONNX Runtime. + Supports multi-speaker voices, 1600+ language ASR, and GPU acceleration. + tags: + - text-to-speech + - TTS + - speech-to-text + - ASR + capabilities: + default: "cpu-sherpa-onnx" + nvidia: "cuda12-sherpa-onnx" + nvidia-cuda-12: "cuda12-sherpa-onnx" + metal: "metal-sherpa-onnx" +- &supertonic + name: "supertonic" + alias: "supertonic" + urls: + - https://github.com/supertone-inc/supertonic + description: | + Supertonic backend: lightning-fast, on-device multilingual text-to-speech via ONNX Runtime. + Runs Supertone's flow-matching TTS model (Supertone/supertonic-3), 44.1kHz output, 31 languages, + multiple preset voice styles. No espeak-ng dependency. + tags: + - text-to-speech + - TTS + capabilities: + default: "cpu-supertonic" + metal: "metal-supertonic" +- !!merge <<: *neutts + name: "neutts-development" + capabilities: + default: "cpu-neutts-development" + nvidia: "cuda12-neutts-development" + amd: "rocm-neutts-development" + nvidia-cuda-12: "cuda12-neutts-development" +- !!merge <<: *llamacpp + name: "llama-cpp-development" + capabilities: + default: "cpu-llama-cpp-development" + nvidia: "cuda12-llama-cpp-development" + intel: "intel-sycl-f16-llama-cpp-development" + amd: "rocm-llama-cpp-development" + metal: "metal-llama-cpp-development" + vulkan: "vulkan-llama-cpp-development" + nvidia-l4t: "nvidia-l4t-arm64-llama-cpp-development" + nvidia-cuda-13: "cuda13-llama-cpp-development" + nvidia-cuda-12: "cuda12-llama-cpp-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-llama-cpp-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-llama-cpp-development" +- !!merge <<: *ikllamacpp + name: "ik-llama-cpp-development" + capabilities: + default: "cpu-ik-llama-cpp-development" +- !!merge <<: *turboquant + name: "turboquant-development" + capabilities: + default: "cpu-turboquant-development" + nvidia: "cuda12-turboquant-development" + intel: "intel-sycl-f16-turboquant-development" + amd: "rocm-turboquant-development" + vulkan: "vulkan-turboquant-development" + nvidia-l4t: "nvidia-l4t-arm64-turboquant-development" + nvidia-cuda-13: "cuda13-turboquant-development" + nvidia-cuda-12: "cuda12-turboquant-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-turboquant-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-turboquant-development" +- !!merge <<: *bonsai + name: "bonsai-development" + capabilities: + default: "cpu-bonsai-development" + nvidia: "cuda12-bonsai-development" + intel: "intel-sycl-f16-bonsai-development" + amd: "rocm-bonsai-development" + vulkan: "vulkan-bonsai-development" + nvidia-l4t: "nvidia-l4t-arm64-bonsai-development" + nvidia-cuda-13: "cuda13-bonsai-development" + nvidia-cuda-12: "cuda12-bonsai-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-bonsai-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-bonsai-development" +- !!merge <<: *ds4 + name: "ds4-development" + capabilities: + default: "cpu-ds4-development" + nvidia: "cuda13-ds4-development" + nvidia-cuda-13: "cuda13-ds4-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-ds4-development" + metal: "metal-ds4-development" + metal-darwin-arm64: "metal-ds4-development" +- !!merge <<: *audiocpp + name: "audio-cpp-development" + capabilities: + default: "cpu-audio-cpp-development" + nvidia: "cuda12-audio-cpp-development" + nvidia-cuda-12: "cuda12-audio-cpp-development" + nvidia-cuda-13: "cuda13-audio-cpp-development" + amd: "rocm-audio-cpp-development" + metal: "metal-audio-cpp-development" + metal-darwin-arm64: "metal-audio-cpp-development" +- !!merge <<: *stablediffusionggml + name: "stablediffusion-ggml-development" + capabilities: + default: "cpu-stablediffusion-ggml-development" + nvidia: "cuda12-stablediffusion-ggml-development" + intel: "intel-sycl-f16-stablediffusion-ggml-development" + amd: "rocm-stablediffusion-ggml-development" + vulkan: "vulkan-stablediffusion-ggml-development" + nvidia-l4t: "nvidia-l4t-arm64-stablediffusion-ggml-development" + metal: "metal-stablediffusion-ggml-development" + nvidia-cuda-13: "cuda13-stablediffusion-ggml-development" + nvidia-cuda-12: "cuda12-stablediffusion-ggml-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-stablediffusion-ggml-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-stablediffusion-ggml-development" +- !!merge <<: *trellis2cpp + name: "trellis2cpp-development" + capabilities: + default: "cpu-trellis2cpp-development" + nvidia: "cuda12-trellis2cpp-development" + vulkan: "vulkan-trellis2cpp-development" + nvidia-l4t: "nvidia-l4t-arm64-trellis2cpp-development" + metal: "metal-trellis2cpp-development" + nvidia-cuda-13: "cuda13-trellis2cpp-development" + nvidia-cuda-12: "cuda12-trellis2cpp-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-trellis2cpp-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-trellis2cpp-development" +- !!merge <<: *neutts + name: "cpu-neutts" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-neutts" + mirrors: + - localai/localai-backends:latest-cpu-neutts +- !!merge <<: *neutts + name: "cuda12-neutts" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-neutts" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-neutts +- !!merge <<: *neutts + name: "rocm-neutts" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-neutts" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-neutts +- !!merge <<: *neutts + name: "cpu-neutts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-neutts" + mirrors: + - localai/localai-backends:master-cpu-neutts +- !!merge <<: *neutts + name: "cuda12-neutts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-neutts" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-neutts +- !!merge <<: *neutts + name: "rocm-neutts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-neutts" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-neutts +- !!merge <<: *mlx + name: "metal-mlx" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-mlx +- !!merge <<: *mlx-video + name: "metal-mlx-video" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx-video" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-mlx-video +- !!merge <<: *mlx-video + name: "metal-mlx-video-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-mlx-video" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-mlx-video +- !!merge <<: *mlx-video + name: "mlx-video-development" + capabilities: + metal: "metal-mlx-video-development" +- !!merge <<: *mlx + name: "metal-mlx-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-mlx" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-mlx +- !!merge <<: *mlx + name: "mlx-development" + capabilities: + default: "cpu-mlx-development" + nvidia: "cuda12-mlx-development" + metal: "metal-mlx-development" + nvidia-cuda-12: "cuda12-mlx-development" + nvidia-cuda-13: "cuda13-mlx-development" + nvidia-l4t: "nvidia-l4t-mlx-development" + nvidia-l4t-cuda-12: "nvidia-l4t-mlx-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx-development" +- !!merge <<: *mlx-vlm + name: "metal-mlx-vlm" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx-vlm" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-mlx-vlm +- !!merge <<: *mlx-vlm + name: "metal-mlx-vlm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-mlx-vlm" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-mlx-vlm +- !!merge <<: *mlx-vlm + name: "mlx-vlm-development" + capabilities: + default: "cpu-mlx-vlm-development" + nvidia: "cuda12-mlx-vlm-development" + metal: "metal-mlx-vlm-development" + nvidia-cuda-12: "cuda12-mlx-vlm-development" + nvidia-cuda-13: "cuda13-mlx-vlm-development" + nvidia-l4t: "nvidia-l4t-mlx-vlm-development" + nvidia-l4t-cuda-12: "nvidia-l4t-mlx-vlm-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx-vlm-development" +- !!merge <<: *mlx-audio + name: "metal-mlx-audio" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx-audio" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-mlx-audio +- !!merge <<: *mlx-audio + name: "metal-mlx-audio-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-mlx-audio" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-mlx-audio +- !!merge <<: *mlx-audio + name: "mlx-audio-development" + capabilities: + default: "cpu-mlx-audio-development" + nvidia: "cuda12-mlx-audio-development" + metal: "metal-mlx-audio-development" + nvidia-cuda-12: "cuda12-mlx-audio-development" + nvidia-cuda-13: "cuda13-mlx-audio-development" + nvidia-l4t: "nvidia-l4t-mlx-audio-development" + nvidia-l4t-cuda-12: "nvidia-l4t-mlx-audio-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx-audio-development" +- !!merge <<: *mlx-distributed + name: "metal-mlx-distributed" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx-distributed" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-mlx-distributed +- !!merge <<: *mlx-distributed + name: "metal-mlx-distributed-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-mlx-distributed" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-mlx-distributed +- !!merge <<: *mlx-distributed + name: "mlx-distributed-development" + capabilities: + default: "cpu-mlx-distributed-development" + nvidia: "cuda12-mlx-distributed-development" + metal: "metal-mlx-distributed-development" + nvidia-cuda-12: "cuda12-mlx-distributed-development" + nvidia-cuda-13: "cuda13-mlx-distributed-development" + nvidia-l4t: "nvidia-l4t-mlx-distributed-development" + nvidia-l4t-cuda-12: "nvidia-l4t-mlx-distributed-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-mlx-distributed-development" +## mlx +- !!merge <<: *mlx + name: "cpu-mlx" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-mlx" + mirrors: + - localai/localai-backends:latest-cpu-mlx +- !!merge <<: *mlx + name: "cpu-mlx-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-mlx" + mirrors: + - localai/localai-backends:master-cpu-mlx +- !!merge <<: *mlx + name: "cuda12-mlx" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-mlx" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-mlx +- !!merge <<: *mlx + name: "cuda12-mlx-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-mlx" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-mlx +- !!merge <<: *mlx + name: "cuda13-mlx" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-mlx" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-mlx +- !!merge <<: *mlx + name: "cuda13-mlx-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-mlx" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-mlx +- !!merge <<: *mlx + name: "nvidia-l4t-mlx" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-mlx" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-mlx +- !!merge <<: *mlx + name: "nvidia-l4t-mlx-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-mlx" + mirrors: + - localai/localai-backends:master-nvidia-l4t-mlx +- !!merge <<: *mlx + name: "cuda13-nvidia-l4t-arm64-mlx" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx +- !!merge <<: *mlx + name: "cuda13-nvidia-l4t-arm64-mlx-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-mlx" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-mlx +## mlx-vlm +- !!merge <<: *mlx-vlm + name: "cpu-mlx-vlm" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-mlx-vlm" + mirrors: + - localai/localai-backends:latest-cpu-mlx-vlm +- !!merge <<: *mlx-vlm + name: "cpu-mlx-vlm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-mlx-vlm" + mirrors: + - localai/localai-backends:master-cpu-mlx-vlm +- !!merge <<: *mlx-vlm + name: "cuda12-mlx-vlm" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-mlx-vlm" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-mlx-vlm +- !!merge <<: *mlx-vlm + name: "cuda12-mlx-vlm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-mlx-vlm" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-mlx-vlm +- !!merge <<: *mlx-vlm + name: "cuda13-mlx-vlm" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-mlx-vlm" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-mlx-vlm +- !!merge <<: *mlx-vlm + name: "cuda13-mlx-vlm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-mlx-vlm" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-mlx-vlm +- !!merge <<: *mlx-vlm + name: "nvidia-l4t-mlx-vlm" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-mlx-vlm" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-mlx-vlm +- !!merge <<: *mlx-vlm + name: "nvidia-l4t-mlx-vlm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-mlx-vlm" + mirrors: + - localai/localai-backends:master-nvidia-l4t-mlx-vlm +- !!merge <<: *mlx-vlm + name: "cuda13-nvidia-l4t-arm64-mlx-vlm" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx-vlm" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx-vlm +- !!merge <<: *mlx-vlm + name: "cuda13-nvidia-l4t-arm64-mlx-vlm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-mlx-vlm" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-mlx-vlm +## mlx-audio +- !!merge <<: *mlx-audio + name: "cpu-mlx-audio" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-mlx-audio" + mirrors: + - localai/localai-backends:latest-cpu-mlx-audio +- !!merge <<: *mlx-audio + name: "cpu-mlx-audio-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-mlx-audio" + mirrors: + - localai/localai-backends:master-cpu-mlx-audio +- !!merge <<: *mlx-audio + name: "cuda12-mlx-audio" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-mlx-audio" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-mlx-audio +- !!merge <<: *mlx-audio + name: "cuda12-mlx-audio-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-mlx-audio" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-mlx-audio +- !!merge <<: *mlx-audio + name: "cuda13-mlx-audio" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-mlx-audio" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-mlx-audio +- !!merge <<: *mlx-audio + name: "cuda13-mlx-audio-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-mlx-audio" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-mlx-audio +- !!merge <<: *mlx-audio + name: "nvidia-l4t-mlx-audio" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-mlx-audio" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-mlx-audio +- !!merge <<: *mlx-audio + name: "nvidia-l4t-mlx-audio-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-mlx-audio" + mirrors: + - localai/localai-backends:master-nvidia-l4t-mlx-audio +- !!merge <<: *mlx-audio + name: "cuda13-nvidia-l4t-arm64-mlx-audio" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx-audio" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx-audio +- !!merge <<: *mlx-audio + name: "cuda13-nvidia-l4t-arm64-mlx-audio-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-mlx-audio" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-mlx-audio +## mlx-distributed +- !!merge <<: *mlx-distributed + name: "cpu-mlx-distributed" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-mlx-distributed" + mirrors: + - localai/localai-backends:latest-cpu-mlx-distributed +- !!merge <<: *mlx-distributed + name: "cpu-mlx-distributed-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-mlx-distributed" + mirrors: + - localai/localai-backends:master-cpu-mlx-distributed +- !!merge <<: *mlx-distributed + name: "cuda12-mlx-distributed" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-mlx-distributed" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-mlx-distributed +- !!merge <<: *mlx-distributed + name: "cuda12-mlx-distributed-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-mlx-distributed" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-mlx-distributed +- !!merge <<: *mlx-distributed + name: "cuda13-mlx-distributed" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-mlx-distributed" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-mlx-distributed +- !!merge <<: *mlx-distributed + name: "cuda13-mlx-distributed-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-mlx-distributed" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-mlx-distributed +- !!merge <<: *mlx-distributed + name: "nvidia-l4t-mlx-distributed" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-mlx-distributed" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-mlx-distributed +- !!merge <<: *mlx-distributed + name: "nvidia-l4t-mlx-distributed-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-mlx-distributed" + mirrors: + - localai/localai-backends:master-nvidia-l4t-mlx-distributed +- !!merge <<: *mlx-distributed + name: "cuda13-nvidia-l4t-arm64-mlx-distributed" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx-distributed" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-mlx-distributed +- !!merge <<: *mlx-distributed + name: "cuda13-nvidia-l4t-arm64-mlx-distributed-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-mlx-distributed" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-mlx-distributed +- !!merge <<: *kitten-tts + name: "cpu-kitten-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-kitten-tts" + mirrors: + - localai/localai-backends:latest-kitten-tts +- !!merge <<: *kitten-tts + name: "cpu-kitten-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-kitten-tts" + mirrors: + - localai/localai-backends:master-kitten-tts +- !!merge <<: *kitten-tts + name: "kitten-tts-development" + capabilities: + default: "cpu-kitten-tts-development" + metal: "metal-kitten-tts-development" +- !!merge <<: *kitten-tts + name: "metal-kitten-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-kitten-tts" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-kitten-tts +- !!merge <<: *kitten-tts + name: "metal-kitten-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-kitten-tts" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-kitten-tts +- !!merge <<: *local-store + name: "cpu-local-store" + alias: "local-store" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-local-store" + mirrors: + - localai/localai-backends:latest-cpu-local-store +- !!merge <<: *local-store + name: "cpu-local-store-development" + alias: "local-store" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-local-store" + mirrors: + - localai/localai-backends:master-cpu-local-store +- !!merge <<: *local-store + name: "local-store-development" + alias: "local-store" + capabilities: + default: "cpu-local-store-development" + metal: "metal-local-store-development" +- !!merge <<: *local-store + name: "metal-local-store" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-local-store" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-local-store +- !!merge <<: *local-store + name: "metal-local-store-development" + alias: "local-store" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-local-store" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-local-store +- !!merge <<: *cloud-proxy + name: "cpu-cloud-proxy" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-cloud-proxy" + mirrors: + - localai/localai-backends:latest-cpu-cloud-proxy +- !!merge <<: *cloud-proxy + name: "cpu-cloud-proxy-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-cloud-proxy" + mirrors: + - localai/localai-backends:master-cpu-cloud-proxy +- !!merge <<: *cloud-proxy + name: "cloud-proxy-development" + capabilities: + default: "cpu-cloud-proxy-development" + metal: "metal-cloud-proxy-development" +- !!merge <<: *cloud-proxy + name: "metal-cloud-proxy" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-cloud-proxy" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-cloud-proxy +- !!merge <<: *cloud-proxy + name: "metal-cloud-proxy-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-cloud-proxy" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-cloud-proxy +- !!merge <<: *localai-proxy + name: "cpu-localai-proxy" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-localai-proxy" + mirrors: + - localai/localai-backends:latest-cpu-localai-proxy +- !!merge <<: *localai-proxy + name: "cpu-localai-proxy-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-localai-proxy" + mirrors: + - localai/localai-backends:master-cpu-localai-proxy +- !!merge <<: *localai-proxy + name: "localai-proxy-development" + capabilities: + default: "cpu-localai-proxy-development" + metal: "metal-localai-proxy-development" +- !!merge <<: *localai-proxy + name: "metal-localai-proxy" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-localai-proxy" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-localai-proxy +- !!merge <<: *localai-proxy + name: "metal-localai-proxy-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-localai-proxy" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-localai-proxy +- !!merge <<: *valkey-store + name: "cpu-valkey-store" + alias: "valkey-store" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-valkey-store" + mirrors: + - localai/localai-backends:latest-cpu-valkey-store +- !!merge <<: *valkey-store + name: "cpu-valkey-store-development" + alias: "valkey-store" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-valkey-store" + mirrors: + - localai/localai-backends:master-cpu-valkey-store +- !!merge <<: *valkey-store + name: "valkey-store-development" + alias: "valkey-store" + capabilities: + default: "cpu-valkey-store-development" + metal: "metal-valkey-store-development" +- !!merge <<: *valkey-store + name: "metal-valkey-store" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-valkey-store" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-valkey-store +- !!merge <<: *valkey-store + name: "metal-valkey-store-development" + alias: "valkey-store" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-valkey-store" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-valkey-store +- !!merge <<: *qdrant-store + name: "cpu-qdrant-store" + alias: "qdrant-store" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-qdrant-store" + mirrors: + - localai/localai-backends:latest-cpu-qdrant-store +- !!merge <<: *qdrant-store + name: "cpu-qdrant-store-development" + alias: "qdrant-store" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-qdrant-store" + mirrors: + - localai/localai-backends:master-cpu-qdrant-store +- !!merge <<: *qdrant-store + name: "qdrant-store-development" + alias: "qdrant-store" + capabilities: + default: "cpu-qdrant-store-development" + metal: "metal-qdrant-store-development" +- !!merge <<: *qdrant-store + name: "metal-qdrant-store" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-qdrant-store" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-qdrant-store +- !!merge <<: *qdrant-store + name: "metal-qdrant-store-development" + alias: "qdrant-store" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-qdrant-store" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-qdrant-store +- !!merge <<: *opus + name: "cpu-opus" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-opus" + mirrors: + - localai/localai-backends:latest-cpu-opus +- !!merge <<: *opus + name: "cpu-opus-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-opus" + mirrors: + - localai/localai-backends:master-cpu-opus +- !!merge <<: *opus + name: "metal-opus" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-opus" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-opus +- !!merge <<: *opus + name: "metal-opus-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-opus" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-opus +- !!merge <<: *silero-vad + name: "cpu-silero-vad" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-silero-vad" + mirrors: + - localai/localai-backends:latest-cpu-silero-vad +- !!merge <<: *silero-vad + name: "cpu-silero-vad-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-silero-vad" + mirrors: + - localai/localai-backends:master-cpu-silero-vad +- !!merge <<: *silero-vad + name: "silero-vad-development" + capabilities: + default: "cpu-silero-vad-development" + metal: "metal-silero-vad-development" +- !!merge <<: *silero-vad + name: "metal-silero-vad" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-silero-vad" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-silero-vad +- !!merge <<: *silero-vad + name: "metal-silero-vad-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-silero-vad" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-silero-vad +- !!merge <<: *piper + name: "cpu-piper" + uri: "quay.io/go-skynet/local-ai-backends:latest-piper" + mirrors: + - localai/localai-backends:latest-piper +- !!merge <<: *piper + name: "cpu-piper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-piper" + mirrors: + - localai/localai-backends:master-piper +- !!merge <<: *piper + name: "piper-development" + capabilities: + default: "cpu-piper-development" + metal: "metal-piper-development" +- !!merge <<: *piper + name: "metal-piper" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-piper" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-piper +- !!merge <<: *piper + name: "metal-piper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-piper" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-piper +## llama-cpp +- !!merge <<: *llamacpp + name: "nvidia-l4t-arm64-llama-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-llama-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-llama-cpp +- !!merge <<: *llamacpp + name: "nvidia-l4t-arm64-llama-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-llama-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-llama-cpp +- !!merge <<: *llamacpp + name: "cuda13-nvidia-l4t-arm64-llama-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-llama-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-llama-cpp +- !!merge <<: *llamacpp + name: "cuda13-nvidia-l4t-arm64-llama-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-llama-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-llama-cpp +- !!merge <<: *llamacpp + name: "cpu-llama-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-llama-cpp" + mirrors: + - localai/localai-backends:latest-cpu-llama-cpp +- !!merge <<: *llamacpp + name: "cpu-llama-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-llama-cpp" + mirrors: + - localai/localai-backends:master-cpu-llama-cpp +- !!merge <<: *llamacpp + name: "cuda12-llama-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-llama-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-llama-cpp +- !!merge <<: *llamacpp + name: "rocm-llama-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-llama-cpp" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-llama-cpp +- !!merge <<: *llamacpp + name: "intel-sycl-f32-llama-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-llama-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-llama-cpp +- !!merge <<: *llamacpp + name: "intel-sycl-f16-llama-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-llama-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-llama-cpp +- !!merge <<: *llamacpp + name: "vulkan-llama-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-llama-cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-llama-cpp +- !!merge <<: *llamacpp + name: "vulkan-llama-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-llama-cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-llama-cpp +- !!merge <<: *llamacpp + name: "metal-llama-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-llama-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-llama-cpp +- !!merge <<: *llamacpp + name: "metal-llama-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-llama-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-llama-cpp +- !!merge <<: *llamacpp + name: "cuda12-llama-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-llama-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-llama-cpp +- !!merge <<: *llamacpp + name: "rocm-llama-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-llama-cpp" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-llama-cpp +- !!merge <<: *llamacpp + name: "intel-sycl-f32-llama-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-llama-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-llama-cpp +- !!merge <<: *llamacpp + name: "intel-sycl-f16-llama-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-llama-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-llama-cpp +- !!merge <<: *llamacpp + name: "cuda13-llama-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-llama-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-llama-cpp +- !!merge <<: *llamacpp + name: "cuda13-llama-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-llama-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-llama-cpp +## ik-llama-cpp +- !!merge <<: *ikllamacpp + name: "cpu-ik-llama-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-ik-llama-cpp" + mirrors: + - localai/localai-backends:latest-cpu-ik-llama-cpp +- !!merge <<: *ikllamacpp + name: "cpu-ik-llama-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-ik-llama-cpp" + mirrors: + - localai/localai-backends:master-cpu-ik-llama-cpp +## turboquant +- !!merge <<: *turboquant + name: "cpu-turboquant" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-turboquant" + mirrors: + - localai/localai-backends:latest-cpu-turboquant +- !!merge <<: *turboquant + name: "cpu-turboquant-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-turboquant" + mirrors: + - localai/localai-backends:master-cpu-turboquant +- !!merge <<: *turboquant + name: "cuda12-turboquant" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-turboquant" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-turboquant +- !!merge <<: *turboquant + name: "cuda12-turboquant-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-turboquant" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-turboquant +- !!merge <<: *turboquant + name: "cuda13-turboquant" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-turboquant" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-turboquant +- !!merge <<: *turboquant + name: "cuda13-turboquant-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-turboquant" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-turboquant +- !!merge <<: *turboquant + name: "rocm-turboquant" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-turboquant" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-turboquant +- !!merge <<: *turboquant + name: "rocm-turboquant-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-turboquant" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-turboquant +- !!merge <<: *turboquant + name: "intel-sycl-f32-turboquant" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-turboquant" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-turboquant +- !!merge <<: *turboquant + name: "intel-sycl-f32-turboquant-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-turboquant" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-turboquant +- !!merge <<: *turboquant + name: "intel-sycl-f16-turboquant" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-turboquant" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-turboquant +- !!merge <<: *turboquant + name: "intel-sycl-f16-turboquant-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-turboquant" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-turboquant +- !!merge <<: *turboquant + name: "vulkan-turboquant" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-turboquant" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-turboquant +- !!merge <<: *turboquant + name: "vulkan-turboquant-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-turboquant" + mirrors: + - localai/localai-backends:master-gpu-vulkan-turboquant +- !!merge <<: *turboquant + name: "nvidia-l4t-arm64-turboquant" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-turboquant" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-turboquant +- !!merge <<: *turboquant + name: "nvidia-l4t-arm64-turboquant-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-turboquant" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-turboquant +- !!merge <<: *turboquant + name: "cuda13-nvidia-l4t-arm64-turboquant" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-turboquant" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-turboquant +- !!merge <<: *turboquant + name: "cuda13-nvidia-l4t-arm64-turboquant-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-turboquant" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-turboquant +## bonsai +- !!merge <<: *bonsai + name: "cpu-bonsai" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-bonsai" + mirrors: + - localai/localai-backends:latest-cpu-bonsai +- !!merge <<: *bonsai + name: "cpu-bonsai-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-bonsai" + mirrors: + - localai/localai-backends:master-cpu-bonsai +- !!merge <<: *bonsai + name: "cuda12-bonsai" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-bonsai" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-bonsai +- !!merge <<: *bonsai + name: "cuda12-bonsai-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-bonsai" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-bonsai +- !!merge <<: *bonsai + name: "cuda13-bonsai" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-bonsai" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-bonsai +- !!merge <<: *bonsai + name: "cuda13-bonsai-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-bonsai" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-bonsai +- !!merge <<: *bonsai + name: "rocm-bonsai" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-bonsai" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-bonsai +- !!merge <<: *bonsai + name: "rocm-bonsai-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-bonsai" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-bonsai +- !!merge <<: *bonsai + name: "intel-sycl-f32-bonsai" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-bonsai" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-bonsai +- !!merge <<: *bonsai + name: "intel-sycl-f32-bonsai-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-bonsai" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-bonsai +- !!merge <<: *bonsai + name: "intel-sycl-f16-bonsai" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-bonsai" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-bonsai +- !!merge <<: *bonsai + name: "intel-sycl-f16-bonsai-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-bonsai" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-bonsai +- !!merge <<: *bonsai + name: "vulkan-bonsai" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-bonsai" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-bonsai +- !!merge <<: *bonsai + name: "vulkan-bonsai-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-bonsai" + mirrors: + - localai/localai-backends:master-gpu-vulkan-bonsai +- !!merge <<: *bonsai + name: "nvidia-l4t-arm64-bonsai" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-bonsai" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-bonsai +- !!merge <<: *bonsai + name: "nvidia-l4t-arm64-bonsai-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-bonsai" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-bonsai +- !!merge <<: *bonsai + name: "cuda13-nvidia-l4t-arm64-bonsai" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-bonsai" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-bonsai +- !!merge <<: *bonsai + name: "cuda13-nvidia-l4t-arm64-bonsai-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-bonsai" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-bonsai +## ds4 +- !!merge <<: *ds4 + name: "cpu-ds4" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-ds4" + mirrors: + - localai/localai-backends:latest-cpu-ds4 +- !!merge <<: *ds4 + name: "cpu-ds4-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-ds4" + mirrors: + - localai/localai-backends:master-cpu-ds4 +- !!merge <<: *ds4 + name: "cuda13-ds4" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-ds4" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-ds4 +- !!merge <<: *ds4 + name: "cuda13-ds4-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-ds4" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-ds4 +- !!merge <<: *ds4 + name: "cuda13-nvidia-l4t-arm64-ds4" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-ds4" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-ds4 +- !!merge <<: *ds4 + name: "cuda13-nvidia-l4t-arm64-ds4-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-ds4" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-ds4 +- !!merge <<: *ds4 + name: "metal-ds4" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-ds4" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-ds4 +- !!merge <<: *ds4 + name: "metal-ds4-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-ds4" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-ds4 +## whisper +- !!merge <<: *whispercpp + name: "whisper-development" + capabilities: + default: "cpu-whisper-development" + nvidia: "cuda12-whisper-development" + intel: "intel-sycl-f16-whisper-development" + metal: "metal-whisper-development" + amd: "rocm-whisper-development" + vulkan: "vulkan-whisper-development" + nvidia-l4t: "nvidia-l4t-arm64-whisper-development" + nvidia-cuda-13: "cuda13-whisper-development" + nvidia-cuda-12: "cuda12-whisper-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-whisper-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-whisper-development" +- !!merge <<: *whispercpp + name: "nvidia-l4t-arm64-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-whisper" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-whisper +- !!merge <<: *whispercpp + name: "nvidia-l4t-arm64-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-whisper" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-whisper +- !!merge <<: *whispercpp + name: "cuda13-nvidia-l4t-arm64-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-whisper" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-whisper +- !!merge <<: *whispercpp + name: "cuda13-nvidia-l4t-arm64-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-whisper" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-whisper +- !!merge <<: *whispercpp + name: "cpu-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-whisper" + mirrors: + - localai/localai-backends:latest-cpu-whisper +- !!merge <<: *whispercpp + name: "metal-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-whisper" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-whisper +- !!merge <<: *whispercpp + name: "metal-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-whisper" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-whisper +- !!merge <<: *whispercpp + name: "cpu-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-whisper" + mirrors: + - localai/localai-backends:master-cpu-whisper +- !!merge <<: *whispercpp + name: "cuda12-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-whisper" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-whisper +- !!merge <<: *whispercpp + name: "rocm-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-whisper" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-whisper +- !!merge <<: *whispercpp + name: "intel-sycl-f32-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-whisper" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-whisper +- !!merge <<: *whispercpp + name: "intel-sycl-f16-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-whisper" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-whisper +- !!merge <<: *whispercpp + name: "vulkan-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-whisper" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-whisper +- !!merge <<: *whispercpp + name: "vulkan-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-whisper" + mirrors: + - localai/localai-backends:master-gpu-vulkan-whisper +- !!merge <<: *whispercpp + name: "metal-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-whisper" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-whisper +- !!merge <<: *whispercpp + name: "metal-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-whisper" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-whisper +- !!merge <<: *whispercpp + name: "cuda12-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-whisper" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-whisper +- !!merge <<: *whispercpp + name: "rocm-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-whisper" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-whisper +- !!merge <<: *whispercpp + name: "intel-sycl-f32-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-whisper" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-whisper +- !!merge <<: *whispercpp + name: "intel-sycl-f16-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-whisper" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-whisper +- !!merge <<: *whispercpp + name: "cuda13-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-whisper" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-whisper +- !!merge <<: *whispercpp + name: "cuda13-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-whisper" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-whisper +## crispasr +- !!merge <<: *crispasr + name: "crispasr-development" + capabilities: + default: "cpu-crispasr-development" + nvidia: "cuda12-crispasr-development" + intel: "intel-sycl-f16-crispasr-development" + metal: "metal-crispasr-development" + amd: "rocm-crispasr-development" + vulkan: "vulkan-crispasr-development" + nvidia-l4t: "nvidia-l4t-arm64-crispasr-development" + nvidia-cuda-13: "cuda13-crispasr-development" + nvidia-cuda-12: "cuda12-crispasr-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-crispasr-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-crispasr-development" +- !!merge <<: *crispasr + name: "nvidia-l4t-arm64-crispasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-crispasr" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-crispasr +- !!merge <<: *crispasr + name: "nvidia-l4t-arm64-crispasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-crispasr" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-crispasr +- !!merge <<: *crispasr + name: "cuda13-nvidia-l4t-arm64-crispasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-crispasr" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-crispasr +- !!merge <<: *crispasr + name: "cuda13-nvidia-l4t-arm64-crispasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-crispasr" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-crispasr +- !!merge <<: *crispasr + name: "cpu-crispasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-crispasr" + mirrors: + - localai/localai-backends:latest-cpu-crispasr +- !!merge <<: *crispasr + name: "metal-crispasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-crispasr" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-crispasr +- !!merge <<: *crispasr + name: "metal-crispasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-crispasr" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-crispasr +- !!merge <<: *crispasr + name: "cpu-crispasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-crispasr" + mirrors: + - localai/localai-backends:master-cpu-crispasr +- !!merge <<: *crispasr + name: "cuda12-crispasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-crispasr" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-crispasr +- !!merge <<: *crispasr + name: "rocm-crispasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-crispasr" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-crispasr +- !!merge <<: *crispasr + name: "intel-sycl-f32-crispasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-crispasr" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-crispasr +- !!merge <<: *crispasr + name: "intel-sycl-f16-crispasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-crispasr" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-crispasr +- !!merge <<: *crispasr + name: "vulkan-crispasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-crispasr" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-crispasr +- !!merge <<: *crispasr + name: "vulkan-crispasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-crispasr" + mirrors: + - localai/localai-backends:master-gpu-vulkan-crispasr +- !!merge <<: *crispasr + name: "metal-crispasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-crispasr" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-crispasr +- !!merge <<: *crispasr + name: "metal-crispasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-crispasr" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-crispasr +- !!merge <<: *crispasr + name: "cuda12-crispasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-crispasr" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-crispasr +- !!merge <<: *crispasr + name: "rocm-crispasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-crispasr" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-crispasr +- !!merge <<: *crispasr + name: "intel-sycl-f32-crispasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-crispasr" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-crispasr +- !!merge <<: *crispasr + name: "intel-sycl-f16-crispasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-crispasr" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-crispasr +- !!merge <<: *crispasr + name: "cuda13-crispasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-crispasr" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-crispasr +- !!merge <<: *crispasr + name: "cuda13-crispasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-crispasr" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-crispasr +## parakeet-cpp +- !!merge <<: *parakeetcpp + name: "parakeet-cpp-development" + capabilities: + default: "cpu-parakeet-cpp-development" + nvidia: "cuda12-parakeet-cpp-development" + intel: "intel-sycl-f16-parakeet-cpp-development" + metal: "metal-parakeet-cpp-development" + amd: "rocm-parakeet-cpp-development" + vulkan: "vulkan-parakeet-cpp-development" + nvidia-l4t: "nvidia-l4t-arm64-parakeet-cpp-development" + nvidia-cuda-13: "cuda13-parakeet-cpp-development" + nvidia-cuda-12: "cuda12-parakeet-cpp-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-parakeet-cpp-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-parakeet-cpp-development" +- !!merge <<: *parakeetcpp + name: "nvidia-l4t-arm64-parakeet-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-parakeet-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "nvidia-l4t-arm64-parakeet-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-parakeet-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "cuda13-nvidia-l4t-arm64-parakeet-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-parakeet-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "cuda13-nvidia-l4t-arm64-parakeet-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-parakeet-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "cpu-parakeet-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-parakeet-cpp" + mirrors: + - localai/localai-backends:latest-cpu-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "cpu-parakeet-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-parakeet-cpp" + mirrors: + - localai/localai-backends:master-cpu-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "metal-parakeet-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-parakeet-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "metal-parakeet-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-parakeet-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "cuda12-parakeet-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-parakeet-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "cuda12-parakeet-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-parakeet-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "rocm-parakeet-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-parakeet-cpp" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "rocm-parakeet-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-parakeet-cpp" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "intel-sycl-f32-parakeet-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-parakeet-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "intel-sycl-f32-parakeet-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-parakeet-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "intel-sycl-f16-parakeet-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-parakeet-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "intel-sycl-f16-parakeet-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-parakeet-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "vulkan-parakeet-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-parakeet-cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "vulkan-parakeet-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-parakeet-cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "cuda13-parakeet-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-parakeet-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-parakeet-cpp +- !!merge <<: *parakeetcpp + name: "cuda13-parakeet-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-parakeet-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-parakeet-cpp +## nemo-speech-cpp +- !!merge <<: *nemospeechcpp + name: "nemo-speech-cpp-development" + capabilities: + default: "cpu-nemo-speech-cpp-development" + nvidia: "cuda12-nemo-speech-cpp-development" + metal: "metal-nemo-speech-cpp-development" + vulkan: "vulkan-nemo-speech-cpp-development" + nvidia-l4t: "nvidia-l4t-arm64-nemo-speech-cpp-development" + nvidia-cuda-13: "cuda13-nemo-speech-cpp-development" + nvidia-cuda-12: "cuda12-nemo-speech-cpp-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-nemo-speech-cpp-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-nemo-speech-cpp-development" +- !!merge <<: *nemospeechcpp + name: "cpu-nemo-speech-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-nemo-speech-cpp" + mirrors: + - localai/localai-backends:latest-cpu-nemo-speech-cpp +- !!merge <<: *nemospeechcpp + name: "cpu-nemo-speech-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-nemo-speech-cpp" + mirrors: + - localai/localai-backends:master-cpu-nemo-speech-cpp +- !!merge <<: *nemospeechcpp + name: "cuda12-nemo-speech-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-nemo-speech-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-nemo-speech-cpp +- !!merge <<: *nemospeechcpp + name: "cuda12-nemo-speech-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-nemo-speech-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-nemo-speech-cpp +- !!merge <<: *nemospeechcpp + name: "cuda13-nemo-speech-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-nemo-speech-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-nemo-speech-cpp +- !!merge <<: *nemospeechcpp + name: "cuda13-nemo-speech-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-nemo-speech-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-nemo-speech-cpp +- !!merge <<: *nemospeechcpp + name: "vulkan-nemo-speech-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-nemo-speech-cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-nemo-speech-cpp +- !!merge <<: *nemospeechcpp + name: "vulkan-nemo-speech-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-nemo-speech-cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-nemo-speech-cpp +- !!merge <<: *nemospeechcpp + name: "nvidia-l4t-arm64-nemo-speech-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-nemo-speech-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-nemo-speech-cpp +- !!merge <<: *nemospeechcpp + name: "nvidia-l4t-arm64-nemo-speech-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-nemo-speech-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-nemo-speech-cpp +- !!merge <<: *nemospeechcpp + name: "cuda13-nvidia-l4t-arm64-nemo-speech-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-nemo-speech-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-nemo-speech-cpp +- !!merge <<: *nemospeechcpp + name: "cuda13-nvidia-l4t-arm64-nemo-speech-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-nemo-speech-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-nemo-speech-cpp +- !!merge <<: *nemospeechcpp + name: "metal-nemo-speech-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-nemo-speech-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-nemo-speech-cpp +- !!merge <<: *nemospeechcpp + name: "metal-nemo-speech-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-nemo-speech-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-nemo-speech-cpp +## moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "moss-transcribe-cpp-development" + capabilities: + default: "cpu-moss-transcribe-cpp-development" + nvidia: "cuda12-moss-transcribe-cpp-development" + intel: "intel-sycl-f16-moss-transcribe-cpp-development" + metal: "metal-moss-transcribe-cpp-development" + amd: "rocm-moss-transcribe-cpp-development" + vulkan: "vulkan-moss-transcribe-cpp-development" + nvidia-l4t: "nvidia-l4t-arm64-moss-transcribe-cpp-development" + nvidia-cuda-13: "cuda13-moss-transcribe-cpp-development" + nvidia-cuda-12: "cuda12-moss-transcribe-cpp-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-moss-transcribe-cpp-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-moss-transcribe-cpp-development" +- !!merge <<: *mosstranscribecpp + name: "nvidia-l4t-arm64-moss-transcribe-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "nvidia-l4t-arm64-moss-transcribe-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "cuda13-nvidia-l4t-arm64-moss-transcribe-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "cuda13-nvidia-l4t-arm64-moss-transcribe-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "cpu-moss-transcribe-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:latest-cpu-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "cpu-moss-transcribe-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:master-cpu-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "metal-moss-transcribe-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "metal-moss-transcribe-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "cuda12-moss-transcribe-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "cuda12-moss-transcribe-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "rocm-moss-transcribe-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "rocm-moss-transcribe-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "intel-sycl-f32-moss-transcribe-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "intel-sycl-f32-moss-transcribe-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "intel-sycl-f16-moss-transcribe-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "intel-sycl-f16-moss-transcribe-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "vulkan-moss-transcribe-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "vulkan-moss-transcribe-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "cuda13-moss-transcribe-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-moss-transcribe-cpp +- !!merge <<: *mosstranscribecpp + name: "cuda13-moss-transcribe-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-moss-transcribe-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-moss-transcribe-cpp +## ced +- !!merge <<: *ced + name: "ced-development" + capabilities: + default: "cpu-ced-development" + nvidia: "cuda12-ced-development" + intel: "intel-sycl-f16-ced-development" + metal: "metal-ced-development" + amd: "rocm-ced-development" + vulkan: "vulkan-ced-development" + nvidia-l4t: "nvidia-l4t-arm64-ced-development" + nvidia-cuda-13: "cuda13-ced-development" + nvidia-cuda-12: "cuda12-ced-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-ced-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-ced-development" +- !!merge <<: *ced + name: "nvidia-l4t-arm64-ced" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-ced" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-ced +- !!merge <<: *ced + name: "nvidia-l4t-arm64-ced-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-ced" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-ced +- !!merge <<: *ced + name: "cuda13-nvidia-l4t-arm64-ced" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-ced" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-ced +- !!merge <<: *ced + name: "cuda13-nvidia-l4t-arm64-ced-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-ced" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-ced +- !!merge <<: *ced + name: "cpu-ced" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-ced" + mirrors: + - localai/localai-backends:latest-cpu-ced +- !!merge <<: *ced + name: "cpu-ced-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-ced" + mirrors: + - localai/localai-backends:master-cpu-ced +- !!merge <<: *ced + name: "metal-ced" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-ced" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-ced +- !!merge <<: *ced + name: "metal-ced-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-ced" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-ced +- !!merge <<: *ced + name: "cuda12-ced" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-ced" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-ced +- !!merge <<: *ced + name: "cuda12-ced-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-ced" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-ced +- !!merge <<: *ced + name: "rocm-ced" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-ced" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-ced +- !!merge <<: *ced + name: "rocm-ced-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-ced" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-ced +- !!merge <<: *ced + name: "intel-sycl-f32-ced" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-ced" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-ced +- !!merge <<: *ced + name: "intel-sycl-f32-ced-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-ced" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-ced +- !!merge <<: *ced + name: "intel-sycl-f16-ced" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-ced" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-ced +- !!merge <<: *ced + name: "intel-sycl-f16-ced-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-ced" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-ced +- !!merge <<: *ced + name: "vulkan-ced" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-ced" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-ced +- !!merge <<: *ced + name: "vulkan-ced-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-ced" + mirrors: + - localai/localai-backends:master-gpu-vulkan-ced +- !!merge <<: *ced + name: "cuda13-ced" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-ced" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-ced +- !!merge <<: *ced + name: "cuda13-ced-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-ced" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-ced +## voice-detect +- !!merge <<: *voicedetect + name: "voice-detect-development" + capabilities: + default: "cpu-voice-detect-development" + nvidia: "cuda12-voice-detect-development" + intel: "intel-sycl-f16-voice-detect-development" + metal: "metal-voice-detect-development" + amd: "rocm-voice-detect-development" + vulkan: "vulkan-voice-detect-development" + nvidia-l4t: "nvidia-l4t-arm64-voice-detect-development" + nvidia-cuda-13: "cuda13-voice-detect-development" + nvidia-cuda-12: "cuda12-voice-detect-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-voice-detect-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-voice-detect-development" +- !!merge <<: *voicedetect + name: "nvidia-l4t-arm64-voice-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-voice-detect" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-voice-detect +- !!merge <<: *voicedetect + name: "nvidia-l4t-arm64-voice-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-voice-detect" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-voice-detect +- !!merge <<: *voicedetect + name: "cuda13-nvidia-l4t-arm64-voice-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-voice-detect" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-voice-detect +- !!merge <<: *voicedetect + name: "cuda13-nvidia-l4t-arm64-voice-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-voice-detect" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-voice-detect +- !!merge <<: *voicedetect + name: "cpu-voice-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-voice-detect" + mirrors: + - localai/localai-backends:latest-cpu-voice-detect +- !!merge <<: *voicedetect + name: "cpu-voice-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-voice-detect" + mirrors: + - localai/localai-backends:master-cpu-voice-detect +- !!merge <<: *voicedetect + name: "metal-voice-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-voice-detect" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-voice-detect +- !!merge <<: *voicedetect + name: "metal-voice-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-voice-detect" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-voice-detect +- !!merge <<: *voicedetect + name: "cuda12-voice-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-voice-detect" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-voice-detect +- !!merge <<: *voicedetect + name: "cuda12-voice-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-voice-detect" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-voice-detect +- !!merge <<: *voicedetect + name: "rocm-voice-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-voice-detect" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-voice-detect +- !!merge <<: *voicedetect + name: "rocm-voice-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-voice-detect" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-voice-detect +- !!merge <<: *voicedetect + name: "intel-sycl-f32-voice-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-voice-detect" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-voice-detect +- !!merge <<: *voicedetect + name: "intel-sycl-f32-voice-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-voice-detect" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-voice-detect +- !!merge <<: *voicedetect + name: "intel-sycl-f16-voice-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-voice-detect" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-voice-detect +- !!merge <<: *voicedetect + name: "intel-sycl-f16-voice-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-voice-detect" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-voice-detect +- !!merge <<: *voicedetect + name: "vulkan-voice-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-voice-detect" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-voice-detect +- !!merge <<: *voicedetect + name: "vulkan-voice-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-voice-detect" + mirrors: + - localai/localai-backends:master-gpu-vulkan-voice-detect +- !!merge <<: *voicedetect + name: "cuda13-voice-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-voice-detect" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-voice-detect +- !!merge <<: *voicedetect + name: "cuda13-voice-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-voice-detect" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-voice-detect +## face-detect +- !!merge <<: *facedetect + name: "face-detect-development" + capabilities: + default: "cpu-face-detect-development" + nvidia: "cuda12-face-detect-development" + intel: "intel-sycl-f16-face-detect-development" + metal: "metal-face-detect-development" + amd: "rocm-face-detect-development" + vulkan: "vulkan-face-detect-development" + nvidia-l4t: "nvidia-l4t-arm64-face-detect-development" + nvidia-cuda-13: "cuda13-face-detect-development" + nvidia-cuda-12: "cuda12-face-detect-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-face-detect-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-face-detect-development" +- !!merge <<: *facedetect + name: "nvidia-l4t-arm64-face-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-face-detect" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-face-detect +- !!merge <<: *facedetect + name: "nvidia-l4t-arm64-face-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-face-detect" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-face-detect +- !!merge <<: *facedetect + name: "cuda13-nvidia-l4t-arm64-face-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-face-detect" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-face-detect +- !!merge <<: *facedetect + name: "cuda13-nvidia-l4t-arm64-face-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-face-detect" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-face-detect +- !!merge <<: *facedetect + name: "cpu-face-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-face-detect" + mirrors: + - localai/localai-backends:latest-cpu-face-detect +- !!merge <<: *facedetect + name: "cpu-face-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-face-detect" + mirrors: + - localai/localai-backends:master-cpu-face-detect +- !!merge <<: *facedetect + name: "metal-face-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-face-detect" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-face-detect +- !!merge <<: *facedetect + name: "metal-face-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-face-detect" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-face-detect +- !!merge <<: *facedetect + name: "cuda12-face-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-face-detect" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-face-detect +- !!merge <<: *facedetect + name: "cuda12-face-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-face-detect" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-face-detect +- !!merge <<: *facedetect + name: "rocm-face-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-face-detect" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-face-detect +- !!merge <<: *facedetect + name: "rocm-face-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-face-detect" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-face-detect +- !!merge <<: *facedetect + name: "intel-sycl-f32-face-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-face-detect" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-face-detect +- !!merge <<: *facedetect + name: "intel-sycl-f32-face-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-face-detect" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-face-detect +- !!merge <<: *facedetect + name: "intel-sycl-f16-face-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-face-detect" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-face-detect +- !!merge <<: *facedetect + name: "intel-sycl-f16-face-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-face-detect" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-face-detect +- !!merge <<: *facedetect + name: "vulkan-face-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-face-detect" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-face-detect +- !!merge <<: *facedetect + name: "vulkan-face-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-face-detect" + mirrors: + - localai/localai-backends:master-gpu-vulkan-face-detect +- !!merge <<: *facedetect + name: "cuda13-face-detect" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-face-detect" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-face-detect +- !!merge <<: *facedetect + name: "cuda13-face-detect-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-face-detect" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-face-detect +## stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "cpu-stablediffusion-ggml" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-stablediffusion-ggml" + mirrors: + - localai/localai-backends:latest-cpu-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "cpu-stablediffusion-ggml-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-stablediffusion-ggml" + mirrors: + - localai/localai-backends:master-cpu-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "metal-stablediffusion-ggml" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-stablediffusion-ggml" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "metal-stablediffusion-ggml-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-stablediffusion-ggml" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "vulkan-stablediffusion-ggml" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-stablediffusion-ggml" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "vulkan-stablediffusion-ggml-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-stablediffusion-ggml" + mirrors: + - localai/localai-backends:master-gpu-vulkan-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "cuda12-stablediffusion-ggml" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-stablediffusion-ggml" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "rocm-stablediffusion-ggml" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-stablediffusion-ggml" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "intel-sycl-f32-stablediffusion-ggml" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-stablediffusion-ggml" +- !!merge <<: *stablediffusionggml + name: "intel-sycl-f16-stablediffusion-ggml" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-stablediffusion-ggml" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "cuda12-stablediffusion-ggml-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-stablediffusion-ggml" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "rocm-stablediffusion-ggml-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-stablediffusion-ggml" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "intel-sycl-f32-stablediffusion-ggml-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-stablediffusion-ggml" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "intel-sycl-f16-stablediffusion-ggml-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-stablediffusion-ggml" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "nvidia-l4t-arm64-stablediffusion-ggml-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-stablediffusion-ggml" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "nvidia-l4t-arm64-stablediffusion-ggml" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-stablediffusion-ggml" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "cuda13-nvidia-l4t-arm64-stablediffusion-ggml" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-stablediffusion-ggml" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "cuda13-nvidia-l4t-arm64-stablediffusion-ggml-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-stablediffusion-ggml" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "cuda13-stablediffusion-ggml" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-stablediffusion-ggml" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-stablediffusion-ggml +- !!merge <<: *stablediffusionggml + name: "cuda13-stablediffusion-ggml-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-stablediffusion-ggml" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-stablediffusion-ggml +## kimodo.cpp +- !!merge <<: *kimodocpp + name: "kimodocpp-development" + capabilities: + default: "cpu-kimodocpp-development" + vulkan: "vulkan-kimodocpp-development" + nvidia: "vulkan-kimodocpp-development" + nvidia-cuda-12: "vulkan-kimodocpp-development" + nvidia-cuda-13: "vulkan-kimodocpp-development" + amd: "vulkan-kimodocpp-development" + intel: "vulkan-kimodocpp-development" + metal: "cpu-darwin-arm64-kimodocpp-development" +- !!merge <<: *kimodocpp + name: "cpu-kimodocpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-kimodocpp" + mirrors: + - localai/localai-backends:latest-cpu-kimodocpp +- !!merge <<: *kimodocpp + name: "cpu-kimodocpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-kimodocpp" + mirrors: + - localai/localai-backends:master-cpu-kimodocpp +- !!merge <<: *kimodocpp + name: "vulkan-kimodocpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-kimodocpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-kimodocpp +- !!merge <<: *kimodocpp + name: "vulkan-kimodocpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-kimodocpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-kimodocpp +- !!merge <<: *kimodocpp + name: "cpu-darwin-arm64-kimodocpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-darwin-arm64-kimodocpp" + mirrors: + - localai/localai-backends:latest-cpu-darwin-arm64-kimodocpp +- !!merge <<: *kimodocpp + name: "cpu-darwin-arm64-kimodocpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-darwin-arm64-kimodocpp" + mirrors: + - localai/localai-backends:master-cpu-darwin-arm64-kimodocpp + +## gem-x.cpp +- !!merge <<: *gemxcpp + name: "gemxcpp-development" + capabilities: + default: "cpu-gemxcpp-development" + vulkan: "vulkan-gemxcpp-development" + nvidia: "vulkan-gemxcpp-development" + nvidia-cuda-12: "vulkan-gemxcpp-development" + nvidia-cuda-13: "vulkan-gemxcpp-development" + amd: "vulkan-gemxcpp-development" + intel: "vulkan-gemxcpp-development" + metal: "cpu-darwin-arm64-gemxcpp-development" +- !!merge <<: *gemxcpp + name: "cpu-gemxcpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-gemxcpp" + mirrors: + - localai/localai-backends:latest-cpu-gemxcpp +- !!merge <<: *gemxcpp + name: "cpu-gemxcpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-gemxcpp" + mirrors: + - localai/localai-backends:master-cpu-gemxcpp +- !!merge <<: *gemxcpp + name: "vulkan-gemxcpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-gemxcpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-gemxcpp +- !!merge <<: *gemxcpp + name: "vulkan-gemxcpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-gemxcpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-gemxcpp +- !!merge <<: *gemxcpp + name: "cpu-darwin-arm64-gemxcpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-darwin-arm64-gemxcpp" + mirrors: + - localai/localai-backends:latest-cpu-darwin-arm64-gemxcpp +- !!merge <<: *gemxcpp + name: "cpu-darwin-arm64-gemxcpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-darwin-arm64-gemxcpp" + mirrors: + - localai/localai-backends:master-cpu-darwin-arm64-gemxcpp + +## trellis2cpp +- !!merge <<: *trellis2cpp + name: "cpu-trellis2cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-trellis2cpp" + mirrors: + - localai/localai-backends:latest-cpu-trellis2cpp +- !!merge <<: *trellis2cpp + name: "cpu-trellis2cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-trellis2cpp" + mirrors: + - localai/localai-backends:master-cpu-trellis2cpp +- !!merge <<: *trellis2cpp + name: "metal-trellis2cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-trellis2cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-trellis2cpp +- !!merge <<: *trellis2cpp + name: "metal-trellis2cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-trellis2cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-trellis2cpp +- !!merge <<: *trellis2cpp + name: "vulkan-trellis2cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-trellis2cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-trellis2cpp +- !!merge <<: *trellis2cpp + name: "vulkan-trellis2cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-trellis2cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-trellis2cpp +- !!merge <<: *trellis2cpp + name: "cuda12-trellis2cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-trellis2cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-trellis2cpp +- !!merge <<: *trellis2cpp + name: "cuda12-trellis2cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-trellis2cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-trellis2cpp +- !!merge <<: *trellis2cpp + name: "cuda13-trellis2cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-trellis2cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-trellis2cpp +- !!merge <<: *trellis2cpp + name: "cuda13-trellis2cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-trellis2cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-trellis2cpp +- !!merge <<: *trellis2cpp + name: "nvidia-l4t-arm64-trellis2cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-trellis2cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-trellis2cpp +- !!merge <<: *trellis2cpp + name: "nvidia-l4t-arm64-trellis2cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-trellis2cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-trellis2cpp +- !!merge <<: *trellis2cpp + name: "cuda13-nvidia-l4t-arm64-trellis2cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-trellis2cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-trellis2cpp +- !!merge <<: *trellis2cpp + name: "cuda13-nvidia-l4t-arm64-trellis2cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-trellis2cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-trellis2cpp +## privacy-filter +- !!merge <<: *privacyfilter + name: "cpu-privacy-filter" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-privacy-filter" + mirrors: + - localai/localai-backends:latest-cpu-privacy-filter +- !!merge <<: *privacyfilter + name: "cpu-privacy-filter-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-privacy-filter" + mirrors: + - localai/localai-backends:master-cpu-privacy-filter +- !!merge <<: *privacyfilter + name: "vulkan-privacy-filter" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-privacy-filter" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-privacy-filter +- !!merge <<: *privacyfilter + name: "vulkan-privacy-filter-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-privacy-filter" + mirrors: + - localai/localai-backends:master-gpu-vulkan-privacy-filter +- !!merge <<: *privacyfilter + name: "metal-privacy-filter" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-privacy-filter" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-privacy-filter +- !!merge <<: *privacyfilter + name: "metal-privacy-filter-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-privacy-filter" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-privacy-filter +- !!merge <<: *privacyfilter + name: "cuda13-privacy-filter" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-privacy-filter" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-privacy-filter +- !!merge <<: *privacyfilter + name: "cuda13-privacy-filter-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-privacy-filter" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-privacy-filter +# vllm +- !!merge <<: *vllm + name: "vllm-development" + capabilities: + nvidia: "cuda12-vllm-development" + amd: "rocm-vllm-development" + intel: "intel-vllm-development" + nvidia-cuda-12: "cuda12-vllm-development" + nvidia-cuda-13: "cuda13-vllm-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-vllm-development" + cpu: "cpu-vllm-development" + metal: "metal-vllm-development" +- !!merge <<: *vllm + name: "metal-vllm" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-vllm" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-vllm +- !!merge <<: *vllm + name: "metal-vllm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-vllm" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-vllm +- !!merge <<: *vllm + name: "cuda12-vllm" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-vllm" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-vllm +- !!merge <<: *vllm + name: "cuda13-vllm" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-vllm" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-vllm +- !!merge <<: *vllm + name: "cuda13-nvidia-l4t-arm64-vllm" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-vllm" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-vllm +- !!merge <<: *vllm + name: "rocm-vllm" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-vllm" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-vllm +- !!merge <<: *vllm + name: "intel-vllm" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-vllm" + mirrors: + - localai/localai-backends:latest-gpu-intel-vllm +- !!merge <<: *vllm + name: "cpu-vllm" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-vllm" + mirrors: + - localai/localai-backends:latest-cpu-vllm +- !!merge <<: *vllm + name: "cuda12-vllm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-vllm" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-vllm +- !!merge <<: *vllm + name: "cuda13-vllm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-vllm" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-vllm +- !!merge <<: *vllm + name: "cuda13-nvidia-l4t-arm64-vllm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-vllm" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-vllm +- !!merge <<: *vllm + name: "rocm-vllm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-vllm" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-vllm +- !!merge <<: *vllm + name: "intel-vllm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-vllm" + mirrors: + - localai/localai-backends:master-gpu-intel-vllm +- !!merge <<: *vllm + name: "cpu-vllm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-vllm" + mirrors: + - localai/localai-backends:master-cpu-vllm +# sglang +- !!merge <<: *sglang + name: "sglang-development" + capabilities: + nvidia: "cuda12-sglang-development" + amd: "rocm-sglang-development" + intel: "intel-sglang-development" + nvidia-cuda-12: "cuda12-sglang-development" + nvidia-cuda-13: "cuda13-sglang-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-sglang-development" + cpu: "cpu-sglang-development" +- !!merge <<: *sglang + name: "cuda12-sglang" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-sglang" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-sglang +- !!merge <<: *sglang + name: "cuda13-sglang" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-sglang" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-sglang +- !!merge <<: *sglang + name: "cuda13-nvidia-l4t-arm64-sglang" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-sglang" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-sglang +- !!merge <<: *sglang + name: "rocm-sglang" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-sglang" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-sglang +- !!merge <<: *sglang + name: "intel-sglang" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sglang" + mirrors: + - localai/localai-backends:latest-gpu-intel-sglang +- !!merge <<: *sglang + name: "cpu-sglang" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-sglang" + mirrors: + - localai/localai-backends:latest-cpu-sglang +- !!merge <<: *sglang + name: "cuda12-sglang-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-sglang" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-sglang +- !!merge <<: *sglang + name: "cuda13-sglang-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-sglang" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-sglang +- !!merge <<: *sglang + name: "cuda13-nvidia-l4t-arm64-sglang-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-sglang" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-sglang +- !!merge <<: *sglang + name: "rocm-sglang-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-sglang" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-sglang +- !!merge <<: *sglang + name: "intel-sglang-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sglang" + mirrors: + - localai/localai-backends:master-gpu-intel-sglang +- !!merge <<: *sglang + name: "cpu-sglang-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-sglang" + mirrors: + - localai/localai-backends:master-cpu-sglang +# vllm-omni +- !!merge <<: *vllm-omni + name: "vllm-omni-development" + capabilities: + nvidia: "cuda12-vllm-omni-development" + amd: "rocm-vllm-omni-development" + nvidia-cuda-12: "cuda12-vllm-omni-development" + nvidia-cuda-13: "cuda13-vllm-omni-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-vllm-omni-development" +- !!merge <<: *vllm-omni + name: "cuda12-vllm-omni" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-vllm-omni" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-vllm-omni +- !!merge <<: *vllm-omni + name: "cuda13-vllm-omni" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-vllm-omni" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-vllm-omni +- !!merge <<: *vllm-omni + name: "cuda13-nvidia-l4t-arm64-vllm-omni" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-vllm-omni" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-vllm-omni +- !!merge <<: *vllm-omni + name: "rocm-vllm-omni" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-vllm-omni" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-vllm-omni +- !!merge <<: *vllm-omni + name: "cuda12-vllm-omni-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-vllm-omni" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-vllm-omni +- !!merge <<: *vllm-omni + name: "cuda13-vllm-omni-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-vllm-omni" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-vllm-omni +- !!merge <<: *vllm-omni + name: "cuda13-nvidia-l4t-arm64-vllm-omni-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-vllm-omni" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-vllm-omni +- !!merge <<: *vllm-omni + name: "rocm-vllm-omni-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-vllm-omni" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-vllm-omni +# longcat-video +- !!merge <<: *longcat-video + name: "longcat-video-development" + capabilities: + nvidia: "cuda12-longcat-video-development" + nvidia-cuda-12: "cuda12-longcat-video-development" + nvidia-cuda-13: "cuda13-longcat-video-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-longcat-video-development" +- !!merge <<: *longcat-video + name: "cuda12-longcat-video" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-longcat-video" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-longcat-video +- !!merge <<: *longcat-video + name: "cuda13-longcat-video" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-longcat-video" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-longcat-video +- !!merge <<: *longcat-video + name: "cuda13-nvidia-l4t-arm64-longcat-video" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-longcat-video" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-longcat-video +- !!merge <<: *longcat-video + name: "cuda12-longcat-video-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-longcat-video" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-longcat-video +- !!merge <<: *longcat-video + name: "cuda13-longcat-video-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-longcat-video" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-longcat-video +- !!merge <<: *longcat-video + name: "cuda13-nvidia-l4t-arm64-longcat-video-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-longcat-video" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-longcat-video +# rfdetr +- !!merge <<: *rfdetr + name: "rfdetr-development" + capabilities: + nvidia: "cuda12-rfdetr-development" + intel: "intel-rfdetr-development" + #amd: "rocm-rfdetr-development" + nvidia-l4t: "nvidia-l4t-arm64-rfdetr-development" + metal: "metal-rfdetr-development" + default: "cpu-rfdetr-development" + nvidia-cuda-13: "cuda13-rfdetr-development" +- !!merge <<: *rfdetr + name: "cuda12-rfdetr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-rfdetr" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-rfdetr +- !!merge <<: *rfdetr + name: "intel-rfdetr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-rfdetr" + mirrors: + - localai/localai-backends:latest-gpu-intel-rfdetr +# - !!merge <<: *rfdetr +# name: "rocm-rfdetr" +# uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-hipblas-rfdetr" +# mirrors: +# - localai/localai-backends:latest-gpu-hipblas-rfdetr +- !!merge <<: *rfdetr + name: "nvidia-l4t-arm64-rfdetr" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-rfdetr" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-rfdetr +- !!merge <<: *rfdetr + name: "nvidia-l4t-arm64-rfdetr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-rfdetr" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-rfdetr +- !!merge <<: *rfdetr + name: "cpu-rfdetr" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-rfdetr" + mirrors: + - localai/localai-backends:latest-cpu-rfdetr +- !!merge <<: *rfdetr + name: "cuda12-rfdetr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-rfdetr" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-rfdetr +- !!merge <<: *rfdetr + name: "intel-rfdetr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-rfdetr" + mirrors: + - localai/localai-backends:master-gpu-intel-rfdetr +# - !!merge <<: *rfdetr +# name: "rocm-rfdetr-development" +# uri: "quay.io/go-skynet/local-ai-backends:master-gpu-hipblas-rfdetr" +# mirrors: +# - localai/localai-backends:master-gpu-hipblas-rfdetr +- !!merge <<: *rfdetr + name: "cpu-rfdetr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-rfdetr" + mirrors: + - localai/localai-backends:master-cpu-rfdetr +- !!merge <<: *rfdetr + name: "intel-rfdetr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-rfdetr" + mirrors: + - localai/localai-backends:latest-gpu-intel-rfdetr +- !!merge <<: *rfdetr + name: "cuda13-rfdetr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-rfdetr" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-rfdetr +- !!merge <<: *rfdetr + name: "cuda13-rfdetr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-rfdetr" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-rfdetr +- !!merge <<: *rfdetr + name: "metal-rfdetr" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-rfdetr" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-rfdetr +- !!merge <<: *rfdetr + name: "metal-rfdetr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-rfdetr" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-rfdetr +## sam3-cpp +- !!merge <<: *sam3cpp + name: "sam3-cpp-development" + capabilities: + default: "cpu-sam3-cpp-development" + nvidia: "cuda12-sam3-cpp-development" + nvidia-cuda-12: "cuda12-sam3-cpp-development" + nvidia-cuda-13: "cuda13-sam3-cpp-development" + nvidia-l4t: "nvidia-l4t-arm64-sam3-cpp-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-sam3-cpp-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-sam3-cpp-development" + intel: "intel-sycl-f32-sam3-cpp-development" + vulkan: "vulkan-sam3-cpp-development" + metal: "metal-sam3-cpp-development" +- !!merge <<: *sam3cpp + name: "cpu-sam3-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-sam3-cpp" + mirrors: + - localai/localai-backends:latest-cpu-sam3-cpp +- !!merge <<: *sam3cpp + name: "cpu-sam3-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-sam3-cpp" + mirrors: + - localai/localai-backends:master-cpu-sam3-cpp +- !!merge <<: *sam3cpp + name: "metal-sam3-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-sam3-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-sam3-cpp +- !!merge <<: *sam3cpp + name: "metal-sam3-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-sam3-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-sam3-cpp +- !!merge <<: *sam3cpp + name: "cuda12-sam3-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-sam3-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-sam3-cpp +- !!merge <<: *sam3cpp + name: "cuda12-sam3-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-sam3-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-sam3-cpp +- !!merge <<: *sam3cpp + name: "cuda13-sam3-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-sam3-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-sam3-cpp +- !!merge <<: *sam3cpp + name: "cuda13-sam3-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-sam3-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-sam3-cpp +- !!merge <<: *sam3cpp + name: "nvidia-l4t-arm64-sam3-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-sam3-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-sam3-cpp +- !!merge <<: *sam3cpp + name: "nvidia-l4t-arm64-sam3-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-sam3-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-sam3-cpp +- !!merge <<: *sam3cpp + name: "cuda13-nvidia-l4t-arm64-sam3-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-sam3-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-sam3-cpp +- !!merge <<: *sam3cpp + name: "cuda13-nvidia-l4t-arm64-sam3-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-sam3-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-sam3-cpp +- !!merge <<: *sam3cpp + name: "intel-sycl-f32-sam3-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-sam3-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-sam3-cpp +- !!merge <<: *sam3cpp + name: "intel-sycl-f32-sam3-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-sam3-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-sam3-cpp +- !!merge <<: *sam3cpp + name: "vulkan-sam3-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-sam3-cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-sam3-cpp +- !!merge <<: *sam3cpp + name: "vulkan-sam3-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-sam3-cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-sam3-cpp +## rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "rfdetr-cpp-development" + capabilities: + default: "cpu-rfdetr-cpp-development" + nvidia: "cuda12-rfdetr-cpp-development" + nvidia-cuda-12: "cuda12-rfdetr-cpp-development" + nvidia-cuda-13: "cuda13-rfdetr-cpp-development" + nvidia-l4t: "nvidia-l4t-arm64-rfdetr-cpp-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-rfdetr-cpp-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-rfdetr-cpp-development" + intel: "intel-sycl-f32-rfdetr-cpp-development" + vulkan: "vulkan-rfdetr-cpp-development" + metal: "metal-rfdetr-cpp-development" +- !!merge <<: *rfdetrcpp + name: "cpu-rfdetr-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-rfdetr-cpp" + mirrors: + - localai/localai-backends:latest-cpu-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "cpu-rfdetr-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-rfdetr-cpp" + mirrors: + - localai/localai-backends:master-cpu-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "metal-rfdetr-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-rfdetr-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "metal-rfdetr-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-rfdetr-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "cuda12-rfdetr-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-rfdetr-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "cuda12-rfdetr-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-rfdetr-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "cuda13-rfdetr-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-rfdetr-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "cuda13-rfdetr-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-rfdetr-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "nvidia-l4t-arm64-rfdetr-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-rfdetr-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "nvidia-l4t-arm64-rfdetr-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-rfdetr-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "cuda13-nvidia-l4t-arm64-rfdetr-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-rfdetr-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "cuda13-nvidia-l4t-arm64-rfdetr-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-rfdetr-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "intel-sycl-f32-rfdetr-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-rfdetr-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "intel-sycl-f32-rfdetr-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-rfdetr-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "intel-sycl-f16-rfdetr-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-rfdetr-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "intel-sycl-f16-rfdetr-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-rfdetr-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "vulkan-rfdetr-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-rfdetr-cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-rfdetr-cpp +- !!merge <<: *rfdetrcpp + name: "vulkan-rfdetr-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-rfdetr-cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-rfdetr-cpp +## Rerankers +- !!merge <<: *rerankers + name: "rerankers-development" + capabilities: + nvidia: "cuda12-rerankers-development" + intel: "intel-rerankers-development" + amd: "rocm-rerankers-development" + metal: "metal-rerankers-development" + nvidia-cuda-13: "cuda13-rerankers-development" +- !!merge <<: *rerankers + name: "cuda12-rerankers" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-rerankers" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-rerankers +- !!merge <<: *rerankers + name: "intel-rerankers" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-rerankers" + mirrors: + - localai/localai-backends:latest-gpu-intel-rerankers +- !!merge <<: *rerankers + name: "rocm-rerankers" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-rerankers" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-rerankers +- !!merge <<: *rerankers + name: "cuda12-rerankers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-rerankers" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-rerankers +- !!merge <<: *rerankers + name: "rocm-rerankers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-rerankers" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-rerankers +- !!merge <<: *rerankers + name: "intel-rerankers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-rerankers" + mirrors: + - localai/localai-backends:master-gpu-intel-rerankers +- !!merge <<: *rerankers + name: "cuda13-rerankers" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-rerankers" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-rerankers +- !!merge <<: *rerankers + name: "cuda13-rerankers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-rerankers" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-rerankers +- !!merge <<: *rerankers + name: "metal-rerankers" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-rerankers" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-rerankers +- !!merge <<: *rerankers + name: "metal-rerankers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-rerankers" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-rerankers +## tinygrad +## Single image — the meta anchor above carries the latest uri directly +## since there is only one variant. The development entry below points at +## the master tag. +- !!merge <<: *tinygrad + name: "tinygrad-development" + uri: "quay.io/go-skynet/local-ai-backends:master-tinygrad" + mirrors: + - localai/localai-backends:master-tinygrad +## Transformers +- !!merge <<: *transformers + name: "transformers-development" + capabilities: + nvidia: "cuda12-transformers-development" + intel: "intel-transformers-development" + amd: "rocm-transformers-development" + metal: "metal-transformers-development" + nvidia-cuda-13: "cuda13-transformers-development" +- !!merge <<: *transformers + name: "cuda12-transformers" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-transformers" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-transformers +- !!merge <<: *transformers + name: "rocm-transformers" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-transformers" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-transformers +- !!merge <<: *transformers + name: "intel-transformers" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-transformers" + mirrors: + - localai/localai-backends:latest-gpu-intel-transformers +- !!merge <<: *transformers + name: "cuda12-transformers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-transformers" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-transformers +- !!merge <<: *transformers + name: "rocm-transformers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-transformers" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-transformers +- !!merge <<: *transformers + name: "intel-transformers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-transformers" + mirrors: + - localai/localai-backends:master-gpu-intel-transformers +- !!merge <<: *transformers + name: "cuda13-transformers" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-transformers" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-transformers +- !!merge <<: *transformers + name: "cuda13-transformers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-transformers" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-transformers +- !!merge <<: *transformers + name: "metal-transformers" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-transformers" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-transformers +- !!merge <<: *transformers + name: "metal-transformers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-transformers" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-transformers +## Diffusers +- !!merge <<: *diffusers + name: "diffusers-development" + capabilities: + nvidia: "cuda12-diffusers-development" + intel: "intel-diffusers-development" + amd: "rocm-diffusers-development" + nvidia-l4t: "nvidia-l4t-diffusers-development" + metal: "metal-diffusers-development" + default: "cpu-diffusers-development" + nvidia-cuda-13: "cuda13-diffusers-development" +- !!merge <<: *diffusers + name: "cpu-diffusers" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-diffusers" + mirrors: + - localai/localai-backends:latest-cpu-diffusers +- !!merge <<: *diffusers + name: "cpu-diffusers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-diffusers" + mirrors: + - localai/localai-backends:master-cpu-diffusers +- !!merge <<: *diffusers + name: "nvidia-l4t-diffusers" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-diffusers" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-diffusers +- !!merge <<: *diffusers + name: "nvidia-l4t-diffusers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-diffusers" + mirrors: + - localai/localai-backends:master-nvidia-l4t-diffusers +- !!merge <<: *diffusers + name: "cuda13-nvidia-l4t-arm64-diffusers" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-diffusers" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-diffusers +- !!merge <<: *diffusers + name: "cuda13-nvidia-l4t-arm64-diffusers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-diffusers" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-diffusers +- !!merge <<: *diffusers + name: "cuda12-diffusers" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-diffusers" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-diffusers +- !!merge <<: *diffusers + name: "rocm-diffusers" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-diffusers" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-diffusers +- !!merge <<: *diffusers + name: "intel-diffusers" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-diffusers" + mirrors: + - localai/localai-backends:latest-gpu-intel-diffusers +- !!merge <<: *diffusers + name: "cuda12-diffusers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-diffusers" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-diffusers +- !!merge <<: *diffusers + name: "rocm-diffusers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-diffusers" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-diffusers +- !!merge <<: *diffusers + name: "intel-diffusers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-diffusers" + mirrors: + - localai/localai-backends:master-gpu-intel-diffusers +- !!merge <<: *diffusers + name: "cuda13-diffusers" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-diffusers" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-diffusers +- !!merge <<: *diffusers + name: "cuda13-diffusers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-diffusers" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-diffusers +- !!merge <<: *diffusers + name: "metal-diffusers" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-diffusers" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-diffusers +- !!merge <<: *diffusers + name: "metal-diffusers-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-diffusers" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-diffusers +## ace-step +- !!merge <<: *ace-step + name: "cpu-ace-step" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-ace-step" + mirrors: + - localai/localai-backends:latest-cpu-ace-step +- !!merge <<: *ace-step + name: "cpu-ace-step-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-ace-step" + mirrors: + - localai/localai-backends:master-cpu-ace-step +- !!merge <<: *ace-step + name: "cuda12-ace-step" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-ace-step" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-ace-step +- !!merge <<: *ace-step + name: "cuda12-ace-step-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-ace-step" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-ace-step +- !!merge <<: *ace-step + name: "cuda13-ace-step" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-ace-step" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-ace-step +- !!merge <<: *ace-step + name: "cuda13-ace-step-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-ace-step" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-ace-step +- !!merge <<: *ace-step + name: "rocm-ace-step" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-ace-step" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-ace-step +- !!merge <<: *ace-step + name: "rocm-ace-step-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-ace-step" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-ace-step +- !!merge <<: *ace-step + name: "intel-ace-step" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-ace-step" + mirrors: + - localai/localai-backends:latest-gpu-intel-ace-step +- !!merge <<: *ace-step + name: "intel-ace-step-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-ace-step" + mirrors: + - localai/localai-backends:master-gpu-intel-ace-step +- !!merge <<: *ace-step + name: "metal-ace-step" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-ace-step" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-ace-step +- !!merge <<: *ace-step + name: "metal-ace-step-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-ace-step" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-ace-step +## acestep-cpp +- !!merge <<: *acestepcpp + name: "nvidia-l4t-arm64-acestep-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-acestep-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-acestep-cpp +- !!merge <<: *acestepcpp + name: "nvidia-l4t-arm64-acestep-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-acestep-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-acestep-cpp +- !!merge <<: *acestepcpp + name: "cuda13-nvidia-l4t-arm64-acestep-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-acestep-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-acestep-cpp +- !!merge <<: *acestepcpp + name: "cuda13-nvidia-l4t-arm64-acestep-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-acestep-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-acestep-cpp +- !!merge <<: *acestepcpp + name: "cpu-acestep-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-acestep-cpp" + mirrors: + - localai/localai-backends:latest-cpu-acestep-cpp +- !!merge <<: *acestepcpp + name: "metal-acestep-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-acestep-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-acestep-cpp +- !!merge <<: *acestepcpp + name: "metal-acestep-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-acestep-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-acestep-cpp +- !!merge <<: *acestepcpp + name: "cpu-acestep-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-acestep-cpp" + mirrors: + - localai/localai-backends:master-cpu-acestep-cpp +- !!merge <<: *acestepcpp + name: "cuda12-acestep-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-acestep-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-acestep-cpp +- !!merge <<: *acestepcpp + name: "rocm-acestep-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-acestep-cpp" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-acestep-cpp +- !!merge <<: *acestepcpp + name: "intel-sycl-f32-acestep-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-acestep-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-acestep-cpp +- !!merge <<: *acestepcpp + name: "intel-sycl-f16-acestep-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-acestep-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-acestep-cpp +- !!merge <<: *acestepcpp + name: "vulkan-acestep-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-acestep-cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-acestep-cpp +- !!merge <<: *acestepcpp + name: "vulkan-acestep-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-acestep-cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-acestep-cpp +- !!merge <<: *acestepcpp + name: "cuda12-acestep-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-acestep-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-acestep-cpp +- !!merge <<: *acestepcpp + name: "rocm-acestep-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-acestep-cpp" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-acestep-cpp +- !!merge <<: *acestepcpp + name: "intel-sycl-f32-acestep-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-acestep-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-acestep-cpp +- !!merge <<: *acestepcpp + name: "intel-sycl-f16-acestep-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-acestep-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-acestep-cpp +- !!merge <<: *acestepcpp + name: "cuda13-acestep-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-acestep-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-acestep-cpp +- !!merge <<: *acestepcpp + name: "cuda13-acestep-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-acestep-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-acestep-cpp +## qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "nvidia-l4t-arm64-qwen3-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "nvidia-l4t-arm64-qwen3-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "cuda13-nvidia-l4t-arm64-qwen3-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "cuda13-nvidia-l4t-arm64-qwen3-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "cpu-qwen3-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:latest-cpu-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "metal-qwen3-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "metal-qwen3-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "cpu-qwen3-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:master-cpu-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "cuda12-qwen3-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "rocm-qwen3-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "intel-sycl-f32-qwen3-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "intel-sycl-f16-qwen3-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "vulkan-qwen3-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "vulkan-qwen3-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "cuda12-qwen3-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "rocm-qwen3-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "intel-sycl-f32-qwen3-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "intel-sycl-f16-qwen3-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "cuda13-qwen3-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-qwen3-tts-cpp +- !!merge <<: *qwen3ttscpp + name: "cuda13-qwen3-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-qwen3-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-qwen3-tts-cpp +## moss-tts-cpp +- !!merge <<: *mossttscpp + name: "nvidia-l4t-arm64-moss-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-moss-tts-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "nvidia-l4t-arm64-moss-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-moss-tts-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "cuda13-nvidia-l4t-arm64-moss-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-moss-tts-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "cuda13-nvidia-l4t-arm64-moss-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-moss-tts-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "cpu-moss-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-moss-tts-cpp" + mirrors: + - localai/localai-backends:latest-cpu-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "metal-moss-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-moss-tts-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "metal-moss-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-moss-tts-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "cpu-moss-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-moss-tts-cpp" + mirrors: + - localai/localai-backends:master-cpu-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "cuda12-moss-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-moss-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "rocm-moss-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-moss-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "intel-sycl-f32-moss-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-moss-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "intel-sycl-f16-moss-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-moss-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "vulkan-moss-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-moss-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "vulkan-moss-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-moss-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "cuda12-moss-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-moss-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "rocm-moss-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-moss-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "intel-sycl-f32-moss-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-moss-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "intel-sycl-f16-moss-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-moss-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "cuda13-moss-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-moss-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-moss-tts-cpp +- !!merge <<: *mossttscpp + name: "cuda13-moss-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-moss-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-moss-tts-cpp +## magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "nvidia-l4t-arm64-magpie-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-magpie-tts-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "nvidia-l4t-arm64-magpie-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-magpie-tts-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "cuda13-nvidia-l4t-arm64-magpie-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-magpie-tts-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "cuda13-nvidia-l4t-arm64-magpie-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-magpie-tts-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "cpu-magpie-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-magpie-tts-cpp" + mirrors: + - localai/localai-backends:latest-cpu-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "metal-magpie-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-magpie-tts-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "metal-magpie-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-magpie-tts-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "cpu-magpie-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-magpie-tts-cpp" + mirrors: + - localai/localai-backends:master-cpu-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "cuda12-magpie-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-magpie-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "rocm-magpie-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-magpie-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "intel-sycl-f32-magpie-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-magpie-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "intel-sycl-f16-magpie-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-magpie-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "vulkan-magpie-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-magpie-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "vulkan-magpie-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-magpie-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "cuda12-magpie-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-magpie-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "rocm-magpie-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-magpie-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "intel-sycl-f32-magpie-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-magpie-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "intel-sycl-f16-magpie-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-magpie-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "cuda13-magpie-tts-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-magpie-tts-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-magpie-tts-cpp +- !!merge <<: *magpiettscpp + name: "cuda13-magpie-tts-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-magpie-tts-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-magpie-tts-cpp +## omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "omnivoice-cpp-development" + capabilities: + default: "cpu-omnivoice-cpp-development" + nvidia: "cuda12-omnivoice-cpp-development" + nvidia-cuda-13: "cuda13-omnivoice-cpp-development" + nvidia-cuda-12: "cuda12-omnivoice-cpp-development" + intel: "intel-sycl-f16-omnivoice-cpp-development" + metal: "metal-omnivoice-cpp-development" + amd: "rocm-omnivoice-cpp-development" + vulkan: "vulkan-omnivoice-cpp-development" + nvidia-l4t: "nvidia-l4t-arm64-omnivoice-cpp-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-omnivoice-cpp-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-omnivoice-cpp-development" +- !!merge <<: *omnivoicecpp + name: "nvidia-l4t-arm64-omnivoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-omnivoice-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "nvidia-l4t-arm64-omnivoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-omnivoice-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "cuda13-nvidia-l4t-arm64-omnivoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-omnivoice-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "cuda13-nvidia-l4t-arm64-omnivoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-omnivoice-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "cpu-omnivoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-omnivoice-cpp" + mirrors: + - localai/localai-backends:latest-cpu-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "metal-omnivoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-omnivoice-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "metal-omnivoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-omnivoice-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "cpu-omnivoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-omnivoice-cpp" + mirrors: + - localai/localai-backends:master-cpu-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "cuda12-omnivoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-omnivoice-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "rocm-omnivoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-omnivoice-cpp" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "intel-sycl-f32-omnivoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-omnivoice-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "intel-sycl-f16-omnivoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-omnivoice-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "vulkan-omnivoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-omnivoice-cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "vulkan-omnivoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-omnivoice-cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "cuda12-omnivoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-omnivoice-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "rocm-omnivoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-omnivoice-cpp" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "intel-sycl-f32-omnivoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-omnivoice-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "intel-sycl-f16-omnivoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-omnivoice-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "cuda13-omnivoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-omnivoice-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-omnivoice-cpp +- !!merge <<: *omnivoicecpp + name: "cuda13-omnivoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-omnivoice-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-omnivoice-cpp +## vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "nvidia-l4t-arm64-vibevoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-vibevoice-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "nvidia-l4t-arm64-vibevoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-vibevoice-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "cuda13-nvidia-l4t-arm64-vibevoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-vibevoice-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "cuda13-nvidia-l4t-arm64-vibevoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-vibevoice-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "cpu-vibevoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-vibevoice-cpp" + mirrors: + - localai/localai-backends:latest-cpu-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "metal-vibevoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-vibevoice-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "metal-vibevoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-vibevoice-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "cpu-vibevoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-vibevoice-cpp" + mirrors: + - localai/localai-backends:master-cpu-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "cuda12-vibevoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-vibevoice-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "rocm-vibevoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-vibevoice-cpp" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "intel-sycl-f32-vibevoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-vibevoice-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f32-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "intel-sycl-f16-vibevoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f16-vibevoice-cpp" + mirrors: + - localai/localai-backends:latest-gpu-intel-sycl-f16-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "vulkan-vibevoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-vibevoice-cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "vulkan-vibevoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-vibevoice-cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "cuda12-vibevoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-vibevoice-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "rocm-vibevoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-vibevoice-cpp" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "intel-sycl-f32-vibevoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f32-vibevoice-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f32-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "intel-sycl-f16-vibevoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-sycl-f16-vibevoice-cpp" + mirrors: + - localai/localai-backends:master-gpu-intel-sycl-f16-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "cuda13-vibevoice-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-vibevoice-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-vibevoice-cpp +- !!merge <<: *vibevoicecpp + name: "cuda13-vibevoice-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-vibevoice-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-vibevoice-cpp +## localvqe +- !!merge <<: *localvqecpp + name: "cpu-localvqe" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-localvqe" + mirrors: + - localai/localai-backends:latest-cpu-localvqe +- !!merge <<: *localvqecpp + name: "cpu-localvqe-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-localvqe" + mirrors: + - localai/localai-backends:master-cpu-localvqe +- !!merge <<: *localvqecpp + name: "vulkan-localvqe" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-localvqe" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-localvqe +- !!merge <<: *localvqecpp + name: "vulkan-localvqe-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-localvqe" + mirrors: + - localai/localai-backends:master-gpu-vulkan-localvqe +- !!merge <<: *localvqecpp + name: "metal-localvqe" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-localvqe" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-localvqe +- !!merge <<: *localvqecpp + name: "metal-localvqe-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-localvqe" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-localvqe +## kokoro +- !!merge <<: *kokoro + name: "kokoro-development" + capabilities: + default: "cpu-kokoro-development" + nvidia: "cuda12-kokoro-development" + intel: "intel-kokoro-development" + amd: "rocm-kokoro-development" + nvidia-l4t: "nvidia-l4t-kokoro-development" + metal: "metal-kokoro-development" +- !!merge <<: *kokoro + name: "cpu-kokoro" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-kokoro" + mirrors: + - localai/localai-backends:latest-cpu-kokoro +- !!merge <<: *kokoro + name: "cpu-kokoro-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-kokoro" + mirrors: + - localai/localai-backends:master-cpu-kokoro +- !!merge <<: *kokoro + name: "cuda12-kokoro-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-kokoro" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-kokoro +- !!merge <<: *kokoro + name: "rocm-kokoro-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-kokoro" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-kokoro +- !!merge <<: *kokoro + name: "intel-kokoro" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-kokoro" + mirrors: + - localai/localai-backends:latest-gpu-intel-kokoro +- !!merge <<: *kokoro + name: "intel-kokoro-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-kokoro" + mirrors: + - localai/localai-backends:master-gpu-intel-kokoro +- !!merge <<: *kokoro + name: "nvidia-l4t-kokoro" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-kokoro" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-kokoro +- !!merge <<: *kokoro + name: "nvidia-l4t-kokoro-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-kokoro" + mirrors: + - localai/localai-backends:master-nvidia-l4t-kokoro +- !!merge <<: *kokoro + name: "cuda12-kokoro" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-kokoro" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-kokoro +- !!merge <<: *kokoro + name: "rocm-kokoro" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-kokoro" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-kokoro +- !!merge <<: *kokoro + name: "cuda13-kokoro" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-kokoro" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-kokoro +- !!merge <<: *kokoro + name: "cuda13-kokoro-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-kokoro" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-kokoro +- !!merge <<: *kokoro + name: "metal-kokoro" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-kokoro" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-kokoro +- !!merge <<: *kokoro + name: "metal-kokoro-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-kokoro" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-kokoro +## kokoros (Rust) +- !!merge <<: *kokoros + name: "kokoros-development" + capabilities: + default: "cpu-kokoros-development" +- !!merge <<: *kokoros + name: "cpu-kokoros" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-kokoros" + mirrors: + - localai/localai-backends:latest-cpu-kokoros +- !!merge <<: *kokoros + name: "cpu-kokoros-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-kokoros" + mirrors: + - localai/localai-backends:master-cpu-kokoros +## faster-whisper +- !!merge <<: *faster-whisper + name: "faster-whisper-development" + capabilities: + default: "cpu-faster-whisper-development" + nvidia: "cuda12-faster-whisper-development" + intel: "intel-faster-whisper-development" + amd: "rocm-faster-whisper-development" + metal: "metal-faster-whisper-development" + nvidia-cuda-13: "cuda13-faster-whisper-development" + nvidia-l4t: "nvidia-l4t-arm64-faster-whisper-development" +- !!merge <<: *faster-whisper + name: "cuda12-faster-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-faster-whisper" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-faster-whisper +- !!merge <<: *faster-whisper + name: "rocm-faster-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-faster-whisper" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-faster-whisper +- !!merge <<: *faster-whisper + name: "intel-faster-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-faster-whisper" + mirrors: + - localai/localai-backends:latest-gpu-intel-faster-whisper +- !!merge <<: *faster-whisper + name: "intel-faster-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-faster-whisper" + mirrors: + - localai/localai-backends:master-gpu-intel-faster-whisper +- !!merge <<: *faster-whisper + name: "cuda13-faster-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-faster-whisper" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-faster-whisper +- !!merge <<: *faster-whisper + name: "cuda13-faster-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-faster-whisper" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-faster-whisper +- !!merge <<: *faster-whisper + name: "metal-faster-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-faster-whisper" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-faster-whisper +- !!merge <<: *faster-whisper + name: "metal-faster-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-faster-whisper" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-faster-whisper +- !!merge <<: *faster-whisper + name: "cuda12-faster-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-faster-whisper" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-faster-whisper +- !!merge <<: *faster-whisper + name: "rocm-faster-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-faster-whisper" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-faster-whisper +- !!merge <<: *faster-whisper + name: "cpu-faster-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-faster-whisper" + mirrors: + - localai/localai-backends:latest-cpu-faster-whisper +- !!merge <<: *faster-whisper + name: "cpu-faster-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-faster-whisper" + mirrors: + - localai/localai-backends:master-cpu-faster-whisper +- !!merge <<: *faster-whisper + name: "nvidia-l4t-arm64-faster-whisper" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-faster-whisper" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-faster-whisper +- !!merge <<: *faster-whisper + name: "nvidia-l4t-arm64-faster-whisper-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-faster-whisper" + mirrors: + - localai/localai-backends:master-nvidia-l4t-faster-whisper +## moonshine +- !!merge <<: *moonshine + name: "moonshine-development" + capabilities: + nvidia: "cuda12-moonshine-development" + default: "cpu-moonshine-development" + nvidia-cuda-13: "cuda13-moonshine-development" + nvidia-cuda-12: "cuda12-moonshine-development" +- !!merge <<: *moonshine + name: "cpu-moonshine" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-moonshine" + mirrors: + - localai/localai-backends:latest-cpu-moonshine +- !!merge <<: *moonshine + name: "cpu-moonshine-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-moonshine" + mirrors: + - localai/localai-backends:master-cpu-moonshine +- !!merge <<: *moonshine + name: "cuda12-moonshine" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-moonshine" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-moonshine +- !!merge <<: *moonshine + name: "cuda12-moonshine-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-moonshine" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-moonshine +- !!merge <<: *moonshine + name: "cuda13-moonshine" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-moonshine" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-moonshine +- !!merge <<: *moonshine + name: "cuda13-moonshine-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-moonshine" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-moonshine +- !!merge <<: *moonshine + name: "metal-moonshine" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-moonshine" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-moonshine +- !!merge <<: *moonshine + name: "metal-moonshine-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-moonshine" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-moonshine +## whisperx +- !!merge <<: *whisperx + name: "whisperx-development" + capabilities: + nvidia: "cuda12-whisperx-development" + metal: "metal-whisperx-development" + default: "cpu-whisperx-development" + nvidia-cuda-13: "cuda13-whisperx-development" + nvidia-cuda-12: "cuda12-whisperx-development" + nvidia-l4t: "nvidia-l4t-arm64-whisperx-development" +- !!merge <<: *whisperx + name: "cpu-whisperx" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-whisperx" + mirrors: + - localai/localai-backends:latest-cpu-whisperx +- !!merge <<: *whisperx + name: "cpu-whisperx-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-whisperx" + mirrors: + - localai/localai-backends:master-cpu-whisperx +- !!merge <<: *whisperx + name: "cuda12-whisperx" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-whisperx" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-whisperx +- !!merge <<: *whisperx + name: "cuda12-whisperx-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-whisperx" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-whisperx +- !!merge <<: *whisperx + name: "cuda13-whisperx" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-whisperx" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-whisperx +- !!merge <<: *whisperx + name: "cuda13-whisperx-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-whisperx" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-whisperx +- !!merge <<: *whisperx + name: "metal-whisperx" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-whisperx" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-whisperx +- !!merge <<: *whisperx + name: "metal-whisperx-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-whisperx" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-whisperx +- !!merge <<: *whisperx + name: "nvidia-l4t-arm64-whisperx" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-whisperx" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-whisperx +- !!merge <<: *whisperx + name: "nvidia-l4t-arm64-whisperx-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-whisperx" + mirrors: + - localai/localai-backends:master-nvidia-l4t-whisperx +## coqui + +- !!merge <<: *coqui + name: "coqui-development" + capabilities: + nvidia: "cuda12-coqui-development" + intel: "intel-coqui-development" + amd: "rocm-coqui-development" + metal: "metal-coqui-development" +- !!merge <<: *coqui + name: "cuda12-coqui" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-coqui" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-coqui +- !!merge <<: *coqui + name: "cuda12-coqui-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-coqui" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-coqui +- !!merge <<: *coqui + name: "rocm-coqui-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-coqui" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-coqui +- !!merge <<: *coqui + name: "intel-coqui" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-coqui" + mirrors: + - localai/localai-backends:latest-gpu-intel-coqui +- !!merge <<: *coqui + name: "intel-coqui-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-coqui" + mirrors: + - localai/localai-backends:master-gpu-intel-coqui +- !!merge <<: *coqui + name: "rocm-coqui" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-coqui" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-coqui +- !!merge <<: *coqui + name: "metal-coqui" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-coqui" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-coqui +- !!merge <<: *coqui + name: "metal-coqui-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-coqui" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-coqui +## outetts +- !!merge <<: *outetts + name: "outetts-development" + capabilities: + default: "cpu-outetts-development" + nvidia-cuda-12: "cuda12-outetts-development" +- !!merge <<: *outetts + name: "cpu-outetts" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-outetts" + mirrors: + - localai/localai-backends:latest-cpu-outetts +- !!merge <<: *outetts + name: "cpu-outetts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-outetts" + mirrors: + - localai/localai-backends:master-cpu-outetts +- !!merge <<: *outetts + name: "cuda12-outetts" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-outetts" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-outetts +- !!merge <<: *outetts + name: "cuda12-outetts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-outetts" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-outetts +## chatterbox +- !!merge <<: *chatterbox + name: "chatterbox-development" + capabilities: + nvidia: "cuda12-chatterbox-development" + metal: "metal-chatterbox-development" + default: "cpu-chatterbox-development" + nvidia-l4t: "nvidia-l4t-arm64-chatterbox" + nvidia-cuda-13: "cuda13-chatterbox-development" + nvidia-cuda-12: "cuda12-chatterbox-development" + nvidia-l4t-cuda-12: "nvidia-l4t-arm64-chatterbox" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-chatterbox-development" +- !!merge <<: *chatterbox + name: "cpu-chatterbox" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-chatterbox" + mirrors: + - localai/localai-backends:latest-cpu-chatterbox +- !!merge <<: *chatterbox + name: "cpu-chatterbox-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-chatterbox" + mirrors: + - localai/localai-backends:master-cpu-chatterbox +- !!merge <<: *chatterbox + name: "nvidia-l4t-arm64-chatterbox" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-arm64-chatterbox" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-arm64-chatterbox +- !!merge <<: *chatterbox + name: "nvidia-l4t-arm64-chatterbox-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-arm64-chatterbox" + mirrors: + - localai/localai-backends:master-nvidia-l4t-arm64-chatterbox +- !!merge <<: *chatterbox + name: "metal-chatterbox" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-chatterbox" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-chatterbox +- !!merge <<: *chatterbox + name: "metal-chatterbox-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-chatterbox" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-chatterbox +- !!merge <<: *chatterbox + name: "cuda12-chatterbox-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-chatterbox" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-chatterbox +- !!merge <<: *chatterbox + name: "cuda12-chatterbox" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-chatterbox" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-chatterbox +- !!merge <<: *chatterbox + name: "cuda13-chatterbox" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-chatterbox" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-chatterbox +- !!merge <<: *chatterbox + name: "cuda13-chatterbox-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-chatterbox" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-chatterbox +- !!merge <<: *chatterbox + name: "cuda13-nvidia-l4t-arm64-chatterbox" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-chatterbox" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-chatterbox +- !!merge <<: *chatterbox + name: "cuda13-nvidia-l4t-arm64-chatterbox-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-chatterbox" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-chatterbox +## vibevoice +- !!merge <<: *vibevoice + name: "vibevoice-development" + capabilities: + nvidia: "cuda12-vibevoice-development" + intel: "intel-vibevoice-development" + amd: "rocm-vibevoice-development" + nvidia-l4t: "nvidia-l4t-vibevoice-development" + metal: "metal-vibevoice-development" + default: "cpu-vibevoice-development" + nvidia-cuda-13: "cuda13-vibevoice-development" + nvidia-cuda-12: "cuda12-vibevoice-development" + nvidia-l4t-cuda-12: "nvidia-l4t-vibevoice-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-vibevoice-development" +- !!merge <<: *vibevoice + name: "cpu-vibevoice" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-vibevoice" + mirrors: + - localai/localai-backends:latest-cpu-vibevoice +- !!merge <<: *vibevoice + name: "cpu-vibevoice-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-vibevoice" + mirrors: + - localai/localai-backends:master-cpu-vibevoice +- !!merge <<: *vibevoice + name: "cuda12-vibevoice" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-vibevoice" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-vibevoice +- !!merge <<: *vibevoice + name: "cuda12-vibevoice-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-vibevoice" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-vibevoice +- !!merge <<: *vibevoice + name: "cuda13-vibevoice" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-vibevoice" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-vibevoice +- !!merge <<: *vibevoice + name: "cuda13-vibevoice-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-vibevoice" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-vibevoice +- !!merge <<: *vibevoice + name: "intel-vibevoice" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-vibevoice" + mirrors: + - localai/localai-backends:latest-gpu-intel-vibevoice +- !!merge <<: *vibevoice + name: "intel-vibevoice-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-vibevoice" + mirrors: + - localai/localai-backends:master-gpu-intel-vibevoice +- !!merge <<: *vibevoice + name: "rocm-vibevoice" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-vibevoice" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-vibevoice +- !!merge <<: *vibevoice + name: "rocm-vibevoice-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-vibevoice" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-vibevoice +- !!merge <<: *vibevoice + name: "nvidia-l4t-vibevoice" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-vibevoice" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-vibevoice +- !!merge <<: *vibevoice + name: "nvidia-l4t-vibevoice-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-vibevoice" + mirrors: + - localai/localai-backends:master-nvidia-l4t-vibevoice +- !!merge <<: *vibevoice + name: "cuda13-nvidia-l4t-arm64-vibevoice" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-vibevoice" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-vibevoice +- !!merge <<: *vibevoice + name: "cuda13-nvidia-l4t-arm64-vibevoice-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-vibevoice" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-vibevoice +- !!merge <<: *vibevoice + name: "metal-vibevoice" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-vibevoice" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-vibevoice +- !!merge <<: *vibevoice + name: "metal-vibevoice-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-vibevoice" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-vibevoice +## liquid-audio +- !!merge <<: *liquid-audio + name: "liquid-audio-development" + capabilities: + nvidia: "cuda12-liquid-audio-development" + intel: "intel-liquid-audio-development" + amd: "rocm-liquid-audio-development" + default: "cpu-liquid-audio-development" + nvidia-cuda-13: "cuda13-liquid-audio-development" + nvidia-cuda-12: "cuda12-liquid-audio-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-liquid-audio-development" + metal: "metal-liquid-audio-development" +- !!merge <<: *liquid-audio + name: "cpu-liquid-audio" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-liquid-audio" + mirrors: + - localai/localai-backends:latest-cpu-liquid-audio +- !!merge <<: *liquid-audio + name: "cpu-liquid-audio-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-liquid-audio" + mirrors: + - localai/localai-backends:master-cpu-liquid-audio +- !!merge <<: *liquid-audio + name: "metal-liquid-audio" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-liquid-audio" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-liquid-audio +- !!merge <<: *liquid-audio + name: "metal-liquid-audio-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-liquid-audio" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-liquid-audio +- !!merge <<: *liquid-audio + name: "cuda12-liquid-audio" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-liquid-audio" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-liquid-audio +- !!merge <<: *liquid-audio + name: "cuda12-liquid-audio-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-liquid-audio" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-liquid-audio +- !!merge <<: *liquid-audio + name: "cuda13-liquid-audio" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-liquid-audio" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-liquid-audio +- !!merge <<: *liquid-audio + name: "cuda13-liquid-audio-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-liquid-audio" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-liquid-audio +- !!merge <<: *liquid-audio + name: "intel-liquid-audio" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-liquid-audio" + mirrors: + - localai/localai-backends:latest-gpu-intel-liquid-audio +- !!merge <<: *liquid-audio + name: "intel-liquid-audio-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-liquid-audio" + mirrors: + - localai/localai-backends:master-gpu-intel-liquid-audio +- !!merge <<: *liquid-audio + name: "rocm-liquid-audio" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-liquid-audio" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-liquid-audio +- !!merge <<: *liquid-audio + name: "rocm-liquid-audio-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-liquid-audio" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-liquid-audio +- !!merge <<: *liquid-audio + name: "cuda13-nvidia-l4t-arm64-liquid-audio" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-liquid-audio" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-liquid-audio +- !!merge <<: *liquid-audio + name: "cuda13-nvidia-l4t-arm64-liquid-audio-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-liquid-audio" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-liquid-audio +## qwen-tts +- !!merge <<: *qwen-tts + name: "qwen-tts-development" + capabilities: + nvidia: "cuda12-qwen-tts-development" + intel: "intel-qwen-tts-development" + amd: "rocm-qwen-tts-development" + nvidia-l4t: "nvidia-l4t-qwen-tts-development" + metal: "metal-qwen-tts-development" + default: "cpu-qwen-tts-development" + nvidia-cuda-13: "cuda13-qwen-tts-development" + nvidia-cuda-12: "cuda12-qwen-tts-development" + nvidia-l4t-cuda-12: "nvidia-l4t-qwen-tts-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-qwen-tts-development" +- !!merge <<: *qwen-tts + name: "cpu-qwen-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-qwen-tts" + mirrors: + - localai/localai-backends:latest-cpu-qwen-tts +- !!merge <<: *qwen-tts + name: "cpu-qwen-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-qwen-tts" + mirrors: + - localai/localai-backends:master-cpu-qwen-tts +- !!merge <<: *qwen-tts + name: "cuda12-qwen-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-qwen-tts" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-qwen-tts +- !!merge <<: *qwen-tts + name: "cuda12-qwen-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-qwen-tts" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-qwen-tts +- !!merge <<: *qwen-tts + name: "cuda13-qwen-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-qwen-tts" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-qwen-tts +- !!merge <<: *qwen-tts + name: "cuda13-qwen-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-qwen-tts" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-qwen-tts +- !!merge <<: *qwen-tts + name: "intel-qwen-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-qwen-tts" + mirrors: + - localai/localai-backends:latest-gpu-intel-qwen-tts +- !!merge <<: *qwen-tts + name: "intel-qwen-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-qwen-tts" + mirrors: + - localai/localai-backends:master-gpu-intel-qwen-tts +- !!merge <<: *qwen-tts + name: "rocm-qwen-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-qwen-tts" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-qwen-tts +- !!merge <<: *qwen-tts + name: "rocm-qwen-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-qwen-tts" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-qwen-tts +- !!merge <<: *qwen-tts + name: "nvidia-l4t-qwen-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-qwen-tts" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-qwen-tts +- !!merge <<: *qwen-tts + name: "nvidia-l4t-qwen-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-qwen-tts" + mirrors: + - localai/localai-backends:master-nvidia-l4t-qwen-tts +- !!merge <<: *qwen-tts + name: "cuda13-nvidia-l4t-arm64-qwen-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-qwen-tts" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-qwen-tts +- !!merge <<: *qwen-tts + name: "cuda13-nvidia-l4t-arm64-qwen-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-qwen-tts" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-qwen-tts +- !!merge <<: *qwen-tts + name: "metal-qwen-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-qwen-tts" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-qwen-tts +- !!merge <<: *qwen-tts + name: "metal-qwen-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-qwen-tts" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-qwen-tts +## fish-speech +- !!merge <<: *fish-speech + name: "fish-speech-development" + capabilities: + nvidia: "cuda12-fish-speech-development" + intel: "intel-fish-speech-development" + amd: "rocm-fish-speech-development" + nvidia-l4t: "nvidia-l4t-fish-speech-development" + default: "cpu-fish-speech-development" + nvidia-cuda-13: "cuda13-fish-speech-development" + nvidia-cuda-12: "cuda12-fish-speech-development" + nvidia-l4t-cuda-12: "nvidia-l4t-fish-speech-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-fish-speech-development" +- !!merge <<: *fish-speech + name: "cpu-fish-speech" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-fish-speech" + mirrors: + - localai/localai-backends:latest-cpu-fish-speech +- !!merge <<: *fish-speech + name: "cpu-fish-speech-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-fish-speech" + mirrors: + - localai/localai-backends:master-cpu-fish-speech +- !!merge <<: *fish-speech + name: "cuda12-fish-speech" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-fish-speech" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-fish-speech +- !!merge <<: *fish-speech + name: "cuda12-fish-speech-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-fish-speech" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-fish-speech +- !!merge <<: *fish-speech + name: "cuda13-fish-speech" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-fish-speech" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-fish-speech +- !!merge <<: *fish-speech + name: "cuda13-fish-speech-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-fish-speech" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-fish-speech +- !!merge <<: *fish-speech + name: "intel-fish-speech" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-fish-speech" + mirrors: + - localai/localai-backends:latest-gpu-intel-fish-speech +- !!merge <<: *fish-speech + name: "intel-fish-speech-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-fish-speech" + mirrors: + - localai/localai-backends:master-gpu-intel-fish-speech +- !!merge <<: *fish-speech + name: "rocm-fish-speech" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-fish-speech" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-fish-speech +- !!merge <<: *fish-speech + name: "rocm-fish-speech-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-fish-speech" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-fish-speech +- !!merge <<: *fish-speech + name: "nvidia-l4t-fish-speech" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-fish-speech" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-fish-speech +- !!merge <<: *fish-speech + name: "nvidia-l4t-fish-speech-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-fish-speech" + mirrors: + - localai/localai-backends:master-nvidia-l4t-fish-speech +- !!merge <<: *fish-speech + name: "cuda13-nvidia-l4t-arm64-fish-speech" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-fish-speech" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-fish-speech +- !!merge <<: *fish-speech + name: "cuda13-nvidia-l4t-arm64-fish-speech-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-fish-speech" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-fish-speech +## faster-qwen3-tts +- !!merge <<: *faster-qwen3-tts + name: "faster-qwen3-tts-development" + capabilities: + nvidia: "cuda12-faster-qwen3-tts-development" + default: "cuda12-faster-qwen3-tts-development" + nvidia-cuda-13: "cuda13-faster-qwen3-tts-development" + nvidia-cuda-12: "cuda12-faster-qwen3-tts-development" + nvidia-l4t: "nvidia-l4t-faster-qwen3-tts-development" + nvidia-l4t-cuda-12: "nvidia-l4t-faster-qwen3-tts-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-faster-qwen3-tts-development" +- !!merge <<: *faster-qwen3-tts + name: "cuda12-faster-qwen3-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-faster-qwen3-tts" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-faster-qwen3-tts +- !!merge <<: *faster-qwen3-tts + name: "cuda12-faster-qwen3-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-faster-qwen3-tts" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-faster-qwen3-tts +- !!merge <<: *faster-qwen3-tts + name: "cuda13-faster-qwen3-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-faster-qwen3-tts" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-faster-qwen3-tts +- !!merge <<: *faster-qwen3-tts + name: "cuda13-faster-qwen3-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-faster-qwen3-tts" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-faster-qwen3-tts +- !!merge <<: *faster-qwen3-tts + name: "nvidia-l4t-faster-qwen3-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-faster-qwen3-tts" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-faster-qwen3-tts +- !!merge <<: *faster-qwen3-tts + name: "nvidia-l4t-faster-qwen3-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-faster-qwen3-tts" + mirrors: + - localai/localai-backends:master-nvidia-l4t-faster-qwen3-tts +- !!merge <<: *faster-qwen3-tts + name: "cuda13-nvidia-l4t-arm64-faster-qwen3-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-faster-qwen3-tts" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-faster-qwen3-tts +- !!merge <<: *faster-qwen3-tts + name: "cuda13-nvidia-l4t-arm64-faster-qwen3-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-faster-qwen3-tts" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-faster-qwen3-tts +## whisper-medusa +- !!merge <<: *whisper-medusa + name: "whisper-medusa-development" + capabilities: + default: "cpu-whisper-medusa-development" + nvidia: "cuda12-whisper-medusa-development" + nvidia-cuda-12: "cuda12-whisper-medusa-development" +- !!merge <<: *whisper-medusa + name: "cpu-whisper-medusa" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-whisper-medusa" + mirrors: + - localai/localai-backends:latest-cpu-whisper-medusa +- !!merge <<: *whisper-medusa + name: "cpu-whisper-medusa-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-whisper-medusa" + mirrors: + - localai/localai-backends:master-cpu-whisper-medusa +- !!merge <<: *whisper-medusa + name: "cuda12-whisper-medusa" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-whisper-medusa" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-whisper-medusa +- !!merge <<: *whisper-medusa + name: "cuda12-whisper-medusa-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-whisper-medusa" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-whisper-medusa + +## qwen-asr +- !!merge <<: *qwen-asr + name: "qwen-asr-development" + capabilities: + nvidia: "cuda12-qwen-asr-development" + intel: "intel-qwen-asr-development" + amd: "rocm-qwen-asr-development" + nvidia-l4t: "nvidia-l4t-qwen-asr-development" + metal: "metal-qwen-asr-development" + default: "cpu-qwen-asr-development" + nvidia-cuda-13: "cuda13-qwen-asr-development" + nvidia-cuda-12: "cuda12-qwen-asr-development" + nvidia-l4t-cuda-12: "nvidia-l4t-qwen-asr-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-qwen-asr-development" +- !!merge <<: *qwen-asr + name: "cpu-qwen-asr" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-qwen-asr" + mirrors: + - localai/localai-backends:latest-cpu-qwen-asr +- !!merge <<: *qwen-asr + name: "cpu-qwen-asr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-qwen-asr" + mirrors: + - localai/localai-backends:master-cpu-qwen-asr +- !!merge <<: *qwen-asr + name: "cuda12-qwen-asr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-qwen-asr" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-qwen-asr +- !!merge <<: *qwen-asr + name: "cuda12-qwen-asr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-qwen-asr" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-qwen-asr +- !!merge <<: *qwen-asr + name: "cuda13-qwen-asr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-qwen-asr" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-qwen-asr +- !!merge <<: *qwen-asr + name: "cuda13-qwen-asr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-qwen-asr" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-qwen-asr +- !!merge <<: *qwen-asr + name: "intel-qwen-asr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-qwen-asr" + mirrors: + - localai/localai-backends:latest-gpu-intel-qwen-asr +- !!merge <<: *qwen-asr + name: "intel-qwen-asr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-qwen-asr" + mirrors: + - localai/localai-backends:master-gpu-intel-qwen-asr +- !!merge <<: *qwen-asr + name: "rocm-qwen-asr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-qwen-asr" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-qwen-asr +- !!merge <<: *qwen-asr + name: "rocm-qwen-asr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-qwen-asr" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-qwen-asr +- !!merge <<: *qwen-asr + name: "nvidia-l4t-qwen-asr" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-qwen-asr" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-qwen-asr +- !!merge <<: *qwen-asr + name: "nvidia-l4t-qwen-asr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-qwen-asr" + mirrors: + - localai/localai-backends:master-nvidia-l4t-qwen-asr +- !!merge <<: *qwen-asr + name: "cuda13-nvidia-l4t-arm64-qwen-asr" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-qwen-asr" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-qwen-asr +- !!merge <<: *qwen-asr + name: "cuda13-nvidia-l4t-arm64-qwen-asr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-qwen-asr" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-qwen-asr +- !!merge <<: *qwen-asr + name: "metal-qwen-asr" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-qwen-asr" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-qwen-asr +- !!merge <<: *qwen-asr + name: "metal-qwen-asr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-qwen-asr" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-qwen-asr +## nemo +- !!merge <<: *nemo + name: "nemo-development" + capabilities: + nvidia: "cuda12-nemo-development" + intel: "intel-nemo-development" + amd: "rocm-nemo-development" + metal: "metal-nemo-development" + default: "cpu-nemo-development" + nvidia-cuda-13: "cuda13-nemo-development" + nvidia-cuda-12: "cuda12-nemo-development" +- !!merge <<: *nemo + name: "cpu-nemo" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-nemo" + mirrors: + - localai/localai-backends:latest-cpu-nemo +- !!merge <<: *nemo + name: "cpu-nemo-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-nemo" + mirrors: + - localai/localai-backends:master-cpu-nemo +- !!merge <<: *nemo + name: "cuda12-nemo" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-nemo" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-nemo +- !!merge <<: *nemo + name: "cuda12-nemo-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-nemo" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-nemo +- !!merge <<: *nemo + name: "cuda13-nemo" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-nemo" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-nemo +- !!merge <<: *nemo + name: "cuda13-nemo-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-nemo" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-nemo +- !!merge <<: *nemo + name: "intel-nemo" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-nemo" + mirrors: + - localai/localai-backends:latest-gpu-intel-nemo +- !!merge <<: *nemo + name: "intel-nemo-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-nemo" + mirrors: + - localai/localai-backends:master-gpu-intel-nemo +- !!merge <<: *nemo + name: "rocm-nemo" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-nemo" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-nemo +- !!merge <<: *nemo + name: "rocm-nemo-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-nemo" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-nemo +- !!merge <<: *nemo + name: "metal-nemo" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-nemo" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-nemo +- !!merge <<: *nemo + name: "metal-nemo-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-nemo" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-nemo +## voxcpm +- !!merge <<: *voxcpm + name: "voxcpm-development" + capabilities: + nvidia: "cuda12-voxcpm-development" + intel: "intel-voxcpm-development" + amd: "rocm-voxcpm-development" + metal: "metal-voxcpm-development" + default: "cpu-voxcpm-development" + nvidia-cuda-13: "cuda13-voxcpm-development" + nvidia-cuda-12: "cuda12-voxcpm-development" +- !!merge <<: *voxcpm + name: "cpu-voxcpm" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-voxcpm" + mirrors: + - localai/localai-backends:latest-cpu-voxcpm +- !!merge <<: *voxcpm + name: "cpu-voxcpm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-voxcpm" + mirrors: + - localai/localai-backends:master-cpu-voxcpm +- !!merge <<: *voxcpm + name: "cuda12-voxcpm" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-voxcpm" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-voxcpm +- !!merge <<: *voxcpm + name: "cuda12-voxcpm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-voxcpm" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-voxcpm +- !!merge <<: *voxcpm + name: "cuda13-voxcpm" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-voxcpm" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-voxcpm +- !!merge <<: *voxcpm + name: "cuda13-voxcpm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-voxcpm" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-voxcpm +- !!merge <<: *voxcpm + name: "intel-voxcpm" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-voxcpm" + mirrors: + - localai/localai-backends:latest-gpu-intel-voxcpm +- !!merge <<: *voxcpm + name: "intel-voxcpm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-voxcpm" + mirrors: + - localai/localai-backends:master-gpu-intel-voxcpm +- !!merge <<: *voxcpm + name: "rocm-voxcpm" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-voxcpm" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-voxcpm +- !!merge <<: *voxcpm + name: "rocm-voxcpm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-voxcpm" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-voxcpm +- !!merge <<: *voxcpm + name: "metal-voxcpm" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-voxcpm" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-voxcpm +- !!merge <<: *voxcpm + name: "metal-voxcpm-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-voxcpm" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-voxcpm +## pocket-tts +- !!merge <<: *pocket-tts + name: "pocket-tts-development" + capabilities: + nvidia: "cuda12-pocket-tts-development" + intel: "intel-pocket-tts-development" + amd: "rocm-pocket-tts-development" + nvidia-l4t: "nvidia-l4t-pocket-tts-development" + metal: "metal-pocket-tts-development" + default: "cpu-pocket-tts-development" + nvidia-cuda-13: "cuda13-pocket-tts-development" + nvidia-cuda-12: "cuda12-pocket-tts-development" + nvidia-l4t-cuda-12: "nvidia-l4t-pocket-tts-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-pocket-tts-development" +- !!merge <<: *pocket-tts + name: "cpu-pocket-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-pocket-tts" + mirrors: + - localai/localai-backends:latest-cpu-pocket-tts +- !!merge <<: *pocket-tts + name: "cpu-pocket-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-pocket-tts" + mirrors: + - localai/localai-backends:master-cpu-pocket-tts +- !!merge <<: *pocket-tts + name: "cuda12-pocket-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-pocket-tts" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-pocket-tts +- !!merge <<: *pocket-tts + name: "cuda12-pocket-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-pocket-tts" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-pocket-tts +- !!merge <<: *pocket-tts + name: "cuda13-pocket-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-pocket-tts" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-pocket-tts +- !!merge <<: *pocket-tts + name: "cuda13-pocket-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-pocket-tts" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-pocket-tts +- !!merge <<: *pocket-tts + name: "intel-pocket-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-pocket-tts" + mirrors: + - localai/localai-backends:latest-gpu-intel-pocket-tts +- !!merge <<: *pocket-tts + name: "intel-pocket-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-pocket-tts" + mirrors: + - localai/localai-backends:master-gpu-intel-pocket-tts +- !!merge <<: *pocket-tts + name: "rocm-pocket-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-pocket-tts" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-pocket-tts +- !!merge <<: *pocket-tts + name: "rocm-pocket-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-pocket-tts" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-pocket-tts +- !!merge <<: *pocket-tts + name: "nvidia-l4t-pocket-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-pocket-tts" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-pocket-tts +- !!merge <<: *pocket-tts + name: "nvidia-l4t-pocket-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-pocket-tts" + mirrors: + - localai/localai-backends:master-nvidia-l4t-pocket-tts +- !!merge <<: *pocket-tts + name: "cuda13-nvidia-l4t-arm64-pocket-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-pocket-tts" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-pocket-tts +- !!merge <<: *pocket-tts + name: "cuda13-nvidia-l4t-arm64-pocket-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-pocket-tts" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-pocket-tts +- !!merge <<: *pocket-tts + name: "metal-pocket-tts" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-pocket-tts" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-pocket-tts +- !!merge <<: *pocket-tts + name: "metal-pocket-tts-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-pocket-tts" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-pocket-tts +## voxtral +- !!merge <<: *voxtral + name: "cpu-voxtral" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-voxtral" + mirrors: + - localai/localai-backends:latest-cpu-voxtral +- !!merge <<: *voxtral + name: "cpu-voxtral-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-voxtral" + mirrors: + - localai/localai-backends:master-cpu-voxtral +- !!merge <<: *voxtral + name: "metal-voxtral" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-voxtral" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-voxtral +- !!merge <<: *voxtral + name: "metal-voxtral-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-voxtral" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-voxtral +- &trl + name: "trl" + alias: "trl" + license: apache-2.0 + description: | + HuggingFace TRL fine-tuning backend. Supports SFT, DPO, GRPO, RLOO, Reward, KTO, ORPO training methods. + Works on CPU and GPU. + urls: + - https://github.com/huggingface/trl + tags: + - fine-tuning + - LLM + - CPU + - GPU + - CUDA + capabilities: + default: "cpu-trl" + nvidia: "cuda12-trl" + nvidia-cuda-12: "cuda12-trl" + nvidia-cuda-13: "cuda13-trl" + metal: "metal-trl" +## TRL backend images +- !!merge <<: *trl + name: "cpu-trl" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-trl" + mirrors: + - localai/localai-backends:latest-cpu-trl +- !!merge <<: *trl + name: "cpu-trl-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-trl" + mirrors: + - localai/localai-backends:master-cpu-trl +- !!merge <<: *trl + name: "cuda12-trl" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-trl" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-trl +- !!merge <<: *trl + name: "cuda12-trl-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-trl" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-trl +- !!merge <<: *trl + name: "cuda13-trl" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-trl" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-trl +- !!merge <<: *trl + name: "cuda13-trl-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-trl" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-trl +- !!merge <<: *trl + name: "metal-trl" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-trl" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-trl +- !!merge <<: *trl + name: "metal-trl-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-trl" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-trl +## llama.cpp quantization backend +- &llama-cpp-quantization + name: "llama-cpp-quantization" + alias: "llama-cpp-quantization" + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + Model quantization backend using llama.cpp. Downloads HuggingFace models, converts them to GGUF format, + and quantizes them to various formats (q4_k_m, q5_k_m, q8_0, f16, etc.). + urls: + - https://github.com/ggml-org/llama.cpp + tags: + - quantization + - GGUF + - CPU + capabilities: + default: "cpu-llama-cpp-quantization" + metal: "metal-darwin-arm64-llama-cpp-quantization" +- !!merge <<: *llama-cpp-quantization + name: "cpu-llama-cpp-quantization" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-llama-cpp-quantization" + mirrors: + - localai/localai-backends:latest-cpu-llama-cpp-quantization +- !!merge <<: *llama-cpp-quantization + name: "metal-darwin-arm64-llama-cpp-quantization" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-llama-cpp-quantization" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-llama-cpp-quantization +# insightface (face recognition) — development and concrete image entries +- !!merge <<: *insightface + name: "insightface-development" + capabilities: + default: "cpu-insightface-development" + nvidia: "cuda12-insightface-development" + nvidia-cuda-12: "cuda12-insightface-development" +- !!merge <<: *insightface + name: "cpu-insightface" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-insightface" + mirrors: + - localai/localai-backends:latest-cpu-insightface +- !!merge <<: *insightface + name: "cuda12-insightface" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-insightface" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-insightface +- !!merge <<: *insightface + name: "cpu-insightface-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-insightface" + mirrors: + - localai/localai-backends:master-cpu-insightface +- !!merge <<: *insightface + name: "cuda12-insightface-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-insightface" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-insightface + +# speaker-recognition (voice/speaker biometrics) — Apache-2.0 stack +- &speakerrecognition + name: "speaker-recognition" + alias: "speaker-recognition" + # SpeechBrain is Apache-2.0. WeSpeaker / 3D-Speaker ONNX exports are + # Apache-2.0. The backend itself ships only Python deps — all model + # weights flow through LocalAI's gallery download mechanism (or + # SpeechBrain's built-in HF auto-download at first LoadModel). + license: apache-2.0 + description: | + Speaker (voice) recognition backend — the audio analog to + insightface. Wraps SpeechBrain ECAPA-TDNN (default engine, 192-d + embeddings, ~1.9% EER on VoxCeleb) plus an OnnxDirectEngine for + pre-exported WeSpeaker / 3D-Speaker ONNX models. + + Exposes speaker verification (/v1/voice/verify), speaker embedding + (/v1/voice/embed), speaker analysis (/v1/voice/analyze), and 1:N + speaker identification (/v1/voice/{register,identify,forget}). + Registrations use LocalAI's built-in vector store — same in-memory + backing the face-recognition registry uses, separate instance. + urls: + - https://speechbrain.github.io/ + - https://github.com/wenet-e2e/wespeaker + - https://github.com/modelscope/3D-Speaker + tags: + - voice-recognition + - speaker-verification + - speaker-embedding + - gpu + - cpu + capabilities: + default: "cpu-speaker-recognition" + nvidia: "cuda12-speaker-recognition" + nvidia-cuda-12: "cuda12-speaker-recognition" + metal: "metal-speaker-recognition" +- !!merge <<: *speakerrecognition + name: "speaker-recognition-development" + capabilities: + default: "cpu-speaker-recognition-development" + nvidia: "cuda12-speaker-recognition-development" + nvidia-cuda-12: "cuda12-speaker-recognition-development" + metal: "metal-speaker-recognition-development" +- !!merge <<: *speakerrecognition + name: "cpu-speaker-recognition" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-speaker-recognition" + mirrors: + - localai/localai-backends:latest-cpu-speaker-recognition +- !!merge <<: *speakerrecognition + name: "cuda12-speaker-recognition" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-speaker-recognition" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-speaker-recognition +- !!merge <<: *speakerrecognition + name: "cpu-speaker-recognition-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-speaker-recognition" + mirrors: + - localai/localai-backends:master-cpu-speaker-recognition +- !!merge <<: *speakerrecognition + name: "cuda12-speaker-recognition-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-speaker-recognition" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-speaker-recognition +- !!merge <<: *speakerrecognition + name: "metal-speaker-recognition" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-speaker-recognition" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-speaker-recognition +- !!merge <<: *speakerrecognition + name: "metal-speaker-recognition-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-speaker-recognition" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-speaker-recognition +## sherpa-onnx +- !!merge <<: *sherpa-onnx + name: "sherpa-onnx-development" + capabilities: + default: "cpu-sherpa-onnx-development" + nvidia: "cuda12-sherpa-onnx-development" + nvidia-cuda-12: "cuda12-sherpa-onnx-development" + metal: "metal-sherpa-onnx-development" +- !!merge <<: *sherpa-onnx + name: "cpu-sherpa-onnx" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-sherpa-onnx" + mirrors: + - localai/localai-backends:latest-cpu-sherpa-onnx +- !!merge <<: *sherpa-onnx + name: "cpu-sherpa-onnx-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-sherpa-onnx" + mirrors: + - localai/localai-backends:master-cpu-sherpa-onnx +- !!merge <<: *sherpa-onnx + name: "cuda12-sherpa-onnx" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-sherpa-onnx" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-sherpa-onnx +- !!merge <<: *sherpa-onnx + name: "cuda12-sherpa-onnx-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-sherpa-onnx" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-sherpa-onnx +- !!merge <<: *sherpa-onnx + name: "metal-sherpa-onnx" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-sherpa-onnx" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-sherpa-onnx +- !!merge <<: *sherpa-onnx + name: "metal-sherpa-onnx-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-sherpa-onnx" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-sherpa-onnx +## supertonic +- !!merge <<: *supertonic + name: "supertonic-development" + capabilities: + default: "cpu-supertonic-development" + metal: "metal-supertonic-development" +- !!merge <<: *supertonic + name: "cpu-supertonic" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-supertonic" + mirrors: + - localai/localai-backends:latest-cpu-supertonic +- !!merge <<: *supertonic + name: "cpu-supertonic-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-supertonic" + mirrors: + - localai/localai-backends:master-cpu-supertonic +- !!merge <<: *supertonic + name: "metal-supertonic" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-supertonic" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-supertonic +- !!merge <<: *supertonic + name: "metal-supertonic-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-supertonic" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-supertonic +- !!merge <<: *vllm-cpp + name: "cpu-vllm-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-vllm-cpp" + mirrors: + - localai/localai-backends:latest-cpu-vllm-cpp +- !!merge <<: *vllm-cpp + name: "cpu-vllm-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-vllm-cpp" + mirrors: + - localai/localai-backends:master-cpu-vllm-cpp +- !!merge <<: *vllm-cpp + name: "cuda13-vllm-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-vllm-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-vllm-cpp +- !!merge <<: *vllm-cpp + name: "cuda13-vllm-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-vllm-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-vllm-cpp +- !!merge <<: *vllm-cpp + name: "nvidia-l4t-arm64-vllm-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-vllm-cpp" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-vllm-cpp +- !!merge <<: *vllm-cpp + name: "nvidia-l4t-arm64-vllm-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-vllm-cpp" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-vllm-cpp +- !!merge <<: *vllm-cpp + name: "vulkan-vllm-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-vllm-cpp" + mirrors: + - localai/localai-backends:latest-gpu-vulkan-vllm-cpp +- !!merge <<: *vllm-cpp + name: "vulkan-vllm-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-vulkan-vllm-cpp" + mirrors: + - localai/localai-backends:master-gpu-vulkan-vllm-cpp +- !!merge <<: *vllm-cpp + name: "metal-vllm-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-vllm-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-vllm-cpp +- !!merge <<: *vllm-cpp + name: "metal-vllm-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-vllm-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-vllm-cpp +## audio-cpp +- !!merge <<: *audiocpp + name: "cpu-audio-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-audio-cpp" + mirrors: + - localai/localai-backends:latest-cpu-audio-cpp +- !!merge <<: *audiocpp + name: "cpu-audio-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-audio-cpp" + mirrors: + - localai/localai-backends:master-cpu-audio-cpp +- !!merge <<: *audiocpp + name: "cuda12-audio-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-audio-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-audio-cpp +- !!merge <<: *audiocpp + name: "cuda12-audio-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-audio-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-audio-cpp +- !!merge <<: *audiocpp + name: "cuda13-audio-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-audio-cpp" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-audio-cpp +- !!merge <<: *audiocpp + name: "cuda13-audio-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-audio-cpp" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-audio-cpp +- !!merge <<: *audiocpp + name: "rocm-audio-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-audio-cpp" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-audio-cpp +- !!merge <<: *audiocpp + name: "rocm-audio-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-audio-cpp" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-audio-cpp +- !!merge <<: *audiocpp + name: "metal-audio-cpp" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-audio-cpp" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-audio-cpp +- !!merge <<: *audiocpp + name: "metal-audio-cpp-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-audio-cpp" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-audio-cpp +## funasr +- !!merge <<: *funasr + name: "funasr-development" + capabilities: + nvidia: "cuda12-funasr-development" + intel: "intel-funasr-development" + amd: "rocm-funasr-development" + nvidia-l4t: "nvidia-l4t-funasr-development" + metal: "metal-funasr-development" + default: "cpu-funasr-development" + nvidia-cuda-13: "cuda13-funasr-development" + nvidia-cuda-12: "cuda12-funasr-development" + nvidia-l4t-cuda-12: "nvidia-l4t-funasr-development" + nvidia-l4t-cuda-13: "cuda13-nvidia-l4t-arm64-funasr-development" +- !!merge <<: *funasr + name: "cpu-funasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-cpu-funasr" + mirrors: + - localai/localai-backends:latest-cpu-funasr +- !!merge <<: *funasr + name: "cpu-funasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-cpu-funasr" + mirrors: + - localai/localai-backends:master-cpu-funasr +- !!merge <<: *funasr + name: "cuda12-funasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-12-funasr" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-12-funasr +- !!merge <<: *funasr + name: "cuda12-funasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-12-funasr" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-12-funasr +- !!merge <<: *funasr + name: "cuda13-funasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-nvidia-cuda-13-funasr" + mirrors: + - localai/localai-backends:latest-gpu-nvidia-cuda-13-funasr +- !!merge <<: *funasr + name: "cuda13-funasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-nvidia-cuda-13-funasr" + mirrors: + - localai/localai-backends:master-gpu-nvidia-cuda-13-funasr +- !!merge <<: *funasr + name: "intel-funasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-intel-funasr" + mirrors: + - localai/localai-backends:latest-gpu-intel-funasr +- !!merge <<: *funasr + name: "intel-funasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-intel-funasr" + mirrors: + - localai/localai-backends:master-gpu-intel-funasr +- !!merge <<: *funasr + name: "rocm-funasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-gpu-rocm-hipblas-funasr" + mirrors: + - localai/localai-backends:latest-gpu-rocm-hipblas-funasr +- !!merge <<: *funasr + name: "rocm-funasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-gpu-rocm-hipblas-funasr" + mirrors: + - localai/localai-backends:master-gpu-rocm-hipblas-funasr +- !!merge <<: *funasr + name: "nvidia-l4t-funasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-funasr" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-funasr +- !!merge <<: *funasr + name: "nvidia-l4t-funasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-funasr" + mirrors: + - localai/localai-backends:master-nvidia-l4t-funasr +- !!merge <<: *funasr + name: "cuda13-nvidia-l4t-arm64-funasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-nvidia-l4t-cuda-13-arm64-funasr" + mirrors: + - localai/localai-backends:latest-nvidia-l4t-cuda-13-arm64-funasr +- !!merge <<: *funasr + name: "cuda13-nvidia-l4t-arm64-funasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-nvidia-l4t-cuda-13-arm64-funasr" + mirrors: + - localai/localai-backends:master-nvidia-l4t-cuda-13-arm64-funasr +- !!merge <<: *funasr + name: "metal-funasr" + uri: "quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-funasr" + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-funasr +- !!merge <<: *funasr + name: "metal-funasr-development" + uri: "quay.io/go-skynet/local-ai-backends:master-metal-darwin-arm64-funasr" + mirrors: + - localai/localai-backends:master-metal-darwin-arm64-funasr diff --git a/core/gallery/testdata/backend_library/pins.tsv b/core/gallery/testdata/backend_library/pins.tsv new file mode 100644 index 000000000..50c31b27b --- /dev/null +++ b/core/gallery/testdata/backend_library/pins.tsv @@ -0,0 +1,1088 @@ +# id, os, arch, digest (empty: not pinned in the library) +# Written by scripts/backends/cmd/backendcatalog --golden; do not edit by hand. +cpu-ace-step linux amd64 sha256:e322f49a7eea5a99f030d450ab9fc3c4c911429c943a749003d7a382d7eba2d6 +cpu-ace-step-development linux amd64 +cpu-acestep-cpp linux amd64 sha256:4bab8a03b683837c65e652b4c54d95ceeffdb92c8f34790bcc9df2b4910031a0 +cpu-acestep-cpp linux arm64 sha256:cdd8b62de78560c849c11eb58b34ac59352a39e7648f0bb3c39380b246505d6c +cpu-acestep-cpp-development linux amd64 +cpu-acestep-cpp-development linux arm64 +cpu-audio-cpp linux amd64 sha256:4135dc2ce663c72b8dec065c58dd409a8ae5a61b482b6cf100e698515cf1ee90 +cpu-audio-cpp linux arm64 sha256:d37693a85cc29299ebd83123d23102e6a98fb21f48e689b8c5691d0535a4b221 +cpu-audio-cpp-development linux amd64 +cpu-audio-cpp-development linux arm64 +cpu-bonsai linux amd64 sha256:b399c8d7f4e0997ff503a769e3463e712afcdcb33f710748be6f61c4b4c012bb +cpu-bonsai linux arm64 sha256:3c16d81d45dd6cabba4cdaf870f8c5a21a3a615a21a5e7fb66cfd7a280d127c3 +cpu-bonsai-development linux amd64 +cpu-bonsai-development linux arm64 +cpu-ced linux amd64 sha256:40a140d875fa962daa4ba0a9db6c22cfb9db58eac1d563064f28adae3973271f +cpu-ced linux arm64 sha256:c6c645ac4d28506c9bd0dff45e23e238b11699b9619417601cc7f3817a2a4291 +cpu-ced-development linux amd64 +cpu-ced-development linux arm64 +cpu-chatterbox linux amd64 sha256:4493fa1d89f5b7daf25b824672ff805bb759dabbbce857963733fdfd4fa64e2d +cpu-chatterbox-development linux amd64 +cpu-cloud-proxy linux amd64 sha256:16b5112dc5272f11b6f2c966e99d3fbdc9038b944f4e27fb2df68e231e6e6da9 +cpu-cloud-proxy linux arm64 sha256:4e2eb3f3823e3be5178a9751d764a3fe338eb23e4fce83447c70b0a2c7193e5b +cpu-cloud-proxy-development linux amd64 +cpu-cloud-proxy-development linux arm64 +cpu-crispasr linux amd64 sha256:ab0fc0f3a0fbdbf05dc1f6e3ab85a1b9882548d5102370a37f419f2c022ecfd6 +cpu-crispasr linux arm64 sha256:69d75fed793fa9e3c6952e5a8d05f7841f3a45f864c0f97479bedea377e54fa6 +cpu-crispasr-development linux amd64 +cpu-crispasr-development linux arm64 +cpu-darwin-arm64-gemxcpp darwin arm64 sha256:b75bf2496a7264eabfbdf8543e46caf2bee812db5d0b728ff76fcabab5503e7a +cpu-darwin-arm64-gemxcpp-development darwin arm64 +cpu-darwin-arm64-kimodocpp darwin arm64 sha256:9525f31141cf0f465dcd280f517e0ede88b7585a707852c9371b8426dcfa76fc +cpu-darwin-arm64-kimodocpp-development darwin arm64 +cpu-depth-anything-cpp linux amd64 sha256:be1332669672a133fe4c6a41356452859bcdb8db738b0dbcb13910cebffb8b41 +cpu-depth-anything-cpp-development linux amd64 +cpu-diffusers linux amd64 sha256:c1d9f353170d69e50754255dd0f7bff7bc48427c6d22cd7c92f6bc0119962c5d +cpu-diffusers-development linux amd64 +cpu-ds4 linux amd64 sha256:15bbdd953bd5ecaaa381beced63539df4d454f1016a3f64d9e8471960d9587b1 +cpu-ds4 linux arm64 sha256:73f95c0c78758b39956ed0905016b0467a36c426a726ac31f83792d77166bd18 +cpu-ds4-development linux amd64 +cpu-ds4-development linux arm64 +cpu-face-detect linux amd64 sha256:cdb89ff62dd26dddc01c2cebe8a91c604f8bedf5aa02d616ed057658b6ac5458 +cpu-face-detect linux arm64 sha256:c57b4de1caad03731d25304b3c667234a44a1569627738188d2d1364db6623c4 +cpu-face-detect-development linux amd64 +cpu-face-detect-development linux arm64 +cpu-faster-whisper linux amd64 sha256:1d76e70370a65108dd723bbfd14b6cf0b3c22451245793db5442b57af6e12d6c +cpu-faster-whisper linux arm64 sha256:8f503a5fde355b3b694896108b527bf3b365733937b23d277f8739bc0a8590c6 +cpu-faster-whisper-development linux amd64 +cpu-faster-whisper-development linux arm64 +cpu-fish-speech linux amd64 sha256:5fdc50fa04b9a968e7a8c66ced0600e0658de178d7df96dbebd9e97a76c64767 +cpu-fish-speech linux arm64 sha256:93166f3816cab8ae94edb9d07a2c7315146123faf225b4396843364d01c7d61c +cpu-fish-speech-development linux amd64 +cpu-fish-speech-development linux arm64 +cpu-funasr linux amd64 sha256:2eeddb701f9b23824358f25dddad1abce60f13166b6ed922567edc1069c12ff4 +cpu-funasr linux arm64 sha256:b6a62a9883c074362c45f0a60a6ced66f16ad8bfab9c7f9b932d7807435f00f9 +cpu-funasr-development linux amd64 +cpu-funasr-development linux arm64 +cpu-gemxcpp linux amd64 +cpu-gemxcpp-development linux amd64 +cpu-gemxcpp-development linux arm64 +cpu-ik-llama-cpp linux amd64 sha256:c0071414b90148c5e8701272c092c91d5b79e500837655b90f329e67d4b93e50 +cpu-ik-llama-cpp-development linux amd64 +cpu-insightface linux amd64 sha256:67e11d408c7142cb87b2896882c76b607c69f9e332178e15db877e17268f9fdf +cpu-insightface linux arm64 sha256:5ff844d4fd11fa1a2a46b3dacecf088a4cdff0ca4ded1acbba5d2b5b7632e460 +cpu-insightface-development linux amd64 +cpu-insightface-development linux arm64 +cpu-kimodocpp linux amd64 sha256:6a18cb41bb99cdfa9c8ce2aea138241dceb44234c5b46e2abb1b7beebdf82656 +cpu-kimodocpp linux arm64 sha256:dccbaabeadeb7688cfe6872073429f63d7381afee121a12e7e6813de84c4f330 +cpu-kimodocpp-development linux amd64 +cpu-kimodocpp-development linux arm64 +cpu-kitten-tts linux amd64 sha256:7e9f9e7c5b2a9a276ea4a23a7a91b3b3f57a5e1de8e9a0ca712a1b85da4655c7 +cpu-kitten-tts linux arm64 sha256:de46fc3a41a179cb4a97cb656ba0b0264f687a53166fcf0353d1148b07d70967 +cpu-kitten-tts-development linux amd64 +cpu-kitten-tts-development linux arm64 +cpu-kokoro linux amd64 sha256:906749824cf5540fbb744d1d6b7bf216385e83d6664caa9f8c88b8da3b94fca6 +cpu-kokoro linux arm64 sha256:b9085a7d47d16d2e5b25e8c689686ad27c1cc3399aabf7023f120a57b2239bb8 +cpu-kokoro-development linux amd64 +cpu-kokoro-development linux arm64 +cpu-kokoros linux amd64 sha256:9b6ad2d1b6ca7da7ba437af0470f8459d6321ed15f6adfeaa69d873c4d1d8785 +cpu-kokoros-development linux amd64 +cpu-liquid-audio linux amd64 sha256:ad9798b82dae6f2e8d12b077bf1e029c586f44480cea2ff2428671fbbbd4a870 +cpu-liquid-audio-development linux amd64 +cpu-llama-cpp linux amd64 sha256:cc0eaf6d6db4c5c22b9e431e7d90b917906a2262add102da65f241b4cfe06bf7 +cpu-llama-cpp linux arm64 sha256:de6aa44e96e52a715b55ec6ac48b7bde5711401267817fef3af052872b63935c +cpu-llama-cpp-development linux amd64 +cpu-llama-cpp-development linux arm64 +cpu-llama-cpp-quantization linux amd64 sha256:2247b5a65093a087634fa3395c695775d0ebb2746e8b684e590ccb22b12b00b7 +cpu-llama-cpp-quantization linux arm64 sha256:7f13d915da608281635586d720311313ba1fd2b41ac66d48836b5c0b4f0d15b4 +cpu-local-store linux amd64 sha256:0a1056fd863328adf9d1097808aa2b52f68c4ca2e5385100a754755b3ca6218f +cpu-local-store linux arm64 sha256:4c7193a9442b9cc460eaddff8a31566d6314e427b50093a33f2f9c8a91280bfd +cpu-local-store-development linux amd64 +cpu-local-store-development linux arm64 +cpu-localai-proxy linux amd64 sha256:b75eecc47fde44f0d61a88fcf1d8382abe0ba2a71cc73d0a5177fdd27259e2f1 +cpu-localai-proxy linux arm64 sha256:9165c0c1aeb8d4c8e54b462dd52c4bb7b849446df03ed127d0d4fab03bc24d43 +cpu-localai-proxy-development linux amd64 +cpu-localai-proxy-development linux arm64 +cpu-localvqe linux amd64 sha256:2de4122e37312eb5a5f6de7086a3f0996f510809bac8e3230f04f01b6d569e62 +cpu-localvqe linux arm64 sha256:f971080db646067771b1a587e56a10ee2a637ffe0d9bd8629d4e222f13e26e14 +cpu-localvqe-development linux amd64 +cpu-localvqe-development linux arm64 +cpu-locate-anything-cpp linux amd64 sha256:acb078c58ac5e78485e7254fd8f040ba901255f118edf3d8f881bfbd7384b673 +cpu-locate-anything-cpp-development linux amd64 +cpu-magpie-tts-cpp linux amd64 sha256:acd8594a0dde6b96ce36adca32d4a9457bfec0f49223fab93523075013d4428d +cpu-magpie-tts-cpp linux arm64 sha256:6743d45397d6984f21f0f7182bee83dd595af83029ea2a7a48995536094df409 +cpu-magpie-tts-cpp-development linux amd64 +cpu-magpie-tts-cpp-development linux arm64 +cpu-mlx linux amd64 sha256:4ee522af2f5cfc29fa4249a69836e094daf97fc2ec993cfe62293211561e7a3a +cpu-mlx-audio linux amd64 sha256:0094d30432345d6e8077e45cb31b008ccc1b1ef72594b6254d825f23c8a525c9 +cpu-mlx-audio-development linux amd64 +cpu-mlx-development linux amd64 +cpu-mlx-distributed linux amd64 sha256:3f474c214826f142f0fe81baa6a8567c6731ff3750b5513e9ea9d2ee631a1cd7 +cpu-mlx-distributed-development linux amd64 +cpu-mlx-vlm linux amd64 sha256:8b772fabcc0d6360db9fc86762cec7b5b2418dd6fff1a55c2e6c96215acc87a3 +cpu-mlx-vlm-development linux amd64 +cpu-moonshine linux amd64 sha256:7dfb417098f7ba243d7392801fca5d9d003752cd06f4e1bd52ec24636108f460 +cpu-moonshine-development linux amd64 +cpu-moss-transcribe-cpp linux amd64 sha256:77d95a89dfe673761a1298330910d7d552a9d0a38a712fcd48f0c5699c5097bc +cpu-moss-transcribe-cpp linux arm64 sha256:36bb2b9c2f216a0f1f470565995ea1b3bfa135d152f810e3ea7cb6e16ada00d6 +cpu-moss-transcribe-cpp-development linux amd64 +cpu-moss-transcribe-cpp-development linux arm64 +cpu-moss-tts-cpp linux amd64 sha256:879209f9e8d1da6c6ccf6a9b63f12912569cc9cdc5f1809a5683b80a3a087e12 +cpu-moss-tts-cpp linux arm64 sha256:8f1c6a7091cc447b1bbc43511e58bedeca412f374323400061c7f42da342d86b +cpu-moss-tts-cpp-development linux amd64 +cpu-moss-tts-cpp-development linux arm64 +cpu-nemo linux amd64 sha256:808bd33acc38e222c290086ea74034777e039387f5e965d48ad266bee6ca8d1a +cpu-nemo linux arm64 sha256:59d9ce4553310028bbaeab3f74e9f6ba3b53bd9df527243de5c2d894687c4596 +cpu-nemo-development linux amd64 +cpu-nemo-development linux arm64 +cpu-nemo-speech-cpp linux amd64 sha256:eac33ca2ed2b844fdd4e1161b8cb62a78fcf05ec5f1082726d31386715d8ddf4 +cpu-nemo-speech-cpp linux arm64 sha256:354c368ce82b0821c04dea96333dd7de576d2b0b75682bb1476974b06ba18b93 +cpu-nemo-speech-cpp-development linux amd64 +cpu-nemo-speech-cpp-development linux arm64 +cpu-neutts linux amd64 sha256:88f69129f16edbe4f83519aa049de594556de8e4b6d284ed3ece691754c769b5 +cpu-neutts linux arm64 sha256:0b8021312bd8cdc1113fe0b589c1e1a0ac9bae6854df09833f1973625b5c3444 +cpu-neutts-development linux amd64 +cpu-neutts-development linux arm64 +cpu-omnivoice-cpp linux amd64 sha256:093e99dfa54655a8c57b46b317d61aea151e9f884a148d62c2203ca597b9e653 +cpu-omnivoice-cpp linux arm64 sha256:1ae7cd4f100e8a4f31a77242fd57bab8326e4a6607bb365bb2f89db20682e593 +cpu-omnivoice-cpp-development linux amd64 +cpu-omnivoice-cpp-development linux arm64 +cpu-opus linux amd64 sha256:5a0c7bff65959e4218c1e2efaf67fe211259b326c3aa08496c6800313888d662 +cpu-opus linux arm64 sha256:2b42d31fb24f730a30eab559c836a0b17ba299106a586aa6d6bc77600d2a806b +cpu-opus-development linux amd64 +cpu-opus-development linux arm64 +cpu-outetts linux amd64 sha256:26d02bd90f33cc400d3d0f873be66bb87091e8001b2cb40ad8137c6c9b83f0ce +cpu-outetts-development linux amd64 +cpu-parakeet-cpp linux amd64 sha256:2d16574a2df2b01b29da0bf1e4ec9f765215bbd58d02d0f0d0dc5f54d27edd8e +cpu-parakeet-cpp linux arm64 sha256:5f6c00a64a70e203d2530c3c75002838520ff1a1078e6b93135369c392258a5d +cpu-parakeet-cpp-development linux amd64 +cpu-parakeet-cpp-development linux arm64 +cpu-piper linux amd64 sha256:47d923773f3a50a91e14b80612ea69c8b3e99ba85cf4b7c3faf1f14c42f10451 +cpu-piper linux arm64 sha256:ec9a6d49f1591f7b501c3a4f363143e4effbed595c3acd956b17d2e52a0309a7 +cpu-piper-development linux amd64 +cpu-piper-development linux arm64 +cpu-pocket-tts linux amd64 sha256:ea236d75db49af21798b87f7357fcf48d7b239680210075c9c9712194eca1983 +cpu-pocket-tts linux arm64 sha256:5854c13af621d755ba927c058a138f3f9a7aa36990528364c2b771de2759bbaa +cpu-pocket-tts-development linux amd64 +cpu-pocket-tts-development linux arm64 +cpu-privacy-filter linux amd64 sha256:0212fd755263d745b3593aeb7f243c5dac13661471efdd89ab05fb8178505a2c +cpu-privacy-filter linux arm64 sha256:af8651eced9ebd4ac0e0c7be79d021d9007f786d6eeddfdcbb986088e345530f +cpu-privacy-filter-development linux amd64 +cpu-privacy-filter-development linux arm64 +cpu-qdrant-store linux amd64 +cpu-qdrant-store-development linux amd64 +cpu-qdrant-store-development linux arm64 +cpu-qwen-asr linux amd64 sha256:121ec5ab381c07cb6455745da3585a6ea50d7c00bbb9da856d62d3932d0be994 +cpu-qwen-asr linux arm64 sha256:3cb0beca4c844e32a217e36b67ff8c87089c1fd04e374348e6e3774cc079aeb1 +cpu-qwen-asr-development linux amd64 +cpu-qwen-asr-development linux arm64 +cpu-qwen-tts linux amd64 sha256:5a4fb3695e0026ea3e361442d54bd2229ece9cd666f0ea68a5f23f8ca317cd78 +cpu-qwen-tts linux arm64 sha256:71d4bcffcc4d2be3a68724dc5f74b085c2ffa8f4290339500da11c91385d2bfe +cpu-qwen-tts-development linux amd64 +cpu-qwen-tts-development linux arm64 +cpu-qwen3-tts-cpp linux amd64 sha256:30053dde04f87b12af37dff52264b40c0d728823a7ada140c0257bb7a5ff2f52 +cpu-qwen3-tts-cpp linux arm64 sha256:b08543236410107fa3860f923436f15264c1220b3d2bb0944369b407fdc67a15 +cpu-qwen3-tts-cpp-development linux amd64 +cpu-qwen3-tts-cpp-development linux arm64 +cpu-rfdetr linux amd64 sha256:4d996fcd5856957b6e2b863d3e603c452fe1616351a64e4723a2be5d67fc2cda +cpu-rfdetr linux arm64 sha256:b1b6bfa892e655d38abb2d3c47ae9e2abec9de76a144f093767e74ef608e3505 +cpu-rfdetr-cpp linux amd64 sha256:3a369d3bba319f5506ce9676266272cf4188878e6bb75c4a9a97ac422314e225 +cpu-rfdetr-cpp-development linux amd64 +cpu-rfdetr-development linux amd64 +cpu-rfdetr-development linux arm64 +cpu-sam3-cpp linux amd64 sha256:4c36b55dbc8f7def5f907fe9b49ffae23107d0b7f772ab462a35bcb42d25a377 +cpu-sam3-cpp-development linux amd64 +cpu-sglang linux amd64 sha256:e6976f0cbe239e27897a38494ee971609df0152181d6de22e3e3081211f00b99 +cpu-sglang-development linux amd64 +cpu-sherpa-onnx linux amd64 sha256:68382f90ae1b52b99c781576d3b23f116417291aeb705190419fb4d48623b00c +cpu-sherpa-onnx linux arm64 sha256:16994041d7ef1dabdfe715732b4928388642cadeb5e2f74ac9cad4a7e77e423c +cpu-sherpa-onnx-development linux amd64 +cpu-sherpa-onnx-development linux arm64 +cpu-silero-vad linux amd64 sha256:951ae5a37778dee084564b4aa4052633e838141b0a68b94a48dbf29d18933383 +cpu-silero-vad linux arm64 sha256:28761eeb99fb5f0dcc23d07e2fe19b030477caf552c17fcc554d657bfe2da84f +cpu-silero-vad-development linux amd64 +cpu-silero-vad-development linux arm64 +cpu-speaker-recognition linux amd64 sha256:09b9a895fa8fb1e373f4364fe516578c877db466fc1d9011a1d1b6719a1d89a1 +cpu-speaker-recognition linux arm64 sha256:8bc239f3a9da05b895a1e4435c13e71b1887d5557d171163af1d089ef9bc3f91 +cpu-speaker-recognition-development linux amd64 +cpu-speaker-recognition-development linux arm64 +cpu-stablediffusion-ggml linux amd64 sha256:9d9a53b908461ff4445dd3964884c743fdd8d37f16f88b5e59c2ee7b833733b1 +cpu-stablediffusion-ggml-development linux amd64 +cpu-supertonic linux amd64 sha256:c5704d01cd4788bb52b11246121079a0a2bc3b24e006c1863504c4104f9eb506 +cpu-supertonic linux arm64 sha256:1fd612efe2575955324902a30a97d6de827f6bce24413478dd28b2b38374db22 +cpu-supertonic-development linux amd64 +cpu-supertonic-development linux arm64 +cpu-trellis2cpp linux amd64 sha256:ad3f28f8b2e2ba33fd15dc4f8c2bab9bd5a215fe10e05dd345dab675bc943e75 +cpu-trellis2cpp linux arm64 sha256:d0014c03d119a6435a1f26e86c29b948334677dbe1c341794924916c6f85aabf +cpu-trellis2cpp-development linux amd64 +cpu-trellis2cpp-development linux arm64 +cpu-trl linux amd64 sha256:06ecf562865d2dc574f788a9bc014a642888e840ffbcbca3f93320233837c843 +cpu-trl-development linux amd64 +cpu-turboquant linux amd64 sha256:0a67396ca36c76072b7a4bce81bb041c6c989821b4d11e0c450cb26595692d50 +cpu-turboquant linux arm64 sha256:a9825912d5e7db65709aa84d3c8053363ca5d3feca2bd2383d74ce629cce393b +cpu-turboquant-development linux amd64 +cpu-turboquant-development linux arm64 +cpu-valkey-store linux amd64 sha256:ddfed0d4efa741c2c8f310edeb8ac273f06d0dcb42eac7f0d12d2dccd55bd246 +cpu-valkey-store linux arm64 sha256:91db02c0db459b98e61ea4b2bb5470e67bf02134c35402a624320594161e419c +cpu-valkey-store-development linux amd64 +cpu-valkey-store-development linux arm64 +cpu-vibevoice linux amd64 sha256:df220dbff8dc1337cdc0b536b19cec23e59a6594394ee04cffbf959431ea0377 +cpu-vibevoice linux arm64 sha256:6387f1dc083699c8d3374cd7e0711d0d0f6dd366e6e789280f4d8ef441ce2a3e +cpu-vibevoice-cpp linux amd64 sha256:d072bb648568aa7506a331789edb348d47c63080f9b90cb5c88fdab235b99189 +cpu-vibevoice-cpp linux arm64 sha256:51d4e082d6277ad140a042ee3e4ffd35dfd509d98b86df296316751d39706444 +cpu-vibevoice-cpp-development linux amd64 +cpu-vibevoice-cpp-development linux arm64 +cpu-vibevoice-development linux amd64 +cpu-vibevoice-development linux arm64 +cpu-vllm linux amd64 sha256:912286c27330523c34713794b54fda6e7fab2b742e78617fbbc33cd0436876d4 +cpu-vllm-cpp linux amd64 sha256:bbfea378a5ea6f60e12594b5ca5c51dfda75c94ecfb02b540e212431120f8117 +cpu-vllm-cpp linux arm64 sha256:ce71687385c762504dc733373278e3c6a8bdb0ccc3ee416639be6b49a4a6a82e +cpu-vllm-cpp-development linux amd64 +cpu-vllm-cpp-development linux arm64 +cpu-vllm-development linux amd64 +cpu-voice-detect linux amd64 sha256:4cd724e1a37c0ecef994be30513cf3a25b8919d53d9dd6c0a95287ebeeb23282 +cpu-voice-detect linux arm64 sha256:719f74170bce84573c0f8c496547e9d616bf60d4409b087043224d6fa08506f4 +cpu-voice-detect-development linux amd64 +cpu-voice-detect-development linux arm64 +cpu-voxcpm linux amd64 sha256:ab8b15a085d7aee9e8db127d69ed0c9e3bee495664b59d4b84e1ea6fd8909e04 +cpu-voxcpm-development linux amd64 +cpu-voxtral linux amd64 sha256:cb4a8f0fa2a30592cfa193c5790ecf037a31504c702cab0bec9029aa74c6520c +cpu-voxtral linux arm64 sha256:1ce94da9ea69b874b6a2bffe7ab36a72bb223af1c09bf27e569884eb72731203 +cpu-voxtral-development linux amd64 +cpu-voxtral-development linux arm64 +cpu-whisper linux amd64 sha256:b74d2c14853fc6447ac7b9ad71ebb8ab1500bf91fcf1aab14682bb4c4af0c012 +cpu-whisper linux arm64 sha256:3f05e4a0045be056b930c1b324436a4804d160f5da714e121f1670578fa1b533 +cpu-whisper-development linux amd64 +cpu-whisper-development linux arm64 +cpu-whisper-medusa linux amd64 sha256:0b7da14d4aafcdbd44ad07aa997793d2ac26bd26ab71de77859c635e4e84a563 +cpu-whisper-medusa-development linux amd64 +cpu-whisperx linux amd64 sha256:5278477e986f6707e89ff6fd27a6fef03943fce1cd6b20c6b283182a59add2d9 +cpu-whisperx linux arm64 sha256:cba461fece818aa987466904c417798fa953a57e3e12b714d2800251bd710edf +cpu-whisperx-development linux amd64 +cpu-whisperx-development linux arm64 +cuda12-ace-step linux amd64 sha256:54a5dd5303b913c99c3815864be155c07a6e353dde9bd7db675f7dbcbfea52c1 +cuda12-ace-step-development linux amd64 +cuda12-acestep-cpp linux amd64 sha256:90c29addaed86a687e7405f9b67870a1f9480e8b8d606073d7082f8a69263ddb +cuda12-acestep-cpp-development linux amd64 +cuda12-audio-cpp linux amd64 sha256:8c49ae7a07e265ab207d5ca63ffc8a3d513205b591b5bfe43dfe958b87f33a55 +cuda12-audio-cpp-development linux amd64 +cuda12-bonsai linux amd64 sha256:7cd8a86dad0895399d90f0fefb6cba2989d088348a252e76276a049edac40c5d +cuda12-bonsai-development linux amd64 +cuda12-ced linux amd64 sha256:cab19f9b870d082b1833b9b1d1eb06490455ca19376d8ed7f9dc1e49966ae352 +cuda12-ced-development linux amd64 +cuda12-chatterbox linux amd64 sha256:138456ac5368b40ce5f160efffc39295af60c9931e34b5bfed22b399b44150a4 +cuda12-chatterbox-development linux amd64 +cuda12-coqui linux amd64 sha256:bb7a848e291432f60eccb1a26de50641251053c6254a7a9465278db697873a47 +cuda12-coqui-development linux amd64 +cuda12-crispasr linux amd64 sha256:31fd23bdbada01b1045eec4da85ea2bc69580a1bfa2a9b3af94e99eef65846a0 +cuda12-crispasr-development linux amd64 +cuda12-depth-anything-cpp linux amd64 sha256:f33e850d87377af2160942bbf194183ee4240058ca4a47a79abc7301c837cd65 +cuda12-depth-anything-cpp-development linux amd64 +cuda12-diffusers linux amd64 sha256:1b153bc901e4051fcd6a677c2bae45320c9cad8fefc7de48427cea9e85935a81 +cuda12-diffusers-development linux amd64 +cuda12-face-detect linux amd64 sha256:527bc5a1cd2666ce441965c6b154d042c06e48ce509950faca56b89704bddf51 +cuda12-face-detect-development linux amd64 +cuda12-faster-qwen3-tts linux amd64 sha256:6b13ff4340589a88e976f79a46a6f55831336ef9590a6c32e1a9ab815f35df16 +cuda12-faster-qwen3-tts-development linux amd64 +cuda12-faster-whisper linux amd64 sha256:ab987aa28e3e34cff0b1583f323184efe2b790dcd56411a24569fa179b646fce +cuda12-faster-whisper-development linux amd64 +cuda12-fish-speech linux amd64 sha256:1cdbbb29268bdb28d88ea014bdcc17e6c838eeba00e1a572e71f4ee93099c9d9 +cuda12-fish-speech-development linux amd64 +cuda12-funasr linux amd64 sha256:a6194c6a89022ca601a4b650a066b2854ba26038a2f2cbaa2a55858315341504 +cuda12-funasr-development linux amd64 +cuda12-insightface linux amd64 sha256:771e0ef97bec577a9e73176de2215cd8a832a5b705d8c0214b32f1f828526d40 +cuda12-insightface-development linux amd64 +cuda12-kokoro linux amd64 sha256:04b040393fad829bd6816c2a52a8e1620eccd9960e80812f6c7e026014745c34 +cuda12-kokoro-development linux amd64 +cuda12-liquid-audio linux amd64 sha256:ca554511dd390a5ffcef6d02164e27f1c22226d51598365bb6126219c0c870b8 +cuda12-liquid-audio-development linux amd64 +cuda12-llama-cpp linux amd64 sha256:21800474dce13aa477b392a61a84015d488cb14bc6cbaf7e6c367521f1190ae3 +cuda12-llama-cpp-development linux amd64 +cuda12-locate-anything-cpp linux amd64 sha256:ce8611790ea22f4807963c2cf6a48556e6e8055888b90a098248169c8d71c181 +cuda12-locate-anything-cpp-development linux amd64 +cuda12-longcat-video linux amd64 sha256:09e3a4b16b7af7de08c67c174d0fe86757d416a704f5061034eeec80143d659e +cuda12-longcat-video-development linux amd64 +cuda12-magpie-tts-cpp linux amd64 sha256:70621244d9fcdafe31cdeb7e2114b0f3672dc8f3ff5b9d7a226e109ab1a6f6f3 +cuda12-magpie-tts-cpp-development linux amd64 +cuda12-mlx linux amd64 sha256:08521ab78b6b33acf6b39435705dacd9783c2617cc95072447d8f31745506533 +cuda12-mlx-audio linux amd64 sha256:853149a3eb867093d00c81cde91df80c7ea20a27f259ce9cdbbf58db0b3e73ab +cuda12-mlx-audio-development linux amd64 +cuda12-mlx-development linux amd64 +cuda12-mlx-distributed linux amd64 sha256:196b6db68ca8df4415dc579219ac334c456f5cc6cfa3a190c0ebdf4ba0080f32 +cuda12-mlx-distributed-development linux amd64 +cuda12-mlx-vlm linux amd64 sha256:e72b0957501e5d876b61dcea6349e3812f750c9e997b3d6b9c25f3cd0364d8ec +cuda12-mlx-vlm-development linux amd64 +cuda12-moonshine linux amd64 sha256:574e10f6dae1c7b796001bfcb1fa68a7a664a22049c5ce04c331248e56b7140b +cuda12-moonshine-development linux amd64 +cuda12-moss-transcribe-cpp linux amd64 sha256:9c033818a0e9e4b067a0487b4578d4d0478153779aee934eff687bfa054df6e2 +cuda12-moss-transcribe-cpp-development linux amd64 +cuda12-moss-tts-cpp linux amd64 sha256:17ea7465b50d6c96d8dce0f906ff9e0a99bd78bef0fbdf1b760140821300181c +cuda12-moss-tts-cpp-development linux amd64 +cuda12-nemo linux amd64 sha256:b5902d3efc20149e2cf9583d08c1c35d4b30c4b59f8adf092b1d02ad7c83e784 +cuda12-nemo-development linux amd64 +cuda12-nemo-speech-cpp linux amd64 sha256:95925119efffbb216373f4fff503fad1e7b6b9b10f79dcc1a51d2696c49fc6ca +cuda12-nemo-speech-cpp-development linux amd64 +cuda12-neutts linux amd64 sha256:a74346a88fd6fdcd625dbf9b986942dc7db853f478fca1d107095e0f8301e7b1 +cuda12-neutts-development linux amd64 +cuda12-omnivoice-cpp linux amd64 sha256:6e91972980d9c125686949ddf008f8d7725a43b0b825c839e7623958d0f1f6fc +cuda12-omnivoice-cpp-development linux amd64 +cuda12-outetts linux amd64 sha256:fc51746da590c0f536df111812d09e476179415c48dc72592625e214817322e6 +cuda12-outetts-development linux amd64 +cuda12-parakeet-cpp linux amd64 sha256:0adbe9b86717d9638176c0ef44c0d805d5608250257c2baaa86961a2aa58ea39 +cuda12-parakeet-cpp-development linux amd64 +cuda12-pocket-tts linux amd64 sha256:5abd73aae902fad4985e1d1323965e5fa94adc1c3c2b7a6de8bf223d53265f5a +cuda12-pocket-tts-development linux amd64 +cuda12-qwen-asr linux amd64 sha256:94c45f761a0a5399d5f8e7f2c0d9326817245036f31fe07b16ce7db9748855af +cuda12-qwen-asr-development linux amd64 +cuda12-qwen-tts linux amd64 sha256:b0fd6d70ee6cd82b468ad996727201953ab2cae507d6b796ad60f77e01946067 +cuda12-qwen-tts-development linux amd64 +cuda12-qwen3-tts-cpp linux amd64 sha256:f70b36ed37c25ddc69f1e2561219537eb5e23b29830c74d3dfdabd9c5e9a69a9 +cuda12-qwen3-tts-cpp-development linux amd64 +cuda12-rerankers linux amd64 sha256:8348d1a84b13e9571f17c06065f1c990b2a6624976b931f2cb852647c9c46745 +cuda12-rerankers-development linux amd64 +cuda12-rfdetr linux amd64 sha256:67f51577203de1dfc884b94a470e91b1f7387529ace58ac0ff2182f2da3ae3cd +cuda12-rfdetr-cpp linux amd64 sha256:36ba228e2d82927d5c0dfcbcbe184f1b6e004a0138759d86a0a132b901f66802 +cuda12-rfdetr-cpp-development linux amd64 +cuda12-rfdetr-development linux amd64 +cuda12-sam3-cpp linux amd64 sha256:8afaee9fd5d93550349891acbc83e1c155fc6f10562cb5b63fff050c60bce78e +cuda12-sam3-cpp-development linux amd64 +cuda12-sglang linux amd64 sha256:18d724e0861d538ae3f98be18e2bf56c29db3b97da78268d78873198356b612d +cuda12-sglang-development linux amd64 +cuda12-sherpa-onnx linux amd64 sha256:768ec637854f1adbcb66dc6d24285d7fc641d15fb2a090bba767e3892155f7b5 +cuda12-sherpa-onnx-development linux amd64 +cuda12-speaker-recognition linux amd64 sha256:7842ae4600056057f13639751b7f0ea8a331585a2027ffad1da145d2ad08da2b +cuda12-speaker-recognition-development linux amd64 +cuda12-stablediffusion-ggml linux amd64 sha256:2cc1bdbed8e46659a98e953e10a9e2ec53450d097d65e0f59569b53b1715901d +cuda12-stablediffusion-ggml-development linux amd64 +cuda12-transformers linux amd64 sha256:86badbaefd2d46512bb215a3cbb570e52212b154d2fa3d28a6932a7c91baf2cb +cuda12-transformers-development linux amd64 +cuda12-trellis2cpp linux amd64 sha256:52e7a9c95c6be94031886c3e8b4c465b70e7223c00385b8bef295a6a42109206 +cuda12-trellis2cpp-development linux amd64 +cuda12-trl linux amd64 sha256:e65147c37e45bddf9e22fc4667b7ff64e62a4b60e2d6aa659988f4868fb2c6ab +cuda12-trl-development linux amd64 +cuda12-turboquant linux amd64 sha256:e4b68e7cc6a045e2dda724bd3aeb13cab1fcfedb3192bd55486758db6c21ee5d +cuda12-turboquant-development linux amd64 +cuda12-vibevoice linux amd64 sha256:af22fd28445d3a0ae8670ed4347165dcfa0a6327728eb6130ba924b71ece9718 +cuda12-vibevoice-cpp linux amd64 sha256:7aa291145c5874574a16602fc821ac6b507941f59ce1fe0884b26beed144606f +cuda12-vibevoice-cpp-development linux amd64 +cuda12-vibevoice-development linux amd64 +cuda12-vllm linux amd64 sha256:59113a129b4ff8ded8cd8bc4f54da3780016af8f20c0010b8ca452d518fa3b39 +cuda12-vllm-development linux amd64 +cuda12-vllm-omni linux amd64 sha256:3c0b901b5a3d0aca696f4ceacd92c4808c544f548315f4eab8e5889e13e95b66 +cuda12-vllm-omni-development linux amd64 +cuda12-voice-detect linux amd64 sha256:453a7a39788993092612c8c39007107d9e67b71efd764bb9463eecea016f408b +cuda12-voice-detect-development linux amd64 +cuda12-voxcpm linux amd64 sha256:198fc966308ccee38b303c43d47bf600ed1e5ac358f49dae4b67238b33de95be +cuda12-voxcpm-development linux amd64 +cuda12-whisper linux amd64 sha256:fccf1bb060e770331ac2bbfe166a500dc01ae44ed12c9a43fdb8943cfc40651a +cuda12-whisper-development linux amd64 +cuda12-whisper-medusa linux amd64 sha256:0db1f2a236a3f75c7c92a88e9f97694277d77e6829a35b545716b8996a2efd89 +cuda12-whisper-medusa-development linux amd64 +cuda12-whisperx linux amd64 sha256:d69cbd08a68763aa474095b1d94965739b0e7c6ce60e8b413e8e0080c5a0df26 +cuda12-whisperx-development linux amd64 +cuda13-ace-step linux amd64 sha256:6dd6c4d5f56b855b36a7028dac1d28b0920d990bb4ce192fab616a63a63a0dd7 +cuda13-ace-step-development linux amd64 +cuda13-acestep-cpp linux amd64 sha256:7115bd6801b50b1b57e65babc0993422469ce9422fdfda83749173f8fdb23a9f +cuda13-acestep-cpp-development linux amd64 +cuda13-audio-cpp linux amd64 sha256:0d3276ca418b3bb06fd58731d043acb9400b4bdb4782b72ff5b3d5b3cade5f0f +cuda13-audio-cpp-development linux amd64 +cuda13-bonsai linux amd64 sha256:ebcce7abdff68786094be4fd316be0a584fb2b7ee1214564a913cbe3dd1bc9af +cuda13-bonsai-development linux amd64 +cuda13-ced linux amd64 sha256:22ba7ce1134dc61d73b62db4fd80f7bf1c7871bd6223dceb648aebc84e7eaac5 +cuda13-ced-development linux amd64 +cuda13-chatterbox linux amd64 sha256:c041444f2233f70b1c709706333d1794f5064f63d8878e8e9f41b176f3cd0c3d +cuda13-chatterbox-development linux amd64 +cuda13-crispasr linux amd64 sha256:5e569fadfd91f6af2bc23e54d16bedc5e15857e59a1af67406a039416f5a0ac8 +cuda13-crispasr-development linux amd64 +cuda13-depth-anything-cpp linux amd64 sha256:189a90ea98965804fc9981f28bb333ddb88429db9792374686d1188f0d3c4ef1 +cuda13-depth-anything-cpp-development linux amd64 +cuda13-diffusers linux amd64 sha256:fdb33291961417bd296c39a052a161732a473e1bbb0363ac26a4eef2f8489e7d +cuda13-diffusers-development linux amd64 +cuda13-ds4 linux amd64 sha256:9e4dde56a5c73388c0cddf01715b7d1db67aed4cb2a6a9fc121b250030f3a7d3 +cuda13-ds4-development linux amd64 +cuda13-face-detect linux amd64 sha256:dfd34b11c7de97c7fe72f15b423a69aef0ec71a5bfd520819efbf2ab90806dc8 +cuda13-face-detect-development linux amd64 +cuda13-faster-qwen3-tts linux amd64 sha256:722d85a0eaa2f95991b80726f6f75ffd80205fb0366730258b6390e51ce9b127 +cuda13-faster-qwen3-tts-development linux amd64 +cuda13-faster-whisper linux amd64 sha256:596578a97b28e0a9b7ae4e59c3b111f7b2fec1840c12ae7cf8a8d3033e7db584 +cuda13-faster-whisper-development linux amd64 +cuda13-fish-speech linux amd64 sha256:e91134cc5dd5b589078c0e710c9df7e983f515f600e99f7d952f96ac86c5d583 +cuda13-fish-speech-development linux amd64 +cuda13-funasr linux amd64 sha256:01db0d81834756fc1bee6b29c0f7e53cd2e0c943db6e350e340763da392c8f89 +cuda13-funasr-development linux amd64 +cuda13-kokoro linux amd64 sha256:1577a61547955fbcf47d9065642a0b9170e9079236e7456702ffeedfec39a52b +cuda13-kokoro-development linux amd64 +cuda13-liquid-audio linux amd64 sha256:d1ec28a025abf0b7397d5dae2bfd08b5a864dc7c80a87359bd9071bdc8b6b063 +cuda13-liquid-audio-development linux amd64 +cuda13-llama-cpp linux amd64 sha256:db9a34f0532badb72551f68c028969bf8bd2b37035d973954d0f47a3e41af034 +cuda13-llama-cpp-development linux amd64 +cuda13-locate-anything-cpp linux amd64 sha256:9ce5321d47c6f0623d110db6e83327ba0dbbfb0d34658fc0d56689ec9b0bfa66 +cuda13-locate-anything-cpp-development linux amd64 +cuda13-longcat-video linux amd64 sha256:568aa1f7d096aefdd9828f7d2228903b5529d3fbe704df498473bc0f5b1bd2d0 +cuda13-longcat-video-development linux amd64 +cuda13-magpie-tts-cpp linux amd64 sha256:f78f3fa4ae920879a72dcd91be9e14be8d088e9ee9f82b4548d4fb84a0e59ab4 +cuda13-magpie-tts-cpp-development linux amd64 +cuda13-mlx linux amd64 sha256:2d79e4bc07c7b806ffd3a015fe718bb1befd49a91138f3905e7d7569f1baf5f5 +cuda13-mlx-audio linux amd64 sha256:085b7f8afb02da71bddf04973aaff1481ace501404bd6b40079c044af51ba236 +cuda13-mlx-audio-development linux amd64 +cuda13-mlx-development linux amd64 +cuda13-mlx-distributed linux amd64 sha256:637df163f10ce38ca4151c22216b175dcf252e27db78c79198fcd02e0281263d +cuda13-mlx-distributed-development linux amd64 +cuda13-mlx-vlm linux amd64 sha256:7a8fc54871cdf234b1cd702979a931f206fa2c38325993159f6ca1e6a3334cc9 +cuda13-mlx-vlm-development linux amd64 +cuda13-moonshine linux amd64 sha256:d8683abe3b60662ea8f044f3dc3eedad27338b6879489045ec388a6e282e56d2 +cuda13-moonshine-development linux amd64 +cuda13-moss-transcribe-cpp linux amd64 sha256:513b744e4c5c18e3015763d64f5eb2c85d8cac7f286b363921d8c6ab4928f60c +cuda13-moss-transcribe-cpp-development linux amd64 +cuda13-moss-tts-cpp linux amd64 sha256:f1f76ac317e7c1854593a2faab076a6527e8689ccf1af7dd646a55cbcf61c4e5 +cuda13-moss-tts-cpp-development linux amd64 +cuda13-nemo linux amd64 sha256:644779919871c23f8bcc95d300f5b118eee42157c7df24cf1ad5c93cc46c7166 +cuda13-nemo-development linux amd64 +cuda13-nemo-speech-cpp linux amd64 sha256:0d370043953877ff612bbd1286cfc5872256fd691dd332ebd80d784a3bea51c1 +cuda13-nemo-speech-cpp-development linux amd64 +cuda13-nvidia-l4t-arm64-acestep-cpp linux arm64 sha256:f47ab326e0c47f17a6de5d2c1277239a8d45d946095722a64d984608cb2f8560 +cuda13-nvidia-l4t-arm64-acestep-cpp-development linux arm64 +cuda13-nvidia-l4t-arm64-bonsai linux arm64 sha256:18d8267963cd773f83791d6f9dad3c42396e990614dbf971076b5134ee12e1d2 +cuda13-nvidia-l4t-arm64-bonsai-development linux arm64 +cuda13-nvidia-l4t-arm64-ced linux arm64 sha256:2b3337290a2d969b528b8608d16f05298214f392b6a37977bc9b6f9299daa864 +cuda13-nvidia-l4t-arm64-ced-development linux arm64 +cuda13-nvidia-l4t-arm64-chatterbox linux arm64 sha256:91d0b0bf98257818297940e7f3c81a708c55aec6418b36a818ad438a298b8d61 +cuda13-nvidia-l4t-arm64-chatterbox-development linux arm64 +cuda13-nvidia-l4t-arm64-crispasr linux arm64 sha256:68081ac52cb27d7abc8417472da7574c290513c880477ea24adb2849f0b71211 +cuda13-nvidia-l4t-arm64-crispasr-development linux arm64 +cuda13-nvidia-l4t-arm64-depth-anything-cpp linux arm64 sha256:e76016783e9b103321e8b48c3f1bd985e0ba42c44cdadf8b9a98105568e145f2 +cuda13-nvidia-l4t-arm64-depth-anything-cpp-development linux arm64 +cuda13-nvidia-l4t-arm64-diffusers linux arm64 sha256:d713fae3a7e41e201ef6b31517dc42970f2a0a2013ec2a5e9c2591d624bb804d +cuda13-nvidia-l4t-arm64-diffusers-development linux arm64 +cuda13-nvidia-l4t-arm64-ds4 linux arm64 sha256:9a0f22f18ab4af6121f693ef0553371461507c248705fcb1544304e3dab6bd51 +cuda13-nvidia-l4t-arm64-ds4-development linux arm64 +cuda13-nvidia-l4t-arm64-face-detect linux arm64 sha256:40025d5dbef07127b53c4c71e330a58fb89a251e7ec6fc8abf29127fdd4acb8b +cuda13-nvidia-l4t-arm64-face-detect-development linux arm64 +cuda13-nvidia-l4t-arm64-faster-qwen3-tts linux arm64 sha256:c670768c1565aa0d62dbe40bdffa5025ad781c61e999850a23064b4b80d2df11 +cuda13-nvidia-l4t-arm64-faster-qwen3-tts-development linux arm64 +cuda13-nvidia-l4t-arm64-fish-speech linux arm64 sha256:d8ed573b1a0622fe7a6eda8b44ea69228852ee203b706eee88e095044024e1bf +cuda13-nvidia-l4t-arm64-fish-speech-development linux arm64 +cuda13-nvidia-l4t-arm64-funasr linux arm64 sha256:b9e4659ed178da1ce73af4b65f7cf0d364aef107d5df45019092d895e2b4cad1 +cuda13-nvidia-l4t-arm64-funasr-development linux arm64 +cuda13-nvidia-l4t-arm64-liquid-audio linux arm64 sha256:fb521024116a1c2c69fcdc241922a25631c46555e42b3fcf66aa2d23da9506f2 +cuda13-nvidia-l4t-arm64-liquid-audio-development linux arm64 +cuda13-nvidia-l4t-arm64-llama-cpp linux arm64 sha256:18824d9c35c313f92c430c816726ce9743809d2b48b03285754b8b490b6ca57d +cuda13-nvidia-l4t-arm64-llama-cpp-development linux arm64 +cuda13-nvidia-l4t-arm64-locate-anything-cpp linux arm64 sha256:d3017733e7f376f1492361cb795bc8b0facf7546ab9d2c0cd9c9c8b40c5e5807 +cuda13-nvidia-l4t-arm64-locate-anything-cpp-development linux arm64 +cuda13-nvidia-l4t-arm64-longcat-video linux arm64 sha256:2fc336ae754bc6937894347bb5747062da3656fa68f5310dce5ca1b0381ae768 +cuda13-nvidia-l4t-arm64-longcat-video-development linux arm64 +cuda13-nvidia-l4t-arm64-magpie-tts-cpp linux arm64 sha256:9e86bc9636a2da6ba0cce9bc546da01dd556a757cf26c332e5bfd4a52c8593a3 +cuda13-nvidia-l4t-arm64-magpie-tts-cpp-development linux arm64 +cuda13-nvidia-l4t-arm64-mlx linux arm64 sha256:e0e2601d1ddfcca5ff87e1318c318ca12caa7acfcce80d6cacbcd7799d79e03c +cuda13-nvidia-l4t-arm64-mlx-audio linux arm64 sha256:b709f31f44b9e9582b5e176a8170057e2e68745e9b948fa53f4ebb9ebe4cda6d +cuda13-nvidia-l4t-arm64-mlx-audio-development linux arm64 +cuda13-nvidia-l4t-arm64-mlx-development linux arm64 +cuda13-nvidia-l4t-arm64-mlx-distributed linux arm64 sha256:01b501bc3c650e84a129ad590d719f8e65a317d022392883ce02333b879b9236 +cuda13-nvidia-l4t-arm64-mlx-distributed-development linux arm64 +cuda13-nvidia-l4t-arm64-mlx-vlm linux arm64 sha256:c594da8bba97a919e81f8016f5eaca85906ca1660549a25e77f42fb09c145fdd +cuda13-nvidia-l4t-arm64-mlx-vlm-development linux arm64 +cuda13-nvidia-l4t-arm64-moss-transcribe-cpp linux arm64 sha256:2a07ebce4c3a784bf970cd368692cc257296d1d89a1ce7b8acb6e2338bdd8ec3 +cuda13-nvidia-l4t-arm64-moss-transcribe-cpp-development linux arm64 +cuda13-nvidia-l4t-arm64-moss-tts-cpp linux arm64 sha256:79bfc5c75d62113cff5ec22fed78d0f126030de8f5a2cfae47a3f1e2a6800732 +cuda13-nvidia-l4t-arm64-moss-tts-cpp-development linux arm64 +cuda13-nvidia-l4t-arm64-nemo-speech-cpp linux arm64 sha256:65da9eef3df338975bd0010cb7fa8938ae086916dd6a1e7f47c2a6d20cc2dffa +cuda13-nvidia-l4t-arm64-nemo-speech-cpp-development linux arm64 +cuda13-nvidia-l4t-arm64-omnivoice-cpp linux arm64 sha256:2e4355694b6163dd10dedc8987857c6c6ca99b069192a8f969c84f0e4050158d +cuda13-nvidia-l4t-arm64-omnivoice-cpp-development linux arm64 +cuda13-nvidia-l4t-arm64-parakeet-cpp linux arm64 sha256:1f8c5f049d1beff6b90c855f557730a7210fe1ed8b08fe59573703c7eaddd766 +cuda13-nvidia-l4t-arm64-parakeet-cpp-development linux arm64 +cuda13-nvidia-l4t-arm64-pocket-tts linux arm64 sha256:c1ce60d51997cafc10305e25067ca4fd1fcacd5bc065ec55b60b98cda4b902da +cuda13-nvidia-l4t-arm64-pocket-tts-development linux arm64 +cuda13-nvidia-l4t-arm64-qwen-asr linux arm64 sha256:daa510a1bc65c25e0dd50b709f3a9c3f1ca899f9422a381413b3c9726a2bb97d +cuda13-nvidia-l4t-arm64-qwen-asr-development linux arm64 +cuda13-nvidia-l4t-arm64-qwen-tts linux arm64 sha256:49d42a4cf9af890fbbf41a9850f91d02abda3aa270a8c5e46f7faed99dbb4cbe +cuda13-nvidia-l4t-arm64-qwen-tts-development linux arm64 +cuda13-nvidia-l4t-arm64-qwen3-tts-cpp linux arm64 sha256:a15eaf64d469677f4456858d8e221fd3220825ee5d04bd32685de54123bd0656 +cuda13-nvidia-l4t-arm64-qwen3-tts-cpp-development linux arm64 +cuda13-nvidia-l4t-arm64-rfdetr-cpp linux arm64 sha256:446adfaa4fbc04a94ccea1bcbc08c143706216a649ea88f6d17869704cc8a5b4 +cuda13-nvidia-l4t-arm64-rfdetr-cpp-development linux arm64 +cuda13-nvidia-l4t-arm64-sam3-cpp linux arm64 sha256:d89b6781db3437aa3ca3b461c07c5346293e96d5d7b6fb196aece698151bd1db +cuda13-nvidia-l4t-arm64-sam3-cpp-development linux arm64 +cuda13-nvidia-l4t-arm64-sglang linux arm64 sha256:8dc9ea6d9fcc322b8710028ca8cfd5438f3abd0560059bb855f1604891b8fbb9 +cuda13-nvidia-l4t-arm64-sglang-development linux arm64 +cuda13-nvidia-l4t-arm64-stablediffusion-ggml linux arm64 sha256:656956851054866c475ba28e79cf455fe4c54ca134a074ca61f827cf81bb953b +cuda13-nvidia-l4t-arm64-stablediffusion-ggml-development linux arm64 +cuda13-nvidia-l4t-arm64-trellis2cpp linux arm64 sha256:ffbaca55a1070d391c3a911cec316bd9dfbc56686d7d2cea287e4f8e1a1b0899 +cuda13-nvidia-l4t-arm64-trellis2cpp-development linux arm64 +cuda13-nvidia-l4t-arm64-turboquant linux arm64 sha256:7b3f240b52f56a1167ad79b0a0508b7aef3b968a7e6ddce57f757748640ce2fe +cuda13-nvidia-l4t-arm64-turboquant-development linux arm64 +cuda13-nvidia-l4t-arm64-vibevoice linux arm64 sha256:a7ea0885d0cb5889fa8bb6169e0e3e526c8902cf1165f403449d9d10844c40a2 +cuda13-nvidia-l4t-arm64-vibevoice-cpp linux arm64 sha256:fc32afba2d6f6c9484c71ee326d48056d92a2ef634eb60dfab0caf5fcba8cd16 +cuda13-nvidia-l4t-arm64-vibevoice-cpp-development linux arm64 +cuda13-nvidia-l4t-arm64-vibevoice-development linux arm64 +cuda13-nvidia-l4t-arm64-vllm linux arm64 sha256:b39cc8ad34aa8c77e05dfc4ca139101ed28ec04caeb2579b388fb1833d4bd1ac +cuda13-nvidia-l4t-arm64-vllm-development linux arm64 +cuda13-nvidia-l4t-arm64-vllm-omni linux arm64 sha256:47fd78833a9809251224213d42e301224e746a6472c850fecd912241db82fd47 +cuda13-nvidia-l4t-arm64-vllm-omni-development linux arm64 +cuda13-nvidia-l4t-arm64-voice-detect linux arm64 sha256:fb9855281e385d83a17ec15c62f2e331f6c0b1d5812a91c73395a90a4ea31c79 +cuda13-nvidia-l4t-arm64-voice-detect-development linux arm64 +cuda13-nvidia-l4t-arm64-whisper linux arm64 sha256:c304cee2e923cb7099080cda43695d3efe9d85eebb82d5b52f2796672d3473b8 +cuda13-nvidia-l4t-arm64-whisper-development linux arm64 +cuda13-omnivoice-cpp linux amd64 sha256:5a2340841738a3793f628db29ab495eba4591537dc13eb5de91e32cf10c86d0c +cuda13-omnivoice-cpp-development linux amd64 +cuda13-parakeet-cpp linux amd64 sha256:5ee66d27ab5afb122617ca66ae472ae88e0ea0da792e79f07cdbbe7f6a122a14 +cuda13-parakeet-cpp-development linux amd64 +cuda13-pocket-tts linux amd64 sha256:5f518e0de62fe108b937cd5b27218121fa69015201bec1376e7446e4a83759ba +cuda13-pocket-tts-development linux amd64 +cuda13-privacy-filter linux amd64 sha256:a9b7d34d353661e9477988d770e077b5523dec35f7168f36f91529574d85806e +cuda13-privacy-filter-development linux amd64 +cuda13-qwen-asr linux amd64 sha256:d0c1a251d4e3da9f97238d4a6050c9fe6b1d173c1dcf0f54af28d6fde0366874 +cuda13-qwen-asr-development linux amd64 +cuda13-qwen-tts linux amd64 sha256:821dd4ad29b0fde5649a95700ec5bb326f510d1d4e2e21978bfb4912fbc0b862 +cuda13-qwen-tts-development linux amd64 +cuda13-qwen3-tts-cpp linux amd64 sha256:29d00cea0926ee3cf7c3244735bd9fe6be097ea79c0fb3ab8e4142f8e28c2ee2 +cuda13-qwen3-tts-cpp-development linux amd64 +cuda13-rerankers linux amd64 sha256:8e84060cf63fe2497f7af6b69b2bb0746e74909acd22b2cb4c15ea7cbaa4ca35 +cuda13-rerankers-development linux amd64 +cuda13-rfdetr linux amd64 sha256:ade066486adb19238da22b16b0543db0ff21dda3524eb3207517f13bc6d0e1c8 +cuda13-rfdetr-cpp linux amd64 sha256:d7af4a43347ea13c054cae3477e20a5da1e001c8b91a726d66fd36c330b0094a +cuda13-rfdetr-cpp-development linux amd64 +cuda13-rfdetr-development linux amd64 +cuda13-sam3-cpp linux amd64 sha256:f3b759f5b011c12b42b8b296adf2b187b558ffbedf6dc62e99817e450c7910c7 +cuda13-sam3-cpp-development linux amd64 +cuda13-sglang linux amd64 sha256:b99528b38fd14d4c3a33a1a6b1a7096ec9ae20575b7d696342c710b9e4b72a9d +cuda13-sglang-development linux amd64 +cuda13-stablediffusion-ggml linux amd64 sha256:ffd2cd6a6b2956ab642506a209db4a4f23fddd3d93255806564c7e4c088ce1f8 +cuda13-stablediffusion-ggml-development linux amd64 +cuda13-transformers linux amd64 sha256:33b266f0f6f04c97f8a753dec4014b553067abda368367ffd0ebaecfcfe08502 +cuda13-transformers-development linux amd64 +cuda13-trellis2cpp linux amd64 sha256:3215a4df01d4e243cc906776511ce82fbceb7aa29de1b207fc3ca6e3b39bfdf6 +cuda13-trellis2cpp-development linux amd64 +cuda13-trl linux amd64 sha256:457c8215cee3b957c8132b4c4519df55f271b3e90b3a5bb130343d4b7dbd4997 +cuda13-trl-development linux amd64 +cuda13-turboquant linux amd64 sha256:1b349d41195e0435a7b6a9182f61c2404a2ba5a48d66f7caba8fddb7baad99c3 +cuda13-turboquant-development linux amd64 +cuda13-vibevoice linux amd64 sha256:76dd3c2edd0a3e01059884e9829aa45b455de0f634f13249e0ee2de2df7eeee6 +cuda13-vibevoice-cpp linux amd64 sha256:d84b96d40bf8f2a56a5b4a499cba33cb74247e49388ec78185a2255074245732 +cuda13-vibevoice-cpp-development linux amd64 +cuda13-vibevoice-development linux amd64 +cuda13-vllm linux amd64 sha256:72b7bfee221e646a7b2ac66abf081cadf12f994c48ac2b23cf4279735a73dc09 +cuda13-vllm-cpp linux amd64 sha256:3542afc376aa1ce544d4ab74620040f636d15dd5debb17b2a01c889b1b8117cc +cuda13-vllm-cpp-development linux amd64 +cuda13-vllm-development linux amd64 +cuda13-vllm-omni linux amd64 sha256:110c062c22b4f3aa9783d0aca6f2ebd5f04fe47913d1d76c2257412beaac0bbe +cuda13-vllm-omni-development linux amd64 +cuda13-voice-detect linux amd64 sha256:209955b97b650f0664d856f5e0f4eca561b67e443c16297f0a8e218360c8354c +cuda13-voice-detect-development linux amd64 +cuda13-voxcpm linux amd64 sha256:107d9324447ef715a60f081a6e90b1b84199a6cc9dbf4599fc4c004db27c4dae +cuda13-voxcpm-development linux amd64 +cuda13-whisper linux amd64 sha256:d1e9cb26945dc4d39acdd5f421471bf107a93d3576a1ac17eee848023398cdfd +cuda13-whisper-development linux amd64 +cuda13-whisperx linux amd64 sha256:3e05b2ecb30412404f6a942ae4b0aefed94c0eab0cd5704b0fd2906631451700 +cuda13-whisperx-development linux amd64 +intel-ace-step linux amd64 sha256:308821ce4ce6593ff2d0ef247186cbfbb5b77547f91029e9fcc6ae5e6aa819ce +intel-ace-step-development linux amd64 +intel-coqui linux amd64 sha256:d449ca099b7c699a73949fac905774020d2155ebb2a0a946de7c525072052756 +intel-coqui-development linux amd64 +intel-diffusers linux amd64 sha256:01cb64c773ed8ab393db14ccdc2f74ec5399103e9fe42ae8eea09950401f7cb4 +intel-diffusers-development linux amd64 +intel-faster-whisper linux amd64 sha256:6b827412e31a1dc5c19cbdffdab861b0af2b4879a78bddb04d6b7b8dda38de6c +intel-faster-whisper-development linux amd64 +intel-fish-speech linux amd64 sha256:3e3b95d0b35e1d5a3540d472bc5bb1d4a89f93ab3ecbd97d653974b3c2e49d43 +intel-fish-speech-development linux amd64 +intel-funasr linux amd64 sha256:6283ffaf34bf7c3fec112cbf66cea6573cdf3c16f27743a0e9a1b07ac15e0ec3 +intel-funasr-development linux amd64 +intel-kokoro linux amd64 sha256:367b1857cbf7d0a5b67fcff482a8e79eb12e139f064bd9be91d2bb587f5e3c8f +intel-kokoro-development linux amd64 +intel-liquid-audio linux amd64 sha256:e331eab911829e84d23634483beeef813e0fb334bc58743f95e3a9eba9db360b +intel-liquid-audio-development linux amd64 +intel-nemo linux amd64 sha256:7347434ab262b06e0a7159b624f1a3eaf47d0f172c46da6468f481b522d65f32 +intel-nemo-development linux amd64 +intel-pocket-tts linux amd64 sha256:8140d0f885716d0c0f045b03ef3f01c3366ef131e5466707afc79d4f9def564a +intel-pocket-tts-development linux amd64 +intel-qwen-asr linux amd64 sha256:24ce5db6bdb7b15ebaf076fbea94593d0c4701c3ab2e25e42d8b31ae7e108b90 +intel-qwen-asr-development linux amd64 +intel-qwen-tts linux amd64 sha256:b421a7e4cc38d90144c710aebed01aecf104cda693a74a6d6bedee3523c489bd +intel-qwen-tts-development linux amd64 +intel-rerankers linux amd64 sha256:e5868af5d32e91e1cc706ce0a693dba12017b0321b919227c98150e8658af6d0 +intel-rerankers-development linux amd64 +intel-rfdetr linux amd64 sha256:96bb3e4286db592168b8136df4c37b6642c60980f9d916e4c2a7079a8507b526 +intel-rfdetr-development linux amd64 +intel-sglang linux amd64 sha256:2d4e1c0e1b46bf4f386af30106ce12428c52006ca96c3eecb6f8b11f36f1a37f +intel-sglang-development linux amd64 +intel-sycl-f16-acestep-cpp linux amd64 sha256:fe57762344b540a838834ca4533aa6b4b27a5fca0886eace0c0588a9cc7f6de4 +intel-sycl-f16-acestep-cpp-development linux amd64 +intel-sycl-f16-bonsai linux amd64 sha256:1daa541cb697750b97d928b497c15156f944a7e70ec1f017602d045368d5cd99 +intel-sycl-f16-bonsai-development linux amd64 +intel-sycl-f16-ced linux amd64 sha256:ea2011cb4d7f54c70daac1742069c85e600a77fbe29362938c7e203af5221874 +intel-sycl-f16-ced-development linux amd64 +intel-sycl-f16-crispasr linux amd64 sha256:01474b84879dd6830076c2e70be58ee2cc1037375515a92433bd371d959ad152 +intel-sycl-f16-crispasr-development linux amd64 +intel-sycl-f16-depth-anything-cpp linux amd64 sha256:14bd481268d998fadfdd9367ad15c2d051052e7373b6b02f8ecf8ed8ec95c77e +intel-sycl-f16-depth-anything-cpp-development linux amd64 +intel-sycl-f16-face-detect linux amd64 sha256:5bddf33491ac552d145ddca1d58e18b6f03cae031151c74dbc40602722678313 +intel-sycl-f16-face-detect-development linux amd64 +intel-sycl-f16-llama-cpp linux amd64 sha256:e0973872175cd3b6dd3e8192b527ba2b5ca80d5aa50f79d298d913342c328ede +intel-sycl-f16-llama-cpp-development linux amd64 +intel-sycl-f16-locate-anything-cpp linux amd64 sha256:a132eddcc2c915ea020f28074772003e71f19914830587d720b190f468b07bca +intel-sycl-f16-locate-anything-cpp-development linux amd64 +intel-sycl-f16-magpie-tts-cpp linux amd64 sha256:945ae7955d3bcddb0dc812d320b4c03e1c8f23e4c609ce8a67496702d1c1dd46 +intel-sycl-f16-magpie-tts-cpp-development linux amd64 +intel-sycl-f16-moss-transcribe-cpp linux amd64 sha256:ae4ebdc65e5bcdcb42476073a96a14dffd7e2393657106b44fad99971a8f1e24 +intel-sycl-f16-moss-transcribe-cpp-development linux amd64 +intel-sycl-f16-moss-tts-cpp linux amd64 sha256:4e36a57d685ae8cc7665968b430d0c5c4f859bba9e4ae2c08a933683b5fdb43e +intel-sycl-f16-moss-tts-cpp-development linux amd64 +intel-sycl-f16-omnivoice-cpp linux amd64 sha256:8d0d40710435fe91dc0b610847d71c91c07e4309080dbd7bcd2be7307d532ce6 +intel-sycl-f16-omnivoice-cpp-development linux amd64 +intel-sycl-f16-parakeet-cpp linux amd64 sha256:30db54a3bf70325c066f31c526699e64249950cb208188985a55b5a958475411 +intel-sycl-f16-parakeet-cpp-development linux amd64 +intel-sycl-f16-qwen3-tts-cpp linux amd64 sha256:c9d403f036527a9f1a35e8898f645ff0aa4c4b55796dd923a6f77b0312eb571e +intel-sycl-f16-qwen3-tts-cpp-development linux amd64 +intel-sycl-f16-rfdetr-cpp linux amd64 sha256:a2adb8f14207beab18d2e2feaa095e39d1b2a2e70e298d03e0d7c4d5fd90798b +intel-sycl-f16-rfdetr-cpp-development linux amd64 +intel-sycl-f16-stablediffusion-ggml linux amd64 sha256:fba9835e96c3d5d8ec26359691e067bea8eb1a996c54c4978db780f96809f6ef +intel-sycl-f16-stablediffusion-ggml-development linux amd64 +intel-sycl-f16-turboquant linux amd64 sha256:4fb488d48b4c53d930fc43f3478318f2920b8a68fea7ae15ace7dd4be7fb59c0 +intel-sycl-f16-turboquant-development linux amd64 +intel-sycl-f16-vibevoice-cpp linux amd64 sha256:a97c823159e4db9774bf01f39dd04bf05197ea5b4e1041beaf1f684a29c8ea68 +intel-sycl-f16-vibevoice-cpp-development linux amd64 +intel-sycl-f16-voice-detect linux amd64 sha256:27301205b59efabce329c255efd60a779c11c88cbef2579eb59b67507124c5fe +intel-sycl-f16-voice-detect-development linux amd64 +intel-sycl-f16-whisper linux amd64 sha256:05e9cc488aaafd3b1586c5dceb012bd970dd0793c704632b8601304b586a5590 +intel-sycl-f16-whisper-development linux amd64 +intel-sycl-f32-acestep-cpp linux amd64 sha256:d92d6d297bad7dca4340cd26915056d72b96fafc48c9546249546351ab75501f +intel-sycl-f32-acestep-cpp-development linux amd64 +intel-sycl-f32-bonsai linux amd64 sha256:a9206e3781ab81d6dd53989c077e1172c0f1316dc46a7d40fb620cf54b3810ed +intel-sycl-f32-bonsai-development linux amd64 +intel-sycl-f32-ced linux amd64 sha256:affe79cf7c7696516eb2b1e7f0a96fa7bb0292a2383bdd2114e11769318b044e +intel-sycl-f32-ced-development linux amd64 +intel-sycl-f32-crispasr linux amd64 sha256:fe7af98731357a3e947ca3607575769b7371caed65f423c9b507d239b29ff751 +intel-sycl-f32-crispasr-development linux amd64 +intel-sycl-f32-depth-anything-cpp linux amd64 sha256:cb3b48772d5e1473b4337443cc30705bb092e00793bc823a3192e93d40e2e63c +intel-sycl-f32-depth-anything-cpp-development linux amd64 +intel-sycl-f32-face-detect linux amd64 sha256:2f334d0e50ec6efd99b84028d8f91ff33138cccd19768005591d9e5442f2d709 +intel-sycl-f32-face-detect-development linux amd64 +intel-sycl-f32-llama-cpp linux amd64 sha256:d3b0ac9746aaac82db6ca01e97d6d7d9b92208fd9195d2da1fb2ed445ebc9e7e +intel-sycl-f32-llama-cpp-development linux amd64 +intel-sycl-f32-locate-anything-cpp linux amd64 sha256:89eb1ed73d99e7e7454c15c452ef6548132b09999aec198aa7d3fe70833a5ac0 +intel-sycl-f32-locate-anything-cpp-development linux amd64 +intel-sycl-f32-magpie-tts-cpp linux amd64 sha256:509c510527db5fb3d558964f7d5e27bd6b9ab681ba428596540a810c80ef0998 +intel-sycl-f32-magpie-tts-cpp-development linux amd64 +intel-sycl-f32-moss-transcribe-cpp linux amd64 sha256:641a4b178da8ebb1e11ff52c46c6cebbeb5ec0c2e3578d384f4ae58689cb4e98 +intel-sycl-f32-moss-transcribe-cpp-development linux amd64 +intel-sycl-f32-moss-tts-cpp linux amd64 sha256:1c7fab0c9dad3e818960b5549c8eb1d08396ccea08cebbccf21b1400f3808eaf +intel-sycl-f32-moss-tts-cpp-development linux amd64 +intel-sycl-f32-omnivoice-cpp linux amd64 sha256:ab34736789c044de012cb0e620dbe1e26146c05f30aa9d4fdf16a0d7a2a26c67 +intel-sycl-f32-omnivoice-cpp-development linux amd64 +intel-sycl-f32-parakeet-cpp linux amd64 sha256:f9b8c27dbd750a54a72409b51f8bdc763e0ac8daaba5ea45a9533dd6323e6743 +intel-sycl-f32-parakeet-cpp-development linux amd64 +intel-sycl-f32-qwen3-tts-cpp linux amd64 sha256:d1c021320780dcf79d350279c5a6fe8a787759a9b9feb340bce975eae4d5479a +intel-sycl-f32-qwen3-tts-cpp-development linux amd64 +intel-sycl-f32-rfdetr-cpp linux amd64 sha256:f0b18ae3caee15afb37cf092bf5f69c97b8a6327c62ebc7c3c0aa043b1159dce +intel-sycl-f32-rfdetr-cpp-development linux amd64 +intel-sycl-f32-sam3-cpp linux amd64 sha256:23d518c8a7fd2f19ef6ef4aa46de338cb18d5a2913f73afba48bf9e9092b1aad +intel-sycl-f32-sam3-cpp-development linux amd64 +intel-sycl-f32-stablediffusion-ggml linux amd64 sha256:b3e306c0b628e830ae92c94f50afb9aebe48186a0c42ab68858c6a3afc1b9984 +intel-sycl-f32-stablediffusion-ggml-development linux amd64 +intel-sycl-f32-turboquant linux amd64 sha256:ba3b960e75fb6da73c5030ea932a7a32f12b8d25876f1e76f62d2f052fd35a69 +intel-sycl-f32-turboquant-development linux amd64 +intel-sycl-f32-vibevoice-cpp linux amd64 sha256:7c87512fdd03b0caad47c324acf195a376d7c2dd01b188b7c89e9a9ff06da242 +intel-sycl-f32-vibevoice-cpp-development linux amd64 +intel-sycl-f32-voice-detect linux amd64 sha256:3dca354c88742f33f73a8cd495a482e287cd75b1e67e6e717595fffcaf15b584 +intel-sycl-f32-voice-detect-development linux amd64 +intel-sycl-f32-whisper linux amd64 sha256:3f06bf8a86f71175b699f67376224ab32675db34578715d22cd771a5fbb390ce +intel-sycl-f32-whisper-development linux amd64 +intel-transformers linux amd64 sha256:2c2acd041746de516666de08a5f0230341e8dd58f20604541fbe7ff55c7fccb1 +intel-transformers-development linux amd64 +intel-vibevoice linux amd64 sha256:2b841b0bad34777a6dc683bb0994a95a60a30887442590bc79e51e63ffa52f87 +intel-vibevoice-development linux amd64 +intel-vllm linux amd64 sha256:4fae8cb3a4e3ba5d7891f309bd6ec54e6cc54e2dd5bc03265a42ef60b9ecf16c +intel-vllm-development linux amd64 +intel-voxcpm linux amd64 sha256:07b33f9739019b170c7a136b25614e713c53b807cf12032d26fa9cae26aef15c +intel-voxcpm-development linux amd64 +metal-ace-step darwin arm64 sha256:fb26d7c247059b7553758feef8a415a61946e9e71cb423847fcd2bdeb1f3c2a1 +metal-ace-step-development darwin arm64 +metal-acestep-cpp darwin arm64 sha256:195f2876e8d8d23d3388cacf97031430af0d57236310a3a556cd483702d4255b +metal-acestep-cpp-development darwin arm64 +metal-audio-cpp darwin arm64 sha256:37c1853dc4ad5663caadd843f6fda53914014a7878e6158c61b0373a9beddfbb +metal-audio-cpp-development darwin arm64 +metal-ced darwin arm64 sha256:eeb42e38a502b9631f7e0e8d2b1b470f7aab0647a9fa96913b74ef7b9c170504 +metal-ced-development darwin arm64 +metal-chatterbox darwin arm64 sha256:85baa94d88eb95a80fdd0ae54ab84cac1d25e553ea233722fc2a30f382c50727 +metal-chatterbox-development darwin arm64 +metal-cloud-proxy darwin arm64 sha256:5776d3dc965fa9e6b272629c281e9405338f97e57909a4deca556f4e52259ff8 +metal-cloud-proxy-development darwin arm64 +metal-coqui darwin arm64 sha256:d9f6001ce3ea9dc59e426f3ccc3502c5697277098e70993b32941d29115f5b1d +metal-coqui-development darwin arm64 +metal-crispasr darwin arm64 sha256:b9c0b8583ab8a0891896a6e4a938521ebb3f52546d93501a775796d2a82e85fc +metal-crispasr-development darwin arm64 +metal-darwin-arm64-llama-cpp-quantization darwin arm64 sha256:5257db837b8639219134a70d94c9270d5ab8d293aedb8d550939aa6a297093fd +metal-depth-anything-cpp darwin arm64 sha256:cd9d0a3df0be93127adfc4ef20e9dbda28a1ee18e88142d6c126f4b9ed7c102f +metal-depth-anything-cpp-development darwin arm64 +metal-diffusers darwin arm64 sha256:a35598c76239ed3c6fed7e3793d5b6e6c48e5e17129f6c9a653e614bfc99e65e +metal-diffusers-development darwin arm64 +metal-ds4 darwin arm64 sha256:64345e1554549d98289487542db3ebf159590401d9dbc94746782dee5f84c62c +metal-ds4-development darwin arm64 +metal-face-detect darwin arm64 sha256:7b43a1ce15be96d976f1518cd116cfbd7d613b13eee6bf4b65137dd76f61f58e +metal-face-detect-development darwin arm64 +metal-faster-whisper darwin arm64 sha256:58b45b40cdf60af967f4602cef908923bf91c47be1d08ec847e0b92ad1fbf2bf +metal-faster-whisper-development darwin arm64 +metal-funasr darwin arm64 sha256:ed14f6740fab7bf5f51b8280ee20d090c9c50a58161425f1d33215320810f41a +metal-funasr-development darwin arm64 +metal-kitten-tts darwin arm64 sha256:2626da6d0f0ba6abd41bf62431459aa5554ceb55d2f32cc33bce607c060a72b8 +metal-kitten-tts-development darwin arm64 +metal-kokoro darwin arm64 sha256:c53faaa7724694b9957fbafb79ba9eb830688ead472504944692ec328c44fdac +metal-kokoro-development darwin arm64 +metal-liquid-audio darwin arm64 sha256:f744bafbc2026d852d109161c9aad3efd99d5b339fcdea0856d058e1a50e6d78 +metal-liquid-audio-development darwin arm64 +metal-llama-cpp darwin arm64 sha256:090580162ce329b460ebb51a40f9c19cc576ef8f446e976bfeef6e5ba63a2b91 +metal-llama-cpp-development darwin arm64 +metal-local-store darwin arm64 sha256:58e8e057ab81e50a4a2d6d699692c9dd788908a3b4bd12a25119e26b6eca1623 +metal-local-store-development darwin arm64 +metal-localai-proxy darwin arm64 sha256:7a514137bcdaf95bdd43705965adad43b6f43cb6ad8bd29b3b0236eef9a4e835 +metal-localai-proxy-development darwin arm64 +metal-localvqe darwin arm64 sha256:75033ba8324d87ca0123524720295483b93a50523ef5f500b850c3cb5dc307ad +metal-localvqe-development darwin arm64 +metal-locate-anything-cpp darwin arm64 sha256:fac84b965073902f73143269ed9e2c8e4aba55fa5eb0895c95b8e8678455283b +metal-locate-anything-cpp-development darwin arm64 +metal-magpie-tts-cpp darwin arm64 sha256:1c351c0baa4f090c60652dc7783ba4fe813e42eb8c9cd795ddb55da8d28f1112 +metal-magpie-tts-cpp-development darwin arm64 +metal-mlx darwin arm64 sha256:79efa3f8b96d1df41efbc75fbaa7f1e496b811ff4025a164307e0da185b46b90 +metal-mlx-audio darwin arm64 sha256:fbe1dee7da7c324d90312767467f74bcb6be510e619882e40ef58c3fe3f61bbe +metal-mlx-audio-development darwin arm64 +metal-mlx-development darwin arm64 +metal-mlx-distributed darwin arm64 sha256:7287deaee8e8b043e4c5a9aa5d7183dff9c6c207f304652a99c7a8dbec94a088 +metal-mlx-distributed-development darwin arm64 +metal-mlx-video darwin arm64 sha256:2f0d6f6a53f5444eb55b332ed6d0b02e885a7bb97b669a36175c7ec50c338a16 +metal-mlx-video-development darwin arm64 +metal-mlx-vlm darwin arm64 sha256:2720f8e49588787495ece2e7e99152aa332606782c848c5b460d49a2030f787b +metal-mlx-vlm-development darwin arm64 +metal-moonshine darwin arm64 sha256:f179af483c47254539791f1efab47735d09d9e5fc01001c31cd11baf3ecde6c8 +metal-moonshine-development darwin arm64 +metal-moss-transcribe-cpp darwin arm64 sha256:fdb6c7a2e90afb769c7e8512e0746732047d11211d88e9e496173b33925bf52b +metal-moss-transcribe-cpp-development darwin arm64 +metal-moss-tts-cpp darwin arm64 sha256:b17d9ebf3fc56921dfa14d5ee99368987fcfc197109cfde0d0ba56d661963017 +metal-moss-tts-cpp-development darwin arm64 +metal-nemo darwin arm64 sha256:ede5e603726056dc18ad4fb8344153c926b823158b53bea79cee61d4ceacd206 +metal-nemo-development darwin arm64 +metal-nemo-speech-cpp darwin arm64 sha256:741e6618d4dde30bfb37bb908663d635898f1a43d891eb3b8c986c7560663ff1 +metal-nemo-speech-cpp-development darwin arm64 +metal-omnivoice-cpp darwin arm64 sha256:c320e5aa34209d07282dedad4dcf8184134c895eec27609865519a72b58b42e6 +metal-omnivoice-cpp-development darwin arm64 +metal-opus darwin arm64 sha256:f5b16fc99b150feb711d91a317d099691166895621c3c79fb1155d1b841faabd +metal-opus-development darwin arm64 +metal-parakeet-cpp darwin arm64 sha256:84ba88d1fa6492d20e0b3dc46c28da8c8af60f76fe13719471e9f18898222fae +metal-parakeet-cpp-development darwin arm64 +metal-piper darwin arm64 sha256:987cc49bb63ce2f4cd71a5aad3984f687d68eb55d41c9b328ebad249caadf49b +metal-piper-development darwin arm64 +metal-pocket-tts darwin arm64 sha256:ddce69df9e235c0b398fc8061b102572876f0e8f5d5b5d8a0a9cb04de644cf11 +metal-pocket-tts-development darwin arm64 +metal-privacy-filter darwin arm64 sha256:f86ce2a03ac3d167d434b431e1281c9987fe09168cc0a3e47c8c3ad13deabfcc +metal-privacy-filter-development darwin arm64 +metal-qdrant-store darwin arm64 +metal-qdrant-store-development darwin arm64 +metal-qwen-asr darwin arm64 sha256:f17c3458257b0d12067778befe5230edaaff26bf858726880486a4baa82b3e79 +metal-qwen-asr-development darwin arm64 +metal-qwen-tts darwin arm64 sha256:5e9fba852948a3b5bd8f80efac27fe3bc3aec96b5042e1697a27449a2c866d99 +metal-qwen-tts-development darwin arm64 +metal-qwen3-tts-cpp darwin arm64 sha256:ac23f8972431ba5ea0a1f9339f679cb721f6aa6643b1c6ead0b732d1294b40d1 +metal-qwen3-tts-cpp-development darwin arm64 +metal-rerankers darwin arm64 sha256:9b9e02868e2b5bc5a088dc5a1c2418b18babc697dc99c476afa048736872f20d +metal-rerankers-development darwin arm64 +metal-rfdetr darwin arm64 sha256:79473b1c3f1a421b79b80038aa5fd8211b29df3c9c30d57ac155653e8c1af6da +metal-rfdetr-cpp darwin arm64 sha256:606bd122111a10a6f003e3f9962ce1590659dc1c1ae1bda6a64d0ff814cf1163 +metal-rfdetr-cpp-development darwin arm64 +metal-rfdetr-development darwin arm64 +metal-sam3-cpp darwin arm64 sha256:b38c512695411a93149dac65008ba683878b254e9790af7e9d1015d18f2d6185 +metal-sam3-cpp-development darwin arm64 +metal-sherpa-onnx darwin arm64 sha256:3343da2f816a82fac39ba6e32ffa3150fd56dda062164a6c16584fc3c277587f +metal-sherpa-onnx-development darwin arm64 +metal-silero-vad darwin arm64 sha256:c21965004ebcfd30251031a0b9bc1a80cf220c0ba86948cf492fb58939ecaff0 +metal-silero-vad-development darwin arm64 +metal-speaker-recognition darwin arm64 sha256:e8dc6bff1aab8b21438ffc7ac8fb19525bda7d5e888bc2f6ec657731c133acc2 +metal-speaker-recognition-development darwin arm64 +metal-stablediffusion-ggml darwin arm64 sha256:e0cc3e1b9f5fdcf1edeb1c6116dec9c38e15a0c0d4d04f1a55e1c4248601ad61 +metal-stablediffusion-ggml-development darwin arm64 +metal-supertonic darwin arm64 sha256:87be5b8df142ebb5138086c1928551cd488b79c487278dfe5931345c8002bbc9 +metal-supertonic-development darwin arm64 +metal-transformers darwin arm64 sha256:849649acb62dfe335cad58b9e27f032f58982f8923ac5f9c9906b30f28ebcdd9 +metal-transformers-development darwin arm64 +metal-trellis2cpp darwin arm64 sha256:f2cd0c8f8344230a29457c48e0f579bd95e415ae503ba8424b67eeb019be6186 +metal-trellis2cpp-development darwin arm64 +metal-trl darwin arm64 sha256:b9c481f4b4a9d6ef209ca6edd0ab48496c566d476f8f02d7d6f9f2550d0eb200 +metal-trl-development darwin arm64 +metal-valkey-store darwin arm64 sha256:6e98fff1919c52b5859299f79820c09650b5f45a59c288f63038b3990bda7b22 +metal-valkey-store-development darwin arm64 +metal-vibevoice darwin arm64 sha256:43fe7294b50b47a21460a58634749b6e5e3fe15c8e9960daebc0276d8a6f4579 +metal-vibevoice-cpp darwin arm64 sha256:d13114571231b04377d0aa5573c2985ffb05376c2d6f8ce44493ced2e7f79f16 +metal-vibevoice-cpp-development darwin arm64 +metal-vibevoice-development darwin arm64 +metal-vllm darwin arm64 sha256:4c329b4cc910a5277bca0d79b8b370e9206435769c97b5217d346682f4d2bc28 +metal-vllm-cpp darwin arm64 sha256:03041765e39e1ccd358aa0a5337e25c76d112c943887f20c4df1e4dbc5142735 +metal-vllm-cpp-development darwin arm64 +metal-vllm-development darwin arm64 +metal-voice-detect darwin arm64 sha256:16546492427b58ded42d304048e05267c8b26d8828562e505e14e6d427dc0847 +metal-voice-detect-development darwin arm64 +metal-voxcpm darwin arm64 sha256:324a5a50dfa5b5a50966089b79d5daba7b438d52a77bfb67cfa5f4c1988ee756 +metal-voxcpm-development darwin arm64 +metal-voxtral darwin arm64 sha256:7590512313677ec2db10ab79f9ee12eb99ce8cb44fab4b3ccff017a6b54a601a +metal-voxtral-development darwin arm64 +metal-whisper darwin arm64 sha256:cafb6a837b6ca57060820e9fabe76bdf19a425ffeac9e7f2860a8a9d5e00c73b +metal-whisper-development darwin arm64 +metal-whisperx darwin arm64 sha256:f193a7084560d15c37a41912152635fdcd641c32a8959fdfcc530ccf455a9a02 +metal-whisperx-development darwin arm64 +nvidia-l4t-arm64-acestep-cpp linux arm64 sha256:ae8f28c315654ba875938f74060932168a5de18fa0af26cba4014e6938e6eea2 +nvidia-l4t-arm64-acestep-cpp-development linux arm64 +nvidia-l4t-arm64-bonsai linux arm64 sha256:8b54fd0fbe6db93150f384d27cfd998a6159545d98f18e6a98284168ed4e1b8a +nvidia-l4t-arm64-bonsai-development linux arm64 +nvidia-l4t-arm64-ced linux arm64 sha256:1e16563e0b63efb66a4b0339bf124c78be04ffd51d014ce7d0483dffcb9e6ebc +nvidia-l4t-arm64-ced-development linux arm64 +nvidia-l4t-arm64-chatterbox linux arm64 sha256:337630ad78fa5f5b98e66dfba15e48ccc881d3b6682fef3ebc6bd075343a44ac +nvidia-l4t-arm64-chatterbox-development linux arm64 +nvidia-l4t-arm64-crispasr linux arm64 sha256:43235ee3f01a45f4b1cb291fd90fcc33fcf3adb99c9c57d936776363f71cb833 +nvidia-l4t-arm64-crispasr-development linux arm64 +nvidia-l4t-arm64-depth-anything-cpp linux arm64 sha256:682a53bcfa5536afb8f75da2e4f3215bf25abacf3a30b6dbd7e56f2ed036316b +nvidia-l4t-arm64-depth-anything-cpp-development linux arm64 +nvidia-l4t-arm64-face-detect linux arm64 sha256:b42d4699c99b8da2f40e2aa8e1bdf5708eb68a5f1775133f394f5b40b7ed6fce +nvidia-l4t-arm64-face-detect-development linux arm64 +nvidia-l4t-arm64-faster-whisper linux arm64 sha256:2b9d5bb508f43b5ae40bdc65e9013ca2580af3475f214a3addb4999c3cedcad3 +nvidia-l4t-arm64-faster-whisper-development linux arm64 +nvidia-l4t-arm64-llama-cpp linux arm64 sha256:c75a79428e4e34ed189457d830cbd6495a528de4cbce71c69647544c96689988 +nvidia-l4t-arm64-llama-cpp-development linux arm64 +nvidia-l4t-arm64-locate-anything-cpp linux arm64 sha256:e15cdf9943562f75fde210ee25f9d942f67e1a2b106a905156dd70c4a35140cd +nvidia-l4t-arm64-locate-anything-cpp-development linux arm64 +nvidia-l4t-arm64-magpie-tts-cpp linux arm64 sha256:f64a42c94cadd234b5013088c13274391715f3d04d42a9a37318842761673d78 +nvidia-l4t-arm64-magpie-tts-cpp-development linux arm64 +nvidia-l4t-arm64-moss-transcribe-cpp linux arm64 sha256:713f597f454ba9b5940d0c2d495475bde7dcd54e12ed773768fa26ef48779ec8 +nvidia-l4t-arm64-moss-transcribe-cpp-development linux arm64 +nvidia-l4t-arm64-moss-tts-cpp linux arm64 sha256:5e7cf4de40c343209b867ef89a32957fe8c6e051950174ff7da5b159fefad937 +nvidia-l4t-arm64-moss-tts-cpp-development linux arm64 +nvidia-l4t-arm64-nemo-speech-cpp linux arm64 sha256:41ed29c19e3b4642a4557a975468f84f3df6498fd7f89df6ed2907ea5623b765 +nvidia-l4t-arm64-nemo-speech-cpp-development linux arm64 +nvidia-l4t-arm64-omnivoice-cpp linux arm64 sha256:dcdd6b878e8a436a0810af617c3ae36a6423c8e2db3685c9bf0f28a66300e53a +nvidia-l4t-arm64-omnivoice-cpp-development linux arm64 +nvidia-l4t-arm64-parakeet-cpp linux arm64 sha256:578237ef64c63ab631910f0322ca4d0b8ca118b0a0d44460ef16f0fa124cd8f9 +nvidia-l4t-arm64-parakeet-cpp-development linux arm64 +nvidia-l4t-arm64-qwen3-tts-cpp linux arm64 sha256:88c22d13dced12c91f487a46901dff00df2ebb7489579e74952dde0c9f4acd3f +nvidia-l4t-arm64-qwen3-tts-cpp-development linux arm64 +nvidia-l4t-arm64-rfdetr linux arm64 sha256:409cb07ad2f7f7a75cb02553f395883933d42fb21809eff04656ada034105149 +nvidia-l4t-arm64-rfdetr-cpp linux arm64 sha256:c44617a242babe4e2fa8c3c761014cff946f84eaced9492312098b00cc729583 +nvidia-l4t-arm64-rfdetr-cpp-development linux arm64 +nvidia-l4t-arm64-rfdetr-development linux arm64 +nvidia-l4t-arm64-sam3-cpp linux arm64 sha256:2d0c900341539b027ad173730290daa5cec3e7f5db75d48b43af1244bd10dead +nvidia-l4t-arm64-sam3-cpp-development linux arm64 +nvidia-l4t-arm64-stablediffusion-ggml linux arm64 sha256:273b2aefa8f2211ec75a080d8e9e6e59fe1e8cb3b85fffe75e3cf60a74d1f984 +nvidia-l4t-arm64-stablediffusion-ggml-development linux arm64 +nvidia-l4t-arm64-trellis2cpp linux arm64 sha256:c1e63f519539ba81491bf44becec14aba955c5abdc13256a5e9c7effde4da971 +nvidia-l4t-arm64-trellis2cpp-development linux arm64 +nvidia-l4t-arm64-turboquant linux arm64 sha256:dfef657c0059952453c4ab11f298325ddbf4e39715ebb46d263eef92de24fd1a +nvidia-l4t-arm64-turboquant-development linux arm64 +nvidia-l4t-arm64-vibevoice-cpp linux arm64 sha256:60f0c6b86833244103933e101200c67a7f506065e62b82dc4abb04209ebd3a08 +nvidia-l4t-arm64-vibevoice-cpp-development linux arm64 +nvidia-l4t-arm64-vllm-cpp linux arm64 sha256:144ed7aab3393ca6cfe4add5fea78aebb55581212d58e04121e86612cdf34114 +nvidia-l4t-arm64-vllm-cpp-development linux arm64 +nvidia-l4t-arm64-voice-detect linux arm64 sha256:c8156a282f2ca6eb5027d2704c39e0121b74a50a4f9c55a8ecd6e8e60c5a2d52 +nvidia-l4t-arm64-voice-detect-development linux arm64 +nvidia-l4t-arm64-whisper linux arm64 sha256:1b0fae8c7d3c1d493060c4a22bf30fd929166ed8abcfa060308e6e3966f930ea +nvidia-l4t-arm64-whisper-development linux arm64 +nvidia-l4t-arm64-whisperx linux arm64 sha256:b43391765f580b9839e6d1498846fce13b09bb38f8bc498eb41d08ee9ba119a6 +nvidia-l4t-arm64-whisperx-development linux arm64 +nvidia-l4t-diffusers linux arm64 sha256:0c2c975d2344bfaf2e860df5ad87fda5bf5fbcd669279bdc6a394cdc1558e451 +nvidia-l4t-diffusers-development linux arm64 +nvidia-l4t-faster-qwen3-tts linux arm64 sha256:c73c56e0fb9fcd92484edac8d43000eeda4cebd567a24befac8bb428c479ef8d +nvidia-l4t-faster-qwen3-tts-development linux arm64 +nvidia-l4t-fish-speech linux arm64 sha256:15c3249f6a419cceb4d026dd92e2ffa733c1db04d11be5431bb249786bcbd7e7 +nvidia-l4t-fish-speech-development linux arm64 +nvidia-l4t-funasr linux arm64 sha256:6be572072f692354487b940ca09748cafe8b47ee0096fd82b38fc510acd7c81b +nvidia-l4t-funasr-development linux arm64 +nvidia-l4t-kokoro linux arm64 sha256:d646b4094f6c6838365420633714f5aeef5380b36f771cae97b493d4dcf6eedd +nvidia-l4t-kokoro-development linux arm64 +nvidia-l4t-mlx linux arm64 sha256:d77122da6cb9479d7f86e800a7f787ac4cca44888029f18769ce18db38c63155 +nvidia-l4t-mlx-audio linux arm64 sha256:a3f324fe1d5a082d586f66ef3afae63095ddf9294de122515918c63090608297 +nvidia-l4t-mlx-audio-development linux arm64 +nvidia-l4t-mlx-development linux arm64 +nvidia-l4t-mlx-distributed linux arm64 sha256:b3d3d2cdb9c0ef2a9b854a005de0d3f5dd77d5d0aa4117b5f4f63f57964449b6 +nvidia-l4t-mlx-distributed-development linux arm64 +nvidia-l4t-mlx-vlm linux arm64 sha256:883c5e51401d342f4bd3375b493efd6bb4a67eaf8ab5fee882445c6bba0fad11 +nvidia-l4t-mlx-vlm-development linux arm64 +nvidia-l4t-pocket-tts linux arm64 sha256:2fb4ee52cbcd03e7882f793b7b9fcb0be9f5068f12e17d2284447069516c09ea +nvidia-l4t-pocket-tts-development linux arm64 +nvidia-l4t-qwen-asr linux arm64 sha256:a30b71d4b11f4f4e8cb6f88a57b2c50da4d33ad89d9784d4d2bb8625a09a7b74 +nvidia-l4t-qwen-asr-development linux arm64 +nvidia-l4t-qwen-tts linux arm64 sha256:1284fa234e46d0d1622fe3ee18c11fa9359309619331387e6e9ca1c36d273a49 +nvidia-l4t-qwen-tts-development linux arm64 +nvidia-l4t-vibevoice linux arm64 sha256:b6fe83ea943faff4b5cce5ba2643bbcf06823c5ae3af024868c4bfff96d25c95 +nvidia-l4t-vibevoice-development linux arm64 +rocm-ace-step linux amd64 sha256:32aae93646d2dc9173855f40db2800595e0c1570827d8e5279d2d533cf6637d9 +rocm-ace-step-development linux amd64 +rocm-acestep-cpp linux amd64 sha256:05ba47534cbde147c1c9d9788a9d4113c65e5664671961d5960f8f353b4294cf +rocm-acestep-cpp-development linux amd64 +rocm-audio-cpp linux amd64 sha256:eb9b292a1d97570e6b6e38365fb2433a175ced7bcd031960cfce6becca451ec5 +rocm-audio-cpp-development linux amd64 +rocm-bonsai linux amd64 sha256:7316bc7c17b1f8c9630db6a85ba5abb8354b8339b6f263035d516aa7f15d751c +rocm-bonsai-development linux amd64 +rocm-ced linux amd64 sha256:aaad70a47909f2d68f27cacfb4698f96586b04065dd30f7798df0875daf35b64 +rocm-ced-development linux amd64 +rocm-coqui linux amd64 sha256:d498f2b78f4511040db63439fc94bc7c6e1d040c7f4e8ebb4b2568d336408501 +rocm-coqui-development linux amd64 +rocm-crispasr linux amd64 sha256:59ed0681ea3e6c513c0a2ff9242ae4129536ea7a34d8b5727059e0c604fc4f26 +rocm-crispasr-development linux amd64 +rocm-diffusers linux amd64 sha256:270fb04fa10a6a84001ad169be82e0ff6210ad8a90949a1263d3665f4c494538 +rocm-diffusers-development linux amd64 +rocm-face-detect linux amd64 sha256:b2138cb51bc8fc0bfb89dc36d851ec3f533793c4424a34f84c45ef6b1085decf +rocm-face-detect-development linux amd64 +rocm-faster-whisper linux amd64 sha256:d617ec411045799ae3358858eddf2c4fb0b34721895f23b2d7f6468baaeb7e8f +rocm-faster-whisper-development linux amd64 +rocm-fish-speech linux amd64 sha256:40bb00d5b74854b85139c8c4745541cb4cc4d802bc0aeff54151e2ba994ea0fd +rocm-fish-speech-development linux amd64 +rocm-funasr linux amd64 sha256:f02fe7f955725d005ae707f56be269980f5ed46cbb067d055edafd5ed36e3ddf +rocm-funasr-development linux amd64 +rocm-kokoro linux amd64 sha256:992505e2c68ab49261761708cad4dd0c0ba08d2dec9cb1ee2dd26a307375368a +rocm-kokoro-development linux amd64 +rocm-liquid-audio linux amd64 sha256:6fafe2ba12f0810292899fc37f35553ebdada0e073d7b5d7fcde2c8fcc3b50d4 +rocm-liquid-audio-development linux amd64 +rocm-llama-cpp linux amd64 sha256:3668d32f62aa63431e1214129b06eb964813c73105be58ff51c2afcff0f12803 +rocm-llama-cpp-development linux amd64 +rocm-magpie-tts-cpp linux amd64 sha256:b820d07693b65ac905bbae1289bd8ed431d9cb1735ac300d750316660ca86b99 +rocm-magpie-tts-cpp-development linux amd64 +rocm-moss-transcribe-cpp linux amd64 sha256:3d3e809d685dddbf2d9890777d4991f033c9b7df77e0a77af2a1192fe0131999 +rocm-moss-transcribe-cpp-development linux amd64 +rocm-moss-tts-cpp linux amd64 sha256:80e21b407c391fde25179a00ce1e4f8983fce9da7bd9822c51717ef76ce9db2a +rocm-moss-tts-cpp-development linux amd64 +rocm-nemo linux amd64 sha256:c700c142588385ecbfda90e12f1a66dacad23eed955c38c5d4b271883ec69a01 +rocm-nemo-development linux amd64 +rocm-neutts linux amd64 sha256:044bd8d756be97f51e7871656d9dda0f673a186f21f69a9fb4aafb6ef0e916d3 +rocm-neutts-development linux amd64 +rocm-omnivoice-cpp linux amd64 sha256:cf38171b7b869d05ea808ebd6fc38e2ba05b87bac28c4caa73a373654989c6b9 +rocm-omnivoice-cpp-development linux amd64 +rocm-parakeet-cpp linux amd64 sha256:25de24837cc7d12a7baf243dd39688c117b21e4bdbe8765089f2d160195fd717 +rocm-parakeet-cpp-development linux amd64 +rocm-pocket-tts linux amd64 sha256:8a8e6c52fd92df46ca3b8ce74c52b74424e16d3b80c10ab293caebc672d5de5c +rocm-pocket-tts-development linux amd64 +rocm-qwen-asr linux amd64 sha256:a7f50274ca9e3d6639487ec69fc8245724274459d04964b9bab7d153f230b208 +rocm-qwen-asr-development linux amd64 +rocm-qwen-tts linux amd64 sha256:65b55d821c0e6dc770505500b4cef84bf34ead06e0ddc45816b3325fa3174686 +rocm-qwen-tts-development linux amd64 +rocm-qwen3-tts-cpp linux amd64 sha256:ece9f9d411f35722e4570b6db694524021377fe0956978f32d7dd7f5cb464f7a +rocm-qwen3-tts-cpp-development linux amd64 +rocm-rerankers linux amd64 sha256:3ef0a1a2ca25b675902c2d1f792135c5e6e4ca8290b942d9bd0a75f89de6d939 +rocm-rerankers-development linux amd64 +rocm-sglang linux amd64 sha256:11ae2fb0ff6eeef6ee7c24a98092f041e0f8eae53201aa322d0a48d45374a7ae +rocm-sglang-development linux amd64 +rocm-stablediffusion-ggml linux amd64 sha256:dc71c222a1a7e339a1ac4e8600de01a596debd1bb7daf96f7c00c556d2c3bdb6 +rocm-stablediffusion-ggml-development linux amd64 +rocm-transformers linux amd64 sha256:0ca32bd63e2d80e82632208e30fe62004e8cca9fdc4fe7a0773cfb1174cc5d64 +rocm-transformers-development linux amd64 +rocm-turboquant linux amd64 sha256:be4cf194ba24e1d737f1f26ef9085694cab315af3e369e92f567932f58655e35 +rocm-turboquant-development linux amd64 +rocm-vibevoice linux amd64 sha256:eeb78d0d4924ab146ac24c5d55d7b7112ecc9201bac7dd9d265dac40193934e3 +rocm-vibevoice-cpp linux amd64 sha256:3ab6b2de8a46c95fa659c5e2bec09fde107f1f27189a889ba111f2cf6d0c0315 +rocm-vibevoice-cpp-development linux amd64 +rocm-vibevoice-development linux amd64 +rocm-vllm linux amd64 sha256:94945928cecb359d8b72ca13419873bf216dbbe74d86fbffea20755670181412 +rocm-vllm-development linux amd64 +rocm-vllm-omni linux amd64 sha256:e7a5a994dcf6b334867c386d4d089301f30b4440a9f92e8bc936be1e7c534fae +rocm-vllm-omni-development linux amd64 +rocm-voice-detect linux amd64 sha256:0ff971025b53552edcb36cc90ccaace3b27c4b4960cee0aa83d93d13a4d5fbc6 +rocm-voice-detect-development linux amd64 +rocm-voxcpm linux amd64 sha256:459ab0e421313d81c2c83f9b9e7ae08c1fecd583a1921f890728b7b3b0ec6f06 +rocm-voxcpm-development linux amd64 +rocm-whisper linux amd64 sha256:2107b23b38d047e2f12adeb8fe6499f7450fd481ae8a63968897a858dbc0591a +rocm-whisper-development linux amd64 +tinygrad linux amd64 sha256:6669664044c012b9e13d462d9cbe30cfdea1e28106a2e4ed656ee4ae919704da +tinygrad-development linux amd64 +vulkan-acestep-cpp linux amd64 sha256:3129dd0583107c2c57796ea2ca963dc44ef29d0d82f7dd2b4731a7d86c8e8c85 +vulkan-acestep-cpp linux arm64 sha256:a20253a5ecaa3c6330379e01a54aa8ca921ecdd30c5cb6b9ddf032dfdd9701dd +vulkan-acestep-cpp-development linux amd64 +vulkan-acestep-cpp-development linux arm64 +vulkan-bonsai linux amd64 sha256:2cf63fb99ad12da9666d1219a423a1502f2168cabf0277e5e67a9bb249799907 +vulkan-bonsai linux arm64 sha256:a48b9ebcd8e47fcc01ccfda62843e94d0ecef51be204c52910b168c29176a433 +vulkan-bonsai-development linux amd64 +vulkan-bonsai-development linux arm64 +vulkan-ced linux amd64 sha256:b606408105ab12503b4a0fb5c4288a9aece129f7007d242b60c79e31501b9218 +vulkan-ced linux arm64 sha256:78bce6f7d17e7e023f70242bf4b1cd6dd0073a45cd7f15ff6a4c10d52d779f53 +vulkan-ced-development linux amd64 +vulkan-ced-development linux arm64 +vulkan-crispasr linux amd64 sha256:a0117da8844df4267cbd550d69145d346fb5162668d567d35329c724e4372ac1 +vulkan-crispasr linux arm64 sha256:70141c22645144a8dc233776a0ba304a25a5b9ab497a5f7c7864878584d6bd46 +vulkan-crispasr-development linux amd64 +vulkan-crispasr-development linux arm64 +vulkan-depth-anything-cpp linux amd64 sha256:f2a1e92f410c4de9451ac7840c8ba547f432350cd94bfb128790ff1da54d7a6d +vulkan-depth-anything-cpp linux arm64 sha256:18bdfeb8725edbad8b303bbb99d95721ac1074b92b2ba484049b7d4451702590 +vulkan-depth-anything-cpp-development linux amd64 +vulkan-depth-anything-cpp-development linux arm64 +vulkan-face-detect linux amd64 sha256:6f1f2480fde67bac90c6d6cc970f503fa5cbe3d8bf4ec1cb7822219295997974 +vulkan-face-detect linux arm64 sha256:95b949fa16d37ef78109d09c9296766ada33e3955f4d0d447e548d8f3727635e +vulkan-face-detect-development linux amd64 +vulkan-face-detect-development linux arm64 +vulkan-gemxcpp linux amd64 +vulkan-gemxcpp-development linux amd64 +vulkan-gemxcpp-development linux arm64 +vulkan-kimodocpp linux amd64 sha256:87580eaa9ca12d7df521d31261dd8802f246d21339022c8c102d88021f7cf1bb +vulkan-kimodocpp linux arm64 sha256:cbe14d8d4b07268c6dacc1951cd891467356bdf40b7d93c011258da996d34611 +vulkan-kimodocpp-development linux amd64 +vulkan-kimodocpp-development linux arm64 +vulkan-llama-cpp linux amd64 sha256:c98fe3255d104231995be1980f55bede711ad69c05a397c7d81321d1b3b45fc1 +vulkan-llama-cpp linux arm64 sha256:9bbfcc81aaa0d7f5ccf946569d7ea08959a16bca3518c14f221b46c2918d0cc9 +vulkan-llama-cpp-development linux amd64 +vulkan-llama-cpp-development linux arm64 +vulkan-localvqe linux amd64 sha256:520da95f87233d765e9bdb9c4d92bc5afbf40df669abe26057b538fa0e619fb5 +vulkan-localvqe linux arm64 sha256:9cce7148958597e8649d9737bfb6e0afd5a693c720638b5bd3f94c20a310f9db +vulkan-localvqe-development linux amd64 +vulkan-localvqe-development linux arm64 +vulkan-locate-anything-cpp linux amd64 sha256:856873f7908e97b4548c991b5970fe35935cf4189f4597b993844c4ee1a651c6 +vulkan-locate-anything-cpp linux arm64 sha256:9e9d13626573ee32c132f2511d22c0cb7ac129ca9205d31ceb60b70dcf3b4523 +vulkan-locate-anything-cpp-development linux amd64 +vulkan-locate-anything-cpp-development linux arm64 +vulkan-magpie-tts-cpp linux amd64 sha256:6ac37852c838a7451833cf5b4d6737db87324f77c15bd45eed541dadbf02da0a +vulkan-magpie-tts-cpp linux arm64 sha256:32430c06c59adf03399f0027f09f5ed3556f92c7a84977795ad3710d156537d1 +vulkan-magpie-tts-cpp-development linux amd64 +vulkan-magpie-tts-cpp-development linux arm64 +vulkan-moss-transcribe-cpp linux amd64 sha256:f54ace32aded62b5aa4975fda91a6d20c3e846e1fc00d74349b213e85bafb5c5 +vulkan-moss-transcribe-cpp linux arm64 sha256:3a618a56042fb99113283fe815c8d7bf2d93e464a96f123f75b5e636fbe175db +vulkan-moss-transcribe-cpp-development linux amd64 +vulkan-moss-transcribe-cpp-development linux arm64 +vulkan-moss-tts-cpp linux amd64 sha256:192bc39b056870c76bba2ad8cc934bb1cbe93435b73230e2d568c7045907d5a6 +vulkan-moss-tts-cpp linux arm64 sha256:95ca9a1c24fb591e8116e794c42bf93acfef65d4948e0f564393ff46b12bdf9c +vulkan-moss-tts-cpp-development linux amd64 +vulkan-moss-tts-cpp-development linux arm64 +vulkan-nemo-speech-cpp linux amd64 sha256:e25297f699a60687d212b88a00cb1d40c124ff69eafa6d11a762436f1e1e1539 +vulkan-nemo-speech-cpp linux arm64 sha256:95fb2761fdfe863cc1cb57b4dd3f1d079b764c66c4b26db60a78046d1eafa196 +vulkan-nemo-speech-cpp-development linux amd64 +vulkan-nemo-speech-cpp-development linux arm64 +vulkan-omnivoice-cpp linux amd64 sha256:e816636d69b20eed0cac089e8b4b3fa3a482145e5303d289929f7d54d0ab8899 +vulkan-omnivoice-cpp linux arm64 sha256:b09689cc4e3eb899712d9b145290bd1db3aac93834f31c9fe39daad6cb47b8c2 +vulkan-omnivoice-cpp-development linux amd64 +vulkan-omnivoice-cpp-development linux arm64 +vulkan-parakeet-cpp linux amd64 sha256:77ca89a87a43f443a4a2a8f81902fbc1eb6433e860bd9010e9d7f898e8571557 +vulkan-parakeet-cpp linux arm64 sha256:ec6f8f02da1e9f7287d6b5738a537b19119afb4ebcb66bb7100acd466eef759d +vulkan-parakeet-cpp-development linux amd64 +vulkan-parakeet-cpp-development linux arm64 +vulkan-privacy-filter linux amd64 sha256:bbc354a8362049640e8c05c9aca068dee9ebd6ffa43a68e323160214e23002db +vulkan-privacy-filter-development linux amd64 +vulkan-qwen3-tts-cpp linux amd64 sha256:756cb1190ccc6ddc645a24451a476b68553df10744bf5444266464f7e8c63d35 +vulkan-qwen3-tts-cpp linux arm64 sha256:553f9bc14ca5779b4fbae1c0be24b2b09025e3a50ef66f50c6d39d96696f9cd6 +vulkan-qwen3-tts-cpp-development linux amd64 +vulkan-qwen3-tts-cpp-development linux arm64 +vulkan-rfdetr-cpp linux amd64 sha256:166dd87c04a84a120bc59e934b147bce929e843f5402f613e1d7ef366cfbf60b +vulkan-rfdetr-cpp linux arm64 sha256:8103528f4d9be0d965dd8d6749794e16848dd59c3e0009cc4fdafe8585abed9a +vulkan-rfdetr-cpp-development linux amd64 +vulkan-rfdetr-cpp-development linux arm64 +vulkan-sam3-cpp linux amd64 sha256:98600561e3ad655d40869147c11d0bef6e4aa99cc1cc80694333b18eb519a7cc +vulkan-sam3-cpp linux arm64 sha256:99e85eb1dd961263ea9e157d9c830d5c6a4affa3dd854989241b363b7d36f32e +vulkan-sam3-cpp-development linux amd64 +vulkan-sam3-cpp-development linux arm64 +vulkan-stablediffusion-ggml linux amd64 sha256:0170210fdbeeadd719e0884e7504dd81055b06c8ca509709eb2e786d388b8e2e +vulkan-stablediffusion-ggml linux arm64 sha256:422c1ab88f6a8f7843ece230cf47df221c8dda28e68c02594306176965067845 +vulkan-stablediffusion-ggml-development linux amd64 +vulkan-stablediffusion-ggml-development linux arm64 +vulkan-trellis2cpp linux amd64 sha256:0217087076de0eee7987693a774f609a05e4bd7aedeaa3afe336f351faa180b7 +vulkan-trellis2cpp linux arm64 sha256:b54b832cce2b7801151dac9a1a6312aaad5f716e9c783b35dbe733e057daf9a3 +vulkan-trellis2cpp-development linux amd64 +vulkan-trellis2cpp-development linux arm64 +vulkan-turboquant linux amd64 sha256:15c2afc2f1394a5b34f66871938ed1c0a2b1f016305a5e48c27f376d6dea0a90 +vulkan-turboquant linux arm64 sha256:ac506228c2f467bb668afd1f79dc984ae4ab8b288f1fcd23b47beeffe50a3739 +vulkan-turboquant-development linux amd64 +vulkan-turboquant-development linux arm64 +vulkan-vibevoice-cpp linux amd64 sha256:ce4b536216f00078adfe6966b47f796d958900cb6930533bef4d7123b461a36e +vulkan-vibevoice-cpp linux arm64 sha256:929680be71ba3cb2fc87d057c889b022f8983707fc1125408d39a0b250f97ac4 +vulkan-vibevoice-cpp-development linux amd64 +vulkan-vibevoice-cpp-development linux arm64 +vulkan-vllm-cpp linux amd64 sha256:bdb1794841cc3fd418d42510b82b2a4bdc1c52bcf1071de3246901583b3dea8b +vulkan-vllm-cpp-development linux amd64 +vulkan-voice-detect linux amd64 sha256:7ac1f49bea39cb8be1208b5f2fd641151769cdc857f6d527330db08a62cec1d7 +vulkan-voice-detect linux arm64 sha256:5087d061954aacf326f24a19bcf1aa988ad63d5e6107e923d96eb04758f094b8 +vulkan-voice-detect-development linux amd64 +vulkan-voice-detect-development linux arm64 +vulkan-whisper linux amd64 sha256:b4020584b57cadce01f33430dbe5cf504c627129df0870a331e5fc02f3701786 +vulkan-whisper linux arm64 sha256:16345287a8b42e97f34ffc4a1deed6cbbc31d46a8daa3d3936f3fe4be3a98a4e +vulkan-whisper-development linux amd64 +vulkan-whisper-development linux arm64 diff --git a/core/gallery/testdata/backend_library/samples/development.gallery.yaml b/core/gallery/testdata/backend_library/samples/development.gallery.yaml new file mode 100644 index 000000000..7419e8f5d --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/development.gallery.yaml @@ -0,0 +1,32 @@ +- name: cpu-locate-anything-cpp-development + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:master-cpu-locate-anything-cpp + mirrors: + - localai/localai-backends:master-cpu-locate-anything-cpp diff --git a/core/gallery/testdata/backend_library/samples/development.library.yaml b/core/gallery/testdata/backend_library/samples/development.library.yaml new file mode 100644 index 000000000..87c6ce609 --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/development.library.yaml @@ -0,0 +1,40 @@ +- alias: locate-anything + arch: amd64 + artifact: oci://quay.io/go-skynet/local-ai-backends:master-cpu-locate-anything-cpp + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + channel: development + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + id: cpu-locate-anything-cpp-development + kind: backend + license: apache-2.0 + mirrors: + - oci://localai/localai-backends:master-cpu-locate-anything-cpp + mutable: true + name: cpu-locate-anything-cpp-development + os: linux + schemaVersion: 1 + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + version: 0.0.0-development diff --git a/core/gallery/testdata/backend_library/samples/meta-development.gallery.yaml b/core/gallery/testdata/backend_library/samples/meta-development.gallery.yaml new file mode 100644 index 000000000..eb35b7034 --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/meta-development.gallery.yaml @@ -0,0 +1,37 @@ +- name: vllm-cpp-development + alias: vllm-cpp + license: apache-2.0 + description: | + ALPHA development builds. Try it, but llama-cpp stays the recommendation for + production use. + + vllm.cpp is an Apache-2.0 C++20 inference engine maintained by the LocalAI team, + developed in its own repository and usable without LocalAI. It began as a port of + vLLM and keeps vLLM as its reference implementation, checking output against it and + benchmarking against it, while growing a featureset of its own. It implements vLLM's + V1 architecture (paged KV cache, continuous batching, prefix caching, scheduler, + sampler) on a portable tensor runtime with no Python, PyTorch or ggml at inference + time. It loads GGUF as well as Hugging Face safetensors, supports structured output + (JSON schema / regex / choice / GBNF grammar) enforced in-engine, ships speculative + decoding and KV offload, and runs on CPU, NVIDIA CUDA (Blackwell-family), Apple + Metal and Vulkan. + + The project is expected to be renamed as it diverges further from vLLM; the new + name is still to be decided. + urls: + - https://github.com/mudler/vllm.cpp + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - metal + capabilities: + default: cpu-vllm-cpp-development + metal: metal-vllm-cpp-development + nvidia: cuda13-vllm-cpp-development + nvidia-cuda-13: cuda13-vllm-cpp-development + nvidia-l4t: nvidia-l4t-arm64-vllm-cpp-development + nvidia-l4t-cuda-13: nvidia-l4t-arm64-vllm-cpp-development + vulkan: vulkan-vllm-cpp-development diff --git a/core/gallery/testdata/backend_library/samples/meta-development.library.yaml b/core/gallery/testdata/backend_library/samples/meta-development.library.yaml new file mode 100644 index 000000000..5360de040 --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/meta-development.library.yaml @@ -0,0 +1,42 @@ +- alias: vllm-cpp + capabilities: + default: cpu-vllm-cpp-development + metal: metal-vllm-cpp-development + nvidia: cuda13-vllm-cpp-development + nvidia-cuda-13: cuda13-vllm-cpp-development + nvidia-l4t: nvidia-l4t-arm64-vllm-cpp-development + nvidia-l4t-cuda-13: nvidia-l4t-arm64-vllm-cpp-development + vulkan: vulkan-vllm-cpp-development + channel: development + description: | + ALPHA development builds. Try it, but llama-cpp stays the recommendation for + production use. + + vllm.cpp is an Apache-2.0 C++20 inference engine maintained by the LocalAI team, + developed in its own repository and usable without LocalAI. It began as a port of + vLLM and keeps vLLM as its reference implementation, checking output against it and + benchmarking against it, while growing a featureset of its own. It implements vLLM's + V1 architecture (paged KV cache, continuous batching, prefix caching, scheduler, + sampler) on a portable tensor runtime with no Python, PyTorch or ggml at inference + time. It loads GGUF as well as Hugging Face safetensors, supports structured output + (JSON schema / regex / choice / GBNF grammar) enforced in-engine, ships speculative + decoding and KV offload, and runs on CPU, NVIDIA CUDA (Blackwell-family), Apple + Metal and Vulkan. + + The project is expected to be renamed as it diverges further from vLLM; the new + name is still to be decided. + id: vllm-cpp-development + kind: backend + license: apache-2.0 + name: vllm-cpp-development + schemaVersion: 1 + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - metal + urls: + - https://github.com/mudler/vllm.cpp + version: 0.0.0-development diff --git a/core/gallery/testdata/backend_library/samples/meta.gallery.yaml b/core/gallery/testdata/backend_library/samples/meta.gallery.yaml new file mode 100644 index 000000000..e06f39da1 --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/meta.gallery.yaml @@ -0,0 +1,30 @@ +- name: llama-cpp + alias: llama-cpp + license: mit + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + description: | + LLM inference in C/C++ + urls: + - https://github.com/ggerganov/llama.cpp + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp diff --git a/core/gallery/testdata/backend_library/samples/meta.library.yaml b/core/gallery/testdata/backend_library/samples/meta.library.yaml new file mode 100644 index 000000000..df9294c27 --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/meta.library.yaml @@ -0,0 +1,35 @@ +- alias: llama-cpp + capabilities: + amd: rocm-llama-cpp + default: cpu-llama-cpp + intel: intel-sycl-f16-llama-cpp + metal: metal-llama-cpp + nvidia: cuda12-llama-cpp + nvidia-cuda-12: cuda12-llama-cpp + nvidia-cuda-13: cuda13-llama-cpp + nvidia-l4t: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-llama-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-llama-cpp + vulkan: vulkan-llama-cpp + channel: latest + description: | + LLM inference in C/C++ + icon: https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png + id: llama-cpp + kind: backend + license: mit + name: llama-cpp + schemaVersion: 1 + tags: + - text-to-text + - text-to-speech + - TTS + - LLM + - CPU + - GPU + - Metal + - CUDA + - HIP + urls: + - https://github.com/ggerganov/llama.cpp + version: 0.0.0-latest diff --git a/core/gallery/testdata/backend_library/samples/multi-platform.gallery.yaml b/core/gallery/testdata/backend_library/samples/multi-platform.gallery.yaml new file mode 100644 index 000000000..704bf11f4 --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/multi-platform.gallery.yaml @@ -0,0 +1,32 @@ +- name: vulkan-locate-anything-cpp + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-locate-anything-cpp + mirrors: + - localai/localai-backends:latest-gpu-vulkan-locate-anything-cpp diff --git a/core/gallery/testdata/backend_library/samples/multi-platform.library.yaml b/core/gallery/testdata/backend_library/samples/multi-platform.library.yaml new file mode 100644 index 000000000..0c761f2a4 --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/multi-platform.library.yaml @@ -0,0 +1,80 @@ +- alias: locate-anything + arch: amd64 + artifact: oci://quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-locate-anything-cpp + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + channel: latest + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + digest: sha256:856873f7908e97b4548c991b5970fe35935cf4189f4597b993844c4ee1a651c6 + id: vulkan-locate-anything-cpp + kind: backend + license: apache-2.0 + mirrors: + - oci://localai/localai-backends:latest-gpu-vulkan-locate-anything-cpp + name: vulkan-locate-anything-cpp + os: linux + schemaVersion: 1 + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + version: 0.0.0-latest.856873f7908e +- alias: locate-anything + arch: arm64 + artifact: oci://quay.io/go-skynet/local-ai-backends:latest-gpu-vulkan-locate-anything-cpp + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + channel: latest + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + digest: sha256:9e9d13626573ee32c132f2511d22c0cb7ac129ca9205d31ceb60b70dcf3b4523 + id: vulkan-locate-anything-cpp + kind: backend + license: apache-2.0 + mirrors: + - oci://localai/localai-backends:latest-gpu-vulkan-locate-anything-cpp + name: vulkan-locate-anything-cpp + os: linux + schemaVersion: 1 + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + version: 0.0.0-latest.9e9d13626573 diff --git a/core/gallery/testdata/backend_library/samples/multiline-description.gallery.yaml b/core/gallery/testdata/backend_library/samples/multiline-description.gallery.yaml new file mode 100644 index 000000000..80d1ddda4 --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/multiline-description.gallery.yaml @@ -0,0 +1,28 @@ +- name: turboquant + alias: turboquant + license: mit + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + urls: + - https://github.com/TheTom/llama-cpp-turboquant + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant diff --git a/core/gallery/testdata/backend_library/samples/multiline-description.library.yaml b/core/gallery/testdata/backend_library/samples/multiline-description.library.yaml new file mode 100644 index 000000000..845f04a49 --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/multiline-description.library.yaml @@ -0,0 +1,33 @@ +- alias: turboquant + capabilities: + amd: rocm-turboquant + default: cpu-turboquant + intel: intel-sycl-f16-turboquant + nvidia: cuda12-turboquant + nvidia-cuda-12: cuda12-turboquant + nvidia-cuda-13: cuda13-turboquant + nvidia-l4t: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-12: nvidia-l4t-arm64-turboquant + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-turboquant + vulkan: vulkan-turboquant + channel: latest + description: | + Fork of llama.cpp adding the TurboQuant KV-cache quantization scheme. + Reuses the LocalAI llama.cpp gRPC server sources against the fork's libllama. + id: turboquant + kind: backend + license: mit + name: turboquant + schemaVersion: 1 + tags: + - text-to-text + - LLM + - CPU + - GPU + - CUDA + - HIP + - turboquant + - kv-cache + urls: + - https://github.com/TheTom/llama-cpp-turboquant + version: 0.0.0-latest diff --git a/core/gallery/testdata/backend_library/samples/no-description.gallery.yaml b/core/gallery/testdata/backend_library/samples/no-description.gallery.yaml new file mode 100644 index 000000000..c99b6a447 --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/no-description.gallery.yaml @@ -0,0 +1,7 @@ +- name: rerankers + alias: rerankers + capabilities: + amd: rocm-rerankers + intel: intel-rerankers + metal: metal-rerankers + nvidia: cuda12-rerankers diff --git a/core/gallery/testdata/backend_library/samples/no-description.library.yaml b/core/gallery/testdata/backend_library/samples/no-description.library.yaml new file mode 100644 index 000000000..e7c603d04 --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/no-description.library.yaml @@ -0,0 +1,12 @@ +- alias: rerankers + capabilities: + amd: rocm-rerankers + intel: intel-rerankers + metal: metal-rerankers + nvidia: cuda12-rerankers + channel: latest + id: rerankers + kind: backend + name: rerankers + schemaVersion: 1 + version: 0.0.0-latest diff --git a/core/gallery/testdata/backend_library/samples/no-icon.gallery.yaml b/core/gallery/testdata/backend_library/samples/no-icon.gallery.yaml new file mode 100644 index 000000000..4f6b7b38a --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/no-icon.gallery.yaml @@ -0,0 +1,32 @@ +- name: cpu-locate-anything-cpp + alias: locate-anything + license: apache-2.0 + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + uri: quay.io/go-skynet/local-ai-backends:latest-cpu-locate-anything-cpp + mirrors: + - localai/localai-backends:latest-cpu-locate-anything-cpp diff --git a/core/gallery/testdata/backend_library/samples/no-icon.library.yaml b/core/gallery/testdata/backend_library/samples/no-icon.library.yaml new file mode 100644 index 000000000..c19333fc4 --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/no-icon.library.yaml @@ -0,0 +1,40 @@ +- alias: locate-anything + arch: amd64 + artifact: oci://quay.io/go-skynet/local-ai-backends:latest-cpu-locate-anything-cpp + capabilities: + default: cpu-locate-anything-cpp + intel: intel-sycl-f32-locate-anything-cpp + metal: metal-locate-anything-cpp + nvidia: cuda12-locate-anything-cpp + nvidia-cuda-12: cuda12-locate-anything-cpp + nvidia-cuda-13: cuda13-locate-anything-cpp + nvidia-l4t: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-12: nvidia-l4t-arm64-locate-anything-cpp + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-locate-anything-cpp + vulkan: vulkan-locate-anything-cpp + channel: latest + description: | + Open-vocabulary object detection and visual grounding (NVIDIA + LocateAnything-3B) in C/C++ using GGML. Loads pre-built GGUF weights + and, given an image and a free-form text prompt, returns bounding + boxes, class labels, and confidence scores for the referred objects. + digest: sha256:acb078c58ac5e78485e7254fd8f040ba901255f118edf3d8f881bfbd7384b673 + id: cpu-locate-anything-cpp + kind: backend + license: apache-2.0 + mirrors: + - oci://localai/localai-backends:latest-cpu-locate-anything-cpp + name: cpu-locate-anything-cpp + os: linux + schemaVersion: 1 + tags: + - object-detection + - visual-grounding + - open-vocabulary + - locate-anything + - gpu + - cpu + urls: + - https://github.com/mudler/locate-anything.cpp + - https://huggingface.co/nvidia/LocateAnything-3B + version: 0.0.0-latest.acb078c58ac5 diff --git a/core/gallery/testdata/backend_library/samples/no-mirrors.gallery.yaml b/core/gallery/testdata/backend_library/samples/no-mirrors.gallery.yaml new file mode 100644 index 000000000..4821ba0d2 --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/no-mirrors.gallery.yaml @@ -0,0 +1,28 @@ +- name: intel-sycl-f32-stablediffusion-ggml + alias: stablediffusion-ggml + license: mit + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + description: | + Stable Diffusion and Flux in pure C/C++ + urls: + - https://github.com/leejet/stable-diffusion.cpp + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + uri: quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-stablediffusion-ggml diff --git a/core/gallery/testdata/backend_library/samples/no-mirrors.library.yaml b/core/gallery/testdata/backend_library/samples/no-mirrors.library.yaml new file mode 100644 index 000000000..512d349b0 --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/no-mirrors.library.yaml @@ -0,0 +1,36 @@ +- alias: stablediffusion-ggml + arch: amd64 + artifact: oci://quay.io/go-skynet/local-ai-backends:latest-gpu-intel-sycl-f32-stablediffusion-ggml + capabilities: + amd: rocm-stablediffusion-ggml + default: cpu-stablediffusion-ggml + intel: intel-sycl-f16-stablediffusion-ggml + metal: metal-stablediffusion-ggml + nvidia: cuda12-stablediffusion-ggml + nvidia-cuda-12: cuda12-stablediffusion-ggml + nvidia-cuda-13: cuda13-stablediffusion-ggml + nvidia-l4t: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-12: nvidia-l4t-arm64-stablediffusion-ggml + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-stablediffusion-ggml + vulkan: vulkan-stablediffusion-ggml + channel: latest + description: | + Stable Diffusion and Flux in pure C/C++ + digest: sha256:b3e306c0b628e830ae92c94f50afb9aebe48186a0c42ab68858c6a3afc1b9984 + icon: https://github.com/leejet/stable-diffusion.cpp/raw/master/assets/cat_with_sd_cpp_42.png + id: intel-sycl-f32-stablediffusion-ggml + kind: backend + license: mit + name: intel-sycl-f32-stablediffusion-ggml + os: linux + schemaVersion: 1 + tags: + - image-generation + - CPU + - GPU + - Metal + - CUDA + - HIP + urls: + - https://github.com/leejet/stable-diffusion.cpp + version: 0.0.0-latest.b3e306c0b628 diff --git a/core/gallery/testdata/backend_library/samples/release.gallery.yaml b/core/gallery/testdata/backend_library/samples/release.gallery.yaml new file mode 100644 index 000000000..f3d603f9e --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/release.gallery.yaml @@ -0,0 +1,23 @@ +- name: metal-mlx + license: MIT + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + description: | + Run LLMs with MLX + urls: + - https://github.com/ml-explore/mlx-lm + tags: + - text-to-text + - LLM + - MLX + capabilities: + default: cpu-mlx + metal: metal-mlx + nvidia: cuda12-mlx + nvidia-cuda-12: cuda12-mlx + nvidia-cuda-13: cuda13-mlx + nvidia-l4t: nvidia-l4t-mlx + nvidia-l4t-cuda-12: nvidia-l4t-mlx + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx + uri: quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx + mirrors: + - localai/localai-backends:latest-metal-darwin-arm64-mlx diff --git a/core/gallery/testdata/backend_library/samples/release.library.yaml b/core/gallery/testdata/backend_library/samples/release.library.yaml new file mode 100644 index 000000000..9f1bcd02d --- /dev/null +++ b/core/gallery/testdata/backend_library/samples/release.library.yaml @@ -0,0 +1,31 @@ +- arch: arm64 + artifact: oci://quay.io/go-skynet/local-ai-backends:latest-metal-darwin-arm64-mlx + capabilities: + default: cpu-mlx + metal: metal-mlx + nvidia: cuda12-mlx + nvidia-cuda-12: cuda12-mlx + nvidia-cuda-13: cuda13-mlx + nvidia-l4t: nvidia-l4t-mlx + nvidia-l4t-cuda-12: nvidia-l4t-mlx + nvidia-l4t-cuda-13: cuda13-nvidia-l4t-arm64-mlx + channel: latest + description: | + Run LLMs with MLX + digest: sha256:79efa3f8b96d1df41efbc75fbaa7f1e496b811ff4025a164307e0da185b46b90 + icon: https://avatars.githubusercontent.com/u/102832242?s=200&v=4 + id: metal-mlx + kind: backend + license: MIT + mirrors: + - oci://localai/localai-backends:latest-metal-darwin-arm64-mlx + name: metal-mlx + os: darwin + schemaVersion: 1 + tags: + - text-to-text + - LLM + - MLX + urls: + - https://github.com/ml-explore/mlx-lm + version: 0.0.0-latest.79efa3f8b96d diff --git a/core/gallery/testdata/model_library/digests.tsv b/core/gallery/testdata/model_library/digests.tsv new file mode 100644 index 000000000..e403a1bdd --- /dev/null +++ b/core/gallery/testdata/model_library/digests.tsv @@ -0,0 +1,2214 @@ +# id, digest of the library entry, digest of the gallery entry generated from it +# Written by scripts/models/cmd/modelcatalog --golden; do not edit by hand. +70b-l3.3-cirrus-x1 63dbae422cb17f0f 89b15e19b1c6f99e +LocalAI-functioncall-llama3.2-1b-v0.4 998074ebd5d46b14 66ab530be60b3765 +LocalAI-functioncall-llama3.2-3b-v0.5 a6127d18d6c6bd34 5654c51c6b4e4854 +LocalAI-llama3-8b-function-call-v0.2 ecfa6b90a6ff83bf c553da590e7c0420 +Z-Image-Turbo 4e5c198b3b9c76c8 cd89e11c8d85e628 +a2fm-32b-rl 2ae23560a896c26f 173c81d8ec70ed2d +ace-step-turbo b68edbaa66c3dd8e b260cfec4e62dc0e +acestep-cpp-turbo 686dac782f45fa1f a19bb99a3576dfc2 +acestep-cpp-turbo-4b 2b9bc8663942beb4 cde2335359185c37 +acolyte-22b-i1 5142aa5c1d49920f 3720de77cff2d4d5 +adavar-3b-q4 e8cc51c7003bf26f aad21685995313ea +adavar-3b-q8 4149d6650db88cb9 4a2f0db86526e3ca +aescode-8b 09f59c4cff36e570 a8ae735a1af8c15f +aescode-8b-q8 49dfec1215d11017 d40f61ca9900a419 +aevum-0.6b-finetuned 5332f0e427eddeb1 08b6e6cee666b1c8 +agentica-org_deepcoder-1.5b-preview 937908ed8b2647a3 0319abe1ff4895bf +agentica-org_deepcoder-14b-preview 6787258283d366cd 4639abcb2fb158e2 +agentica-org_deepscaler-1.5b-preview d250bbab3ba3a26c 4e2ad03a0cab4035 +agentica-org_deepswe-preview 7b657553f8acda2c 2b8d590ae0e75e28 +agents-a1 eacdc544af41fe21 f3f1a4e33fba0b87 +agents-a1-4b 0c462a8bdfd8f061 f36c15fcd0b46070 +agents-a1-4b-q8 7583f04d5eee8b46 17f6ed190c78b746 +agents-a1-apex-i-balanced 589c56c66945cbc6 79038df66fc4816a +agents-a1-apex-i-compact a413020223300a02 260aab02b13f5489 +agents-a1-apex-i-mini b1c42f79b727af86 fcf5583bb94095a7 +agents-a1-apex-i-quality 89fa03285be942e3 f9cd27d294d6e268 +agi-0_art-skynet-3b ec8319fcfea14525 78f54797ef2ed5b3 +ai21labs_ai21-jamba-reasoning-3b 2b565490fee8f5f1 b09e2f4959b99e8d +akhil-theerthala_kuvera-8b-v0.1.0 ef799815f9c361d4 309b5c1b99e82112 +alamios_mistral-small-3.1-draft-0.5b 5be04cf8a45fe174 0ed1097adc61869e +alibaba-nlp_tongyi-deepresearch-30b-a3b c3666b108380df88 bb2726b011172bcb +all-MiniLM-L6-v2 4cd7b5f28f38ce86 24e0dc8c856ef062 +allenai_llama-3.1-tulu-3.1-8b 90848e3e9fd35091 c1360248c386182b +allenai_olmo-3.1-32b-think 15f84b289a9f6a94 7635b7df08930703 +allura-org_bigger-body-70b 5ce0903258db7a92 93a49322d3f41506 +allura-org_q3-30b-a3b-designant 036f69d5b8523a86 1811a89e1789c3c0 +allura-org_q3-30b-a3b-pentiment 6e4e5101f3a9e726 c468c8250fdbe405 +allura-org_q3-8b-kintsugi 06e7160f17625e73 91510aee9507e66f +allura-org_remnant-qwen3-8b edaefa1b00cd5e03 920b1e3d702edaaa +almost-human-x3-32bit-1839-6b-i1 33e714b55891dabb b4783ae60c4fe933 +amoral-gemma3-1b-v2 3e98ff20095007a5 de5eb7809188c1b6 +amoral-qwen3-14b e30d7a619758e603 19ea5db555da3d0a +antares-1b 601ca9bb3b39a2f7 4add95f8a7114441 +antares-1b-q8 b937612da5d86a80 387b18f8f3c80804 +anubis-70b-v1 db9974bf25c2aa77 fea2484bb3221f03 +apodex-1.1-mini-q4 9b01bfbb67d814b5 30156fa8a349b367 +apodex-1.1-mini-q4-mtp b301f0111589c66d d6c37c37d4f97001 +apodex-1.1-mini-q8 6019dcdb86f84f6f 97d8e251fee02f44 +apollo-astralis-4b-i1 25d4eff3dfb11f1e e40ebad3ed9313c0 +aquif-ai_aquif-3.5-8b-think 060ad241035bf467 05197c50247001f9 +arcee-ai_afm-4.5b 8f73836bfa5146c4 a8657ef6bdb5ea32 +arcee-ai_arcee-maestro-7b-preview 6a46cc0196f574fd d81362b6917248cf +arcee-ai_homunculus 0c74880b29babddf b779494b8a4df8d1 +arch-router-1.5b-q4 c3f7452784c5c316 85afac7a0afd632d +arch-router-1.5b-q8 b5acf0c86072b146 733d58c9a6271805 +archangel_sft_pythia2-8b f9c31ee314feeb4b 5a5dae68f0e9fbe7 +arex-2 4539fe7668009c87 aef5f68eae0abaef +arex-2-q8 74bc164d51870747 b66e9d734db5735e +arex-turbo 8dd90b2d247319b1 497bed98f4d43c92 +arex-turbo-q8 49ed9fb48ffd3042 0a77a2bcd87d4a55 +arliai_llama-3.3-70b-arliai-rpmax-v1.4 e10bdeca0f2cfee4 5a84bbb14e89a99b +artemis-31b-v1.2-q4 7bb751626b44fb98 f8f5c2da27298622 +artemis-31b-v1.2-q8 f56d7c2e06c2d53d 689ffbc2e73e537f +astabrief-8b-q4 db52951a45463ea7 7d4709f9aaf3f872 +astabrief-8b-q8 0a0e12c781441552 dafdc4af2570cf2d +astral-fusion-neural-happy-l3.1-8b 4e03be4dfdf0277b 50d025be27ff5ae8 +astrosage-70b 9618e9b76c67f281 c0e6b3c9d1427377 +audio-cpp-chatterbox 19b6a450237e2f67 4ee9692528075961 +audio-cpp-citrinet-asr 1f91da93267edd9d f6e68e4bb71da79f +audio-cpp-fish-drama3 8a4d2508ec619f6e e30a8ffc5efe8b7e +audio-cpp-forced-aligner 2c566b33db11deb6 fe9ae92cc438c335 +audio-cpp-higgs-audio-v3 a40faf4f0c3c7672 27cdfa9a20785192 +audio-cpp-htdemucs 3cfeeb31134e10d7 6825c092585317f5 +audio-cpp-indextts-2.5 0967e440e4aed638 1e7a0ff03cc22a95 +audio-cpp-irodori-voicedesign b07863efb7d87c13 045e958bf3722e05 +audio-cpp-marblenet-vad 9ca142f39994b85d 57346748adc6300f +audio-cpp-nemotron-asr 8db2b56bebee300a 73dcfeba0a2274b4 +audio-cpp-seedvc-singing a2395a1895a65dc0 14c65935f94c6b8e +audio-cpp-silero-vad 5fd5945fadb7be6e 9f145a561bcc0524 +audio-cpp-sortformer-diarization c553b32323f0083f bac7ff89e15b7b2f +audio-cpp-stable-audio-sfx 689bbd11f226f006 66b9f531ea48d407 +audio-cpp-supertonic f2a2c075b452f87a 4837a1e5edc4583a +audio-cpp-vevo2-speech-to-speech efd1769466b93745 448d8af13bde18ae +audio-cpp-yue2-3b a38e431a62c56c99 7797df855bebd428 +audioldm2 b1356e64b2a32fd7 4d4b79182bdfdc53 +aurore-reveil_koto-small-7b-it 62f65c236828cb9a 7a65255bb4ce56d9 +aya-23-35b 9f57a20ee5f708ae 50e9d9f3251aef29 +aya-23-8b 00b969c727f2f3ff 54ec5e9461ea9ed1 +azure_dusk-v0.2-iq-imatrix fe093115da8790c0 519026493f2236ec +b-nimita-l3-8b-v0.02 6045b94fbd8011d1 c1c658820c4bcb9b +b1-9b df1c88ecacfc3d32 df0718c7f5b0d2cf +b1-9b-q8 285ed31824d61d1e 35bbdb2910a2cc58 +baidu_ernie-4.5-21b-a3b-thinking d5df8c629f3e393e fa3401a011858f4a +baldur-8b b4a46841095eea3a 66a951ce9faf9dd9 +beaverai_mn-2407-dsk-qwqify-v0.1-12b 0cc7e93e751f6c9f fc58f5f53e57f09c +bert-embeddings f29220f45071edcc f460935368aa75ea +bge-m3-colbert 35e325939cfa6efa 426b04defb5294f0 +bigbang-v1-q4-k-m c8c2bc362738e410 8aacb1f67fee6863 +bigbang-v1-q6-k 89c9db62014a4b49 b57b709fc807507a +black-ink-guild_pernicious_prophecy_70b c743ed2ca08a7dec fc174f20d7b46077 +blacksheep-24b-i1 8fe9ecd5822aeeba 170ac33a917e1e2d +bonsai-2-27b-ternary-crack-pq2 afd07664ddafe2fd ab7a64ed092f25d8 +bonsai-27b-1bit dcfc8a37b832602d 9ad5f14c62bccd4e +bonsai-8b-1bit c8d2af698304b101 7982ed887d1b2789 +boomerang-qwen3-2.3b 785c26a43296c3b3 9f10d4e2a6602a26 +boomerang-qwen3-4.9b ae8d51b1c6c9db17 dc999b5be18fdaa8 +btl-4-compact f59f16e8933134ad aa912af4ab53959d +burtenshaw_gemmacoder3-12b 5e6b04fba81a6a96 38b2b84d1b387998 +byteshape-qwen3.8-27b 61274163d14412e5 4242f635ecec3312 +byteshape-qwen3.8-27b-iq2-xxs 391c2bbbcf35ae57 33758dc86fb0d40b +byteshape-qwen3.8-27b-iq3-s a965603fb076b832 54956644e597ffe6 +byteshape-qwen3.8-27b-iq3-xs 6f0ea70e9b3d63a6 6b59981b02506acd +byteshape-qwen3.8-27b-iq3-xxs 3bf39aeca0c19048 7385b3eefff9da6e +cajal-4b-p2pclaw 80c16c1c02bb7834 833cd94970f07015 +calme-2.3-legalkit-8b-i1 ef05deb7b550d2d6 77e819c7bbd52ee4 +calme-3.1-llamaloi-3b 5c66f4a4b9be5f84 f11f7f8aedfa18b6 +calme-3.2-llamaloi-3b 8d05243b18161837 214e9b4a676dd0d7 +calme-3.3-llamaloi-3b 2e659c1c2b7be08d 74a8f346aa0a53a3 +canary-crispasr 87b72111e804bf90 818a50e502bb8184 +captain-eris-diogenes_twilight-v0.420-12b-arm-imatrix eac23738a5bc8400 23dd48c49aafb18a +carbon-3b-q4 da978cc6d27a396d 0fd4f8f28065956c +carbon-3b-q8 7398538a48787d2d 94799570644aba75 +carbon-8b-q4 ae674b40e8e6d03b 3a97d207695bb600 +carbon-8b-q8 c8fdc3793f6cfe0a 03baedc8ae7915d3 +carnice-moe-35b-a3b 96412572f7149777 e79e84dc7319a52c +carnice-moe-35b-a3b-apex-i-balanced dbdafc701fc136ec f8604bc0bb7e0eb0 +carnice-moe-35b-a3b-apex-i-compact 81ae081e8b3fc157 54ef34962284a912 +carnice-moe-35b-a3b-apex-i-mini 1239c0e2e3be15b6 471b3b99a13e9639 +carnice-moe-35b-a3b-apex-i-quality 98bd963f5cbe29be c552b07d6d63d727 +carnice-qwen3.6-moe-35b-a3b de13251a14b23092 179ca3598fd17be2 +carnice-qwen3.6-moe-35b-a3b-apex-i-balanced d462c835ba3781a0 227a6a116e1ee3b0 +carnice-qwen3.6-moe-35b-a3b-apex-i-compact 2191ecbfd3cf1897 43e4d7963b0d82df +carnice-qwen3.6-moe-35b-a3b-apex-i-mini d9c5ffb3360a2e1c 55f28bf5bfa0130a +carnice-qwen3.6-moe-35b-a3b-apex-i-quality 805fa4cfb1e9443b a02bde549714960e +carnice-qwen3.6-moe-35b-a3b-apex-mtp-i-balanced d9b426eebee559c7 d6767fd326d0d9db +carnice-qwen3.6-moe-35b-a3b-apex-mtp-i-compact d715c9479484abf8 d8c01c7a6f6ee0ae +carnice-qwen3.6-moe-35b-a3b-apex-mtp-i-mini 93b35dfec95bf1b2 d1a3b5b236b86481 +carnice-qwen3.6-moe-35b-a3b-apex-mtp-i-nano 32536e23ce586837 739ebab752e3e835 +carnice-qwen3.6-moe-35b-a3b-apex-mtp-i-quality d26850d9e4253bd1 9bafe784599e9ca2 +carnice-v2-27b 656e8d0579014e73 7888151fbb14fe8f +cathallama-70b 4ac3a3f9d23b7f38 81849edd690e2aca +ced-base-f16 d8c1511e940a6ec4 565f6437b2a18a99 +ced-base-q8 b9d08919e3972499 1eccadc136a494cf +ced-mini-f16 14864fdef0d83f3c 786abacce1dd1074 +ced-mini-q8 32d32451ffb6fd18 5037aa06dbe67ac6 +ced-small-f16 9d6015bf73ff3e5a 8e91876432e5fdab +ced-small-q8 b41291bdfb266e63 3f6dc241027261fe +ced-tiny-f16 77bb23ff8edcb404 48e2a4928a40304b +ced-tiny-q8 9dc401cc3425422b b16f73d5ba63deb6 +chatterbox d3bc0905582d26ee be09084b88c60b05 +chatterbox-tts-crispasr f5113726037c39bd 77e9ae029dcd6a5e +chatty-harry_v3.0 b3beb8334781b31c 48fbc715eb8e0e33 +chroma1-hd de74224c8cec3a26 39209ee65d7c03c1 +chronos-gold-12b-1.0 4601cc97b21b1362 e816a3bbe0f0652a +claria-14b d3f85efca706965f 04bd6afc51acc45f +clef f37996b5aec174df 02a9f8aa6da64df9 +clef-flash bb4011da84eead92 3eb483fddf1a4d3c +clef-flash-q8 3bff18c893ab5c99 4b6b526c96c66dda +clef-q8 24463c04cad3634f 1660a399e3f57aa4 +clm-v0.1-8b-vllm-cpp 3a0cfe5f6c052c37 216af7de16df59f5 +codellama-7b c6e93aad9ea16dd3 760933a05eadb525 +codepy-deepthink-3b 13e7634582358716 5ca000996b5f6d37 +codestral-22b-v0.1 b425811291d74284 08e05258ca198ae8 +cognitivecomputations_dolphin-mistral-24b-venice-edition fb54e107c76a1b37 19e56f24609ccda8 +cognitivecomputations_dolphin3.0-mistral-24b f525b4bf759e69d9 6188cfe896fdbab5 +cognitivecomputations_dolphin3.0-r1-mistral-24b c547e81e38b589b1 b15a748fcb4d0f88 +cohere-crispasr af0a369061d29d2a 204fc975290a74ed +comet_12b_v.5-i1 7825968dc427c235 28e09597e5abd8ff +command-r-v01:q1_s b7aa5cdc98f75987 16834ea44a1a3202 +compumacy-experimental-32b 18ad7b46de97cf14 a941576b75773a3b +control-8b-v1.1 29921780f752ccba 45505fb83840bccf +control-nanuq-8b 5e0c536c8c1d2048 f37b36f9be2f3571 +cross-encoder aff77421f3fdacca 7856ea0157b0d511 +cua-s1-forms-vllm-cpp c754bc2fb6cc390c 713d8ad9f7e92cbd +cursorcore-ds-6.7b-i1 c6a9956e00b11043 700593379ce77045 +cursorcore-yi-9b ba677bcc0312a5dd 8fc0c17b099295ef +cyber-ornith-1.5-9b-obliterated 80e70a4227a78846 5cb7996f7641b296 +cyber-ornith-1.5-9b-obliterated-q6 2d5733a0cbb550dc 2a5c2b56dd0f8ae0 +cyber-tiel-coder-35b-a3b-q4-mtp 5d94e468d9697681 81b560b892a3e7cf +cyber-tiel-coder-35b-a3b-q8-mtp a433d964092aac4c 420ac57667cd8678 +cydonia-24b-v4.2.0-i1 3826503dd484bf90 64f6d4ba637d3982 +d1-3b-q4 c0a74118334d64d7 4f79fc7256fdeed5 +d1-3b-q8 b114a3b2cd6d17fe f92b60cd31606cce +daichi-12b cf2527c578865954 b27c4b7f0b34471d +dans-personalityengine-v1.0.0-8b 17e5e77de1318103 bce8cba1dcd47724 +dans-personalityengine-v1.1.0-12b 2982671d90e50238 bed8be93e11c1ec5 +dark-chivalry_v1.0-i1 88a183e1bf252172 6725a77d72bd608e +dark-scarlett-v0.3-26b-a4b 345f6cd58582bff6 3e9f17ca3470e4d0 +darkens-8b c44b451da760bfe4 3cb9c08e49fd7790 +darkidol-llama-3.1-8b-instruct-1.0-uncensored-i1 d6c9071f8ac9bdc5 18491ae9ec5a025a +darkidol-llama-3.1-8b-instruct-1.1-uncensored-iq-imatrix-request e2a6178737c1f540 cb8ab25c7ae9eac1 +darwin-36b-opus 652bdc2eef7a5882 dc12d62dc62efd9e +darwin-36b-opus-apex-i-balanced 695ff609594e9a2a ff55181f08a8841e +darwin-36b-opus-apex-i-compact 3ffa1df437c83be5 38da2ce171ea98b1 +darwin-36b-opus-apex-i-mini 58a83436948b7eb9 6093e55d13b3bbe5 +darwin-36b-opus-apex-i-nano d1ba9d82a9c052dd 37e4ad4ceb82a176 +darwin-36b-opus-apex-i-quality d22a89383d9d65a5 28950702ce2f3bd3 +data2vec-crispasr 77624c925cdfd009 464d9b2541def8f2 +davidbrowne17_llamathink-8b-instruct f4fb91931ac02c1f ba957ef82d7d7e4d +deepcogito_cogito-v1-preview-llama-3b 4a9b1aae045a6539 597a457228cb2d3e +deepcogito_cogito-v1-preview-llama-70b 7d9b67ac9a8d3185 9bb3be992c01a1f5 +deepcogito_cogito-v1-preview-llama-8b 115f8aadba8901a9 f11bc3c72ca148bf +deepkat-32b-i1 9b3a8e3e954ec990 6914035b3db249c2 +deepseek-ai.deepseek-v3.2 6e175074a413bb8e 2241a916006d3fe3 +deepseek-ai_deepseek-r1-0528-qwen3-8b f61144d5a052f37c 949322f79e0b1d6b +deepseek-coder-v2-lite-instruct d6d1fdf15629c3f5 dcf6ab58ecf899ee +deepseek-ocr a72d1801435c53f4 156d6a065e540ae3 +deepseek-r1-distill-llama-70b 620e4059d79fa4d9 b5fb03b67e226774 +deepseek-r1-distill-llama-8b 50981d382027dd30 4a155f5256b74a94 +deepseek-r1-distill-qwen-1.5b 79c6d1f611e43bf9 cbf261827ba7d624 +deepseek-r1-distill-qwen-14b acfe5e6f234d9ab6 e56ca704e25a0fc7 +deepseek-r1-distill-qwen-32b 17d0c821868988a1 5659d087e792a13b +deepseek-r1-distill-qwen-7b 4df15ac5fd3364f3 e39ea66b60118f08 +deepseek-r1-qwen-2.5-32b-ablated d812ad33ce6089d7 db5864f46f3cf38a +deepseek-v4-flash 811865e4aecc4374 f6e7cc85f8a5bd46 +deepseek-v4-flash-0731 1a51ec15657ae627 fda942899666d561 +deepseek-v4-flash-exl3-3bpw-vllm-cpp d03ce5dd080b7c1d f8405578901af034 +deepseek-v4-flash-q2 8cc788b98b2602de 283688a541bfc13a +deepseek-v4-flash-q2-mtp 71c14710670cca19 d2e334bdb136bd2e +deepseek-v4-flash-q2-q4 ed8116cb4cab07fd 1d3f0b7359e1b686 +deepseek-v4-flash-q4-ssd eb3e170ebf067713 5a998bab5c4dae79 +deepseek-v4-flash-spark-exl3-vllm-cpp b01c33d87e56d7e1 c1eb97a1c918c22e +deepseek-v4-flash-vision-exp 3230385096e0bc44 517e5d6c38fce69b +deepseek-v4-pro-0813 40fb4b9bca51dc13 34c2ca3c924a53dd +deepseek-v4-pro-q2-ssd f36569b64b6db29e 81310b76dfd0bd43 +deepthought-8b-llama-v0.01-alpha 4cacc80df0ef2407 0b61f076599d4743 +delta-vector_archaeo-12b-v2 c172d3c45c2a21dd e61b3cbd51d29312 +delta-vector_austral-24b-winton 3a7678ec2cb3e8c2 91058e11cdc27de0 +delta-vector_plesio-70b 2f7669e6820306dd 674614800527af70 +demyagent-4b-i1 86cd1196258f4944 84f30b55655e9e3d +depth-anything-2-base 7448fe698075f91a 48c55cdff6ae5f75 +depth-anything-2-base-f16 c66302988760fa51 dca04eb5c05865b1 +depth-anything-2-base-f32 db5a816e38e8e748 2378ec58fae4b33d +depth-anything-2-base-q8_0 f4f5166f426fe0db b298c8c5b88c732e +depth-anything-2-large 2116d9eff96d3558 d46c479c877663de +depth-anything-2-metric-hypersim-base 26abc72b78ed401b 6f5469aa2f6be75a +depth-anything-2-metric-hypersim-large 62e3158a4e3d3281 7dc1de18b2dbca55 +depth-anything-2-metric-hypersim-small 6c08255e33ff10bb daff52c8a90badce +depth-anything-2-metric-vkitti-base c919340e6d07d28a 09e2366b1f61ef44 +depth-anything-2-metric-vkitti-large d1a9e44f9e2100b4 dd7f290cea3cd6a8 +depth-anything-2-metric-vkitti-small 0e8f8a2c64668c3d 710407f529cd6bfe +depth-anything-2-small 3a40b138ec6d4360 9ac2858597006c94 +depth-anything-3-base ccfd4162685e3f51 132a9847b0344c96 +depth-anything-3-base-f16 04c3f53109cbc0d0 6ff9c0af3a92deac +depth-anything-3-base-f32 ddce558436f675bb 432f7d606ca10dff +depth-anything-3-base-q8_0 38597fc58e7a7d8b cb52b38720fe4bef +depth-anything-3-giant c63f34d9106d0ed2 a897d31fb729495b +depth-anything-3-large 3b6eeeb652e7241d 4608bd2c11706d96 +depth-anything-3-metric-large f2a79edaad9547ab 77c1c48a90c7eaa2 +depth-anything-3-mono-large a0c127ec8550d3a9 871451ad34488b33 +depth-anything-3-nested 303d206f78fabf5d 2b13542ee945ac41 +depth-anything-3-small f578b46c2c44634c 7ed02c7293a2b7e9 +dfm-mimir:vllm abb277bef55cde18 235ac689c3d6e2c3 +dia ab6508a17d4c094d cc60316aca090e04 +diarizationlm-gemma-4-e4b-v1-q4-0 a43d6c28d9694be3 75ba9e5c6380cc86 +diarizationlm-gemma-4-e4b-v1-q4-k-m 5c99dc57e9d4802c e71e352a143f3f05 +dirk-qwen3.8-27b-q4 2a30844fe075148f 9706c9191b40c4c0 +dirk-qwen3.8-27b-q5 fada57a81047bf93 0b2345699f48eba0 +dirk-qwen3.8-27b-q6 310de57cb6fddece 0d9f55afc78138a5 +dirk-qwen3.8-27b-q8 7e02dc8b81c3054e b6ef24c0a3302102 +doctoraifinetune-3.1-8b-i1 d648f31525ffbd06 d1bcbcf6859cc3cc +dolphin-2.9-llama3-8b 5993fd118a0ee4da 984bfbf4f71ffa53 +dolphin-2.9-llama3-8b:Q6_K f6583b95b7d1aad8 943cf95fe863d2fa +dolphin-2.9.2-phi-3-Medium-abliterated 0e44fc8c322e5ce4 345a17ed50e41bfb +dolphin-2.9.2-phi-3-medium d4b0ba9953e36253 8b8648913f82abed +dolphin3-cyber-8b 3ed20c16cb40470b 60e027701998b5df +dolphin3-cyber-8b-q8 afd0a30569667713 a0a2e8425ccc6d44 +dolphin3.0-llama3.1-8b ba7fe3903310cf97 e11626044fafba61 +dolphin3.0-llama3.2-1b 39bca4dfef9a5d67 0d24cc2f863170b3 +dolphin3.0-llama3.2-3b 4d2df7a468a8b433 94121b19232adab9 +dream-org_dream-v0-instruct-7b df56e12c872d1751 d4daab10f01f8f85 +dreamgen_lucid-v1-nemo 9845e9b6591a5eee 59a181fe4010fdc0 +dreamshaper 8b7f45ffb62bb63b cd5e7fdef86c24d2 +ds-r1-qwen3-8b-arliai-rpr-v4-small-iq-imatrix 095bec9644a16d52 7f7cbd629cc41849 +e-n-v-y_legion-v2.1-llama-70b-elarablated-v0.8-hf a6bd6fd1e8ab5ab8 941983d73b7070d2 +edgetam 14b1c73d9642679d 30029cadcc070902 +einstein-v4-7b d998a5a891cf6501 c7bc48d16ab30d9e +embeddinggemma-2 a9ef7ac0f94ad4d3 cca9995ead4d1782 +embeddinggemma-2-bf16 a7b718b57d61cf67 0f5dd63cd27a8719 +embeddinggemma-2-ud-q4-k-xl fe3341f7fc8491d3 1f9cc54d88539583 +embeddinggemma-2-ud-q5-k-xl fc4b972082e9d6e5 30a1c325d4336ef4 +embeddinggemma-2-ud-q6-k-xl bb08d5d5a8a4881d 9e89abf0185b9604 +embeddinggemma-300m 78bc7100742e54a6 c9b209650d04c398 +entfane_math-genius-7b 8967ca10d8877696 5b66b0f7c75117c7 +eurollm-9b-instruct 99adcf0088315383 a6c3b457ceaf9261 +eurydice-24b-v2-i1 d7837f3d31239bde 732a69340f2c2da4 +evilmind-24b-v1-i1 2f7ee219fb70743e c6dcbee706d3098c +eximius_persona_5b 1bf4fe286139e21c 97fb2a4c04e43084 +f5-tts-crispasr c79a0f4d0eb88b08 4d48aa667c13b1f8 +face-detect-antelopev2 f35f6f63fae8043e 6f345eb94cab84bb +face-detect-buffalo-l 4d5e9c46418dfcdf 249f8a0e75b04cec +face-detect-buffalo-m b512cad7685eff78 77f721b1c4128038 +face-detect-buffalo-s 5b663adff8051900 5db38e76f5c05f76 +face-detect-buffalo-sc 1ba6e65c28be69b7 05bd663e40c545b4 +face-detect-yunet-sface 2a5a3394ae883ef0 958d38655945bf1e +facebook_kernelllm 17d3fcaa08b7aaaa 62270dbf191153f0 +falcon3-10b-instruct 8354237b43dd2466 92d8a7d90364fccd +falcon3-10b-instruct-abliterated 8cf5cc6a7d1318a8 9138b949e6c3c453 +falcon3-1b-instruct 992973f1351bb116 efe5dfb1b3d16b48 +falcon3-1b-instruct-abliterated 599fb460655b7267 94489399c761110b +falcon3-3b-instruct 04c6408fee6b97d9 487631e5b31685cb +falcon3-3b-instruct-abliterated ba1d53083bc7cc23 cbcc052cd4081626 +falcon3-7b-instruct-abliterated 3c5735f999d2c19b 0f26cdf9e74c6331 +fallen-safeword-70b-r1-v4.1 ca5afa6b90a09212 1d12e08781714bd9 +fara1.5-27b 5463d4cc594f421f 6401086bd43da842 +fara1.5-27b-q8 140f5957f990228d 047920d5f3d100fa +fara1.5-4b 7ca148a83ade2637 abb732e9bb138280 +fara1.5-4b-q8 6a480b447cd1237d 2fb17a516a0c80ca +fara1.5-9b 7a6ae7084af49e47 58cd52f4ed8e10f3 +fara1.5-9b-q8 c8c3202a0a959726 039ec99a70c7d043 +fast-math-qwen3-14b 87a4ddee8d1bebd1 66771e90fbd21995 +fastconformer-ctc-crispasr 5b45d9615029a0cc 48874506a7df766b +fastllama-3.2-1b-instruct 5bef8196494a5e1f aa47412744dfa5e8 +fiendish_llama_3b 65a0f5b0c15d7388 bb840c9d2fa388af +financial-gpt-oss-20b-q8-i1 0dbd3049a32d9c99 32e1ab90e0729a11 +finemath-llama-3b 5f70ca639b4a7976 7ee95aeb42283ba8 +fireball-llama-3.11-8b-v1orpo 046870589e4f4f46 7a54bf1184fcd86b +fireball-meta-llama-3.2-8b-instruct-agent-003-128k-code-dpo c40009dbe7f99847 6484ed284c6eaa4a +firered-asr-crispasr b3f5614b48b26a41 47f2f22109610a65 +fish-speech-s2-pro 3a8ea397b22e54c9 8884326d313b70e3 +flux.1-dev 3f8b7e7f48535bfd 73f00c6fe037177f +flux.1-dev-ggml c2d58dca2895d58a f7120dd71619ab9b +flux.1-dev-ggml-abliterated-v2-q8_0 c9a466f1488fe6cd c5508ce46d126619 +flux.1-dev-ggml-q8_0 a07175eed49bb613 dbbd83df747ddb5e +flux.1-kontext-dev fb95b735b02812b5 dbb073d213d2f55b +flux.1-krea-dev-ggml 3f2bd9ed6ed13c55 27463644adf0246e +flux.1-krea-dev-ggml-q8_0 273a9e64d440c6b4 3aaa896451441069 +flux.1-schnell ee39353350e1d44b e0d46d59511157c0 +flux.1dev-abliteratedv2 b1a955c3f7839c49 88c2aadc1f3dfd4c +flux.2-dev 507131a85c491671 6ec955d69fec22f5 +flux.2-klein-4b 8c33998cd573000f 44b92ed078d186b4 +flux.2-klein-9b 5a08603517d0b12e 2d79e46d8c5ace70 +flux.3-image-klein dfa4f8806f96286e ad5ddf1984f6249c +flux.3-image-klein-base 396651a90e2b4547 3a35b0f3c9893c68 +flux.3-image-klein-base-q8_0 9fd0558704021662 cea9b486299f4c9c +flux.3-image-klein-q8_0 fcde345f1da7147c ed02b66ea0359838 +forgotten-abomination-70b-v5.0 cab3dab05ee6117b 85cd6f45a9f3358f +frognano-4b-2609 370e82d3ef60fd32 09f950fc3e28d8cd +frognano-4b-2609-q5 773d1e1ada537ca9 86e0e192b191962f +frognano-4b-2609-q6 6fd6580e4f49a23a 58b1b4de6741b6e2 +frognano-4b-2609-q8 4487573355ae0a5b 0ff65ca41889023a +furina-8b b5bed2579fe243f9 3c5c646b4dd86f47 +fusechat-llama-3.1-8b-instruct cbb9d4c5c4f7a7c1 3b3f5b5a1167ec12 +fusechat-llama-3.2-3b-instruct 489f6f9caf59a752 b02fa2a9f2101e77 +fuseo1-deekseekr1-qwq-skyt1-32b-preview 405e14cddb177887 d75800766e785852 +fuseo1-deepseekr1-qwen2.5-coder-32b-preview-v0.1 fecc4859c2ae5e35 a08596f87ec8d0ae +fuseo1-deepseekr1-qwen2.5-instruct-32b-preview 1f03010429f33830 93dc2c70bf377b8b +fuseo1-deepseekr1-qwq-32b-preview 67efcd3e3d1369ae 375af3ce1a0bb017 +gem-x 3acccfb073c37732 197b8bea5c354bcd +gemma-3-12b-fornaxv.2-qat-cot ec1ae450ac2d77c9 47d04ce6fa06ca8e +gemma-3-12b-it 33a118b0c8a74bae 76356dfffb86c72b +gemma-3-12b-it-qat 20e9a7436d9be97f 2158603eb858d512 +gemma-3-1b-it 66c346909cf6c968 704a789c7c42a6c2 +gemma-3-270m-it-qat e4cdf7f4b5dcd565 5b12f2da87880e8c +gemma-3-27b-it 90d1f861afd9d638 cb158dac8f289748 +gemma-3-27b-it-qat 3fe600674197000f 8f71560ce32ecf08 +gemma-3-4b-it 11d812e05534ac87 b24c487956a054f1 +gemma-3-4b-it-max-horror-uncensored-dbl-x-imatrix a49d0c8c26da0e4d 6a0d49f889c81db5 +gemma-3-4b-it-qat 29cbf8a3fa40a123 962f4802b319bd65 +gemma-3-4b-it-uncensored-dbl-x-i1 1c78472893578f69 55504be3822e833e +gemma-3-glitter-12b-i1 fe622d12e5bc5374 1cdff8ab3b45b7fc +gemma-3-starshine-12b-i1 adeec64ccb7544a5 6547e392754bc8ac +gemma-3-the-grand-horror-27b 4a66539fcb0619b6 753a640209a1c7fc +gemma-3n-e2b-it 720756d894f1262e 0ff846990195037f +gemma-3n-e4b-it 75f4bfca8060d0fe c41f7c18bb6d3766 +gemma-4-12b-agentic-fable5-composer2.5-v2-3.5x-tau2 029d0143ad8639f1 34774cdad9db17ae +gemma-4-12b-agentic-fable5-composer2.5-v2-3.5x-tau2-mtp 12d577fbb015b2b3 2e35245981c82db8 +gemma-4-12b-agentic-fable5-composer2.5-v2-3.5x-tau2-q8 d62e94108ccdce5c 6954751f37338ed5 +gemma-4-12b-coder-fable5-composer2.5-v1 7bf66d0a9086fde5 43a4a198c079d361 +gemma-4-12b-it-q4 0240c2193a78645e 87bcd81cedbc2b8a +gemma-4-12b-it-q5 c7e197bdeefd949d 9dd63d5245af3a7d +gemma-4-12b-it-q6 3948cd3370dfe897 8884092a45ace11b +gemma-4-12b-it-q8 913304050eb662ea 3a869f584c1eed84 +gemma-4-12b-it-qat-mtp 5ceaf2b6ac1b402a 84d9e0e55bda6ffb +gemma-4-12b-it-qat-q4_0 f757674407f08bca fef3c9f8ea944a80 +gemma-4-12b-qat-hauhaucs-balanced 526f1d0d3e6c1c44 1f1a695a78cfd8dd +gemma-4-12b-qat-hauhaucs-balanced-mtp 307d8df5e5f7f612 f1089ee245745b57 +gemma-4-26b-a4b-it 5c71626fd438afdc 2473830004d88b77 +gemma-4-26b-a4b-it-apex 8d980f11a24fcebe 63d11784a5b358c7 +gemma-4-26b-a4b-it-apex-i-balanced 65f7914bfa750cc7 83b43af3229cdc79 +gemma-4-26b-a4b-it-apex-i-compact ebc5925e89c814a8 3faef7991ccb6b89 +gemma-4-26b-a4b-it-apex-i-mini 0dd94f4f35f527fc 9d3a48ce190ac036 +gemma-4-26b-a4b-it-apex-i-nano bfb9230d64dc8f06 b2e9989ff9b06791 +gemma-4-26b-a4b-it-apex-i-quality 6d59e724a81160f9 ce3de7bf26b9e51c +gemma-4-26b-a4b-it-claude-opus-distill 566a8c893c281560 ca93b103674cad66 +gemma-4-26b-a4b-it-claude-opus-distill-apex-i-balanced 5525c7d709da6f19 8bee43d13f771e98 +gemma-4-26b-a4b-it-claude-opus-distill-apex-i-compact b7ccc427d5da33db d868d95e03ec1cee +gemma-4-26b-a4b-it-claude-opus-distill-apex-i-mini e5406f6f4da78285 c579554107bafd6c +gemma-4-26b-a4b-it-claude-opus-distill-apex-i-quality eb3cec2514ad88e8 f4910a682e7539b7 +gemma-4-26b-a4b-it-heretic 368dd6f44e8258d9 d8851e8bcf60ecf1 +gemma-4-26b-a4b-it-heretic-apex-i-balanced 006f9297302aba72 e0bedd02afc3ef25 +gemma-4-26b-a4b-it-heretic-apex-i-compact 45a0c073ef3363ab ca96e06b3bb94e76 +gemma-4-26b-a4b-it-heretic-apex-i-mini 09627f2e0ccd039e 7f71b4e96ca6965c +gemma-4-26b-a4b-it-heretic-apex-i-quality 2f82fe1ad7ac0bde 614e091de2192624 +gemma-4-26b-a4b-it-q8-0 7737bb3ec07ba91d f157612d41977cb3 +gemma-4-26b-a4b-it-qat aab993359c9ad8d4 fcf4adeb55673111 +gemma-4-26b-a4b-it-qat-q4_0 d9b04a6df709c9d9 dd1844a7a597eab3 +gemma-4-26b-a4b-it-ud-q4-k-m e4bfcf72a2e8b966 8835e01cb4061e32 +gemma-4-26b-a4b-it-ud-q5-k-m 3c6c7042933953a0 cbf8fbedaebe5063 +gemma-4-26b-a4b-it-ud-q6-k 1611c3a811727299 910fa4ff6eae5118 +gemma-4-31b-fable-coder-q4 2881d64a79c98ce2 9e7363d5fc0b4eb1 +gemma-4-31b-fable-coder-q8 982f70079bd15ad3 7c0ed7c78752e784 +gemma-4-31b-it 219b9f3879b10dfc 9abda7396bf92e24 +gemma-4-31b-it-qat-mtp 952e3ee4338653a6 088eda31dff19b3f +gemma-4-31b-it-qat-q4_0 06a7de265c5028ea f2c03a137c2e7e7a +gemma-4-31b-ortenzya-q4 1945a9918e96ef9d 554d1e1d34604d72 +gemma-4-31b-ortenzya-q8 c813fcfbff37b81b 1ed76ca2e58b265c +gemma-4-31b-scotoma-2-q4 d2bc4d4acab0839e 577fccbfe9e5fe00 +gemma-4-31b-scotoma-2-q8 eba442598ed90593 26cfb94e45b7ba4c +gemma-4-e2b-it 43993c3b374b6265 2b4a782a73c9a85e +gemma-4-e2b-it-qat-mtp e8871bb4da130026 74a2d9062ad3da19 +gemma-4-e2b-it-qat-q4_0 e9bb63d64d6f11ca aa5e291f1ceeeb86 +gemma-4-e2b-it:sglang-mtp 551bd9200e57a620 2e121310cde6c717 +gemma-4-e4b-hauhaucs-aggressive-q4 40134bd51072efff a904295502d44f4e +gemma-4-e4b-hauhaucs-aggressive-q5 f8055b7a2b100d65 5bba7c1651ed070b +gemma-4-e4b-heretic-q4 bb7a2cb673099066 1555d91bce60f92e +gemma-4-e4b-heretic-q8 fab91bf3fc5bcb99 c2a060effd8fd8dd +gemma-4-e4b-it bddf15293cf9175f 9ef9c650cf0495a8 +gemma-4-e4b-it-qat-mtp 1bd7d343b515fe45 4b4edc7148bfc1be +gemma-4-e4b-it-qat-q4_0 39ac3fba09d34b8b 411e6733faf225d4 +gemma-4-e4b-it:sglang-mtp 724103d072d856a2 91f690eb74234491 +gemma-4-e4b-obliterated-q4 c9dae78229e43765 5c5e142877c6ca83 +gemma-4-e4b-obliterated-q8 43e5dfb74eeac035 f61ef03124b3c277 +gemmable-4-12b-mtp f99180748c698b3b f626e179ac415a22 +gemopus-4-26b-a4b-it-preview 3a449fdb84aae9bc 0aeec9e6c8def6ce +gemopus-4-26b-a4b-it-preview-apex-i-balanced a6998d263930a501 8d042f1c4b1e685e +gemopus-4-26b-a4b-it-preview-apex-i-compact 3e8515133d43bd45 5d6e3d64ad855fc2 +gemopus-4-26b-a4b-it-preview-apex-i-mini b4c8d727bcb48ffd 5d82bb4bbf0d66b6 +gemopus-4-26b-a4b-it-preview-apex-i-quality 64a69f7cd31fb148 bad9799c77fa975c +genericrpv3-4b c40b63fbcc05befb d44f48ca53028d10 +genius-llama3.1-i1 66a4516b3d1127a1 72be374e898003c0 +gliese-4b-oss-0410-i1 2e2a7cecf9939187 000d42d97d8629ac +gliner2.5-vllm-cpp c96c6f9d0e96e419 390f2b37bc2a0b38 +gliner25-decide-vllm-cpp 5fcb1856d135cf1a 5a7aa8da2d16e3df +glm-4.5v-i1 e2516ad3c2ed4308 1c09030b342dc171 +glm-4.7-flash d658257120b75063 0ffbbf1e435272e1 +glm-4.7-flash-apex-i-balanced f3ad3d748090fea8 f08450aa36ae2764 +glm-4.7-flash-apex-i-compact eaa6442ff650c5b2 ae99289da65c6704 +glm-4.7-flash-apex-i-mini f1b800d2850b81a3 d533fc400b8f8f90 +glm-4.7-flash-apex-i-quality 9d030993b8675f5f 203a0b244554c961 +glm-4.7-flash-derestricted 57bc20e0f1a9b3bc 900fdc4dbc697fb9 +glm-4.7-flash-q8-0 805c5c7096dfe1ab c8f519f2918dba90 +glm-5.2 36cf1ddceb5ba805 e56f08ce507ef07c +glm-5.3 4af35f1e0f057b67 b6cc2a736ed14b86 +glm-5.3-flash fec6c68f48b98fcc b1d5348d8ca45a7d +glm-5.3-flash-q4 4a60a35a848245c2 6e1b93bef8cff552 +glm-5.3-flash-q8 c01a54defd755c10 2bdc4310270b5099 +glm-asr-crispasr 17cb027fbd0d8eb0 0fea961e3919846e +glm-ocr 6d3f9d8dd96e2491 efe4c152debd3592 +gmcoder-9b-q4 cf82010c46ad6b60 2b28a3a9a7ffcecb +gmcoder-9b-q8 e75cebf0b40907c2 91329a9b804034f6 +goekdeniz-guelmez_josiefied-qwen3-14b-abliterated-v3 af03c2f347854078 f235ce2a56e3156e +goekdeniz-guelmez_josiefied-qwen3-8b-abliterated-v1 d2b5f58f5c766747 e12d1fd4edc62f99 +google-gemma-3-27b-it-qat-q4_0-small 973517a363c279de 3c3f3deff9929960 +google_medgemma-27b-it 4c17b3ed2b8d1617 b2c45571efd706dc +google_medgemma-4b-it b7de5834a1309261 daeed12f4c98da24 +goppa-ai_goppa-logillama 385150aefda71dec fd7dcd03fb2b4f98 +gpt-oss-120b 87211f6b12c7f3f8 0d1857c6685b29e8 +gpt-oss-20b 9033c37d2ff61f50 abb6698ddec1cef4 +gpt-oss-20b-claude-4-distill-i1 8dbbbc6d88898232 075ddb8318faa77c +gpt-oss-20b-esper3.1-i1 60e00bde08c3f2d1 0437dd65aad2848f +granite-3.0-1b-a400m-instruct 1ba76659556aa56a 2e3fd713de0b1c14 +granite-4.1-crispasr 9c06f111efc42d4d 845b2211a5369271 +granite-4.1-nar-crispasr aa06aa7332411106 70ef6efe68d062e1 +granite-4.1-plus-crispasr 8b7be6b3f7da4c2c 0f38e8d214b8d7ce +granite-4.2-30b-q4 f5cba99414451314 9a29b827c1b67b75 +granite-4.2-30b-q8 1839f3b0596821d1 cb5004149dc14bb1 +granite-4.2-30b:vllm 3c21f22b8f129f6e 538540d12c087d2e +granite-4.2-3b-q4 a0a46da7cf1001c4 23e2ab674dfc7a8a +granite-4.2-3b-q8 f3b05f5cda9e9d3f 7b27c78e8974695a +granite-4.2-3b:vllm 6fc61edf840fb67f 502878bb3541bcb7 +granite-4.2-8b-q4 6ccf82d0bb71be41 8354ce261df75fdd +granite-4.2-8b-q8 4ce490c45f4da3b9 2ad745f8801c500c +granite-4.2-8b:vllm 50ce17681d307f9e 4ec731884feb410d +granite-crispasr 3ac784a1ef977641 0b9856f341f8e641 +granite-embedding-107m-multilingual 95ff7292a0c1de47 d9da611206f15ea1 +granite-embedding-125m-english a7157b74b3eae730 5e3587fce32a6c28 +grovemoe-base-i1 eb2a32ed21edcea2 075175d9e09f58e4 +grug-12b 60fa836b643d1971 767a8c38aad3c101 +grug-12b-q8 01f5f29f04be75f7 d1bc502d5efce054 +grug-27b 909bd35b89a8aeb3 00385621c455d1de +grug-27b-mtp a9d1f46094d2226b 06a6558922e156e3 +grug-27b-q8 009bbf44cf1176b6 b2bdafcc4c3e36e3 +gryphe_pantheon-proto-rp-1.8-30b-a3b efe68dd04b3f4bc5 1888baee3371a7cd +gryphe_pantheon-rp-1.8-24b-small-3.1 e354173034cdb80e ac48cef17f9c84ef +gui-owl-1.5-2b-instruct 2156fe691c6f1e30 c0c73049e9670ab0 +gui-owl-1.5-2b-instruct-q8 e13bb5b2722b7bd5 851869280219baf8 +gustavecortal_beck-0.6b 160b9b512065ef60 d46cc5cbbc2111db +gustavecortal_beck-1.7b d807185f4e204310 1c2b7cdb130cca91 +gustavecortal_beck-4b 68544cc092c63bf0 ccb93ca3acb2bf95 +gustavecortal_beck-8b c77f14d7eeaddc34 d54cf1e0460e1699 +hamanasu-adventure-4b-i1 45e806c4bac5bab8 f1128f302d66bb09 +hamanasu-magnum-4b-i1 3d6ab739990db152 8e6cb279cd342b36 +helpingai_dhanishtha-2.0-preview 17e05f30dbcb995b fcedb072152daa1f +hemmingway-1 ee25051642f34ad3 d7899abc2c897add +hemmingway-1-heretic 77a36bdce672fadf 75dcac16c3ec8b96 +hemmingway-1-heretic-q8 8f88e9efe0264959 e66c47ecc07e073c +hemmingway-1-q8 b11dbec9d088c20d a2af2cef4a6b6c4c +hermes-3-llama-3.1-405b:vllm ef9062b65c2939cc e83154d1c0d5e492 +hermes-3-llama-3.1-70b-lorablated 692bfd73855820b7 bb515f03ae3109bf +hermes-3-llama-3.1-70b:vllm 63ee50376ae5108c 6f45919be0ccd07d +hermes-3-llama-3.1-8b-lorablated 0bedea1f4b0ca541 035d4dd3409e4205 +hermes-3-llama-3.1-8b:vllm 484c280a16d6062d cb14abf89ba21916 +hermes-3-llama-3.2-3b 74f55081cbcbf257 a449c3aaf14c81ba +holo3-35b-a3b 219dab4a7a15da87 faee153a09dc71c6 +holo3-35b-a3b-apex-i-balanced 652de50f0197d537 e01a4f1ed79849fc +holo3-35b-a3b-apex-i-compact 613fe169c23c6c28 bf2e291fa83dcff8 +holo3-35b-a3b-apex-i-mini fb207a9a5576dac7 804f58d7b4b3d0f9 +holo3-35b-a3b-apex-i-quality 13632de77a0df0cf 45482ba291c83899 +holo4-27b 3f9eefb1bc59b2b3 221f6cf468c3ade1 +holo4-27b-q8 8d3df44a8ea643d2 a8850aa43ccb7a55 +holo4-35b-a3b 4313590842338e53 4db214fa16ef933a +holo4-35b-a3b-q8 154c8bac5784f2d7 b9374da386fa942a +homura-30b-q4 ada001e2f0417dea 590972835e913e43 +huatuogpt-o1-8b da469bcf22a61667 c8941ee7f962452b +hubble-4b-v1 e17c47baf3a82e01 b40afc9e3098b327 +hubert-crispasr 1d751b732682c934 5e57c541a1bafed5 +huggingfacetb_smollm3-3b 3dba525643f44d38 d06a349807d48142 +huihui-ai_deepseek-r1-distill-llama-70b-abliterated 1e6aac918cebfc5a 08731d680af53a6c +huihui-ai_gemma-3-1b-it-abliterated 61b77a8b5888f003 9c7d7a1775fbacdd +huihui-ai_huihui-gemma-3n-e4b-it-abliterated 73ba6d648f06f5a9 61879e90abc5f214 +huihui-ai_huihui-gpt-oss-20b-bf16-abliterated 1e9442d1cbda3feb 70b3f77cd58d29b1 +huihui-ai_qwen3-14b-abliterated 935455016f9d87c4 5fffce963fbd1ae6 +huihui-glm-4.7-flash-abliterated-i1 e2461cf4a1b3d676 cf0642d389b5ae51 +huihui-glm-5.3-flash-abliterated d52f73950d1e092d 206e60d641a68e6f +huihui-glm-5.3-flash-abliterated-iq4-xs 5c0d755a6309eb37 260666c4b8320760 +huihui-jan-nano-abliterated 9dbfe0829d0cbf7c 0318d88afc1cd27b +huihui-qwen3-vl-30b-a3b-instruct-abliterated d0a4c16edb9824a7 f95cc8062a3ba6b8 +huihui-qwen3-vl-30b-a3b-instruct-abliterated-mxfp4_moe 15520a1edc3d8f31 f61ff524273591cb +huihui-qwen3.8-27b-abliterated f402b08962f34025 d947cb5f69a1bf8c +huihui-qwen3.8-27b-abliterated-q4 92f5ed9efc52fd76 7648625b0f081872 +huihui-qwen3.8-27b-abliterated-q5 7ae6316b78bbfb72 5d2e9a40408223c9 +huihui-qwen3.8-27b-abliterated-q6 139423da0db7c7ae b57c962ed618bca9 +huihui-qwen3.8-27b-abliterated-q8 be2248c4c256098a dca0150cdcbc7df1 +huihui-qwen3.8-flash-next-abliterated-q4 e4bc4fb5cb738008 2a0cdcf879268420 +huihui3.5-67b-a3b 93be86fe2bd3ef65 b2ec993cb137d3cf +huihui3.5-67b-a3b-apex-i-balanced 4c934de96ff892d3 baceb5fa94173199 +huihui3.5-67b-a3b-apex-i-compact 6d7252891ccfe748 a91dff44bc113fc0 +huihui3.5-67b-a3b-apex-i-mini c241a982ec5b27df 4884fb197dc55687 +huihui3.5-67b-a3b-apex-i-quality 9706254387112ea0 f1157346e02b7eaa +humanish-roleplay-llama-3.1-8b-i1 32d4fafc506f7ccf 21d0d50e2101346b +humanizer-12b-iq2-qat 43960a8e29e49bae d5e9053ba5f23747 +humanizer-12b-q3-qat 3f3f7d59e30cdaaa 48ce9fb98a973127 +humanizer-12b-q4 42b5a645cae13fee 7f6fc9575ad08889 +humanizer-12b-q6 2a36371edcbecbb8 429d1377e9e133e8 +humanizer-12b-q8 f0bf1ec75780eb1b d776e0383363333e +hunyuan-ocr-bf16 5d09df5a12b8603b 89f89acfe0011b02 +hunyuan-ocr-q8 df20f45ca36f74f3 75b4fc37cd156d42 +hy-mt2-1.8b-q4 d014dd1fe253a8ba b4bdb45cd0e01291 +hy-mt2-1.8b-q8 f75e09e5cd556830 29d9f9cb7bc4eedb +hy-mt2-7b-q4 9d3a3d6407f8ecd1 3279ba87603eb1c0 +hy-mt2-7b-q6 799bab3d3171570f c40764e05f95fed5 +hy-mt2-7b-q8 974415b7f8563c5d 480ff772c47ae530 +hy3 01d506706ce9810d 65c521b92fd47b83 +hy4-preview f7da8c0b1601ec27 4417633b88360a86 +hyperllama3.1-v2-i1 3a412bdba2019e4e 73034def199f9a4d +ibm-granite.granite-4.0-1b ad540f4d7834d135 e98f844486d4f265 +ibm-granite_granite-3.2-2b-instruct 192930fdaccc01bc bde9bce31c535f79 +ibm-granite_granite-3.2-8b-instruct 54d4d3ecc13c89a6 c12445eced01da30 +ibm-granite_granite-3.3-2b-instruct cf13dc1a245d1d4f 6186752ebb3cc469 +ibm-granite_granite-3.3-8b-instruct 103315143bd5e7c5 a0053a65139deb01 +ibm-granite_granite-4.0-h-micro e2627d3bd60c108f 6994be2c27542920 +ibm-granite_granite-4.0-h-small 1ab9ddc33fdfb7ba a37f2db212c4e9b4 +ibm-granite_granite-4.0-h-tiny 81f7135805c8fb37 8e99339bd33c2be2 +ibm-granite_granite-4.0-micro cbd5557d05eb4fc5 00e82bcb44e4662f +ideogram-4-iq4nl-ggml cbb12f1e0f8260d8 2e78555ec00e1123 +ideogram-4-q8_0-ggml f20b29dcd2aa7a7c 3da41157b408322b +ilsp_llama-krikri-8b-instruct 6f0a29ad31f5984c f391ae74e4e2bc82 +impish_llama_3b e76f8d217dded9ae ff8b543034d730c0 +impish_longtail_12b 028fecc9a5009b8d cba4c857ced24ffc +impish_magic_24b-i1 27a68c5afcc1355e 8532562b3b9c3ab5 +impish_mind_8b b599dba4e330e142 ed24882001a67c8a +impish_nemo_12b cf761960745d8733 9b317c1f094f7e04 +impish_qwen_14b-1m 2f2883bbbd1131ca 87610c9b17067056 +index-homura-2b 29e1a69f7d3489d8 8968b11ccace2cdc +index-homura-2b-q8 07d541bbb2a5fd95 8e5b377bce37765e +index-homura-9b a09d5d376d2e1b7e 8c54a869869d0f17 +index-homura-9b-q8 ac07a7e0119da2cf d26e732a693068cf +index-translate-2b 21172980122a0c6b 176270653c457ecb +index-translate-2b-q8 535b6157b0ead24d 2e01578162482f97 +index-translate-35b-a3b-preview f0eeca5502e7625b 7a194998b589bb2a +index-translate-35b-a3b-preview-q8 c94dea0dc030da1d c71b00f4ed533dae +index-translate-9b d4b24c5c08e582eb aeab9c3d6ddeb7fa +index-translate-9b-q8 ac06946cdeacab9f 7ee4db28f2d57b38 +index-translate-9b-vision f702cdafef453779 22f95a8b89d2fa63 +index-translate-9b-vision-q8 204962e6acfc70dd c387534268bd5823 +infinity-instruct-7m-gen-llama3_1-70b 6a3888a59adbcb3d f20fa5ac7a317126 +inkling f3421dc3cdf6189c 6bab66fb34d44dd0 +inkling-small caa720878dba8954 cf54ae58d98fec94 +inkling-small-iq2-m 5eef27d8c7dbeb4b ea70703e56f66bb6 +insight-doc-8b-q4 952a2f1f96b65407 8afce8a8804e4d7c +insight-doc-8b-q8 e0537f4e3a7911bc b2e5dbf0d3846420 +insightface-antelopev2 fde486ca3a3954e9 3bd01ff61fd39e28 +insightface-buffalo-l 1f52932cc4e6e678 f398fbd1ffccdc61 +insightface-buffalo-m ae811b64251c9775 b29a08e54ec5902a +insightface-buffalo-s 19254b068d79e11f f06bb7f4a52f7032 +insightface-buffalo-sc 11b20d26ebc2d888 1cb4f80579511ca0 +insightface-opencv f35ce57f1c16a30f 240c89ca01000b38 +insightface-opencv-int8 bad887f0ed5dbae7 9e29d46510689099 +intellect-1-instruct 93a79f9a8efecbe9 b26ee1f015e3de4b +internlm_oreal-deepseek-r1-distill-qwen-7b 769065f4e0cf2439 b6932592023a7b91 +invisietch_l3.3-ignition-v0.1-70b b425d68d325aa6fa 88d85957613cbfd1 +iquest-coder-v1-40b-instruct-i1 56470ee643053d81 480b27f5e5cd249b +iris-3b-ggml 23d99f2f75e8c207 35f714958c545da3 +jdineen_llama-3.1-8b-think 12c8422c33e8e46c 37806567f3f35a84 +jina-reranker-v1-tiny-en 6e5de81a09442907 af906e09883e06de +john1604-ai-status-japanese-2025 f98d54dbed626377 892146ab9e77fb3f +josiefied-qwen3-8b-abliterated-v1 2a6ab239b80c0fcd 9d80c6c07715e611 +julia-1-llama-cpp 586468502ec7210c ddbdd3431050d995 +kalomaze_qwen3-16b-a3b 85a3d1aaa3eeca25 56673f15e028164c +kat-coder-v2.5-dev ed91712d65fdf319 d86427b24987749a +kat-coder-v2.5-dev-apex-balanced d38aabbe70dd4130 515510aef1c52689 +kat-coder-v2.5-dev-apex-compact 4186a0d5971c0bf3 0acabfd1b5a0c07e +kat-coder-v2.5-dev-apex-i-balanced a6e3aa5ad93491d0 40cb93ca52da7de2 +kat-coder-v2.5-dev-apex-i-compact f4443018bca67769 4b6be3bdf10d1295 +kat-coder-v2.5-dev-apex-i-mini 74b97a14f318a03c 568c5472377b8d21 +kat-coder-v2.5-dev-apex-i-quality b3f6f7d0e9fb163a 1f2a4db2c98df0bd +kat-coder-v2.5-dev-apex-quality 8b8d544db59a29ee 0042490e91c57696 +kat-coder-v2.5-dev-q8 ed288d2a5d220d20 35b241b74c7b9606 +kev-0.8b-vllm-cpp c313d0fc1cc93390 4a386622051183a1 +kev-4b-llama-cpp 2caa7b3cb0ed33e9 ce779b85b6e51139 +kimi-k2.6 f58a34b86c18bd61 1504ce2fe8bb099d +kimi-k2.7-code c20f9025e8cef796 b2efba883640fd5e +kimi-k3 57f24a2cf2c137db 9e7060be4862892d +kimodo-g1-rp 0b4cad099dbe5976 4b22714f3135f313 +kimodo-g1-rp-bf16 b1cfcff81ce88fd1 d573b3914b2fb76f +kimodo-g1-rp-q4_k 3babdb92d92f0cc2 d187e76a872143f5 +kimodo-g1-rp-q4_k_m 502ec7f43c89a625 e0583d472a2dfa91 +kimodo-g1-rp-q5_k aae11c56a2282b69 7e22daf53e073316 +kimodo-g1-rp-q6_k de6e2ef9ac2d09b2 c3da61a8294190d2 +kimodo-g1-seed 71589394aa9585a2 c947a7fd5d7aa37a +kimodo-g1-seed-bf16 72846db072c11808 f91726b0727094c0 +kimodo-g1-seed-q4_k 415c676bf11465cf 49bdff08af9713f0 +kimodo-g1-seed-q4_k_m a16eee2432f974c8 fd0eef48a3b1246c +kimodo-g1-seed-q5_k 9c1a8e446d92bdcb 89a7144aff1749f7 +kimodo-g1-seed-q6_k e5bae98ffc846028 7d6626258c7b2d49 +kimodo-soma-rp d28c63a23f4a8714 dc25d437ae9ecdd2 +kimodo-soma-rp-bf16 569fe4769d34595e 5eeeaf6db2cb610e +kimodo-soma-rp-q4_k 64985c4bce001ca7 1dfa51ea855d1e8c +kimodo-soma-rp-q4_k_m c24eaa8b6952d25c 2f59de1b6a227e9d +kimodo-soma-rp-q5_k c119ffe82c4e0d45 e6f3c316fec0e2aa +kimodo-soma-rp-q6_k 55f78442fa58233e 1629ec4396e10bf2 +kimodo-soma-seed e1592f93e50547a5 e5a6a5c4e44d1514 +kimodo-soma-seed-bf16 ee14fb9d89f9efc1 5cc5d062de3e253e +kimodo-soma-seed-q4_k 650d03d463e063a4 056c66ae5073f7ba +kimodo-soma-seed-q4_k_m 070594f411a36a9b 56a5303f4a8b0604 +kimodo-soma-seed-q5_k 9f213be46feb3be6 d11e73568f9e2c60 +kimodo-soma-seed-q6_k ebfe851dfeff6796 23fab57ba53e3100 +kitten-tts b6f45d93bae8488e 98a23814a460e6d4 +knoveleng_open-rs3 1f67489d304fc7ec 8d7efad0edfdd103 +kokoro 9dd9a7e71227a6e5 971441cf75e2edbc +kokoro-multi-lang-v1.0-sherpa 2cd3a7a05845f894 5bfcc61227734017 +kokoros be130b3d6b1c597a 406c33793bc44c35 +kokoros-cmn 9ee627c555902023 f44a659e34c3d724 +kokoros-de 25400180f36f2263 3851ee196ac0fe48 +kokoros-ja dc62958fe5550665 95872cae2d08d38a +krutrim-ai-labs_krutrim-2-instruct a0aa51e2d83031b3 ab24c37f3e537a39 +kubeguru-llama3.2-3b-v0.1 8e1d5de06c3cd616 2d102ecbffcc5b45 +kumiho-v1-rp-uwu-8b 0d71a5bae8ff03e4 1870e50dfdbcfc2c +kwaipilot_kwaicoder-autothink-preview 7b02526cf13cd3f4 4e6c62ff8dbeb140 +kyutai-stt-crispasr 6a1a210ca4de7068 5ebbbfc068dca1cf +l3.1-70b-glitz-v0.2-i1 0a06495cd28b9ab6 3bbd69adc2069a42 +l3.1-70blivion-v0.1-rc1-70b-i1 7f50f83d0158ffa9 223164fcda00a11e +l3.1-8b-celeste-v1.5 51313ae32b4d2cc4 392d388a6e106fcc +l3.1-8b-llamoutcast-i1 7a7687ee5d16a254 5eb94402ecbc5c81 +l3.1-8b-niitama-v1.1-iq-imatrix 0793f8f5ab4ab100 3ded60d1f72692b3 +l3.1-8b-rp-ink e5d44dbd10f8c919 4395ea89f67c48d1 +l3.1-8b-slush-i1 9398f131fda72789 c1eb3a31df83b924 +l3.1-aspire-heart-matrix-8b 13162fc6d1c515b0 1783a6e13c1dc0dd +l3.1-etherealrainbow-v1.0-rc1-8b 30a4801e8ad3c4fa 810b1f1f083e8583 +l3.1-moe-2x8b-v0.2 dd3b861885fc3338 34ced4e4a20442a6 +l3.1-ms-astoria-70b-v2 9153739491f0abeb 94c883ee4dcd5552 +l3.1-nemotron-sunfall-v0.7.0-i1 14e94c350708b5f7 38a3e474a80774c3 +l3.1-purosani-2-8b f191ceeda0313cfc 5c0eea98aa5ecea7 +l3.3-70b-euryale-v2.3 308963364e007e89 d3f57310a05a96dd +l3.3-70b-magnum-v4-se 7324b1b8698f941a 27403c109b66d8e4 +l3.3-genetic-lemonade-sunset-70b 6a37dfa38d666d4e 5048eeb54b2767ba +l3.3-geneticlemonade-unleashed-70b-i1 14b0f5d9847097da 7821e88d1cf2ec7d +l3.3-geneticlemonade-unleashed-v2-70b 0236ecd801fdffd7 7c0403d86134f743 +l3.3-ms-evalebis-70b e57e2abbe54cb2f8 cd6b6910da40bd4d +l3.3-ms-evayale-70b 9afaa97873411c50 fa6bfa32b155360f +l3.3-ms-nevoria-70b d9a7158a6a03fe99 feb24e6b993d8666 +l3.3-nevoria-r1-70b 2d984fbcc3dd3592 a4b483b87e72b783 +l3.3-prikol-70b-v0.2 8216b65bb59c35bb 35cd12274a583cd3 +laguna-s-2.1 20e79232fbc9108b ee3fa0c4514b2975 +laguna-s-2.1-apex-i-compact 370cf7bcbbf1fabd 2993627c5166a4af +laguna-s-2.1-apex-i-quality 777be6896a2e7221 226907b519bb84e0 +laguna-s-2.1-dflash 1e420b8a11bee81c 2bebb46f1dd93ce7 +laguna-s-2.1-q8 7d343bbca815b824 bbc2f91e8b7663dd +laguna-xs-2.1 992ab24d6b595d24 d576a6da75db743f +laguna-xs-2.1-apex-balanced efb44d69f568a55c e84b4133782f21aa +laguna-xs-2.1-apex-compact 814e3348c389aef0 64547878429597dd +laguna-xs-2.1-apex-i-balanced 857d2dfad5c76187 cb1412e2cddc8d7d +laguna-xs-2.1-apex-i-compact e591c5c66f1f4704 f1baf115c24a37bf +laguna-xs-2.1-apex-i-mini c054bba7530fb306 3861cb3ed3c1df24 +laguna-xs-2.1-apex-i-quality 992da278fb418735 992293cd77ab3f5a +laguna-xs-2.1-apex-quality a0cd823887978067 dd723f6ed823067e +latitudegames_wayfarer-large-70b-llama-3.3 923b2578b1d0ca61 fe65d0b5c5ee76c1 +laya-llama-cpp 55ddaf905d43480c 1eba0881632c8009 +laya-vllm-cpp 1b2454a023983b54 ff8c08d375e94de2 +leetcodewizard_7b_v1.1-i1 e52388109aedc64a a5ea3ae4f3ba93b2 +lemon07r_vellummini-0.1-qwen3-14b 0e56dbd3a27ad4b3 558635ba83d3bd73 +lensvlm-9b 7b70cce4d308fe63 d503ab512350ab15 +lensvlm-9b-q8 1ec8d536383a4d1a cffdebac88b3d8b8 +lev-llama-cpp 708a8b53e2ee33ad ee91393d382837ae +lfm2-1.2b 9daca5b9f82f0088 dc2d63d9ca82b9d0 +lfm2-24b-a2b ed2923d21f0ef771 58ac3ee88b477f92 +lfm2-24b-a2b-apex-i-balanced 9e60698ca5834a90 847cc4b02fa815ae +lfm2-24b-a2b-apex-i-compact 3cab236813b39bcd cf16acab906f02ca +lfm2-24b-a2b-apex-i-mini 82d2c144878dea7d 04638fd0df1e1b92 +lfm2-24b-a2b-apex-i-quality f44c11c6dcea3e73 20e0180f50df799f +lfm2-vl-1.6b 302a90eb41de4b6a b1c100a31cb2e913 +lfm2-vl-450m 0b4a869261196fe7 888a4afdecb39d9d +lfm2.5-1.2b-instruct 364f201db1e75e20 085fc49502767acd +lfm2.5-1.2b-nova-function-calling 04c113c541a4545f 9f5c6901cd9cd35c +lfm2.5-2.6b eae9a053fe014ee7 b58ba3b56e461a2f +lfm2.5-2.6b-dspark a131a30f728ff18b cf8ecd177c4c8798 +lfm2.5-2.6b-q8 59c83150f1215f69 41da9a2b3941ca6a +lfm2.5-2.6b-q8-dspark fceba6cf1e40fc99 85d319ab4b114ce0 +lfm2.5-2.6b-turbo-brilliance a2f5f8e51baa0ee2 22215671d6b0a57a +lfm2.5-2.6b-turbo-brilliance-q6 8391b42cb0e857ef 056f3967b1ca63f0 +lfm2.5-2.6b-turbo-brilliance-q8 eab9311acaf024d3 ceeb5f06e2cb032c +lfm2.5-230m 12d971fe9295bbcd 27c1abc5f0e8d03e +lfm2.5-230m-q8 2b5b0e8ddb3cb88c 470e298b233f8f6c +lfm2.5-24b-a2b 792ac646a6108500 61ec9fee2668002a +lfm2.5-24b-a2b-q5 3661864ed1f3fec4 dda25db781063655 +lfm2.5-24b-a2b-q6 56505b792acca67f 414afd9a5deb66c9 +lfm2.5-24b-a2b-q8 fde4c874f992ad5a d2dfb832a872ccae +lfm2.5-8b-a1b abd18a13d5a72c52 318ab20dd7afa3a5 +lfm2.5-8b-a1b-apex-i-balanced 56a80edd48ac44ee 0e44ad3e01d4e0a8 +lfm2.5-8b-a1b-apex-i-compact 4448e93005eb111c 3176bc2f3afa82ba +lfm2.5-8b-a1b-apex-i-mini dddfeefdfdbd49f1 1c0a12cf00049295 +lfm2.5-8b-a1b-apex-i-quality 70e9118cd9581f47 f4d91d28ffcaafd6 +lfm2.5-8b-a1b-dspark 1eb1815af1fe7522 be621ed45b15e3dd +lfm2.5-8b-a1b-q8-0 2cbcb446285a4c20 d9b427bfaba411da +lfm2.5-8b-a1b-q8-dspark eab1341afb64d159 71dd796e03a0bb3c +lfm2.5-8b-a1b-turbo-brilliance 3a05b39488876fcd 753b6f2cbb441f75 +lfm2.5-8b-a1b-turbo-brilliance-q8 2b5e7d14f21d34aa 1de63f4ae75cc4c9 +lfm2.5-8b-a1b-ud-q4-k-m 0ac4fb822288834f 263f8313abda67e4 +lfm2.5-8b-a1b-ud-q5-k-m b83925a5e3b29a5c 0ff938a9bd62b57b +lfm2.5-8b-a1b-ud-q6-k ce01c23fcca939f5 0b77cad30dbf9f37 +lfm2.5-audio-1.5b-asr 74afda871e1aa19a cb76eb7d6450549a +lfm2.5-audio-1.5b-chat 885d4ce952880708 bbebd03a511bdeb5 +lfm2.5-audio-1.5b-realtime 741b42e8456b210f 5cec0853616f6dbf +lfm2.5-audio-1.5b-tts 69fa289e787fc130 737be4078fe19136 +lfm2.5-vl-1.6b 479cc1a80370ec8e 4fe05d3586ad5ec3 +lfm2.5-vl-1.6b-q8 bd0fdd818daeca7e a4255a36c8befa24 +lfm2.5-vl-3b 46353b2ffd227315 f7e2e762a6f52e30 +lfm2.5-vl-3b-q8 f19b80eca5b14862 b379504442242a8f +lightonocr-2-1b 5e4e8cda75e1c8ac 1cbf503842a22d99 +lightonocr-2-1b-f16 453a9a46b2f0e42b 27ce75d903ad1b52 +ling-3.0-flash-iq1 0d36492ca254ad8e 959cac0e7d723f8b +ling-3.0-flash-iq2 a50c188dfb8a2b3b 499d16269c078864 +ling-3.0-tiny-q4 e840d8900d822637 0f9037f91274d6fc +ling-3.0-tiny-q8 23314d6fe3dce900 71e1157a53ee9ea5 +liquidai.lfm2-2.6b-transcript 40fc94a6bc3864ec dd46dc4458e66347 +liquidai_lfm2-1.2b-extract 822cca6230e3c911 835fe2ea9f039d99 +liquidai_lfm2-1.2b-rag c4a7f1a4daaf7a06 dcb5f046e40752cd +liquidai_lfm2-1.2b-tool d88010dec0daf731 96049e79c8e09975 +liquidai_lfm2-350m-extract 5dda485082c308f9 16b58e81ab3a1bad +liquidai_lfm2-350m-math ee118f5f56320542 f302e2695c34c538 +liquidai_lfm2-8b-a1b 4a4cc7331512131c a7aaa6cb67379069 +llama-3.1-70b-japanese-instruct-2407 e60e571fc101c066 ec6d8ea804b7dae8 +llama-3.1-8b-arliai-formax-v1.0-iq-arm-imatrix 061fdd0268a2c43b 5785b7866df4c40e +llama-3.1-8b-arliai-rpmax-v1.1 244283edb97fd431 8e75b7742341403a +llama-3.1-8b-arliai-rpmax-v1.3 4f9f50837f298c88 cfbed14f5cbf5cd4 +llama-3.1-8b-instruct-fei-v1-uncensored 1be8cb4d98513588 9957831821529cd6 +llama-3.1-8b-instruct-ortho-v3 1dd8c3d62cde3c53 25d095390db31efe +llama-3.1-8b-instruct-uncensored-delmat-i1 d1b79a167a16abaa 25963b0a96be0c64 +llama-3.1-8b-open-sft 67e2dbbfb4cc0c0d 51db3de6041e360d +llama-3.1-8b-stheno-v3.4-iq-imatrix 2f724dd8280990a0 cfbcf281c41b9dfa +llama-3.1-hawkish-8b 447464095e79fdf5 00eef9e081209a40 +llama-3.1-nemotron-70b-instruct-hf 7e0a8d58942ae8ea 23079a7f3ba2ee41 +llama-3.1-storm-8b-q4_k_m 1591fe3004727214 1769716d8e94d68d +llama-3.1-supernova-lite 852138b414b695fa 6472e355aa917a47 +llama-3.1-supernova-lite-reflection-v1.0-i1 96530b43b5388a36 3cbf04602462a670 +llama-3.1-swallow-70b-v0.1-i1 4f84e7142730bc27 bf7c7f184addf775 +llama-3.1-techne-rp-8b-v1 f215b2611a9c02b8 16b9befb4d23504c +llama-3.1-tulu-3-70b-dpo 1a861a9d7bd91e2f c741e7d30ef7ce32 +llama-3.1-tulu-3-8b-dpo f8e9c6d1b3050e15 ac8852e007d7055c +llama-3.1-tulu-3-8b-sft 5e6fdcdfefe27ad5 f904589f2d7fb90f +llama-3.1-whiterabbitneo-2-8b 053585122436c379 76e2b87bf412f54f +llama-3.1_openscholar-8b b5fb280e3f545300 cbdc55e3ee3fc2ec +llama-3.2-1b-instruct:q4_k_m b78f877fc3af9327 cdecff3b73db8668 +llama-3.2-1b-instruct:q8_0 97750fece526cd12 f33130ac471b5d7d +llama-3.2-3b-agent007 268dd937d7ca9c8d ca26a2de44d6e1ae +llama-3.2-3b-agent007-coder 23aaeb5d780b0479 948ec97990fd3a19 +llama-3.2-3b-instruct-uncensored 498bea3944fc69fa 64f804f44ac6a5bf +llama-3.2-3b-instruct:q4_k_m e33c5b8a7996dd86 539340e9801927d7 +llama-3.2-3b-instruct:q8_0 854f54866faa1db2 cd7e8f92dad21ecf +llama-3.2-3b-reasoning-time 5d35140c4ce21279 4d56abdc5b8439c0 +llama-3.2-3b-small_shiro_roleplay 7b51c9378813592a f949eeab0d9c2c7a +llama-3.2-chibi-3b ab27314aa839c495 198d9ac034970d4a +llama-3.2-sun-2.5b-chat ba5e433ab17b0a4a e703e0a6372e8414 +llama-3.3-70b-instruct cf5b9d9f001b9562 05d4f3bbbec235c5 +llama-3.3-70b-instruct-ablated ffee7dfa6b7bf418 1cedaecd9860dcac +llama-3.3-magicalgirl-2 fd6c139550ebc06d f048b7bab5523f10 +llama-3.3-magicalgirl-2.5-i1 dc5db5ba55f6bb29 d0a4feaa719e852f +llama-chat-summary-3.2-3b 4e95f977ed046016 ad93db7e2ab756e1 +llama-deepsync-3b 0954af864b260fff 16173252a737db66 +llama-doctor-3.2-3b-instruct 1a17573ef03a68d1 49e342b945113e2d +llama-guard-3-8b 8f986e1ab6a6d6cd 72fac383ea3e7eeb +llama-mesh 6f8459af7c71ceab 6fd597ddad8e6db4 +llama-openreviewer-8b 0f83f32e71804a6e b803095d02fa049c +llama-sentient-3.2-3b-instruct 8525f9de13d18712 2ecec312ac8d28d5 +llama-smoltalk-3.2-1b-instruct 4ad9f197645d2a46 afaa5d0022df6575 +llama-song-stream-3b-instruct f2bc5219b7111fea c484636fcabcde02 +llama-spark 8bfdcbb887050bb0 5d5eb44e68a7cdd1 +llama3-24b-mullein-v1 2e1a02330c5febec 3f9aa2b5936bf8d7 +llama3.1-70b-chinese-chat 53b51333242259c1 96ffea1a154c69fd +llama3.1-8b-chinese-chat d140e768fb4784df c003e715262a41db +llama3.1-8b-cobalt f5055f4f656aebc0 28594782f18ac091 +llama3.1-8b-enigma 7b029bd2dad1d500 643776cbb83a95ff +llama3.1-8b-fireplace2 f848063bdbe27168 c494380cae679a59 +llama3.1-8b-prm-deepseek-data 13a8891575008289 bec7ab51bfcae65c +llama3.1-8b-shiningvaliant2 630b80688c021a68 fa24a0328943488f +llama3.1-bestmix-chem-einstein-8b 592c9cde17a8d5a9 889298c004c0f9b8 +llama3.1-darkstorm-aspire-8b e501831e28d1bacc a389ab71af0bd227 +llama3.1-flammades-70b 28d1293c504d3e9e 93c5ca84404c37f5 +llama3.1-gutenberg-doppel-70b 5810e3cb7de60472 aa43d0cc8b922e03 +llama3.2-3b-enigma 647e5ea77137db92 a35f48d77788b8bd +llama3.2-3b-esper2 d4b3d4d08262211a c809d511f85dcd47 +llama3.2-3b-shiningvaliant2-i1 40f4beb1dfb7a508 2a413d73fd01ddb1 +llama_3.3_70b_darkhorse-i1 6d9c63ceb7caac89 09e25e5c44cd4e8f +llm-compiler-13b-ftd bbd0b77003e124da 932ce2693015806e +llm-compiler-13b-imat 0b5d5bd4de87452a 7035f5be67020dd3 +llm-compiler-7b-ftd-imat 5992d0b55eb48a44 48ae9ed5eab3ff3f +llm-compiler-7b-imat-GGUF 9cd9acbf091a3125 681c01e11895f1b5 +llm-jp-4-33b-thinking-bf16 3884dbe59b9b1009 36901c8291d41e30 +llm-jp-4-33b-thinking-q4 e699a13d8d4318be fd30e188b308a6cb +llmevollama-3.1-8b-v0.1-i1 690f70303d20b703 cfc7c0e4a461eba5 +localvqe-v1.1-1.3m 06e86024a64a19e8 e4aecb648dd39119 +localvqe-v1.2-1.3m 1fcb0cf0b8a3bf1c 3086a59bb7b7b4d7 +localvqe-v1.3-4.8m cda28ef867395820 36bb75ff0876ef26 +locate-anything-3b 219517439d84c281 665f2b19762c76f5 +locutusque_thespis-llama-3.1-8b fb31cda7a5edb43f 85a66c44d7bf3722 +logics-qwen3-math-4b 375d6fb27b46c481 07ac24e25b0075b3 +loki-v2.6-8b-1024k 1afec249445a2c7f 2cdf2ac676cc8c21 +lolzinventor_meta-llama-3.1-8b-survivev3 c37255d5901012e0 fd295efddf04c7cd +longcat-video 262b1db9d69041bf 8b8a970bf84ac5fa +longcat-video-avatar-1.5 f64ec09ac0222bab 1f701b4d71e4f511 +ltx-2 47df7812bc7ca292 e77f12a05f82714c +ltx-2.3 46739eb061832863 6ade50efadb77f94 +ltx-2.3-22b-dev-ggml cb176e3104a87dfe f60ff7ba100a1b69 +ltx-2.3-22b-dev-ggml-q4_k_m b4a80a02d5268955 3581dfbaa078e4ff +ltx-2.3-22b-dev-ggml-q8_0 fd270f2f574aa8d7 5ab168b7f4f788f8 +ltx-2.3-22b-distilled-ggml b82678e57da61282 774bb61f6e86c388 +ltx-2.3-22b-distilled-ggml-q4_k_m ba891e9e619ffd91 4882537df8f43def +ltx-2.3-22b-distilled-ggml-q8_0 2cf00d5573654a57 8ecb7565aaca0f10 +luckyrp-24b 9efc97fed127b6a1 6707c3295baa15c1 +lumimaid-v0.2-12b b9d650d38866f6b8 9c9638870e2bd7f5 +lumimaid-v0.2-70b-i1 55ab3da0270ef990 84917bdde5475eff +lumimaid-v0.2-8b 4853a7860660d2aa 6ca8f60d322315e9 +lyranovaheart_starfallen-snow-fantasy-24b-ms3.2-v0.0 33669f0c134954d7 a59a5e229cd75b19 +lythri-4b-a2b-q4 35e36f3a28a3ba78 b8bde2a89437224e +lythri-4b-a2b-q8 0f2ad22b3958c0bc 94489ab5c783908b +lythri-7b-a4b-q5 7222c6f3f89ed2a0 0211fa262c94b71c +lythri-7b-a4b-q6 ecdadc45473d9bac 4aaef9b9ef4c8ed9 +lythri-7b-a4b-q8 5d3cb5def56eb51f 6050f5d6463700b3 +magidonia-24b-v4.2.0-i1 e57ae7af8c9656a1 358aecd5db93d1a8 +magnum-12b-v2.5-kto-i1 c8142443d0a0f563 69a1accd36189093 +magnum-v2-4b-i1 9547576e24d8d5ca 39779ab26c19f6b9 +magnum-v3-34b 85ad2e8b73dd01b8 9f36b55924ee2f1e +magnusintellectus-12b-v1-i1 235dfd66e8c736e9 43246a3284632c08 +magpie-tts-cpp-357m-f16 0bb72a2e63133d3c 1fc4d3894e48e2b8 +magpie-tts-cpp-357m-q8_0 02495273fb8808f0 13d686d45f9a2a54 +mahou-1.3-llama3.1-8b 0e74581a8c15270d 5d758c63639bdcfc +mahou-1.3d-mistral-7b-i1 7f3bf70d34a3860d d6b20fdc7239af7a +mahou-1.5-llama3.1-70b-i1 a6fab41c2d992dca 0ff067eabf8416ae +maple-preview-tq1-0-head-f16 54858d86c272c72b ebfacf1b6fd11a57 +maple-preview-tq1-0-head-q4-k be53d7c606aaba43 c1d82835b908763f +maple-preview-tq2-0-head-f16 278ad0d695a71bcd 775f4ac4b578e910 +maple-preview-tq2-0-head-q4-k cbd65d5e12fa4eec a8163499c56129d4 +master-yi-9b 18d43c1ea0e1a9f6 c27d5ad2fbc4b9c6 +mathstral-7b-v0.1-imat a1b87c24d0c5e5e4 f8bd0c15bd724806 +mawdistical_mawdistic-nightlife-24b bf155aca6eea1b8c 78786e05d2a1467d +medgemma-27b-text-it 5f3fb4fb58719442 8e88774278881de0 +medgemma-4b-it 99713e54af76548a 993688bf7e0c3fac +melinoe-30b-a3b-thinking-i1 31fb0be0b72ff760 d877701ae0f627e3 +mellum2-12b-a2.5b-instruct d18f81d8afed2365 f734c41b339b2464 +mellum2-12b-a2.5b-instruct-q8 78acf778321caca4 4deecdcea7e24e36 +mellum2.1-12b-a2.5b-thinking 9da682e08a0f3f1f 4efc16c907e6eaf9 +mellum2.1-12b-a2.5b-thinking-q8 6d6b6df97dde143b c074a90066125b93 +melody1437-26b-a4b-v2.0 b436d6167a19d80e ee7167006d20a69e +menlo_jan-nano 664ee5183222344b c2b1791b5c3c7ef2 +menlo_jan-nano-128k d263bdf3986a3f3e f90425aa7d37c67a +menlo_lucy 65f4a93ee3e094ba bbbac9f47c6722bf +menlo_lucy-128k df8598937afd1426 ab469c7840430264 +menlo_rezero-v0.1-llama-3.2-3b-it-grpo-250404 58bf9eb681741e88 c25f3d84d3eb2476 +meta-llama-3.1-70b-instruct ac4dc29ad8ecf3db 4b54e9a957a4031c +meta-llama-3.1-8b-claude-imat 8705a11fcf46037b 3b439bf3e460bdba +meta-llama-3.1-8b-instruct 1e52bc342eddbe60 7ac03a391b6cdfe5 +meta-llama-3.1-8b-instruct-abliterated a79eb1a22e9c6596 6540da30720dd279 +meta-llama-3.1-8b-instruct:Q8_grammar-functioncall b18f3431ce0c1ee5 2e4a8c3d9267097b +meta-llama-3.1-8b-instruct:grammar-functioncall cae9ec2690cf0471 becfb8308aef9778 +meta-llama_llama-4-scout-17b-16e-instruct 02115d4df409a4c8 773399f975b1e255 +metatune-gpt20b-r1.1-i1 2ee860175550efe1 72c8c27fbcbeb953 +mimo-7b-mtp:sglang dc1a624a08ea3c5b 2e9775b82a6357e2 +mimo-asr-crispasr dc635140dbbe8f81 5d52331fd3d148a2 +mimo-v2.6-distill-qwen-9b 164a04ef9f4efdaa 870702a538c944fa +mimo-v2.6-distill-qwen-9b-q8 e3b88443798cda10 b8e2d669cf926b9b +mini-hydra d22c41dd2bb9fe0d 5ca984df71b70ae3 +minicpm-o-2_6 d9656b309b50239d 01b54e5855711c99 +minicpm-o-4_5 51b27113d4a02d31 e8a11dca7239ff97 +minicpm-v-4 1a99484e686cff32 bec07f3fb2cb1a42 +minicpm-v-4_5 0a5f99f574aba1ae 6c6bf64f9f36f50e +minicpm-v-4_6 c44b3736f8a4c61c 83a709e7aee6b7b9 +minicpm-v-4_6-thinking d0e764e2f929e68b 39a88bfcdf263106 +minicpm-v-4_7-1b-q4 75d0d984d376be2a 76a533d3fdad35af +minicpm-v-4_7-1b-q5 178f3e1910e817cd 1822c4b454bdb0bd +minicpm-v-4_7-1b-q6 79119bd1533fd21a 1e38d5e59747a2a0 +minicpm-v-4_7-1b-q8 43f6ebe714cf2e8a dc93ef935e881712 +minicpm3-4b 5fa9f8b31a9e146a 89442cd759b2a81a +minicpm4-8b b7f4b17c2810317e d9d321480f6cf245 +minicpm4_1-8b 0cf7417868556c66 7ab3ee51f307ba14 +minicpm5-1b 303d6ca2354a7b97 a04b204b0653c7f1 +minicpm5-1b-claude-opus-fable5-thinking 781a0d27638a3562 5a8e672b5780d37d +minicpm5-1b-claude-opus-fable5-v2-thinking 8bfa9094ffd82a0c f6ca25ff87dd0084 +minicpm5-1b-q8 744d22488de8b760 032b391a3601ef03 +minicpm5-2b 3fb43d78c5739817 88a3505522becd89 +minicpm5-2b-f16 b1a810823127d346 70c63632617bbaa5 +minicpm5-2b-q8 f7ecb581717dbcd1 150577e381936048 +minimax-h3-fl2va-pruned-nvfp4 9117795bf7a30fa2 555e712c48f466db +minimax-h3-fl2va-pruned-q2 c57499b389f7fade b6937533b94fdc64 +minimax-h3-fl2va-pruned-q3 507e8844d60db5dd 22b3008dc217d3e1 +minimax-h3-fl2va-pruned-q4 ed3561aaa8d7dd4b f2e231385632cddf +minimax-h3-fl2va-pruned-q4-ggml 3a2d710857c38ce5 24883383f9f0a1e8 +minimax-h3-fl2va-pruned-q5 292bccefd5d99642 26213b470be4ccc5 +minimax-h3-fl2va-pruned-q6 94d122e44f126725 425d1b522f67af0f +minimax-h3-fl2va-pruned-q8 2af55a15297fab32 54e435e03618beb6 +minimax-h3-fl2va-q4 1da7faf4c7af5c46 9c069fd1ae89441c +minimax-h3-fl2va-unpruned-q4 bb207a123e112d8a 86b56dc1ddd725e7 +minimax-h3-fl2va-unpruned-q4-ggml 1b62b47659f890ea 14e3941ea2b3b665 +minimax-h3-ref2va-pruned-q2 8228de3e3af43c6b 44e1e66934c7a2f5 +minimax-h3-ref2va-pruned-q3 5bb51e47a080110d 55511b96664193fc +minimax-h3-ref2va-pruned-q4 a3f85bd6913f5a13 635e15c7d6ae08f3 +minimax-h3-ref2va-pruned-q4-ggml 8eb85ef538fe8a00 7562793d36654332 +minimax-h3-ref2va-pruned-q5 c3f640436bab3127 0486d6e15733ff03 +minimax-h3-ref2va-pruned-q6 2b88fec84e493e90 8ab505c72731211a +minimax-h3-ref2va-pruned-q8 9086cee08ec661d5 9bdae33f96b53954 +minimax-h3-ref2va-q4 4f8eb8797d37b62e 35340ebac8e5a8e6 +minimax-h3-ref2va-unpruned-q4 14217409fc6c5138 560bfde8d2bb6d45 +minimax-m2.1-i1 b4d2ef120b589bd1 bfb999d438df37ef +minimax-m2.5 dd08ca6d5deabd71 5cb2d9c00aa117de +minimax-m2.5-apex-i-balanced 151d51b3d0cfd427 a8119ad89c5a7276 +minimax-m2.5-apex-i-compact 006a0b01359e8df2 2c3f61fed049ac29 +minimax-m2.5-apex-i-mini 82de71493b2cbb81 c6d26e18ce0163e9 +minimax-m2.5-apex-i-quality 4ca7019cc820412c ba288f26b57a826f +minimax-m2.5-q8-0 a64f9febc7d42be7 cae8ae546287aa22 +minimax-m2.7 0efda3189369197c 43bdc456c3ed4a58 +minimax-m2.7-apex-i-balanced b59fd3793fe4c5a8 be11ea0aeeeac8c4 +minimax-m2.7-apex-i-compact 4f090343613491fc 87f0a7f87b9ca346 +minimax-m2.7-apex-i-mini fb647e575468d782 f9498fc33c2eb7a8 +minimax-m2.7-apex-i-nano bb996644f057a9d3 e181813710c7f5c3 +minimax-m2.7-apex-i-quality 0b10c695fe150e4f 531fef80d9e15481 +minimax-m2.7-q8-0 33543fac7e2b0fe2 ad6c796761bc815c +minimax-m2.7-ud-q4-k-m d3ba65dc141f37d2 5baa161fa2f72179 +minimax-m2.7-ud-q5-k-m 59703a9f62e8edcf 96c2cbaeed40593c +minimax-m2.7-ud-q6-k 8e447fa89416bf3c f45046aaec77f99b +minithinky-v2-1b-llama-3.2 9a423ca576969281 67be6c401e5e00ef +mira-v1.23-27b-rlvr ab46f9e0c62fc321 c16433f54d77f571 +mira-v1.23-27b-rlvr-q8 1c4ac032f5763252 944ade9940cf930d +mira-v1.7-27b-i1 d3e3e4b8e27301b2 22c168a8b28ef8aa +mirai-nova-llama3-LocalAI-8b-v0.1 d3f559a8eb07d1eb 8a079a01e4c84588 +mistral-7b-instruct-v0.3 5456f8a3d9b14aa8 07d3d93478caff0c +mistral-community_pixtral-12b f6860064785ecdb2 9b1a53314b9ef63a +mistral-nemo-instruct-2407 c085d63b45dc2230 0813f33c4769826a +mistral-nemo-instruct-2407-12b-thinking-m-claude-opus-high-reasoning-i1 267a98a9f20a4283 4e39b8de07c7815d +mistral-nemo-prism-12b 002edb71435d7c6a 7d0b9cdf7f66aa4b +mistral-small-24b-instruct-2501 b524ead737158615 cc92b71998ba9363 +mistral-small-3.2-46b-the-brilliant-raconteur-ii-instruct-2506 445827b5124e893a aaaf266d2b2aa515 +mistral-small-4-119b-2603 09063727e24b5e81 3511eabc8542114b +mistral-small-4-119b-2603-apex-i-balanced fd6e3ca17e89641f 47ceda56ca1b8761 +mistral-small-4-119b-2603-apex-i-compact a6ec27709b23d2d9 658739c9c00c0ea8 +mistral-small-4-119b-2603-apex-i-mini 5d5afd967b23d6d2 2877e3c000d35b57 +mistral-small-4-119b-2603-apex-i-quality 3e6596e525d8be35 af46f943e34b2cc6 +mistral-small-4-119b-2603-q8-0 e7315d0de9e4b5f7 5253a2469d93d2df +mistral-small-4-119b-2603-ud-q4-k-m bb217f14ff595d87 babd5fa238fd7e48 +mistral-small-4-119b-2603-ud-q5-k-m 9698bfa4881120b8 2396c102a1f43417 +mistral-small-4-119b-2603-ud-q6-k c9f7cc4194532d17 e35997daba3dc030 +mistralai_devstral-small-2505 561df62ba55cad7e 015590d901758a8e +mistralai_devstral-small-2507 333d57eb4b43b1f6 987e8f179e546e69 +mistralai_magistral-small-2506 9bb72d7c83e30506 23586e8abd2fa7f2 +mistralai_magistral-small-2509 5ed9daea26d61b8d f906f9ab3c6ede65 +mistralai_magistral-small-2509-multimodal 3236feb995226e42 5c1600239816ed21 +mistralai_ministral-3-14b-instruct-2512-multimodal e36ad9f3f3319c73 001deaab190137ed +mistralai_ministral-3-14b-reasoning-2512-multimodal c46d346d999f05b4 c0468f8d8eb81824 +mistralai_ministral-3-3b-instruct-2512-multimodal 57b333ccad4ee1ce 2fc5c0e75ee0011a +mistralai_ministral-3-3b-reasoning-2512-multimodal 95941cb195dbd764 7f7a4e0dd8515067 +mistralai_ministral-3-8b-instruct-2512-multimodal 809187e53f3e0922 4d9d967d42dcbee6 +mistralai_ministral-3-8b-reasoning-2512-multimodal 34685b405ea75020 c6b6fe7c4abb1d21 +mistralai_mistral-small-3.1-24b-instruct-2503 b2da262dffa45b36 2b74f2973509fc26 +mistralai_mistral-small-3.1-24b-instruct-2503-multimodal 667c9c2906879e97 9c3c060ab61ce9c6 +mistralai_mistral-small-3.2-24b-instruct-2506 93c133bd6d1dac72 d26ecb3a411866e8 +mitsuba-comfyui-27b 1a5887694d76227c 824aee2b328a7596 +mitsuba-comfyui-27b-ptq1 a97879e8f9c56314 239b50ff46bd419a +ml-ms-etheris-123b 230fc706c66e945f 6e46269e4f88f3f9 +mlabonne_gemma-3-12b-it-abliterated 81897512b18a7a00 5dc7238fddeed141 +mlabonne_gemma-3-27b-it-abliterated 21a9553b84fe2683 2ab7b41a4cc95b27 +mlabonne_gemma-3-4b-it-abliterated 0c8e04cd06515bec 24be36932b7764bb +mlabonne_qwen3-14b-abliterated 443c7abce6de9d68 e28e029bfb3c84d0 +mlabonne_qwen3-4b-abliterated 578fe467fea67eaa e6b9faae9db8eca7 +mlabonne_qwen3-8b-abliterated 67dde7c0b43ec6eb 40f86a79285d5657 +mn-12b-celeste-v1.9 f596b52b394cf08b 9df45a345421126c +mn-12b-lyra-v4-iq-imatrix 027c9fd4be326e2a bc4cc77d0a327832 +mn-12b-mag-mell-r1-iq-arm-imatrix 481e25bfff0b2e74 4ba0fc0ecc38a6e6 +mn-backyardai-party-12b-v1-iq-arm-imatrix 9fdd5a10415a0e92 053018bc8ca76b7b +mn-charthink-12b-base-q4 8d0121b1c3adee6b 3465024980e59747 +mn-charthink-12b-base-q6 cfcf96792c31cf7d bce60f0f3937cabe +mn-chunky-lotus-12b b4c26d68c8b6681e d524ee1d0a7d2414 +mn-lulanum-12b-fix-i1 d3fb9d4d13f68452 3849134b25c60345 +mn-tiramisu-12b 8db97df3df832931 4d81d8c734fc8357 +moe-girl-1ba-7bt-i1 07dd76e2bdd16730 b7a34bd368abd50a +moe-girl-800ma-3bt 0d149ea582871631 10d665cc6c801bb0 +moondream2 6e3c0048e6c3c5d5 00a8169b64cb6a77 +moondream2-20250414 4e052658d25bf620 d4bdf87f07ee230a +moonshine-crispasr f8004bd09ad9f01e f3e40a0c5d2c640f +moonshine-de-crispasr 334a9c9c23271c25 2148edd86470d4df +moonshine-streaming-crispasr d163b94c1f99284a 815ec9ae2afee6a6 +moonshine-tiny 462f498dbfdb4b4a a07d0dc760573ea4 +moonshine-tiny-de-crispasr a53c3da2969f6b69 47092d451262d47b +moss-image-base 5fc92b3431d76c0b 78dfde077df14f4a +moss-image-sft 497ca963f58a731c 358128cc4b620324 +moss-transcribe-cpp-0.9b 38adbf40fc132f22 f64a54ca0e25d7a1 +moss-tts-cpp-v1_5-f16 1cf8623684641afd 85d46e3cefc757da +moss-tts-cpp-v1_5-q8_0 784c4e26a4e616b7 07109d74d1f5a390 +mox-small-1-i1 b80933821f0dfb1e 3da405506cc420cb +mrm8488_qwen3-14b-ft-limo 0e2de149ee7a4b6b 74d637916b208a23 +ms-24b-mullein-v0 685a1b95b9a7393f e6f6d49ec15f6293 +muse-glimmer-30b 947978ae73ca8a70 4c60bb5024ce6a79 +muse-glimmer-30b-17gb abdf8d265ca7e2dc 4c928d9f4dcb097b +muse-glimmer-30b-17gb-dflash b927529363885930 11ef876d015a0b1e +muse-glimmer-30b-dflash 5db822f3245b770d 8833c7a3114a1701 +mxbai-embed-large-v1-f16 88a3ed908a18dc19 829201043eb941a0 +mxbai-embed-large-v1-q4 bae3ced95099e995 e2e49d71d6937a3b +mxbai-embed-large-v1-q8 b1a064c6e834d9ac fd49dcc7da240dd9 +nanbeige4.1-3b-q4 8023ee2de9492fc1 1a8042bdd5b5bdf7 +nanbeige4.1-3b-q8 675ca28fcbd5241c 059aad7f7a846b19 +nanbeige4.2-3b 0b237efa79f15c6c dd2067ca2ae418ef +nanbeige4.2-3b-q8 2c7f4513967794fd e1f19468ecc16ba0 +nano_imp_1b-q8_0 e9122126665c3a25 d937262bb05a3f37 +naturallm-7b-instruct 76f322c6978b5c48 547e87afc67e4aed +nbeerbower_qwen3-gutenberg-encore-14b cc870e7282be4935 4a5116b1c0773c9f +negative-anubis-70b-v1 2e51a90e08b3d8d8 7ad6d00850b1229b +negative_llama_70b fcfb7d93168418f9 becdfa1cdaca9433 +nemo-parakeet-tdt-0.6b 5d74da8d6cde1731 28828417a7bbc64b +nemo-speech-cpp-nemotron-3.5-asr-streaming 35349f7999aa9774 e4e7e7afdd7ecc71 +nemo-speech-cpp-nemotron-3.5-asr-streaming-diarized 1124d71e31a68855 5bd4f53244d4bffb +nemo-speech-cpp-parakeet-tdt-0.6b-v3 760299ac89a976ff a0b70a63b801ab9b +nemo-speech-cpp-parakeet-tdt-0.6b-v3-diarized 176b6d3bf120f630 1022ed1dd7a8cecd +nemo-speech-cpp-sortformer-diarization-v2 a892ad7117ba310e 44faf8adbb115f26 +nemotron-3-embed-1b-q4 6eb69f81f658b38f 8856741d13a33514 +nemotron-3-embed-8b-q4 6cc0808ecd506e0b 0d80a7d928c48191 +nemotron-3-nano-30b-a3b edf4d663908034b9 01548f991a570eea +nemotron-3-nano-30b-a3b-apex-i-balanced 419c5234fd250771 e4ebbab9592303be +nemotron-3-nano-30b-a3b-apex-i-compact 1d173739c003e21f e4f50b19931eeb08 +nemotron-3-nano-30b-a3b-apex-i-mini 4d16ffd82ed749ef 5de336c38ee50fec +nemotron-3-nano-30b-a3b-apex-i-quality 89af8172d62bbf73 4dff40cd835d3fda +nemotron-3-nano-30b-a3b-q8-0 a71e74aec42d1496 068887dc3af3c485 +nemotron-3-nano-omni-30b-a3b-reasoning ebd2f78d9bfaca64 2c84a9806eeafbbf +nemotron-3-nano-omni-30b-a3b-reasoning-apex 10e849b70af6c661 75786e0020062aa5 +nemotron-3-nano-omni-30b-a3b-reasoning-apex-i-balanced 82024ece96d85d39 f99eaa55335bb474 +nemotron-3-nano-omni-30b-a3b-reasoning-apex-i-compact 8033d5469b0a159c 8b9cc92b10d6a971 +nemotron-3-nano-omni-30b-a3b-reasoning-apex-i-mini 5fb8cd95ce27e8b1 0fa644157cc7b98b +nemotron-3-nano-omni-30b-a3b-reasoning-apex-i-nano 10db43fcd75c1363 6af861010e53eaad +nemotron-3-nano-omni-30b-a3b-reasoning-apex-i-quality 287bcce773c91eb2 d7e71cf300548a3a +nemotron-3.5-lightning-30b-a3b-nvfp4 2e86665a767f3e96 9e511c4ffa367775 +nemotron-3.5-lightning-30b-a3b-q4 e300a85cbde74c8d 998fecc5b8eac5c9 +nemotron-3.5-lightning-30b-a3b-q8 004bb07e0483badd 434cca401967b5f8 +neohorse-1-4b-bf16 0c5870824a0a325f 02a1728c06e7a3cf +neohorse-1-4b-q4 c95babf8a869c3b1 3fdf62cac6a11f08 +neohorse-1-4b-q5 1d002d832b8243e4 9d321f1194476a25 +neohorse-1-4b-q6 536a5e254c7db8ba 181b798b80611ec5 +neohorse-1-4b-q8 ab03497af98e4158 76d21ae0f71c670d +nera_noctis-12b cde6e8d032f24883 8b8d289b1cd8cfba +neutts-air a9a2360adcc312a8 9cec4f05d61bc96b +nex-n2-mini fbbb2bcd31d7e9a6 d6059b67713c52e6 +nex-n2-mini-apex-i-balanced ee6ec19dbd2a8826 228ce7cd6904e9db +nex-n2-mini-apex-i-compact 7eaadab77fdd4bc4 790dafd5beb7e9cc +nex-n2-mini-apex-i-mini 125f10aa9e8091cf dfc725cac1b79a9f +nex-n2-mini-apex-i-quality 96b83402f5b5359b bbb6ed35b2344831 +nex-n2.5-mini-q4 970e939c95a61e95 e1667fb98ea5380e +nex-n2.5-mini-q5 89fb452fe0df6196 450a72eec5617e90 +nex-n2.5-mini-q6 9ac356ee7e731fc2 6a30ddcf5acf4340 +nex-n2.5-mini-q8 96bc103dfaeadfaa 8e2bd3885f572786 +nightwing3-10b-v0.1 241b84fc81bbfb38 229b7bd13d7dd4b8 +nightygurps-14b-v1.1 c81a9bfcdef4e70c b86269a620b28493 +nihappy-l3.1-8b-v0.09 67249438e0994ad9 1eedc279ff52f93c +nimble-9b-v3-llama-cpp c747fdb8e35e1177 9b01655e97e9935b +nimble-9b-vllm-cpp fbc8b09b889bfd5d 30f949e44796d8e8 +nl2sh-1.5b-q4 7dddafeb32d07d90 416bdd2a45bef4e7 +nohobby_l3.3-prikol-70b-extra 43201e6833a403ea 8df199f1d6b28fcd +nohobby_l3.3-prikol-70b-v0.4 bb4f650003c6cbdc 9a820742962735ea +nohobby_l3.3-prikol-70b-v0.5 98f48cbad1765af1 2ecdcbf3d6840f21 +nomic-embed-text-v1.5 e62cd5c0d7257bf9 3c575133537f10eb +noromaid-13b-0.4-DPO 5ffca03282362059 fcfae84b9f9dbd9e +north-mini-code-1.0 97bf2c8ad21e780d ed99382933f1bd18 +north-mini-code-1.0-q8 768bfe8551fc1660 cfe89f6831f73379 +nousresearch_deephermes-3-llama-3-3b-preview 3d716e855943b13d 8fc7f09f777158cd +nousresearch_deephermes-3-llama-3-8b-preview fbb88539cb257cc1 cd9ea27e141ac4fe +nousresearch_deephermes-3-mistral-24b-preview abf71adf7e058975 6fe842c940d230eb +nousresearch_hermes-4-14b ec81acc56b61bc43 e21983b51e154407 +nousresearch_hermes-4-70b e7131f2eda7ebef0 c3255b6006b3f67b +nvidia-nemotron-3-super-120b-a12b f2e131bd17fbb828 ce7eea907bb15637 +nvidia-nemotron-3-super-120b-a12b-apex-i-balanced 03c1b736def5f5c2 4a44086b174133cd +nvidia-nemotron-3-super-120b-a12b-apex-i-compact 79a6f8d12248fbd1 3193dcbb14a8521b +nvidia-nemotron-3-super-120b-a12b-apex-i-mini 6fcd667b83c345a9 f325656a45bf4c9b +nvidia-nemotron-3-super-120b-a12b-apex-i-quality bb8022270e4fa597 8fca391b53ff4e1a +nvidia-nemotron-3-super-120b-a12b-q8-0 8c061ea3f1ebfcb4 17c806a582b3f592 +nvidia-nemotron-3-super-120b-a12b-ud-q4-k-m df6b18acc7971c57 77ff177643a029c0 +nvidia-nemotron-3-super-120b-a12b-ud-q5-k-m feab46c44c180745 8ace9285b7840576 +nvidia-nemotron-3-super-120b-a12b-ud-q6-k 267be53a299621fd 79cdcc48b2c11c24 +nvidia.qwen3-nemotron-32b-rlbff ff468665e57e80f5 54e99c19fc733a03 +nvidia_acereason-nemotron-14b e8adb062b1d58f04 f4ea7ee8041d41e3 +nvidia_llama-3.1-8b-ultralong-1m-instruct 63ea29bde15c7f6d bf709d93e088238f +nvidia_llama-3.1-8b-ultralong-4m-instruct 2c7bef16432f9024 cb8926f1ee0f2f20 +nvidia_llama-3.1-nemotron-nano-4b-v1.1 d22836214b8e75ed 20b4d24cd8438650 +nvidia_llama-3_3-nemotron-super-49b-genrm-multilingual a83de8aac1bdbca1 03a5af376b22f4e3 +nvidia_llama-3_3-nemotron-super-49b-v1 c9dd2d799b037469 efcdd737cdbf1732 +nvidia_nemotron-research-reasoning-qwen-1.5b 115a9049cc9a25f7 2a32db7eb95e59eb +occamy-1.0-q4 6a56e39aa7927cbc 344e0422fe3e9c2e +occamy-1.0-q8 0cfbd97dac051d28 4b33ac5c30ea5b7b +ockerman0_anubislemonade-70b-v1 4ce964a77dd02676 46f1488b1719f68d +ockerman0_anubislemonade-70b-v1.1 1156902ec407829a f0bbf2760b1dd45f +omega-qwen3-atom-8b ce80c63e32f15a3d 801f89a29ae90dc9 +omnilingual-0.3b-ctc-q8-sherpa 6d5203f8d68e713a a53f2a3134aa40ed +omnivoice-cpp 0da91e583566caa4 5b8d4f19c5ce8fdb +omnivoice-cpp-hq 5fbbf307328fabce 37fa5f0c52f64a1f +onellm-doey-v1-llama-3.2-3b 49bf9ad8e18479d1 1d7fbf7fbcc2e649 +onerec-8b 7ce48b42c16b9bdf 5f15c022f75f888a +openai-gpt-oss-20b-abliterated-uncensored-neo-imatrix 6bc5eabc3feac563 4cebe47dbc7b441a +openai_gpt-oss-20b-neo 3f6b70be078481d9 e78f1859cf8682c4 +openbuddy-llama3.1-8b-v22.1-131k f7c9b7a66558429d 20db6e6fd6a38f1c +openbuddy_openbuddy-r1-0528-distill-qwen3-32b-preview0-qat ee0a443df826231e 3303dc0211f9bd36 +opencoder-1.5b-base 420d3f8d2eb68ee8 d05324ab8d746d95 +opencoder-1.5b-instruct a94e66e69cd3826e 168b059b0de35627 +opencoder-8b-base a2cd7c932730d5b2 ac31fe9185f5cad1 +opencoder-8b-instruct d10bb18afcbf2a03 0cbc26b5fcc6b681 +opengvlab_internvl3_5-14b 6441381b62d79347 e55db168dd0dd7cc +opengvlab_internvl3_5-14b-q8_0 6ed9728e10d485ce 8e121832d74d38e3 +opengvlab_internvl3_5-2b cb9a1fb230e56bac c45dff078ee9cdb6 +opengvlab_internvl3_5-30b-a3b b3222d47006d2043 00e3a35f5ee87d9f +opengvlab_internvl3_5-30b-a3b-q8_0 1fe1bc3cf6010881 d73a815c0c202a3a +opengvlab_internvl3_5-4b 5c144e4c75c3d96e 686ca5478664bdf3 +opengvlab_internvl3_5-4b-q8_0 e92f06ee2e14c2e2 d9244e18370a8ffb +opengvlab_internvl3_5-8b 6e2bac04cdb85cb0 7511ad31b66ce229 +opengvlab_internvl3_5-8b-q8_0 10cdbe5cec6c8cdf 65649323c315e615 +openjev-llama-cpp 0d67a3e64906ec69 7176ad2ce9d41494 +openresearcher-30b-a3b-q4 4701d22c6c5d089a 420f530e9bbacb0e +openresearcher-30b-a3b-q8 dda243beca3f86ed a6eaa832e181e0f1 +openvino-all-MiniLM-L6-v2 973d87f6cc22ad3c 38ec84edfbf2af61 +openvino-hermes2pro-llama3 896c82dc90020b0c fd1b373958cb2b58 +openvino-llama-3-8b-instruct-ov-int8 8b3909f596a939db ed3d749f93a5a1a5 +openvino-llama3-aloe 255469903a976862 0f3953c0c77063a5 +openvino-multilingual-e5-base defec6539b4c163a 879bd12bf32c3809 +openvino-phi3 1869f7b3b43b4720 61c7196c44575f2f +openvino-starling-lm-7b-beta-openvino-int8 f567bbae42a7402f 65922558573a1280 +openvino-wizardlm2 1e6655446123909f 8332b51c0f78724a +orca-agent-v0.1 6cdc68dfb306e726 9d5ec6108f4d525c +orca-agent-v0.1-i1 f54506793d16c9c4 e22db86f93a7e920 +orca_mini_v8_1_70b 31dc5520e0f7b51c 448e9c4caaf8545e +ornith-1.0-35b 96c935c7453ce3d1 ff72d15351236eca +ornith-1.0-35b-apex-i-balanced 36e5e50a94418788 996faa4988c6be2b +ornith-1.0-35b-apex-i-compact 7c95d5c081848d99 bd8df8e95f3eaf53 +ornith-1.0-35b-apex-i-mini 1e1ad0badce561d1 9b7366c5c7d92287 +ornith-1.0-35b-apex-i-quality 1ef3cd66f617813f 5e914a74f1daa91d +ornith-1.0-35b-q8-0 da8e48249b7a03ed d37b8e37b979f05a +ornith-1.0-35b-ud-q4-k-m 388be36974c644e7 15f6be75623751e6 +ornith-1.0-35b-ud-q5-k-m e4ddeeadcfe7c4f3 9eaaae4758f7c38c +ornith-1.0-35b-ud-q6-k de5e52be5c5c13a8 93800927118b5813 +ornith-1.0-9b 8b81f58aa9bba155 7607d6e7efae6626 +ornith-1.0-9b-mtp dae6f48b3acb9eae c9d03a2635af1016 +ornith-1.0-9b-q4 51ca3cbb9e37bb3d 68120d4dc1a899f4 +ornith-1.0-9b-q8 7ff1c24c27a01e24 0b387d10110a441c +ornith-1.5-35b-a3b-apex 62cdabd410339548 ea076d1a0cf03757 +ornith-1.5-35b-a3b-apex-compact 0d6e0c88f89e46ad 582012e1c808fc17 +ornith-1.5-35b-a3b-mtp-apex e7271aa2a546d0d7 76ea99e00b37b312 +ornith-1.5-35b-a3b-mtp-apex-compact c8afc20e80b78dce f02fadf98c8caa4b +ornith-1.5-35b-a3b-q4 d58d39d9c6ca7943 8bb8890c880c74da +ornith-1.5-35b-a3b-q5 80e9ca5a60b151e3 8d3adcc7ea6a501e +ornith-1.5-35b-a3b-q6 97997725d98f5bbe 02a64cda89c5a30e +ornith-1.5-35b-a3b-q8 d4ef7ba0d8a5e1d6 0e1ba60df96f0582 +ornith-1.5-397b-q4 e301ecd301c37cfd d89a46c8ed5ab080 +ornith-1.5-397b-q8 984eb6934b19e455 8e9abd52c424e223 +ornith-1.5-9b-obliterated-q4 2d7fa701d296da4e 6e3b492dd72a80f4 +ornith-1.5-9b-obliterated-q8 f5a41c987649d038 e8a3cd235ba92ec1 +ornith-1.5-9b-q4 39d14fb9dec1331d aab113a6b5a44fcb +ornith-1.5-9b-q5 fd146ad3cce16fc5 de4cc163d3c3f414 +ornith-1.5-9b-q6 e496eacdd72becc3 3630b9a7958d2f11 +ornith-1.5-9b-q8 7abe720dd9426523 47456c5bc9634d05 +ornith-1.5-9b-uncensored 34be942fdaa1e2d4 ebe00084ad6261da +ornith-1.5-9b-uncensored-q4 251792d138147354 7e52e980882c8127 +ornith-1.5-9b-uncensored-q6 d8475e308f6be69e 5ecc6e4a232b3434 +ornith-1.5-9b-uncensored-q8 ff56bb705a0826f1 5b9f83ff198dab9d +orpheus-tts-crispasr 8c3ac0da799b9bfd bc76fb1f5a200103 +orukeet 0fdb755dda4b8621 d25de7f39d15b2a8 +ostrich-32b-qwen3-251003-i1 dc077fe85f76ddbd ff01f8e6a3280049 +outetts 7039e055a1738a21 806756972ac8843b +ovisocr2 3f896e2def8ea9e8 35b79faffadc878e +ovisocr2-q8 fb1aa62091056dd1 cbcab01396547fce +pantheon-rp-1.6-12b-nemo 7216795cfe78aec5 3e0c0de024f22d6d +parable-granite-4.1-3b-claude-fable-5 ffd53d599d4de7f7 ce1c4482bcf111d6 +parable-granite-4.1-8b-claude-fable-5 12e48aa140826471 0faf6b94952f1894 +parable-qwen3-4b-claude-fable-5 0fe7fec5dd598a5e 8f30a2387ea796a5 +parable-qwen3-8b-claude-fable-5 f65d2f163b092106 a1eab206b75e982a +parakeet-cpp-bundle-moondream-redux 2f29c2690a3f64cc d2aa91b24a0139d6 +parakeet-cpp-bundle-small afbe499068f07b1d a18dbd2be0569bcd +parakeet-cpp-bundle-standard 612ad992457d2aa9 35238dd611683ff8 +parakeet-cpp-ced-base 55e85dfd06a956f8 8744012021ea564f +parakeet-cpp-ced-tiny 9c3efefb26ebd26e 8134d46f9e150ee5 +parakeet-cpp-ctc-0.6b 3ae774eae7a9ccd4 2286adb4645e32f5 +parakeet-cpp-ctc-1.1b a323fe4452fa1992 61a07cba00ac7b3d +parakeet-cpp-fluid-speech-mini 7566517a85495ea5 38c64851a9841628 +parakeet-cpp-moondream-redux-f16 cc617527bcd7e2cb cd260d8f4391bef2 +parakeet-cpp-moondream-redux-packed 44d7a40821081b71 d840463b4ba22055 +parakeet-cpp-moondream-redux-q8_0 072b866c2b0f622f bde3c359f38bb38b +parakeet-cpp-moondream-ultra-f16 7007dce64ede8adb 7919e7239fa9aca8 +parakeet-cpp-moondream-ultra-q8_0 3faa6a8f3551061c 835d40e927565d06 +parakeet-cpp-multilingual-diarization-speakers 3e5da294d9b14b63 37f48e46ada7e68e +parakeet-cpp-multilingual-diarization-speakers-sounds 5a9378f53c732eb7 df5662bf70369a44 +parakeet-cpp-nemotron-3-diarization c79eaf3b9370a694 c8a062d4fb6a9e6c +parakeet-cpp-nemotron-3-diarization-asr e798d5bbde287f38 a9a92e23b47cca29 +parakeet-cpp-nemotron-3-diarization-asr-speakers b0583ce9155b2769 5a1504f8c36ec637 +parakeet-cpp-nemotron-3-diarization-speakers bd48506a1f16843d e6e0f092c72b3dad +parakeet-cpp-nemotron-3.5-asr-streaming-0.6b 92b84091e3568a25 14f22e3f63cb3aec +parakeet-cpp-realtime-scene b5bb65573e017213 b3a52cf5cdb82b06 +parakeet-cpp-realtime-scene-base c4b26e7fb3dbc462 128e079a818d8279 +parakeet-cpp-realtime-scene-speakers 9be6d260a5f641a3 9d82d4a9c2ff0912 +parakeet-cpp-realtime-scene-tdt ce209d1447daf22e b2bee1c42976765a +parakeet-cpp-realtime-scene-tdt-base 585c091e8d707ba2 bd60dddf257cf17d +parakeet-cpp-realtime_eou_120m-v1 5cf76c37a144a4e6 f06f735b4e20aa6f +parakeet-cpp-rnnt-0.6b a862ff993d1792ad e21a31ce2867d506 +parakeet-cpp-rnnt-1.1b f8c25783a4b5d0b4 fe7d231ec417f3be +parakeet-cpp-silero-vad-f16 769d87114b1c331a 194ad1659d6dad8c +parakeet-cpp-tdt-0.6b-v2 3c2e55dabd7212b5 2205a5f82ec2d0f8 +parakeet-cpp-tdt-0.6b-v3 a93ba7574ad81dab dbb270296a9b51a1 +parakeet-cpp-tdt-0.6b-v3-silero-vad 7b4ac1230a802207 6aa343557cf78deb +parakeet-cpp-tdt-1.1b c0f953e114c6a557 3e4e069f2b919ba2 +parakeet-cpp-tdt_ctc-1.1b 60f488b5f8319af2 57e42a0016a93666 +parakeet-cpp-tdt_ctc-110m 75a475b4bb8af455 ff02f7c996ad2ebc +parakeet-cpp-vad c5c4aacd577914d8 51452fe102bf352b +parakeet-cpp-vad-moondream-redux acc65222bc5c02eb da6758a6095713ad +parakeet-cpp-vad-moondream-redux-packed a5e8b5d978b62879 685f0cb5f482235e +parakeet-cpp-vad-moondream-ultra 01d18bcd91e8bc03 2cf86b16f9c8d848 +parakeet-cpp-vad-moondream-ultra-q8_0 805d37c4167fdfb4 b65f8d74fba703ce +parakeet-crispasr 4c889a4e4ca80e33 8b94ffb399b94966 +parakeet-ja-crispasr 31672b38ec45ef3b 98b9538308d4c3b2 +parakeet-rnnt-0.6b-crispasr 4f478209665afb59 547c9be9de813cca +parakeet-rnnt-1.1b-crispasr efa435dbb1795238 bb5825baf6670b88 +parakeet-tdt-1.1b-crispasr 05547174fabec15c b698a91ccc540403 +parakeet-tdt_ctc-1.1b-crispasr acd6fd00276f51a4 afbf5dab376700f1 +parakeet-tdt_ctc-110m-crispasr 2d7d071c52c2e506 6123ff2e414f72f9 +parakeet-v2-crispasr 18e922649c54748e 26273d9bb1bd7bf1 +parler-tts-mini-v0.1 bf913b80d56ec80f 618df425ca75d017 +perplexity-ai_r1-1776-distill-llama-70b a5e3a8b78437d5fb e28363a0e582dbc1 +phi-2-chat 77afdc83e6d3b204 3a0d8fb1053caf9c +phi-2-chat:Q8_0 cdde3dfabffb82bb 05d31b7398eb6c9d +phi-2-orange c1a91028f2c0fc59 21a3fd8feb137f56 +phonellm-alpha-1:sglang 0e3f774130e4d2ec a7cb416dd055f77d +phonellm-alpha-1:vllm 8fbba54922585094 b749acd385a8ef1a +pinkpixel_crystal-think-v2 f000a7dad99eae22 0d5671932dba19b8 +piper-ar_JO-kareem-medium-crispasr c09b4670758acd97 c70e0dcec5e39acb +piper-bg_BG-dimitar-medium-crispasr 89e1dcd2c30b029f 7a4828d7656e0e5a +piper-ca_ES-upc_ona-medium-crispasr 16aedaabcc3b8384 f681afd2e119f759 +piper-ca_ES-upc_pau-x_low-crispasr 42a31bdedfdaeb28 4578204f21a3e156 +piper-cs_CZ-jirka-medium-crispasr 772ac17dfccaa1e6 f35695f37d0b87e8 +piper-cy_GB-gwryw_gogleddol-medium-crispasr 9f7e7aa95d7c55b7 16540508ab725983 +piper-da_DK-talesyntese-medium-crispasr 7ab64fe79b0230a3 47dea07b6d3eaffb +piper-de_DE-eva_k-x_low-crispasr a9c7b503860eb87f 7bdeec4cb4cc3cb8 +piper-de_DE-karlsson-low-crispasr fc0768b2e2832cc1 645097887e0a3a55 +piper-de_DE-kerstin-low-crispasr 1462da76ee927375 f23d889b4794804e +piper-de_DE-ramona-low-crispasr d015f0d980102dbe 4f3f8dff9714be6e +piper-de_DE-thorsten-medium-crispasr e2be5d9f7e969699 b8c48c23874d72e9 +piper-el_GR-rapunzelina-medium-crispasr 3caa3e8b11914d9f 787a4a1c991d6bd6 +piper-en_GB-cori-medium-crispasr 183c1aacdf5b4f31 f3a45654ef423332 +piper-en_US-lessac-medium-crispasr 258d2a4babcb23a2 db74bd23d9243bf7 +piper-es_ES-davefx-medium-crispasr f3552cbf7cb011de 808e53b00c361d9b +piper-es_ES-mls_10246-low-crispasr 6732f9ba3ec9daa1 23984b8b3cc37715 +piper-es_MX-ald-medium-crispasr fc51b31b32400b40 515cb06e776256ee +piper-eu_ES-antton-medium-crispasr 449090a34b90ff97 ccaa33e5627d8876 +piper-eu_ES-maider-medium-crispasr c3a2202cc28cd3b0 a80b4792f925d61b +piper-fa_IR-amir-medium-crispasr f2698f9bdbba6db1 b93aef02e195b221 +piper-fa_IR-ganji-medium-crispasr c2c5327582e7045d 6c482f2745045fd2 +piper-fi_FI-harri-medium-crispasr 7d628edb22e4d51f 3f493b922b8a93f0 +piper-fr_FR-siwis-medium-crispasr 84a5c3abc0c8886b 56801bd9761e5ba5 +piper-fr_FR-tom-medium-crispasr 3e4aac9dbf9deb6a a3f02ec87f98e941 +piper-hi_IN-pratham-medium-crispasr d11e6f5a1107ca1f 949c205810aefec3 +piper-hi_IN-priyamvada-medium-crispasr a265e6ef797077ad 8a735128a4403979 +piper-hu_HU-anna-medium-crispasr d6fc0ac1fbb4df5e b5c4b146f02dcb44 +piper-hu_HU-berta-medium-crispasr 26cd308b3ea7ef15 15b0ac748093dae9 +piper-id_ID-news_tts-medium-crispasr 61d6a66f1e0a7ea0 5adf6a9c1d365d8e +piper-is_IS-bui-medium-crispasr f2ba9396e196cd40 84f33875031d0928 +piper-is_IS-salka-medium-crispasr 33eb2a9fac043363 035703afe6ab7f0f +piper-it_IT-paola-medium-crispasr adda6ae54b11712a cb76e57afc64cbd1 +piper-it_IT-riccardo-x_low-crispasr 997f51176ed0a81c 36a6a63a5f1e01b6 +piper-ka_GE-natia-medium-crispasr 07e31c09ec63a3d5 a6f201dc8f5aabaa +piper-kk_KZ-iseke-x_low-crispasr 375aac0b962204e1 82eef859fae86dfd +piper-kk_KZ-raya-x_low-crispasr 01b73fd19df032e5 3c12735dba6a3dca +piper-lb_LU-marylux-medium-crispasr 3702b48724e1407f 5433d891d78f3e1d +piper-lv_LV-aivars-medium-crispasr 2237fc4b33f254f7 b1774fddc815c689 +piper-ml_IN-arjun-medium-crispasr 94e8f7b0dcf728b7 1a7da133103ab8fe +piper-ml_IN-meera-medium-crispasr a9233da877e232bb 057ba8134ddad1dc +piper-ne_NP-chitwan-medium-crispasr b200ffcae4195eea 7718c48c6b3c2d51 +piper-nl_BE-nathalie-medium-crispasr 7ea90bf302060f4f 756e31da7676b07d +piper-nl_BE-rdh-medium-crispasr 53c53967f1438cbb a65107f2dc17917b +piper-nl_NL-alex-medium-crispasr 2e28206eff98e7ff 3a4e1de87e31f202 +piper-nl_NL-pim-medium-crispasr a27a41ca632e32ad b33e7a2af1ab4327 +piper-no_NO-talesyntese-medium-crispasr b65d960e73a2108d cf5194bce2d7f693 +piper-pl_PL-darkman-medium-crispasr 39a4398f3b224a15 a9eefd95b74bc3d4 +piper-pl_PL-gosia-medium-crispasr 8e5513f6728b9196 6624202fdbc9043c +piper-pt_BR-cadu-medium-crispasr 83190294e7719b38 1cc1e094c9478c6b +piper-pt_BR-faber-medium-crispasr be0e7b9cc90c69c2 b40012f456605f30 +piper-pt_PT-tugão-medium-crispasr 5da91aa463fc561b 16fe39d895c60af1 +piper-ro_RO-mihai-medium-crispasr c38b44fb66d5c121 5ee9b2236a644744 +piper-ru_RU-denis-medium-crispasr fdb9a6683fec6523 626b3d790b6c550d +piper-ru_RU-dmitri-medium-crispasr 5ea105b7daae419c 5a9585c2e17e0306 +piper-sk_SK-lili-medium-crispasr d6e345a90825d8c6 6c5c474f576db18f +piper-sl_SI-artur-medium-crispasr 3de6db0dd985c6ee af99a90112bc8577 +piper-sq_AL-edon-medium-crispasr 3f95ab8326fb9070 8a10f2d689d798ac +piper-streaming-assistant 247d593e4521e2d1 418800c79457dfde +piper-sv_SE-alma-medium-crispasr bb4855684e632d0b 9d5c73ec349a43c0 +piper-sv_SE-lisa-medium-crispasr 28ebf3ccb588b488 4fc5a5fb1f33a967 +piper-sw_CD-lanfrica-medium-crispasr caac639f51bac0fe 5d4b6878918e0bcc +piper-te_IN-maya-medium-crispasr 82483833d7423246 09c27a3caa3731b3 +piper-te_IN-padmavathi-medium-crispasr e883f6e7ae04fffb 5e0aae076cc0e006 +piper-tr_TR-dfki-medium-crispasr 7c2488f4a814aea6 573523211706e9c9 +piper-uk_UA-lada-x_low-crispasr 771854eee6521895 f95e6b9ad369b17b +piper-ur_PK-fasih-medium-crispasr bacf0c817ad73e6f 971ae96834018e9f +piper-vi_VN-25hours_single-low-crispasr 96f472c0920bdcc3 6835a0a8872b2903 +piper-vi_VN-vais1000-medium-crispasr 4aedca9524f69d6f 777027534fb8f931 +piper-zh_CN-huayan-medium-crispasr d3ae7181c79ac042 58e3fcc8371534a4 +pku-ds-lab_fairyr1-14b-preview cc23ceb726674142 58f5209e5442bfea +pku-ds-lab_fairyr1-32b 3c5a2d4c90155ad3 a70c1fb46eea1c65 +planetoid_27b_v.2 ca8160f672430a8c 776f86418b7065e3 +pocket-26b cc23496902eab8c0 7051135228f7e085 +pocket-26b-q2 0d32c46d6977bd0d 60d7440fc3e7289a +pocket-35b ca8198d331676995 a6a2a1b8a350b710 +pocket-35b-iq1 4edf1f277ff7c70c 8acffabae4fa61d5 +pocket-35b-q2 c4098595f721168b 9467ecaed95b9973 +pocket-35b-q3 97075089ef684030 3adcd044d4711e59 +pocket-darwin-180b-q4 270eb376b3cac123 a90c329b45de5ac1 +pocket-tts 99d2c56cc1e85855 313c3fee4d2feb82 +pocketdoc_dans-personalityengine-v1.2.0-24b 6293cbd0229c6e08 1559dc2aac327e37 +pocketdoc_dans-sakurakaze-v1.0.0-12b 5252a811c249647c 869975274e78f7af +primeintellect_intellect-2 40893a027a75528f 466dce10cd8a8454 +prism-coder-9b 33f398ad2bf6cda7 afcd5c5242774356 +prism-coder-9b-q8 37638e5f2488cb87 a45d37d49a21619e +privacy-filter-multilingual a80af81c3f681a8d 40eb692c42e8c1cc +privacy-filter-nemotron 3fdb4e75c5fde997 378edf70bc840ed4 +privacy-filter-nemotron-q8 8264884147b4a2c5 112ea0113208ba82 +pygmalionai_eleusis-12b c5dc8be4b4ce574f 8d32b11316b950fd +pygmalionai_pygmalion-3-12b af4f7abae51377d7 163abb7e77145d9d +q3.5-bluestar-27b d7840c701e5ed936 88d70ba0849ed02c +qgallouedec_gemma-3-27b-it-codeforces-sft 0a3df3bb97ed6416 fc483849233298fe +qihoo360_tinyr1-32b-preview 93097dfd8da3c363 6e21d1752cd35046 +qwen-3-32b-medical-reasoning-i1 1521b73f3f07a73f 9ce62f10cb73281a +qwen-agentworld-35b-a3b bf8b8d4fae84bf06 68a500c10a375323 +qwen-image 982d1858900695a3 6e4b60bb3cb3c99d +qwen-image-2.1-anime-fusal-gguf c795b63d54ac0108 736ff71bb7dffde0 +qwen-image-2.1-q4_k-ggml 120252cb40c88538 69119459cbe77355 +qwen-image-2.1-q8_0-ggml be0f4fd17337d8e3 b983c5dcc103113a +qwen-image-2.1-text-encoder-heretic a9dd780b1336047d 6908316c0ae03fd3 +qwen-image-2.1-turbo-uncensored-gguf 831a481695721441 c32bebdcabb2453e +qwen-image-2.1-uncensored 7250ae6f39041d8b 331d499c762ab809 +qwen-image-edit 0431ede174109070 69c27c39e1cec8d2 +qwen-image-edit-2509 dcb1dc1a398663c5 61e19929c8b1a5a7 +qwen-sea-lion-v4-32b-it-i1 36606d9c53722d2e 459fb0ac50e2f3f9 +qwen3-0.6b dff153d06aa6611a e2ff626fc1491dc1 +qwen3-0.6b-vllm-cpp d8f6f65bb853655f efbd5a38bdd4f7f9 +qwen3-1.7b 7fa9e4ef3897ee00 745f5500c42a24a3 +qwen3-1.7b-crispasr 962d644cb485f0a5 07cacf997196754c +qwen3-14b 2b99b516aaf910c8 7983dc72b2a89b13 +qwen3-14b-griffon-i1 2c2b87c98288b832 a23283fa360d49bd +qwen3-14b-uncensored 3637f3d936a5b2b1 76caf9bd809c6335 +qwen3-22b-a3b-the-harley-quinn 3d2bc353a5c3e70d e775f9c845659aeb +qwen3-235b-a22b-instruct-2507 72d0ee6cbaf0a203 959504f6effbbacc +qwen3-30b-a1.5b-high-speed 5440b0be57da49f0 bd9eafb6f734cfc9 +qwen3-30b-a3b ed397813e01e8a1b 618401ac3039b741 +qwen3-30b-a3b-abliterated 43515a8a6745f827 9330c1b47671ce92 +qwen3-32b f4c5f3765791fc83 7defc07035dd1a4d +qwen3-33b-a3b-stranger-thoughts-abliterated-uncensored 9d5b6fc2df4eb33f bc0547214875a644 +qwen3-42b-a3b-stranger-thoughts-deep20x-abliterated-uncensored-i1 e94cf7427dee7f5a 6e805522f8dfdcd2 +qwen3-4b cb81b58a7dc97855 280b762294273f73 +qwen3-4b-dflash df2ebceb8aff2048 c11181b6c9fca6e3 +qwen3-4b-esper3-i1 165d060b216f05a8 bec3d4272cd05d1e +qwen3-4b-ra-sft 1ad9c69ca58a9b22 48d597339c6a2ae3 +qwen3-4b-thinking-2507-gspo-easy 8f69f00e63756216 6c4e90bfa838245a +qwen3-4b-vllm-cpp bf91e4d354e98ecd 4346ecf2bc0a6592 +qwen3-55b-a3b-total-recall-deep-40x 8df078449250ade4 1e4e99fbe9a068b2 +qwen3-55b-a3b-total-recall-v1.3-i1 7ac0fec1e775db80 f2e95459dcd93b03 +qwen3-6b-almost-human-xmen-x4-x2-x1-dare-e32 d7a8e0c4e6355e1e ca1e08ef67c93ee2 +qwen3-8b bca0dccad470146c 2a030a082094a37b +qwen3-8b-jailbroken 3ef26441a6cd3652 7d73bfd5b364fbfa +qwen3-8b-shiningvaliant3 6c6f90e8bc5696b1 41db811ab05e02d9 +qwen3-asr-0.6b a3265dfdc92d2eb1 843421f46e73a2c6 +qwen3-asr-1.7b 9727b357b6596821 b6c58eb8b62b6b64 +qwen3-coder-30b 4e6de84cda3acef7 fb7c69b812639e46 +qwen3-coder-30b-a3b-instruct 332d653ca08b2487 b0c63cd48a3fe321 +qwen3-coder-30b-a3b-instruct-rtpurbo-i1 a9bf6c1dbe0fcdc9 5ad09cc45ff11f45 +qwen3-coder-30b-a3b-vllm-cpp 7bded13d8b89d596 cabda292214ced24 +qwen3-coder-30b-apex-i-balanced ebfaf016788e1241 7d5bc2ccb57b9f67 +qwen3-coder-30b-apex-i-compact aa6037147e60489d c71326fccade2315 +qwen3-coder-30b-apex-i-quality f6f038962ddbdc18 a5f00a57a1498fc7 +qwen3-coder-480b-a35b-instruct 4719f7bc771c3a09 fac867a6fca2683b +qwen3-coder-next ba547b095fd6ab6a 5289c202bde6abc6 +qwen3-coder-next-apex-i-balanced 57555ea9c33ebf0a dd6c7d53b98b756d +qwen3-coder-next-apex-i-compact 6d75f6c7d43f5c55 c2acc7d0cf4d342e +qwen3-coder-next-apex-i-mini 2b01a10db961cada 648e6630bdd9e7d4 +qwen3-coder-next-apex-i-quality 1a8f561d4f731477 975d0eb6baed42ba +qwen3-coder-next-mxfp4_moe 68b8156eaae570ee 2c5aacde9200b837 +qwen3-coder-next-q8-0 8a02390cd1b29898 6e0ff360d5ae4898 +qwen3-coder-next-ud-q4-k-m d78bef9c0e8a2e06 53c8280374a69ec7 +qwen3-coder-next-ud-q5-k-m 9e272b9e6d9e5484 a740e28a1c257bbe +qwen3-coder-next-ud-q6-k d1b0a8c05d4a477a 414ad4d74bf2d789 +qwen3-coder-reap-25b-a3b-i1 db8eb2d359d5caec 9eb37ea84c0866ff +qwen3-crispasr 5758b91db2f8a675 462852619a1b9d78 +qwen3-deckard-large-almost-human-6b-i1 1718bdcd31784cfd de2051d964fbdd80 +qwen3-deckard-large-almost-human-6b-iii-160-omega c5a39dccbd6a7531 574349487c451f33 +qwen3-embedding-0.6b d488c9c79b72386d e4bd771cc176ef11 +qwen3-embedding-4b 42ea3a6a6fd2ff08 f755df146fb8d757 +qwen3-embedding-8b e654332b9863d267 c43065df7ce43ea1 +qwen3-nemotron-32b-rlbff-i1 6841d120a777ee14 f967ec34a5c6da36 +qwen3-omni-30b-a3b-instruct 7819b3ca0200d6ec b3ed411cfb044d15 +qwen3-omni-30b-a3b-thinking 0346cbadeefe921f eae768e33e5a7866 +qwen3-reranker-0.6b 5f645728ba38cb37 c540e617a9f00b4d +qwen3-stargate-sg1-uncensored-abliterated-8b-i1 40876c8a1f321834 52cdbc73cf1299c2 +qwen3-streaming-assistant f4b9fd8f225353ff 0ed0e14d95197ae6 +qwen3-the-josiefied-omega-directive-22b-uncensored-abliterated-i1 3dc66eaa8f565d97 3c92813c38ff0c4e +qwen3-the-xiaolong-omega-directive-22b-uncensored-abliterated-i1 e0798432e64ec03f 73d4b162858180b5 +qwen3-tnd-double-deckard-a-c-11b-220-i1 1563baf47248aa3b 3774630f4267c5bb +qwen3-tts-0.6b-custom-voice 38b9d496792bc8a2 8bede2c50bad9f06 +qwen3-tts-1.7b-custom-voice 2230e15894cb8222 c3f6bd191db886e5 +qwen3-tts-cpp 1f3709cd7ebca86b a619f75900b38d5e +qwen3-tts-cpp-0.6b-base-q4 67bd531a2ab46c3b 39bc809f191a3ceb +qwen3-tts-cpp-1.7b-base 089f0b05f63ea6ec 8fad7d659ed780c3 +qwen3-tts-cpp-1.7b-base-q4 58f18b6bc8920e19 2cbec598d52ec24f +qwen3-tts-cpp-1.7b-customvoice 7a87a305f23286f6 546f3072bd95bf09 +qwen3-tts-cpp-1.7b-customvoice-q4 67dd245bfa6ff543 83be10e3bca3bb8c +qwen3-tts-cpp-1.7b-voicedesign 5ef29e92cf81934c 34de14a334b6fcd5 +qwen3-tts-cpp-1.7b-voicedesign-q4 34c2733f12ff3c58 8a02d2b5ba322eb4 +qwen3-tts-cpp-customvoice c42dbf557b53d85d 46bb7971968c9c03 +qwen3-tts-cpp-customvoice-q4 b50e30e4e1ea63a5 f6a932d3fe1aad21 +qwen3-tts-customvoice-crispasr 71373610679201db c4f76b51f335a5d4 +qwen3-tts-llamacpp 7ca5e99d61014d65 3f6baff44961e71c +qwen3-tts-llamacpp-q4 66eeb52f1f2817e9 9e3bd504976dfc6d +qwen3-vl-2b-instruct 4a936b925fa11d89 f5564ea0aae424a7 +qwen3-vl-2b-thinking 274649294f9e408b abc94e419b933af2 +qwen3-vl-30b-a3b-instruct 1e4901da5ad14f26 b1ef6f386b35ea51 +qwen3-vl-30b-a3b-thinking 5ab352fe0c82070f a12dcfbb2acc753e +qwen3-vl-32b-instruct d7ab5b35ce534cd0 7e206c804411c195 +qwen3-vl-4b-instruct 02154a82bc418899 b21f8165d2afa2df +qwen3-vl-4b-thinking d8f8e23aa2b77e88 aaa1788c2aface10 +qwen3-vl-4b-vllm-cpp 02fb8480a65c3d5a e58bc7f97b69897d +qwen3-vl-8b-instruct 7529e9938032b6ab aea14304699f4dfe +qwen3-vl-8b-thinking 32b537bdbb80c982 5bfb8983d4c7ba63 +qwen3-vl-embedding-2b d128fd066492d785 6213825cb482256d +qwen3-vl-embedding-8b b619b6fea59df6d1 a3af1f1441bc0275 +qwen3-vl-reranker-2b-i1 22bb78cbacdb8257 f5ca8412a047c3ff +qwen3-vl-reranker-8b c813f2df0c09e2cf 6173cdefb20ab616 +qwen3-vlto-32b-instruct-i1 13250a4e9dadf76a da3f38b1b4df1cfb +qwen3-vlto-32b-thinking 8c95e2871b6fd5c3 a961b4093b11613d +qwen3-yoyo-v4-42b-a3b-thinking-total-recall-pkdick-v-i1 376b620800c753f5 0e6e75532ce1aef1 +qwen3.5-122b-a10b 05b87d58d8d935d9 79a195b7b7df4fb7 +qwen3.5-122b-a10b-apex-i-balanced 1e5d08e338166dbe d170d71bd72f2dd3 +qwen3.5-122b-a10b-apex-i-compact 9bfd22626580d772 9f6f796e13e7eac2 +qwen3.5-122b-a10b-apex-i-mini ddff28b8f1c03f7f b0121d6e7ee9bd06 +qwen3.5-122b-a10b-apex-i-quality 148dbb742aaa57ea a707d5dc7c6e354c +qwen3.5-122b-a10b-q8-0 07ce2b6404bd481c 223e3b522bc84d50 +qwen3.5-27b b4a4bc55c5f370de 6b330cf99f1ea20b +qwen3.5-27b-claude-4.6-opus-reasoning-distilled-heretic-i1 8bb3693ef3b8e95d edea149cd186a4c7 +qwen3.5-27b-claude-4.6-opus-reasoning-distilled-i1 431a65858fddc911 1c94226c76d95b07 +qwen3.5-35b-a3b 982fed73c720f550 6c5a43177fc2cca0 +qwen3.5-35b-a3b-apex 458d16488ccf8692 230df1d01dfad4a1 +qwen3.5-35b-a3b-apex-i-balanced 72e797db66b820b6 528570e27f989165 +qwen3.5-35b-a3b-apex-i-compact eaab74798f61e2a2 58c5970294f1eaf1 +qwen3.5-35b-a3b-apex-i-quality 600ad0f30cd77482 7a247829147f80db +qwen3.5-35b-a3b-apex-tq-balanced 62f05a6dde4d88f5 22b78687073014d9 +qwen3.5-35b-a3b-apex-tq-compact 12f6ae4e6f260baf 61d187b14daaeed4 +qwen3.5-35b-a3b-apex-tq-quality 0243570a546a0f49 a2ccbade8fb44056 +qwen3.5-35b-a3b-claude-distilled 5fca90d932901713 30a327e7b77b1d47 +qwen3.5-35b-a3b-claude-distilled-apex-i-balanced f8c915686af54238 497300c3557afd87 +qwen3.5-35b-a3b-claude-distilled-apex-i-compact 44b955095ff79d60 ac5179956359ac54 +qwen3.5-35b-a3b-claude-distilled-apex-i-mini 3eac5655f443e7ee be338cfdcbe78936 +qwen3.5-35b-a3b-claude-distilled-apex-i-quality 5fd6dc64874a6c9a 0b2a8a19495ef7ff +qwen3.5-35b-a3b-q8-0 5dec35efdb3bec45 86876279cdb1d013 +qwen3.5-35b-a3b-uncensored-fernflowerai c61fbac01832d890 528934496168fd66 +qwen3.5-35b-a3b-uncensored-fernflowerai-apex-i-balanced e9774409af73045c d10d3ea1816f5592 +qwen3.5-35b-a3b-uncensored-fernflowerai-apex-i-compact 297ffb414d7bae28 a14d11787d7ad887 +qwen3.5-35b-a3b-uncensored-fernflowerai-apex-i-mini 97d9f9d58cc5293e 67a43959a383b595 +qwen3.5-35b-a3b-uncensored-fernflowerai-apex-i-nano 9f54e963b57624c7 357e5bda4b321ff7 +qwen3.5-35b-a3b-uncensored-fernflowerai-apex-i-quality 7f1ab6bf1d870cd0 71f497ef87e57321 +qwen3.5-397b-a17b 12bdb7831cd2c0bf 735b9c781a3560df +qwen3.5-397b-a17b-apex-balanced ba16fabfd57ed183 78d024905cdb842d +qwen3.5-397b-a17b-apex-compact 5a76ea95d0fb60be 95678eef4b14b582 +qwen3.5-397b-a17b-apex-quality 2eacb96eeb17768e adf4d387a980b109 +qwen3.5-397b-a17b-q8-0 20bc8f0491688fe7 f80610f0f7c9de01 +qwen3.5-397b-a17b-ud-q4-k-m 3e4780f344d3bb4f 9209d2d9c5aa4bc2 +qwen3.5-397b-a17b-ud-q5-k-m 6d32c8a25555118b c9b78842b8f5ea26 +qwen3.5-397b-a17b-ud-q6-k cbfabd3e83a6eb8b bcf1d96c3262f956 +qwen3.5-4b-claude-4.6-opus-reasoning-distilled d7ad24275cd9022c 5e4112d799df93df +qwen3.5-4b-dflash e85a270451e23f64 7d851ffb35faa236 +qwen3.5-4b-hauhaucs-aggressive f49b6572e26b0b8b fab97498b37e0b79 +qwen3.5-4b-hauhaucs-aggressive-q6 7fcd6a9dcc898668 38a6850b1f9f2ead +qwen3.5-4b-hauhaucs-aggressive-q8 ec5ec51c44cfdaba 5056a517cf69fdbc +qwen3.5-9b 5d26c01c3b902db4 2ee232aa1e5fb493 +qwen3.5-9b-deepseek-v4-flash 057952c35f94e2a3 4a6d89c9015539c4 +qwen3.5-9b-defiant-fable 6f70305b61dedc8e e129d771f5155986 +qwen3.5-9b-defiant-fable-mtp b9bc6684f0fb1e60 fcb80d4d974c00b6 +qwen3.5-9b-defiant-fable-q8 72557213dadfb6ce 862331006e6d1996 +qwen3.5-9b-defiant-fable-q8-mtp 17c0ed7ef0035172 8da36d3792829c0e +qwen3.5-9b-dflash 20cc287c8edc91de 6c5ca185594c7486 +qwen3.5-9b-glm5.1-distill-v1 24bbd1aa81070da1 4055c605cf1db42b +qwen3.5-9b-hauhaucs-aggressive 23bb5b024a3a9174 9de761e98aa42a60 +qwen3.5-9b-hauhaucs-aggressive-q8 a36f55e3e4d31ed3 e621fcaad2aabf8d +qwen3.5-9b-kimi-k3-distilled-q4 8884977f89e3e708 8b5a3639ca19192e +qwen3.5-9b-kimi-k3-distilled-q8 8e988d25f58b9b4f 21bf4df7604ff5ce +qwen3.5-9b-lukey03-abliterated 7a7996df205ef4fb c53761bb39ad4ad8 +qwen3.5-9b-lukey03-abliterated-f16 945bef069b663583 f6f4251fcfaba3b4 +qwen3.6-14b-a3b-fablevibes af697e8d7da785ab 76f2d3ca8890a2df +qwen3.6-14b-a3b-fablevibes-q8 69318c33ea6123f5 1e0a4f5890bc32a0 +qwen3.6-27b 9ff193d9833f26b9 fde0661773916d7a +qwen3.6-27b-dflash 82ce26268bac71f9 9896cd8cb6abb383 +qwen3.6-27b-fable-fusion-711-uncensored-heretic-nm-dau-neo-max-mtp c88a9c9a45ed83bb dfe11972819fe6cd +qwen3.6-27b-heretic-uncensored-finetune-neo-code-di-imatrix-max 465c693ed13bcd0d ab64f159fbb52e87 +qwen3.6-27b-mtp-pi-tune 5145e65660c863fd 430069a6bab2e99c +qwen3.6-27b-nvfp4-dflash-vllm-cpp 7893fc6f5ec2f86d bc11d07138f2688c +qwen3.6-27b-nvfp4-mtp 67721bec7c7f0a51 6a5cef77bc8104c3 +qwen3.6-27b-nvfp4-mtp-vllm-cpp 694c7d9c5c2db61f 91e48ed62f898ae8 +qwen3.6-27b-nvfp4-vllm-cpp 808e319cde02df12 5d2463b6291e02a1 +qwen3.6-27b-q8 c5537b4503b50f54 38213b2c042b86d9 +qwen3.6-35b-a3b 33298ddfd71cb009 37eb677f7a02ed94 +qwen3.6-35b-a3b-apex 1c1ff5ff79bd61cd 60c2e17c9fe289e4 +qwen3.6-35b-a3b-apex-i-balanced 82f02ff61149520b 5ce572c9f79ada10 +qwen3.6-35b-a3b-apex-i-compact de130bb54587d7bf 0a5793d6e4a28aae +qwen3.6-35b-a3b-apex-i-mini 182b8f93384a3e33 be29332b22fdb663 +qwen3.6-35b-a3b-apex-i-quality daf8416cdb27046c 2c32ecd4f25b5d81 +qwen3.6-35b-a3b-apex-mtp-i-balanced 2dc9d31298dc7a4a a4cd6a3801fa8154 +qwen3.6-35b-a3b-apex-mtp-i-compact 9f3424ebf9d75dd4 de83cb1d3aa5ddfd +qwen3.6-35b-a3b-apex-mtp-i-mini f52e84e91b02c046 69ac2e8c38280a19 +qwen3.6-35b-a3b-apex-mtp-i-nano 91d8a640e70d9724 d15a3eef95b98e0c +qwen3.6-35b-a3b-apex-mtp-i-quality fb8f1d8cff18bc4a 28dea9b39d0df2aa +qwen3.6-35b-a3b-claude-4.6-opus-reasoning-distilled e2ed531928559c49 b531957caba3a3ac +qwen3.6-35b-a3b-claude-4.6-opus-reasoning-distilled-apex-i-balanced 0915b0373f8769da be8391ae8ab2c064 +qwen3.6-35b-a3b-claude-4.6-opus-reasoning-distilled-apex-i-compact 9ebb83565e4f43c3 8f8786a2166a83f6 +qwen3.6-35b-a3b-claude-4.6-opus-reasoning-distilled-apex-i-mini 6af257fb2c5b7cf8 62a62adf3bd368e1 +qwen3.6-35b-a3b-claude-4.6-opus-reasoning-distilled-apex-i-quality 59d29069146c2def bbcead171b0dbf0c +qwen3.6-35b-a3b-claude-4.6-opus-reasoning-distilled-apex-mtp-i-balanced 9d12a5d436b5c0a4 b798c45306ce8743 +qwen3.6-35b-a3b-claude-4.6-opus-reasoning-distilled-apex-mtp-i-compact 0056f78083327736 ceaf82cfee05259f +qwen3.6-35b-a3b-claude-4.6-opus-reasoning-distilled-apex-mtp-i-mini 36bef4ef1cf08f78 c429a87e1a569d9a +qwen3.6-35b-a3b-claude-4.6-opus-reasoning-distilled-apex-mtp-i-nano 9d1c64ae3eae82f3 f70600c38541cc99 +qwen3.6-35b-a3b-claude-4.6-opus-reasoning-distilled-apex-mtp-i-quality b7d3c1f7d39904ff c01589bfcc2b1979 +qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled 54e184c885174dd8 642f027beb0680e7 +qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex-i-balanced 8009a7adfbf4d623 e08249527f8f263f +qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex-i-compact d5318862152c4f12 29f9ce46cc7491a9 +qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex-i-mini 9494be9d0ef18fd0 a1d3c54396b6a7d2 +qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex-i-nano 2e01f0d6289dade9 ebece9b227890a16 +qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex-i-quality 4c2318995a10a500 8247508e1ff477fd +qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex-mtp-i-balanced 5e2dee6ae6d3c4e6 939449e0c7884338 +qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex-mtp-i-compact c46ea0786841736a 435cdea40053d817 +qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex-mtp-i-mini f4516f9aba802336 8a2dba2cdb5cd5f0 +qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex-mtp-i-nano cf72d055f5df4ebb d286de9cfc023363 +qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex-mtp-i-quality c18e37bc5e888255 a5a62ad78ebf1ef1 +qwen3.6-35b-a3b-dflash 6db144141f422838 d34f9ce213e34a94 +qwen3.6-35b-a3b-genesis-hermes-final 045b81b37d479033 b6c102504855002a +qwen3.6-35b-a3b-genesis-hermes-final-apex-compact 04f4f250656ed94d fac9c99307d6cfff +qwen3.6-35b-a3b-genesis-hermes-final-mtp-apex 9b28290b837f4adb 557bfc5cb8cab047 +qwen3.6-35b-a3b-genesis-hermes-final-mtp-apex-compact 1e25fafbff7af735 fa46e2753ba661d7 +qwen3.6-35b-a3b-genesis-hermes-final-q8-k-p d402bed87941fad8 c07af0c645deecf5 +qwen3.6-35b-a3b-genesis-hermes-v7 bec1ebf8d43de117 e97547c25f87dd2d +qwen3.6-35b-a3b-genesis-hermes-v7-apex-compact c1c798e59b855dfe e8450040468ae5fb +qwen3.6-35b-a3b-genesis-hermes-v7-mtp-apex ed5e196d06368cb3 c0a49228c5df5942 +qwen3.6-35b-a3b-genesis-hermes-v7-mtp-apex-compact 0a96762d29ab0088 167f78ab357b37ae +qwen3.6-35b-a3b-genesis-hermes-v7-q8-k-p 07fb409367ade0cb 91b446f185d9c963 +qwen3.6-35b-a3b-nvfp4-mtp e3cd09de97d74a09 892ed6840fcb9411 +qwen3.6-35b-a3b-nvfp4-mtp-vllm-cpp 60799153d01cd51a 3a965b0822f947af +qwen3.6-35b-a3b-nvfp4-vllm-cpp 95a820a757ce274e 90a4648cb49db856 +qwen3.6-35b-a3b-q8-0 6c6cc0801c43b362 5d1ff738648d99e1 +qwen3.6-35b-a3b-ud-q5-k-m bf89bdfba385dc6b bbca0df79c2e1535 +qwen3.6-35b-a3b-ud-q6-k a763909be17487d2 a3e45dc2fd8e37eb +qwen3.6-35b-a3b-uncensored-genesis-hermes-v6 f014c3917d642271 db03d02d8bb088f4 +qwen3.6-35b-a3b-uncensored-heretic 06542b8a1acd92e3 a38da53297b3d54f +qwen3.6-35b-a3b-uncensored-heretic-apex-i-balanced 5867014657ff1b9c 8953d99fc2d805aa +qwen3.6-35b-a3b-uncensored-heretic-apex-i-compact 1023ace39b638694 459452da223cc1bc +qwen3.6-35b-a3b-uncensored-heretic-apex-i-mini 2a316dad756123fd 0afda80e13780f3e +qwen3.6-35b-a3b-uncensored-heretic-apex-i-quality 7a6a4b6e75c8e93a 07530922945b672d +qwen3.6-40b-claude-4.6-opus-deckard-heretic-uncensored-thinking-neo-code-di-imatrix-max 7fbc382236ddc83b 56c991f8bfdd21d5 +qwen3.8-27b 6ac8d2b2e735bdba 8952bd04b69eb6a8 +qwen3.8-27b-agention-ap b2e9cc6d3b8d05ba 7e99c7ee9c763b7a +qwen3.8-27b-agention-ap-iq2-s 3519bd4c8ca94288 d1c3d38c99c08f2e +qwen3.8-27b-agention-ap-q4-k-xl 20c4c09d24250220 f694cb588b579847 +qwen3.8-27b-agention-iq4-xs b8338a9732a49781 663a30341014cba8 +qwen3.8-27b-agention-q4-k-m 15d96e1e3cfad69f 8e706cd04906131b +qwen3.8-27b-coder390-q6 7b8504116f7fea25 2d37f35882484e59 +qwen3.8-27b-coder390-q8 a9e7761029a17b3b 4919e26d4adb6de8 +qwen3.8-27b-cold-fusion-q4-mtp c99f55e08c679e23 02df41160915d364 +qwen3.8-27b-cold-fusion-q8-mtp 1d7e9b842c63a9a9 707f7fa4171b954f +qwen3.8-27b-cyber-iq4-xs 2c25a969ab9209ba f0adb9cb16a4ede6 +qwen3.8-27b-cyber-q8 cf687c5dc0d44140 245452ab980daa7a +qwen3.8-27b-dflash2 df1d4947ae78fac6 5ae11cdb460c7d59 +qwen3.8-27b-dflash2-exl3-vllm-cpp 8b7c2af146c419c0 95a491bb985aa9ac +qwen3.8-27b-efficientthink-q6 ef8c1ebf23c018cc 511c98ee0a506f80 +qwen3.8-27b-efficientthink-q6-dflash cf6bbb049253b0ab 3fc4d457be5aeb93 +qwen3.8-27b-efficientthink-q8 fa12326f7df7a7e5 e3e0320ddb597d8c +qwen3.8-27b-efficientthink-q8-dflash 31578d663206d14e ac7965c650a22d5d +qwen3.8-27b-exl3-vllm-cpp a2b2143a68e1fa05 c7d7a8d7611f6a37 +qwen3.8-27b-fable-5-coding-distilled e34dd8b15c66b1d1 5ea4809fc4d3d492 +qwen3.8-27b-fable-5-coding-distilled-q8 71e8f8c57a0227a0 738dcf836d8471a0 +qwen3.8-27b-gsq-rco-iq2-s 017e76268a65b7b2 1f293994c3083563 +qwen3.8-27b-gsq-rco-iq2-xs 9ce5f5a357ca7f48 41641c36909edf7c +qwen3.8-27b-gsq-rco-iq3-s 0666bab44505c49e 0b6acc8140a7713b +qwen3.8-27b-gsq-rco-iq3-xxs 21f73b4ce1b89c4a c768efae42f60611 +qwen3.8-27b-heretic-abliterated-uncensored bdc7ff9c8d80cf4e 381f427c9314f38c +qwen3.8-27b-humanlike-chat 272f1b42dbbab2bb 89afab3762ca00e7 +qwen3.8-27b-humanlike-chat-q5 35c4f4538f5975b4 176b294239d55d09 +qwen3.8-27b-humanlike-chat-q6 5a024b2486bd4303 f1f7915c8982ef23 +qwen3.8-27b-humanlike-chat-q8 320aeff638c25298 5844b2a7c9ec973f +qwen3.8-27b-nvfp4-mtp a575838e8809f169 609eb826b0aacbb2 +qwen3.8-27b-obliterated-q4 922c3871aa67e01f 422fb1c70452dbb7 +qwen3.8-27b-obliterated-q8 b2ae5d0bd17fca3d 43e4e748407d0d49 +qwen3.8-27b-pi 55978b2cd30e2361 d2fabaf2a1b87ce9 +qwen3.8-27b-pi-q4-mtp ac8f41b2a3fa3f08 48674760ec5589fb +qwen3.8-27b-pi-q5 6d6d918bff467820 c4eec51e3f552638 +qwen3.8-27b-pi-q6 18304635b564396f ef37bea7e9865084 +qwen3.8-27b-pi-q8 07883215e7dd216a c4dbdda6afc63384 +qwen3.8-27b-q4 6d7bfb5a47c1b5c9 4e5e9a52fa9220b3 +qwen3.8-27b-q4-mtp 754bba66111d34a3 27a822fca0e36af7 +qwen3.8-27b-q8 3be18d8fbdde828d 1dac9897ee7e9e45 +qwen3.8-27b-ridge 5045ac86a1b64421 92ce4cd4d5de8368 +qwen3.8-27b-turbo-brilliance-50x-q4 051118417780e3a3 30c883b765a1ad43 +qwen3.8-27b-turbo-brilliance-50x-q8 9431920ff933a406 132295f32329ff4e +qwen3.8-27b-turbo-fable-cold-fusion-735-882-heretic-uncensored-neo-coder-max-mtp 0d8d8b269214e30d 02304befc9c05b34 +qwen3.8-27b-twin-turbo-fable-709-l 121700e20bd0e708 97c7ca0c3c6dc499 +qwen3.8-27b-twin-turbo-fable-709-l-q8 da26c75394160a75 d4327d2f4399bab7 +qwen3.8-27b-twin-turbo-fable-709-ultra f59cef6c112c5725 78a617f8e83dba6e +qwen3.8-27b-twin-turbo-fable-709-ultra-q8 3bb38dd96d483261 3f142ea44d1d2bfb +qwen3.8-27b-uncensored 6b0b072347ecb265 28a9854fcd6654e7 +qwen3.8-27b-uncensored-hauhaucs-aggressive-mtp f3be3c8a686b087a 8e19279957b78ee6 +qwen3.8-27b-uncensored-q4 40c36e5d5caa6aa4 f5eacef9d5ad46c1 +qwen3.8-27b-uncensored-q8 94548740e3cba12d ca45f25f8e00d537 +qwen3.8-27b-velocity-v5 cc43f1812c24df68 6ed39747b6c1f383 +qwen3.8-27b-velocity-v6 79ba26eeef5f8d42 853f82590bd8c791 +qwen3.8-2b-distill-q4 607e8916824ceef2 0b452b35983372de +qwen3.8-2b-distill-q8 0982e7e3cdc8dd24 a1d78096a39bc773 +qwen3.8-2b-q4 1bc87d086ef4471b 1b0da189d0a164cb +qwen3.8-2b-q8 41f1936a77033684 702ba5e13f6f0718 +qwen3.8-3.6-27b-blend 908de26d80b6a356 09bfcfb12e4acbd4 +qwen3.8-3.6-27b-blend-iq3-s 279fb3c163906082 7d6c6d21fa0e3af5 +qwen3.8-3.6-27b-blend-q5-k-m 09594c45f6eb76bf bcc763503c3da5e7 +qwen3.8-35b-a3b-distill-apex-miniplus-v2.1-abliterated 2ec1bed145944e1a 0d0ecfe16299e235 +qwen3.8-35b-a3b-distill-apex-miniplus-v2.1-abliterated-mtp 780fbe4bf9a2c845 11f8659d755f8f4c +qwen3.8-35b-a3b-distill-q4 4a3177e37b051277 4d6533e1aceee439 +qwen3.8-35b-a3b-distill-q5 980bfd6030292845 48fdd7c7ce7db450 +qwen3.8-35b-a3b-distill-q8 4e3051a7bded1d94 93bc999d193e940f +qwen3.8-4b-distill-q4 2376faee03c93e1c 6fa8569cc855d16c +qwen3.8-4b-distill-q8 ee57c16e532222e9 65d7154b409ca546 +qwen3.8-4b-q4 b30bc221cf772d02 e82980cbe56f6eac +qwen3.8-4b-q8 f09ab1faede5f07a c01484b5302b4c05 +qwen3.8-9b-distill-q4 6681250a062ff834 6b798a2bfd7c06dc +qwen3.8-9b-distill-q8 52efc13c79c4553a c701adf87ff2c6ca +qwen3.8-9b-q4 634199ec2ef7d5cf 9b003e3123a0d555 +qwen3.8-9b-q8 55e96facaea94fed a36edf0c26bb0f82 +qwen3.8-flash-next-atomic-iq4 37aa3d236e8cb514 7cb8c1f6eea8f2b8 +qwen3.8-flash-next-atomic-q4 2c6431e06814a2b3 d04a5009274655fe +qwen3.8-flash-next-gsq-rco-coder-iq1-m c6e5dc902883edd2 afcca61cdeb5379a +qwen3.8-flash-next-gsq-rco-iq2-xs bb70d31cfd8ba647 d971715754d0d310 +qwen3.8-flash-next-gsq-rco-iq3-xxs 6bb8aaccd14fddda ad08d77690eaa3b6 +qwen3.8-flash-next-gsq-rco-q2-0 c84cb37cae05d2b7 ae1c96b3e4155b7e +qwen3.8-flash-next-q4 8562750e141282d5 99a9708ad93ecfb7 +qwen3.8-flash-next-q8 47c6d225d7e6b29e 609516bec3eba432 +qwen3.8-flash-next-uncensored 6cc3724a1d5332d5 c43e5bd8eabfac09 +qwen_qwen3-30b-a3b-instruct-2507 ff235651c5d41cee e49240533b5c26b6 +qwen_qwen3-30b-a3b-thinking-2507 52b810df311f1a61 fc9e1e0c8342edb3 +qwen_qwen3-4b-instruct-2507 d08d7176d80fdae3 179108ab792ff915 +qwen_qwen3-4b-thinking-2507 d62e9283f167f0a2 e3c06764a975a180 +qwen_qwen3-next-80b-a3b-thinking a6591de9f6455bf0 2918f229f4b4bbb2 +qwen_qwen3.5-0.8b 934525be7fd9d69a 2f6144e4e9d4b58c +qwen_qwen3.5-2b 58cc68152967f19b 97c14bdcfc7ffe0d +qwen_qwen3.5-35b-a3b 457c40a8fac950be 7100b42bca73b037 +qwen_qwen3.5-4b 0d80f57483f6f3df 233e0c0ee621f15f +qwopus-glm-18b-merged cf4a69b163944048 29a31fc364d1a7f0 +qwopus-moe-35b-a3b d2840fd456813416 f6e539283e4c2b87 +qwopus-moe-35b-a3b-apex-i-balanced 2a11c6cc2150db00 f3d2548eabffcdd6 +qwopus-moe-35b-a3b-apex-i-compact ab2c9be90fbf0a38 68a8884aa6804455 +qwopus-moe-35b-a3b-apex-i-mini 439671f4e3f14fb7 65dc5d5252adeb65 +qwopus-moe-35b-a3b-apex-i-quality 479fb046a0f22dec 9d786a9aa99dd085 +qwopus3.5-9b-coder-mtp 10ba42b184a6c4ef 8b97db9389026eed +qwopus3.5-9b-coder-mtp-q6 664184cf9a28344a 82f63d616495142a +qwopus3.5-9b-coder-mtp-q8 7b69ab28ee5bb7f1 fbf08e0e35d3ccb9 +qwopus3.6-27b-coder-compat-mtp eadb341b1aa1b78a 7f15fac6cd482357 +qwopus3.6-27b-coder-mtp cb60bcf45fd70e77 69e8fdeaf10706f0 +qwopus3.6-27b-coder-mtp-nvfp4 509f84bc4ff60666 47e39a829fca5391 +qwopus3.6-27b-fusion 8da55dfa6646e980 e0f2932385dff849 +qwopus3.6-27b-fusion-q8 318ef68ad53327c7 3c6a1138aec98829 +qwopus3.6-27b-v1-preview eab8cf82710b4ba1 21bb8659122f41ef +qwopus3.6-27b-v2-mtp ab042b2216e5ac8c 2bc36ab4821f7a91 +qwopus3.6-27b-v2-mtp-nvfp4 369cfdbd7e5e93bd 0ecaf62f54997fb1 +qwopus3.6-35b-a3b-coder ca4b567739b3a5bc d1d6027e9af7ccd0 +qwopus3.6-35b-a3b-coder-apex-i-balanced 5804187162f2d3ea cd723e3d1424a0d7 +qwopus3.6-35b-a3b-coder-apex-i-compact d5eac85404620bc4 eb2523673cea1912 +qwopus3.6-35b-a3b-coder-apex-i-mini d98e78f5f5b31ede 391327b268a24035 +qwopus3.6-35b-a3b-coder-apex-i-quality ea90171a52f2b609 f3b81c3eafb41c97 +qwopus3.6-35b-a3b-coder-apex-mtp-i-balanced b8f6201274e369bd 09075529b90fdd2f +qwopus3.6-35b-a3b-coder-apex-mtp-i-compact 8eae6520f54c5697 9e389d19b03d0884 +qwopus3.6-35b-a3b-coder-apex-mtp-i-mini b19dd549f5f65139 0abbbcce4b575a22 +qwopus3.6-35b-a3b-coder-apex-mtp-i-quality 0b86426b1181acf5 9360f95832da58d8 +qwopus3.6-35b-a3b-coder-mtp a36a3480708d7654 9efe2caf98dce379 +qwopus3.6-35b-a3b-v1 fe550d1228909616 5376d3b2c41b9a5b +qwopus3.6-35b-a3b-v1-apex-i-balanced 5a931df9453d4200 b24e6c7d91ec2a77 +qwopus3.6-35b-a3b-v1-apex-i-compact c14e3d83ae80ddc2 9dd8e07a34dcfff0 +qwopus3.6-35b-a3b-v1-apex-i-mini dda95845d8dbdab8 c48eb685d869a6d4 +qwopus3.6-35b-a3b-v1-apex-i-quality 36f7a5072cddfd27 ff6ed1ec4d501bec +qwopus3.6-35b-a3b-v1-apex-mtp-i-balanced 1658d43967175204 72ca045d2c44eddb +qwopus3.6-35b-a3b-v1-apex-mtp-i-compact 5f528e3d4be5d213 60fe9c028a03d0c3 +qwopus3.6-35b-a3b-v1-apex-mtp-i-mini e8cc2d566ce22116 aac04fc9ab4afe99 +qwopus3.6-35b-a3b-v1-apex-mtp-i-nano f6950661cc2c378a 15790aba2246cffc +qwopus3.6-35b-a3b-v1-apex-mtp-i-quality f4c5a137b7585e7e d686888e7669fcc1 +qwopus3.8-27b-flash dad82ec39e045b37 487cd226412ce1ce +qwopus3.8-27b-flash-q8 afc217d1eaddd29e 03b2a0e173795e40 +qwopus3.8-27b-flash-v2 210d9869a43bdd02 02bf5dbf5f9e2a77 +qwopus3.8-27b-flash-v2-q8 4dcb9539d4c41ba2 47289e0226883f12 +qwythos-27b-v1 cbcea451a7ade96e e14717e93f210911 +qwythos-27b-v1-mtp 569c146e0e2fd892 a3857cef425baedf +qwythos-9b-claude-mythos-5-1m b8d1e6c0e4ec9f40 c01a3a252e2f40a3 +qwythos-9b-v2 2b24085ef43d4729 51c1d3dc0ad5a7f5 +readyart_amoral-fallen-omega-gemma3-12b 82917d26a165bfce 10c3f3083c4e544c +readyart_forgotten-safeword-70b-3.6 5a57c4249ae09cb5 a99eb24e31b7ca85 +realesrgan-x4plus-anime-6b 4e47406a61ccef1c 2f1600cc3fe08998 +redcell-26b-a4b 29ce13234d532763 b5c9e5896f689c83 +redcell-26b-a4b-i-compact 41603f418f73657d 6bc7393184904454 +redcell-26b-a4b-q8 a5a3689edfb391aa f1f976336f2e108c +reflection-llama-3.1-70b 92eb109a8e6ec86c 01260c0bc532e6eb +reform-32b-i1 cbf050b85643db30 73f344c6d508de85 +rei-v3-kto-12b a3be5673fd181c9c 611ef78157b5b198 +rfdetr-base cdb12b26c6053c4e 443da0457c9a054b +rfdetr-cpp-base 1e1e0f8ea27f06de 6132e3764a3ac591 +rfdetr-cpp-large 3a64e8fbfac949b6 4f009b85538bc1ca +rfdetr-cpp-medium 3ea1e22726fdaec8 8c7d117e657b844b +rfdetr-cpp-nano e904601f91f3265e 2573f4fc79bca143 +rfdetr-cpp-seg-2xlarge 7afc6dba0c695a67 f58ced221f313067 +rfdetr-cpp-seg-large e6646e2396e30857 9ba15f1ab9838a87 +rfdetr-cpp-seg-medium 6ecaefa33edbaee4 88f221bd5a09c2e7 +rfdetr-cpp-seg-nano 76117fd4a2a28de9 e3adb0350a76aae9 +rfdetr-cpp-seg-small 6082c35eb03e1295 364734e5fb936aac +rfdetr-cpp-seg-xlarge 07eac13e80ac6d0e 70a0d74d8a46fe49 +rfdetr-cpp-small ef32da6cd034c681 9ff955e653182fa0 +rocinante-12b-v1.1 9f437bc18987281b 8063fac91ab6393c +rombos-llm-70b-llama-3.3 381b154cb2f1d072 5c9037adfe562514 +runtimelabs-kayak-qwen3-vl-4b-q4 6d07dd576f0dea01 4b57480af304b892 +runtimelabs-kayak-qwen3-vl-4b-q8 0fca7b0aed9c622f 6b4a9e9196add912 +rwkv-6-world-7b bdd67c9360a721ce efee0e47843b500c +rwkv7-g1c-13.3b 0f6167568fb9e5e0 5f893409d8158504 +s1-mini-f16 c4e8fc4b2ce7da7e 2afabd1395a1d046 +s1-mini-q4 0d13277f75e3381e 0bd88668534d6440 +sainemo-remix f68390f17e4a3e43 069be57c6abfbb3d +salamandra-7b-instruct dd5bf41ec3796094 b60fac0549f64f2d +sao10k_llama-3.3-70b-vulpecula-r1 bf4dfd512577f77c 7844e77b2b83306b +sc117-qwen3.8-flash-next-gsq-rco-iq2-xs 65984fa361599f81 4d7ee350f4bcfb41 +sc117-qwen3.8-flash-next-gsq-rco-iq3-s cb4bcdfe4d223034 3b554699db184023 +sc117-swift-1.5-flash-next-abliterated-iq2-xs b04484a65edd0476 b7487e7e1e46e9e3 +sc117-swift-1.5-flash-next-abliterated-iq3-xxs 62ff3825afa22472 a17dba90d7a099b0 +sd-1.5-ggml ead88879456d2826 04a59dbed8c38d90 +sd-3.5-large-ggml 0fee9d3ef5e20925 93a73940206ff861 +sd-3.5-medium-ggml 938231e49994960f 2fbbb113faa98e07 +secret-filter e7426efb2d66cba7 9a0e567843fab107 +security-slm-gemma-4-e2b-it-q4 822d47d22aee3508 050c5a92cd827dd7 +sekhmet_aleph-l3.1-8b-v0.1-i1 87d0e9069eebd981 78d6cc9653e6d4bb +selene-1-mini-llama-3.1-8b 6ad2866ef7d31632 49cbba972884857b +sentientagi_dobby-unhinged-llama-3.3-70b 89233bc3befe15c0 d3b7ba6b881ea97c +serenity-26b-a4b 8542976c26d3a8ba 96c8572b60cefce5 +sharp-minicpm5-2b 810c90a2e7e8b371 09235938eda2da38 +sharp-minicpm5-2b-q6 3c2ff7f3c4a6631d e28398af202d7d6c +sharp-minicpm5-2b-q8 cddb7efc8f9086f9 c23e42058b997a4c +sharp-spark-x2.5-4b 0c996c2323902d14 05cd3c2e8c0816f0 +sharp-spark-x2.5-4b-q5 28a7e3de815842d7 66d55d9bc0772a04 +sharp-spark-x2.5-4b-q6 77ba5ddb06649620 ae744e43a9d1838b +shieldstral-1.0-3b c0c9130766730c70 7793d60232ef4146 +shieldstral-1.0-3b-q8 9e5bccd994f37a5b 34f6f9abad516038 +shuttleai_shuttle-3.5 133ad88ccf3aa86c 825daa0b6538f1c4 +sicariussicariistuff_impish_llama_4b b77f8f3bdb4c6643 aa263ddabbbde6a8 +sicariussicariistuff_redemption_wind_24b 52976c9045c36ece 991861f71d6cd155 +sicariussicariistuff_x-ray_alpha 44d8a1a204783f15 b9c31dd27a6b076d +silero-vad 7713fd538b9c0fa6 11544b2b192f9178 +silero-vad-ggml 542650120566aade 15d53cedb47008da +silero-vad-sherpa db055814ba4a9399 5a65d49282b2c9db +simia-tau-sft-qwen3-8b 102dbb55c668a117 fb77e1e6bd585649 +simplicio-27b-q4 46672f532f0378ba 37f82fc87ce005e3 +simplicio-27b-q8 e380535b2a290a79 f6ad5e2af17fa19d +skywork-o1-open-llama-3.1-8b 9fede5b37454e858 9355aecca7a2953b +skywork_skywork-or1-32b 77b51c118275c4d0 6353ffd139740dc7 +skywork_skywork-or1-32b-preview c32938c5d255770c 2f14817fe12ad044 +skywork_skywork-or1-7b 725f7be20919e7ee c68361340c838d1e +skywork_skywork-or1-7b-preview 2632be11200b4e05 5b973b6530e68120 +skywork_skywork-or1-math-7b 094eccf83dd6145a 93af655eab197809 +smollm-1.7b-instruct 3a16c8558bbe9028 38b444ec7da3cf31 +smollm2-1.7b-instruct 7df5134e4176b68f 267c59fa613ba1ba +smolvlm-256m-instruct 5562a3be7dfe18ea 6ba6ca12e4cebe33 +smolvlm-500m-instruct 54f21411122bb590 c36f37ef55cb11e9 +smolvlm-instruct 9417332c7e32d458 d3d35ea992eff63b +smolvlm2-2.2b-instruct 3bcf99f35b9576a0 a699683aed5a2f4e +smolvlm2-256m-video-instruct 500e602b0f800ff7 790f549b89f4d453 +smolvlm2-500m-video-instruct 89818a250b16891b 2ac60dbbf43b08b4 +smoothie-qwen3-8b cb4237b2380d7794 482557d586865085 +soob3123_amoral-gemma3-12b 06fa48f812aaea3b d340bfd6d92ba694 +soob3123_amoral-gemma3-12b-v2 a642e05bf149f74b fb234a7c7bcbc928 +soob3123_amoral-gemma3-4b 2fe72522f0849261 159e418b399aa968 +soob3123_grayline-qwen3-14b 05041fbc359c3fc0 82bfef6b5adbb5b5 +soob3123_grayline-qwen3-8b 791fc308dcf2246d 5a5188262d19dcee +soob3123_veritas-12b df7b86bde64d48f3 2a0ee289c1c47845 +sophosympatheia_strawberrylemonade-70b-v1.1 579bf99f8a6f0c53 57ebfb5050106734 +sophosympatheia_strawberrylemonade-l3-70b-v1.0 bd0f83f9c5372621 2b10dd635573d4e5 +spark-s1-4b-v6 2f43f743ce1a5c11 5238af7fd8262136 +spark-x2.5-1.7b-q4 43efb314a811ee0e 99b124ba456f4e50 +spark-x2.5-1.7b-q8 a2af64a5080fb0af b78d832693fe3801 +spark-x2.5-4b 0ad9673828acc421 b936133a8812b75e +spark-x2.5-4b-heretic-jp-q4 254da823f46fd3a3 36a95f3481fcf471 +spark-x2.5-4b-heretic-jp-q8 70caf841fcf29782 f6a0a10a531895de +spark-x2.5-4b-q4 b04a6da93c34bbce e3f8d1125dbc8b08 +spark-x2.5-4b-q6 2b3f10c4d78b6c93 2d7242a07f55828f +spark-x2.5-4b-q8 341367eda53f31bb 91d3a41f6658fd13 +sparse-llama-3.1-8b-2of4 27fa1ab35e0f1e9d 751dcccd68ed7fcb +speechbrain-ecapa-tdnn 1cd7cd65696f5f3b 0cf92d148d0a5c45 +spiral-qwen3-4b-multi-env 039752c259db9d9c 2672f9c7b3affc39 +stable-diffusion-3-medium 3d57a26b3e8e96c3 395d3d8879bb3ec8 +stable-diffusion-x4-upscaler 8a2a24f317347899 96ef6a3760dfb50e +starcannon-unleashed-12b-v1.0 a85f165e4a64a6ef 8668fed37cad0a43 +starrysky-12b-i1 986a4760f3cd53dd e138f27a9b73d72d +steelskull_l3.3-cu-mai-r1-70b c1a74cd068e7466c d8b018243a67b0c8 +steelskull_l3.3-damascus-r1 49ac642a77e3957d 5b2accd574c8e483 +steelskull_l3.3-electra-r1-70b 79e64b3de2be130f 8c73bb5c05a43876 +steelskull_l3.3-mokume-gane-r1-70b 2d7d76d3e062452e d65a6f51f1ff49c7 +steelskull_l3.3-mokume-gane-r1-70b-v1.1 799e41b66d195557 c8804a0a2bee79ba +steelskull_l3.3-san-mai-r1-70b dd8e250cdb1a4fd5 6fe53e164ad1a16e +steelskull_l3.3-shakudo-70b d2473c0e57f05527 8cc7bcd0180dc88e +step-3.5-flash 070733522824d457 9cd273692262a51a +step-3.5-flash-apex-i-balanced 966893adc45946c4 8c63fbd3ea973884 +step-3.5-flash-apex-i-compact df8c68bc1697ab6c 0dbb5702928f8320 +step-3.5-flash-apex-i-mini 67922e4c9b8b98b5 683b60fc1c7835e8 +step-3.5-flash-apex-i-quality 4abcee9626c8bb6c a31daa64495a03b5 +step-3.7-flash a1323ae02c4a6f32 4649f141cdcb31e3 +step-3.7-flash-apex-i-balanced ab728450c38d8448 f2efef5085b1758e +step-3.7-flash-apex-i-compact 633ddb4a490c14f9 6a98828946b494fe +step-3.7-flash-apex-i-mini cce2ff19680a9e82 c833cceccda6c22c +step-3.7-flash-apex-i-quality f9d6aad54e1f946c 825be8f7a613e7a7 +step-3.7-flash-q8-0 d74b8f45647f52d9 b605a74c4ad662fe +step-3.7-flash-ud-q5-k-m 9e6887c33a8edf21 15c0b5ccb5eb6357 +step-3.7-flash-ud-q6-k eca95c92119ca39c 6e4b96326dc08907 +streaming-zipformer-en-sherpa de0722c33dab2514 1518eff0a1bba73a +suayptalha_maestro-10b 04ee465be4c448c7 43bd0263ebfaa8fd +supergemma4-26b-uncensored-v2 75787c797d22fc19 27b1f58ff0daab29 +supertonic-3 6761251b8847ff49 bb0dd029a69a7c48 +supra2-100m-instruct 56e534857f72995c df90566a5b0d81c5 +swift-1.5-qwen3.8-27b-gsq-rco c7b9021f60597ce8 b1947db69340e7d7 +swift-1.5-qwen3.8-27b-gsq-rco-iq2-s 0f79fb3b12fe240c 19e5b6678e85858f +swift-1.5-qwen3.8-27b-gsq-rco-iq3-s d05e93a3d36c8e55 e9234e8959fe622e +swift-1.5-qwen3.8-27b-gsq-rco-iq3-xxs 373ac0f907affb2f 924c3e015129ba7d +swift-1.5-qwen3.8-27b-heretic-gsq-rco-iq2-s 9edff9555372384c 1bc53e76f151f0c4 +swift-1.5-qwen3.8-27b-heretic-gsq-rco-iq3-s 78a61a5672ca0af5 892a1e4cdfaa4b78 +swift-1.5-qwen3.8-27b-heretic-gsq-rco-iq3-xxs d0922aaedc2fe7d9 f5d740aba7b6d415 +swift-1.5-qwen3.8-27b-q4 4746d8ba7cb0ef09 4bf0ab71bce5a968 +swift-1.5-qwen3.8-27b-q5 dd25bda0482a72fa bda2ab0e6ba7751e +swift-1.5-qwen3.8-27b-q6 95f0d3ec57c05008 fcc00a3f0408fef0 +swift-1.5-qwen3.8-27b-q8 d4ece440d7e25fe5 15fd5e0f69cf4696 +swift-1.5-qwen3.8-27b-uncensored-mtp 3603f1ac7533247c cc922f29736addf4 +swift-1.5-qwen3.8-27b-uncensored-mtp-q8 677f1b37bc0ba352 c9cd622ce1f304d1 +swift-1.5-qwen3.8-flash-next dcb2d7117209fba4 e8b46941738d2bcc +swift-1.5-qwen3.8-flash-next-q8 d52fac776c0b259d 3cc83c747f0a04e8 +swift-bonsai-2-pq2 b03cc2e3fb709133 1d0277f88522dafd +swift-qwen3.8-27b 8e4f48bb29ddd5b4 8c42cc49f587cd01 +symiotic-14b-i1 b07d61bd84674358 b393155e03199d4c +tarek07_legion-v2.1-llama-70b abededcb94d7c647 4d3141db4e8ff8eb +tarek07_nomad-llama-70b ccce85767afb88fb 63648552192b36e5 +ternary-bonsai-2-27b 6ac355586190da6f 992278ba7a3502f6 +ternary-bonsai-2-27b-abliterated-pq2 7db8bb4e4915b600 e04cfd543a413569 +ternary-bonsai-27b 2fa1400f104eed87 10376bc860d4fda9 +ternary-bonsai-27b-pq2 52bcce3cbee6e9d1 5f7d6caff77967b0 +ternary-bonsai-27b-q2-g64 5d7f3cc4264b2fad 74201f40c8a0b892 +ternary-bonsai-8b 5871d58146b277d6 e56db523d1fd2b5a +ternary-bonsai-8b-pq2 45f596c50d1ce28b d2053cea59111b6a +ternary-bonsai-8b-q2-g64 4914db6d955b5b27 2707b9724bee19a4 +tess-3-llama-3.1-70b bbbead7c2f2b029e 9c068767cfd71188 +tess-4-27b 3a62dea7b96b289f 855b5c37397c0208 +tess-4-27b-mtp 946a15f40aa072ee 2680fa707e19beff +tess-4-27b-q8 09ef0ce8f9acf3ae 5bfbf5a8c95b19a7 +tess-r1-limerick-llama-3.1-70b 2d74cde22cf3f15b a659a5ca2995d9d9 +tesslate_synthia-s1-27b effc88951b7b23d9 62a6edc4c434c796 +tev1-0.8b-vllm-cpp a90088a7ea910eb6 6efdc3add3ecc775 +tev1-4b-vllm-cpp 491a0b0e902093a2 690f509bfd6a5574 +textsynth-8b-i1 8b18b76646192134 51f84c132f8f05cd +thedrummer_anubis-70b-v1.1 248a1149e4c3ed82 5ce9b29e4742c6e2 +thedrummer_big-tiger-gemma-27b-v3 74453d8bdd2d684d 64e85f70495d5493 +thedrummer_fallen-gemma3-12b-v1 42a536fa0015a49e 314e5c0fd104ca48 +thedrummer_fallen-gemma3-27b-v1 8a50238baa5e9135 ec096d9cd32cf5db +thedrummer_fallen-gemma3-4b-v1 f08f812d3a6a02e9 28bf3b114138f891 +thedrummer_fallen-llama-3.3-r1-70b-v1 edc553410f5e3dc1 601315868d1d1391 +thedrummer_gemma-3-r1-12b-v1 4fa38846abef0cc6 07ebea9b41725805 +thedrummer_gemma-3-r1-27b-v1 bfdb3aa5be05e32a 0108893a7462ff77 +thedrummer_gemma-3-r1-4b-v1 aebf884291baab1d 1c714bf1b2d34878 +thedrummer_rivermind-12b-v1 e7070229ea283afc e120604014f305bd +thedrummer_rivermind-lux-12b-v1 13d1013f10ded206 a0029a5f2c140bf7 +thedrummer_snowpiercer-15b-v1 a898e6efce6a79b7 6c3b4efa1706f5c6 +thedrummer_tiger-gemma-12b-v3 0339d52af784eecf 335f66e276fa41db +thedrummer_valkyrie-49b-v1 e42a9c6a87568a6e 0ef5bf880d859129 +theia-llama-3.1-8b-v1 c859abd53f32d35c 89249c3411d0b214 +theskullery_l3.3-exp-unnamed-model-70b-v0.5 cdf5b65cfe61c0a1 a22b044ab2bc5e9b +thinkingcap-qwen3.8-27b 05cfa3a713546ced 741204929f7a6219 +thinkingcap-qwen3.8-27b-q8 0a3d8a01e272bd46 7f2a119c82d0af90 +thomson-1.0-small-q4 66f684c1a9ec2bdf d4f8d307a5b9d35b +thomson-1.0-small-q8 3c395b411cb6ef9f 0db9d1bf0d82994d +thoughtless-fallen-abomination-70b-r1-v4.1-i1 01b44e0d01e9484e 6a54fd03c106dbb4 +tiel-coder-35b-a3b-q4 f07348d653e21ef5 548d45f2cd11b6a8 +tiel-coder-35b-a3b-q4-mtp d4f55dd880d137ce 70889e8becfdc441 +tiel-coder-35b-a3b-q5-mtp d69e746763ad811d 1441cc16e578351b +tiel-coder-35b-a3b-q6-mtp 154441960f562c7e b5dff27ee292477f +tiel-coder-35b-a3b-q8 74b9d0ec9090cf7c 21d0636193f5680e +tiel-coder-35b-a3b-q8-mtp 4664720e06ea7b7b 3deaabceeeb94fbc +tildeopen-30b-instruct-lv-i1 e1a1994290cc4993 79a84a53c2408855 +tlacuilo-12b 10472b656f3e3318 4d139876709cc7ec +tor-8b c4e25a9bdc3eaa1b 8e198bbaa6b26ae4 +trappu_magnum-picaro-0.7-v2-12b 1a12299b20900236 97e3290c89f51eba +trellis2-4b 95cd267660be2c3a 59b4fc6bea6d6614 +trellis2-4b-geometry f9551dc5faab382c 68044ac26ce0181d +tulu-3.1-8b-supernova-i1 754338e02d4be5ed fd535418d01f05ed +tulu-3.1-8b-supernova-smart 79191a9e8fc010d0 67c4e98a9d3a59df +twil-lm3-pro-q4 cdea5f70769bc66a deb46b0f7e72523b +twil-lm3-pro-q5 cffcf8b3d7025cc3 eadd629e362f3d44 +twil-lm3-pro-q6 0221e79b27f75925 32ccfa044411895f +twil-lm3-pro-q8 1c1aefacbaca2bd7 80ef29ed35c27578 +twil-lm3-q4 8977204660946966 63ca4555311586d9 +twil-lm3-q8 5e614f06d9721165 e44c92253782a09b +ui-mate-27b ee408b267147464e 886005b7eb7f5521 +ui-mate-27b-q8 2fc54418f23b3258 db50618556644438 +ui-mate-9b ab62426d397f6a1e 87418bf572d0892f +ui-mate-9b-q8 24d2408032575708 7d4b3ee0b7535485 +ultravox-v0_5-llama-3_1-8b 2dd04a0bae1d01d7 bfb01114b36a5e32 +ultravox-v0_5-llama-3_2-1b 8a3bcf76546a916d 576e3f1855c904cf +una-thepitbull-21.4b-v2 b2407f6b506aab20 10fe83946dfbd6e5 +uncensoredai_uncensoredlm-deepseek-r1-distill-qwen-14b 08326528b073d757 237f7b61e410bf31 +underdog-saluki-27b-1.0 113811d234f7599d 4e72e819089b3e55 +valor-7b-v0.1 296eb2942f89e342 ba26c9495637a77e +verbamaxima-12b-i1 98d1ff2a80002eaa 9c457acae64b7e82 +versatillama-llama-3.2-3b-instruct-abliterated dff0bb1d377f77b0 741fb096e21afff4 +vibevoice 5b54eff117ad9d8d 0107d912f7c49ac9 +vibevoice-asr-bitnet-aggro-crispasr c37ce98f466ea424 9390620127cba74f +vibevoice-asr-bitnet-both-q5-crispasr 3fd273f4932c1c67 9ee1b8d60b9edc7a +vibevoice-asr-bitnet-crispasr a8e26c728614b449 1914e972e81dda9e +vibevoice-asr-bitnet-embed-q8-crispasr 6df6f018d47eb158 45c372f4aabf193d +vibevoice-asr-bitnet-vae-q4-crispasr b72b62559fbc4940 7076e5d40872ab24 +vibevoice-asr-bitnet-vae-q5-crispasr a9c05dfada352851 67f845685877b45e +vibevoice-cpp 37b5b04210d0954a c5ec40a1ca57a13a +vibevoice-cpp-asr c415822e7d31bea8 91180cc9f96e172e +vibevoice-crispasr e553f8847bd4577d 65e56ffdcea82cac +vibevoice-tts-crispasr cf4f15c4af4eddd7 94fa7a1070cda386 +violet_twilight-v0.2 0d83eccbe143c737 fc340d484c6365d3 +violet_twilight-v0.2-iq-imatrix eea827fb35bce3a3 783878b41d01e73c +virtuoso-lite 7ac066de36755344 d54569a3eef692cb +vits-ljs-sherpa 91146ae35a88634e fe7e3fee1501696e +vits-piper-de_DE-thorsten-sherpa 7f1a15736e0c8100 117fe04d4b2d3c76 +vits-piper-en_GB-alan-low-sherpa 74570ea689fb5118 5f4fb3a1af25c6f9 +vits-piper-en_GB-alan-medium-sherpa 9254c067147cfc57 76bbb4d4b285fa17 +vits-piper-en_GB-alba-medium-sherpa 6706164cd6d005e2 066f3c256ebc532e +vits-piper-en_GB-aru-medium-sherpa 2ff264dccdb9e352 06a7f45dbf61b9c3 +vits-piper-en_GB-cori-high-sherpa 4c049343b8281fda 9fb7012f835c7b73 +vits-piper-en_GB-cori-medium-sherpa 81bb797cbcf84e9a 03b106d62b506956 +vits-piper-en_GB-dii-high-sherpa bd31ead926468296 53fe905f48052815 +vits-piper-en_GB-jenny_dioco-medium-sherpa 867e241a5f1b07ab 0cd87b1e3a44f538 +vits-piper-en_GB-miro-high-sherpa 2e06d9d29b082c7c 87e2361e09b4d624 +vits-piper-en_GB-northern_english_male-medium-sherpa 9c0b7d981a53dfc4 49264267bacc2f51 +vits-piper-en_GB-semaine-medium-sherpa 04eba97b3b5d1267 681cb0473f30f267 +vits-piper-en_GB-southern_english_female-low-sherpa 1abb455e49c5ab32 cd3337ac0589f2e1 +vits-piper-en_GB-southern_english_female-medium-sherpa 42263a2011c6d2af e25be2da7446217f +vits-piper-en_GB-southern_english_male-medium-sherpa b8cf6a714bc646d6 3630765ee52ac765 +vits-piper-en_GB-sweetbbak-amy-sherpa 78a9c8722d9fc08e 04275a436562351f +vits-piper-en_GB-vctk-medium-sherpa 5673c640251e631a 6cc133e4480975cb +vits-piper-en_US-amy-sherpa 6be48c5e113ca471 2384df93a2cc3599 +vits-piper-es_ES-davefx-sherpa dee429d64f69309c 4d82d54757721ce8 +vits-piper-fr_FR-siwis-sherpa ff547420e2221192 7509b6ba3fa9dc08 +vits-piper-it_IT-dii-high-sherpa 9b5d69bb87f6c52d 80ad83cd56c5447a +vits-piper-it_IT-miro-high-sherpa 178d12b5cbc34331 599e573db2962c2a +vits-piper-it_IT-paola-sherpa 8627d441d13f7b84 a16450ab29937c9c +vits-piper-it_IT-riccardo-x_low-sherpa 74df8678dd1b33e0 8da951a4fc79209f +vits-streaming-assistant 371801b04f7da99d 2adda7a87e2fd3d4 +vllm-omni-qwen3-omni-30b 2013cea638d639f6 36a5a5829b7992f4 +vllm-omni-qwen3-tts-custom-voice c3125a77a4dea4dc c564ac60ff8edd3c +vllm-omni-wan2.2-i2v 3520097cc30d000f d54f217ce5ace6ad +vllm-omni-wan2.2-t2v 3e5a5c9e986dff9c 9632358f47776641 +vllm-omni-z-image-turbo 1bf1260270a2358f f44148cb186c7cc7 +voice-ca-upc_ona-x-low 29648d84f5f51a58 2ebd77cd5eb51b2f +voice-ca-upc_pau-x-low 547f1d6048bb21fc c3319ef626020c72 +voice-ca_ES-upc_ona-medium e0b69b51e1072c75 abefb9c7a65ab63f +voice-cs_CZ-jirka-low 1f0c04f6dbd4358c 0932b0e1135b3f2d +voice-cs_CZ-jirka-medium 20e2f6ef50ae2457 e20df874758c5feb +voice-cy_GB-bu_tts-medium 7faf8ffd3742918d 863a7c672a5a547b +voice-cy_GB-gwryw_gogleddol-medium 92846fd9562a2139 25afd01dcdf69522 +voice-da-nst_talesyntese-medium c7c6da57825de8e8 d8dff30ad1d23be0 +voice-de-eva_k-x-low 2657b2a76aad063e 4a3f28f648d15ebb +voice-de-karlsson-low e2426bb18320239c 710e705f837f4ac9 +voice-de-kerstin-low e40129c8fa6f8b4b 009fb9eb0870f4cb +voice-de-pavoque-low 88e0bf13c14b2a8a 1e9ca6015b20a2a8 +voice-de-ramona-low 90773e373f69f3a8 ab774b37156b911e +voice-de-thorsten-low ee94c01530f93a4a 06e048a318a4e65b +voice-de_DE-thorsten-high 1d49b47f78efbd66 2b412195913b355e +voice-de_DE-thorsten-medium 63b6bcffc2123304 3bbff46a2fc7c093 +voice-de_DE-thorsten_emotional-medium 0b9ed28bd2f2b605 a7a447ceebf46a3d +voice-detect-age-gender-wav2vec2 3e7f1874844b618f 99951d79392da0d3 +voice-detect-campplus 2a9f2ca118276e91 56b8de8f1dbd9545 +voice-detect-ecapa-tdnn cc45814eb98d6a4b c4a8b49f5790483e +voice-detect-emotion-wav2vec2 89dfc9f575e2e32a 553f4330d4ed38d2 +voice-detect-eres2net 501713e60d3cea20 f5500ee4c1826738 +voice-detect-wespeaker-resnet34 a6c1619a9ad5b1d3 ade0e8b965d3db2d +voice-el-gr-rapunzelina-low 7454af0dde7ff4b7 4baddadc4e01c4cf +voice-el_GR-rapunzelina-medium 45f92dbfed65f5aa 7707051bc60b7356 +voice-en-gb-alan-low 39fe0565e10eb3bc 4296daa7b307d5fe +voice-en-gb-southern_english_female-low 168b74740fb6aaaf 50a9968e6c88b4f0 +voice-en-us-amy-low 9b87ce04d544d089 81aa1a227a8412a0 +voice-en-us-danny-low 0ae81aef9a16e6fc 80d9d7cddca3e1de +voice-en-us-kathleen-low 56c7acbfe9336c23 41b8ff794f752ad7 +voice-en-us-lessac-low a909109fb08a5baf 6ad5c4561cc1c2ea +voice-en-us-lessac-medium d0de4350e129c558 639e6e03b8cf4730 +voice-en-us-libritts-high ed4da840f404adb9 86f52fcfbc3a76cf +voice-en-us-ryan-high afe2229248202718 a4a22b641c5006d9 +voice-en-us-ryan-low 5e13dbea1f54bc6f 6616fd2a5ca50250 +voice-en-us-ryan-medium ec620bed0b474cd4 99d5cb1f2f5bf755 +voice-en-us_lessac 6b5f31bd446e07d9 2d8e34c4ff9871ff +voice-en_GB-alan-medium 3eecd92f2e6a3be0 ea6a35b3bc4daa29 +voice-en_GB-alba-medium fca18f862381259a 81688e3735270c2c +voice-en_GB-aru-medium c2ebd0041be3179a 55b8802c0ca0d145 +voice-en_GB-cori-high 8407e4386ff461cb bc093c063a184e75 +voice-en_GB-cori-medium 88eaeebc35dc2e23 0f3a91e0b74bbc19 +voice-en_GB-jenny_dioco-medium a36d8f4f7cbe81d3 e179fd38ef55e0cc +voice-en_GB-northern_english_male-medium fda4d1713181ccaa d2414a5d8a872f06 +voice-en_GB-semaine-medium ed885e6c508027bd a616cc90c26be42a +voice-en_GB-vctk-medium 196ed622187b6317 daf9dee2ac1966d2 +voice-en_US-amy-medium f144451d7c678e12 e9860fe95f54e4d5 +voice-en_US-arctic-medium a595026930dec734 6012719d63273b30 +voice-en_US-bryce-medium 27a513785edaa948 4ca88a26d4ffa6a1 +voice-en_US-hfc_female-medium 5c6e7f2a5a61f21a 16970fa07884f358 +voice-en_US-hfc_male-medium 7e26f017bb9f75e1 0507b978d6dbea05 +voice-en_US-joe-medium ce52247d74c42406 aebf9c373a521d83 +voice-en_US-john-medium 2cfc2b56b9a414e5 d05aef7e52479a33 +voice-en_US-kristin-medium d32bb7627e195b0e 8ef97e5964efbd3a +voice-en_US-kusal-medium ea5354265a502b83 9e8b1f3f0a98b82d +voice-en_US-l2arctic-medium 2043c85092504188 93138a90cd23a841 +voice-en_US-lessac-high 9d0dbd55020dc2a2 751ceaf80588c545 +voice-en_US-libritts_r-medium 98a5e030fda4b833 8ab2658d4dc2136c +voice-en_US-ljspeech-high d49a96943d9c2d3b b4cfe2aac17918a0 +voice-en_US-ljspeech-medium 3693218d70064d9c e2ff9d8f42f2bcb0 +voice-en_US-norman-medium 132876acab5686da 6c3b8f41e2a98453 +voice-en_US-reza_ibrahim-medium 824b4f9975520bff a706abe30b3ab3fc +voice-en_US-ryan-high 75f68c1b28a095d3 1a73ab1ba48fa9b8 +voice-en_US-sam-medium 7a6ab4f191fcc10a a1fbe74b36270b6c +voice-es-carlfm-x-low 58909e11e14430b6 850c9302ec7a73f2 +voice-es-mls_10246-low 5d911a060144beef 1e35c8bc9dac5da1 +voice-es-mls_9972-low decf7d7177d10252 6acea7813049ffdd +voice-es_AR-daniela-high 7a62cb19b9b969ff ca7271fdb109e163 +voice-es_ES-davefx-medium 68c1ca779d4dac1b bfa986980dafb40f +voice-es_ES-sharvard-medium ab5521a8039fc69e 971b4855ccf3a1ed +voice-es_MX-ald-medium f49ff687e870dd22 53e49247a347b2d6 +voice-es_MX-claude-high 5fdefbecaab8f9bc 5ca9755a826466b1 +voice-fa_IR-amir-medium a9f45a9f8b47da21 eb37acf467ca136a +voice-fa_IR-ganji-medium 197b590aaf72cad8 de472505bab818d1 +voice-fa_IR-ganji_adabi-medium ae3e86eb49fe84aa 91ca60a69465e2c5 +voice-fa_IR-gyro-medium 46c1e3f3a03698f7 15963fd744a28d48 +voice-fa_IR-reza_ibrahim-medium 180a537e9b49515b 5d277f7cdb2f02a2 +voice-fi-harri-low 7c55b5e9fc9b5f08 c88b75c606382947 +voice-fi_FI-harri-medium 008c5bd804fa8fa5 a5b74004867a7a8f +voice-fr-gilles-low 395432dc621153da 577051c8bbd769f4 +voice-fr-mls_1840-low 9ee6f31015474568 48c569f1e2500f3c +voice-fr-siwis-low 2e0b53aadde4a7e3 37686705503965e0 +voice-fr-siwis-medium f523ad8020a8d595 8d242a2c06eb4f98 +voice-fr_FR-tom-medium 23de1ced1309278e bff1555ab8ec8946 +voice-fr_FR-upmc-medium f788e9e3eac3a624 8def1fcaa846ca23 +voice-hi_IN-pratham-medium 284da5d5d0b1f489 df8a0c4a04fd2c30 +voice-hi_IN-priyamvada-medium e980a59515a08f36 1433522fdddf5930 +voice-hi_IN-rohan-medium 96c22f0b63214a94 faf61c39d43cd464 +voice-hu_HU-anna-medium 117f34f9f47a180f f6973acf213ac99b +voice-hu_HU-berta-medium a7fa9a5c959d19a6 510b6a6325509273 +voice-hu_HU-imre-medium 5f232267e663b659 c556290f8e6652d8 +voice-id_ID-news_tts-medium 4769930d60d43cde d7fe1700d8671843 +voice-is-bui-medium c1fc084e68888f63 0dd1f005ee0dafc1 +voice-is-salka-medium b57a2a3cdf0c5e11 f4fe4efa52d84af0 +voice-is-steinn-medium 3a1d5af9f086207d d5607dd676b42cc7 +voice-is-ugla-medium f67caeea97b43ca8 3d23b48c564bfd5c +voice-it-paola-medium 0e51c8a59db72ec6 4c8b3fba578d3b2a +voice-it-riccardo_fasol-x-low b71fdf1f509812c0 9a6ff72231c13b2e +voice-it_IT-aurora-medium 7b4cf535032dfd65 b0ad85db1fdd3434 +voice-it_IT-giorgio-high a9152ae6fd6eea9a e2a9c7f2635f24a6 +voice-it_IT-leonardo-high 109259aba4fe7967 ecaedc5a5e7220bc +voice-it_IT-ugo-medium 4cfa7854f19fc7a3 a46890a792a08cb7 +voice-ka_GE-natia-medium 68d9ffff9e34cc80 97cda4e898dbf0df +voice-kk-iseke-x-low 9461727c054386a2 6023b52e00d40a76 +voice-kk-issai-high b06477cb012d80a7 67f9ace97d211728 +voice-kk-raya-x-low cf6cdbd87ef5b2d1 51c85482d940e386 +voice-lb_LU-marylux-medium 373c0f6a26455f89 a1cdab3736aade56 +voice-lv_LV-aivars-medium 2929178f891423b3 ef210df5d5c43fdb +voice-ml_IN-arjun-medium 7b881da885c2128c acbb574ecf076b43 +voice-ml_IN-meera-medium a9b50ec00c81bdcf 266ac2a60d123cf5 +voice-ne-google-medium 274cc30d5c2b6d76 ff25b27906bf7d56 +voice-ne-google-x-low 477bc8bf747e27f4 957db2d456551750 +voice-ne_NP-chitwan-medium 77dcbdc0fdeb9f88 91894b39d8deabf0 +voice-nl-mls_5809-low 274d5e6ed30baf75 841d246feaea6bcc +voice-nl-mls_7432-low f867082f542bc1bf 506477d4f5622d9c +voice-nl-nathalie-x-low f262b884fe5f7fc9 8ff06eddb5541789 +voice-nl-rdh-medium b49e28eff8a7d8e6 36a5af0b0f3e071d +voice-nl-rdh-x-low 4f1449caae772e25 c3936f3fd4950ac5 +voice-nl_BE-nathalie-medium 5223876bc6fc3830 578595be449dfd65 +voice-nl_NL-pim-medium 171c8e7e1ecb3893 3f36ee41801cbe30 +voice-nl_NL-ronnie-medium 211c7ea867ea6898 82aa7e9f82caf02b +voice-no-talesyntese-medium d5c3edf40e479940 2e2a1898af2f1eee +voice-pl-mls_6892-low 2bcbd3ad33264423 99eeac3a0146a986 +voice-pl_PL-darkman-medium d9f046234dd3e8f1 a54c6049ce82514a +voice-pl_PL-gosia-medium f109a1e15b22aa3f b6bd8bcf5c858e81 +voice-pl_PL-mc_speech-medium fb6d2f05382ce4ba feb4d61c51b44437 +voice-pt-br-edresson-low 9226c6888c87e847 ce7d2b1c054c1a19 +voice-pt_BR-cadu-medium db3320c35a2b8cac 0697fb0d81096c00 +voice-pt_BR-faber-medium 5abacb58dd2ec6b8 ff4ffd936a8d8f01 +voice-pt_BR-jeff-medium f7aacbe60e748a47 ecd01cff00b4826c +voice-pt_PT-tugão-medium 2a32192c74e7f298 c24acb14fafcc64c +voice-ro_RO-mihai-medium 0f683b7bff306510 fe64824820b14bc0 +voice-ru-irinia-medium 374b9cc0622f9268 7489c5966213ce32 +voice-ru_RU-denis-medium 9f650fa3a28289e1 96d27b6d7ca955ac +voice-ru_RU-dmitri-medium ccf6b76346b80594 5e52d065edb744f3 +voice-ru_RU-irina-medium aca2df861b408d2c 5805d6fe44158b40 +voice-ru_RU-ruslan-medium 5d0fa422f11e5f45 a5daf109cc413516 +voice-sk_SK-lili-medium febdc5d545e3a79b 6844ed386c4cdebd +voice-sl_SI-artur-medium a36fa40bc2e26fc2 94878cec06a35857 +voice-sr_RS-serbski_institut-medium f8516c55add465e4 c5db36133a3ecd84 +voice-sv-se-nst-medium c0ecc04d3565f902 bb7a42e0d1e3ea65 +voice-sv_SE-lisa-medium 096be787faa21fb0 d0a9f71d46e08bd0 +voice-sv_SE-nst-medium 368b7d8b9debfe98 f08de6ec69a45379 +voice-sw_CD-lanfrica-medium a9b93e4b2806f350 d1aa43da8d9fa3e6 +voice-te_IN-maya-medium 58ca7531517b83e4 aff2a002601b1de9 +voice-te_IN-padmavathi-medium 3bf13fc05cd9ba67 fa4f3094d56e941d +voice-te_IN-venkatesh-medium 2bbcefbc9aee8052 e76201f58b9e4194 +voice-tr_TR-dfki-medium 06cc93eb292cc1d9 6485661e4af2380d +voice-uk-lada-x-low ed4c6bf44dd51275 957a4b4bec1cbf64 +voice-vi-25hours-single-low 8da0a9f93c2e2b69 ff6b985ff5c8e218 +voice-vi-vivos-x-low 1df32bf419c1f601 27566666ce701a15 +voice-zh-cn-huayan-x-low 00817d033468501c cb4296bb44ebe242 +voice-zh_CN-huayan-medium 2085944db091faf3 c8a180898fd3b0b7 +voxcpm-1.5 2d0c63ca1eb85e11 f13f7a3fcbcad71c +voxcpm2 6b48c595d0fcb9bf 39eca6e314a44dd1 +voxtral-crispasr 571eadc271a3e810 a7d4a167c7705c2e +voxtral-mini-4b-realtime 11b6d21bb2b308ce b96f55bde3a4a073 +voxtral4b-crispasr 7da30502347b42a3 89bd02b74e2635c2 +vulpecula-4b 3a1733dc0cbba9d5 dbadd0367b2e27a6 +wan-2.1-flf2v-14b-720p-ggml 95989949510d3a8f 420a916a04f8e7eb +wan-2.1-i2v-14b-480p-ggml a59cc3f89935bb1a 4573af9b1e00a70f +wan-2.1-i2v-14b-720p-ggml 02c3bad17041f9d6 9c87aad270743fb5 +wan-2.1-t2v-1.3b-ggml 49ae8b7c6263eafc 57107020229c6a0d +watt-ai_watt-tool-70b 6450dcb197ae3b05 e9f7a270fb9f1221 +wav2vec2-crispasr 8322a349ca1c306d d850c3bf2ded7b30 +wav2vec2-de-crispasr 08eaeb888bb2aaf4 ced1591101dea058 +wayfarer-12b cfa663d86dc027fb 2410febeb0e863d6 +wemm-embedding-2b 61d84fe4c81a6b0c 947cd4b61bb2d438 +wemm-embedding-4b 63731781a64a3d10 9a038bab4c868863 +wemm-embedding-9b 49c42d008e0fc484 282543d6006808b1 +wespeaker-resnet34 f2421d5ca7466047 b46a3ed2ce322670 +whisper-1 95156a550fc1da82 cc44331e89fa480b +whisper-base 1fe05c56f4cc403d 088f3ac87a3736cc +whisper-base-en 4984ae621bdc4973 1c0f01a9ff545e96 +whisper-base-en-q5_1 d0bc4fe40c8fb087 a66f8bb5ee49045c +whisper-base-q5_1 2ba92fba86cff79d c259ee37eb01d0ca +whisper-large 0593881d6fb20392 0f767969ba30cdc1 +whisper-large-q5_0 babb969f19d6ff87 929b92262a3fca16 +whisper-large-turbo 8834d77d0e87434d 8af6aea33a88885d +whisper-large-turbo-q5_0 33f6a7385f2a71ce be7839e1df77f099 +whisper-large-turbo-q8_0 606f65600a84e730 f0710e31ab39cc41 +whisper-medium 099695fb4cf7c63c badff11c0f671bbe +whisper-medium-q5_0 78c28129c2ee9df7 5c7e28804a912d83 +whisper-small fee0a6e55077331c 1f743bbb075b7dc7 +whisper-small-en 8d4468119055de8e 7651369cafb3b229 +whisper-small-en-q5_1 8a0faa2724e1ad8a 61ffe1830a93402b +whisper-small-q5_1 1be3f8e7ac5497d5 2f3c59fc9184657a +whisper-tiny 40cefba9906eec1a 9b24ede99ecbce6a +whisper-tiny-en b331b307a61ccf10 444a905128e02280 +whisper-tiny-en-q5_1 80ef4f02d2b56dad 159f1e3673a00434 +whisper-tiny-en-q8_0 9b3cd2da4585db3b 7dcd406674b64204 +whisper-tiny-q5_1 a07446c9635b4e11 be1e9d31a9de4beb +whisperx-tiny 452d896778aba349 d341759f7de36ebe +wingless_imp_8b-i1 0601029479c65692 5926956e4a524e7d +winnow-12b c8b23cbfb6566f0d b717243bc97b7fce +winnow-12b-bf16 54f866e0b1131a9d 98d8d51b54a6a845 +winnow-e4b 47a4738f211dce3d cac4a23ee9b2cbd4 +winnow-e4b-bf16 822eabc7eaec6f4e e031ee13662a6443 +wraith-8b-i1 4f10fea34a6cfdb9 59d0ea77b50b1dce +xiaomi-ocr-0-q4-k-m d0fe6ce46978fab8 82f5de302e50851b +xiaomi-ocr-0-q6-k 94016e38e5582e7b 2a6a1c09ca548003 +xing4.0-29b-a4b 3bc30da345b3711a e2a1ce72187fbefa +xing4.0-29b-a4b-q5 cbc4ef736d63d37e 842db1718d1ede3a +xing4.0-29b-a4b-q6 ae8ca3128b49a0a7 7b981a2be10d44cf +xing4.0-29b-a4b-q8 b74e1d4ab1a63106 b7b0841e734b3e6f +xyz-aquila-mini 25125b463b715f31 9ece20ce2c9f6329 +xyz-aquila-mini-q6 98f86692a9552587 dd9b376267f47d44 +yanfei-v2-qwen3-32b ac4249a6c4d87420 0d66e13f15518938 +yanolja_yanoljanext-rosetta-12b-2510 e1bf898aeeab8eb5 40d9afb1ad47f979 +yanoljanext-rosetta-27b-2511-i1 093d921ad66d09ff e9f33e6a960a726f +yi-1.5-6b-chat 6d30c5399c9f58a0 1b60a35f93b4e0f0 +yi-1.5-9b-chat d60ab77637f12d24 626d35d389812c27 +yi-coder-1.5b 90e415f92f0eede1 8953610ef3fbfce4 +yi-coder-1.5b-chat 3ed1bc759c743c38 a325dcdbe8af1c6b +yi-coder-9b 9970ec70e4896bec 23440587e8134e9a +yi-coder-9b-chat 99d4d39820aa2740 bd12777bf9956835 +z-image-diffusers 91cdd0f6ca4a9e93 ac93dba81dc92c3a +z-image-turbo-diffusers 2366cda06c0b783f f4cf9291d6eeb1dd +zero-gemma4-e4b-openzero-q5-k-m 5332ed5630b301b0 d65a60810ca19b03 +zero-qwen3-8b-openzero-q5-k-m ccb8ae2b7ff010bd fe7579fe69dac9c0 +zerofata_l3.3-geneticlemonade-opus-70b 7b6c4ef21c24c498 3a30de2e513d9364 +zerofata_ms3.2-paintedfantasy-visage-33b f0943a75f3ba5367 50323a3f85b046f2 +zhi-create-qwen3-32b-i1 0d5db9d9aa57545c d7dd5c1befe225d9 +zirel-2-i1 30e0156392db693b fac5c87a1b69159b +zonui-3b-i1 407d106799c36b1f 6d4f167d3b73976d +zyphra_zr1-1.5b 6b3bfc59e9be027e 6658643b5e37579c diff --git a/core/gallery/testdata/model_library/samples/backend.gallery.yaml b/core/gallery/testdata/model_library/samples/backend.gallery.yaml new file mode 100644 index 000000000..3db0c8ffd --- /dev/null +++ b/core/gallery/testdata/model_library/samples/backend.gallery.yaml @@ -0,0 +1,44 @@ +- url: github:mudler/LocalAI/gallery/kimodocpp.yaml@master + name: kimodo-soma-rp + description: | + Kimodo SOMA RP v1.1 text-to-motion on CPU or Vulkan, with F32 motion weights + and the shared monolithic Q8_0 Llama-3/LLM2Vec text encoder. + Exports an animated skeleton GLB without a mesh or skin. Motion and text + weights retain their respective NVIDIA Open Model License and Llama 3 terms. + urls: + - https://huggingface.co/LocalAI-io/Kimodo-SOMA-RP-v1.1-GGML + - https://huggingface.co/nvidia/Kimodo-SOMA-RP-v1.1 + - https://huggingface.co/LocalAI-io/Llama-3-Kimodo-GGML + tags: + - 3d_animation + - text-to-motion + - gguf + - cpu + - vulkan + - kimodo + - q8_0 + files: + - filename: kimodo/kimodo-soma-rp-v1.1-f32.gguf + sha256: 3bf1229f4c1eff1d28f5196a854113da2df9a11a5e21c60694630903bf948ee4 + uri: https://huggingface.co/LocalAI-io/Kimodo-SOMA-RP-v1.1-GGML/resolve/65f8b8ab34ee7524161cc87b20ae4cb4f5d3a12d/models/kimodo-soma-rp-v1.1-f32.gguf + - filename: kimodo/text/tokenizer.gguf + sha256: 81614aca62a98846c02b72cc2e5378e5bdce8b4d507b88f96eb1faa90dae607e + uri: https://huggingface.co/LocalAI-io/Llama-3-Kimodo-GGML/resolve/3e8d958803beaddb6011ac534f2be972e2710c7d/tokenizer.gguf + - filename: kimodo/text/Llama-3-Kimodo-Q8_0.gguf + sha256: b26d0e74b115b33a7f2df5aca04426548365e99217cd590986f8abc4172e4c5c + uri: https://huggingface.co/LocalAI-io/Llama-3-Kimodo-GGML/resolve/3e8d958803beaddb6011ac534f2be972e2710c7d/Llama-3-Kimodo-Q8_0.gguf + backend: kimodocpp + overrides: + options: + - text_bundle:kimodo/text/Llama-3-Kimodo-Q8_0.gguf + - frames:150 + - steps:100 + - text_guidance:2 + parameters: + model: kimodo/kimodo-soma-rp-v1.1-f32.gguf + variants: + - model: kimodo-soma-rp-bf16 + - model: kimodo-soma-rp-q4_k + - model: kimodo-soma-rp-q4_k_m + - model: kimodo-soma-rp-q5_k + - model: kimodo-soma-rp-q6_k diff --git a/core/gallery/testdata/model_library/samples/backend.library.yaml b/core/gallery/testdata/model_library/samples/backend.library.yaml new file mode 100644 index 000000000..56e3d44d0 --- /dev/null +++ b/core/gallery/testdata/model_library/samples/backend.library.yaml @@ -0,0 +1,52 @@ +- kind: model + id: kimodo-soma-rp + name: kimodo-soma-rp + version: 0.0.0-gallery.dc25d437ae9e + description: | + Kimodo SOMA RP v1.1 text-to-motion on CPU or Vulkan, with F32 motion weights + and the shared monolithic Q8_0 Llama-3/LLM2Vec text encoder. + Exports an animated skeleton GLB without a mesh or skin. Motion and text + weights retain their respective NVIDIA Open Model License and Llama 3 terms. + urls: + - https://huggingface.co/LocalAI-io/Kimodo-SOMA-RP-v1.1-GGML + - https://huggingface.co/nvidia/Kimodo-SOMA-RP-v1.1 + - https://huggingface.co/LocalAI-io/Llama-3-Kimodo-GGML + tags: + - 3d_animation + - text-to-motion + - gguf + - cpu + - vulkan + - kimodo + - q8_0 + channel: gallery + policy: + requireSignature: false + schemaVersion: 1 + model: + url: github:mudler/LocalAI/gallery/kimodocpp.yaml@master + backend: kimodocpp + files: + - filename: kimodo/kimodo-soma-rp-v1.1-f32.gguf + sha256: 3bf1229f4c1eff1d28f5196a854113da2df9a11a5e21c60694630903bf948ee4 + uri: https://huggingface.co/LocalAI-io/Kimodo-SOMA-RP-v1.1-GGML/resolve/65f8b8ab34ee7524161cc87b20ae4cb4f5d3a12d/models/kimodo-soma-rp-v1.1-f32.gguf + - filename: kimodo/text/tokenizer.gguf + sha256: 81614aca62a98846c02b72cc2e5378e5bdce8b4d507b88f96eb1faa90dae607e + uri: https://huggingface.co/LocalAI-io/Llama-3-Kimodo-GGML/resolve/3e8d958803beaddb6011ac534f2be972e2710c7d/tokenizer.gguf + - filename: kimodo/text/Llama-3-Kimodo-Q8_0.gguf + sha256: b26d0e74b115b33a7f2df5aca04426548365e99217cd590986f8abc4172e4c5c + uri: https://huggingface.co/LocalAI-io/Llama-3-Kimodo-GGML/resolve/3e8d958803beaddb6011ac534f2be972e2710c7d/Llama-3-Kimodo-Q8_0.gguf + overrides: + options: + - text_bundle:kimodo/text/Llama-3-Kimodo-Q8_0.gguf + - frames:150 + - steps:100 + - text_guidance:2 + parameters: + model: kimodo/kimodo-soma-rp-v1.1-f32.gguf + variants: + - model: kimodo-soma-rp-bf16 + - model: kimodo-soma-rp-q4_k + - model: kimodo-soma-rp-q4_k_m + - model: kimodo-soma-rp-q5_k + - model: kimodo-soma-rp-q6_k diff --git a/core/gallery/testdata/model_library/samples/config-file.gallery.yaml b/core/gallery/testdata/model_library/samples/config-file.gallery.yaml new file mode 100644 index 000000000..bf617084f --- /dev/null +++ b/core/gallery/testdata/model_library/samples/config-file.gallery.yaml @@ -0,0 +1,31 @@ +- name: vits-streaming-assistant + description: | + English voice assistant preset: Silero VAD, Parakeet TDT 0.6B v3, Qwen3 + 0.6B chat, and VITS-LJS English single-speaker TTS through sherpa-onnx. + Buffers streamed LLM output into clauses and emits audio progressively. + Each clause starts a separate synthesis; this is not native incremental + text input. This installs only the pipeline configuration. First install + silero-vad-ggml, parakeet-cpp-tdt-0.6b-v3, qwen3-0.6b, and vits-ljs-sherpa. + WebRTC also needs the opus backend. No browser or hardware performance + is established by this preset. + license: mit + urls: + - https://localai.io/features/openai-realtime/ + tags: + - voice-assistant + - audio-pipeline + - realtime + - streaming + - english + - sherpa-onnx + config_file: + pipeline: + disable_thinking: true + llm: qwen3-0.6b + streaming: + clause_chunking: true + llm: true + tts: true + transcription: parakeet-cpp-tdt-0.6b-v3 + tts: vits-ljs-sherpa + vad: silero-vad-ggml diff --git a/core/gallery/testdata/model_library/samples/config-file.library.yaml b/core/gallery/testdata/model_library/samples/config-file.library.yaml new file mode 100644 index 000000000..5aa17e502 --- /dev/null +++ b/core/gallery/testdata/model_library/samples/config-file.library.yaml @@ -0,0 +1,39 @@ +- kind: model + id: vits-streaming-assistant + name: vits-streaming-assistant + version: 0.0.0-gallery.2adda7a87e2f + description: | + English voice assistant preset: Silero VAD, Parakeet TDT 0.6B v3, Qwen3 + 0.6B chat, and VITS-LJS English single-speaker TTS through sherpa-onnx. + Buffers streamed LLM output into clauses and emits audio progressively. + Each clause starts a separate synthesis; this is not native incremental + text input. This installs only the pipeline configuration. First install + silero-vad-ggml, parakeet-cpp-tdt-0.6b-v3, qwen3-0.6b, and vits-ljs-sherpa. + WebRTC also needs the opus backend. No browser or hardware performance + is established by this preset. + license: mit + urls: + - https://localai.io/features/openai-realtime/ + tags: + - voice-assistant + - audio-pipeline + - realtime + - streaming + - english + - sherpa-onnx + channel: gallery + policy: + requireSignature: false + schemaVersion: 1 + model: + configFile: + pipeline: + disable_thinking: true + llm: qwen3-0.6b + streaming: + clause_chunking: true + llm: true + tts: true + transcription: parakeet-cpp-tdt-0.6b-v3 + tts: vits-ljs-sherpa + vad: silero-vad-ggml diff --git a/core/gallery/testdata/model_library/samples/empty-variants.gallery.yaml b/core/gallery/testdata/model_library/samples/empty-variants.gallery.yaml new file mode 100644 index 000000000..d800449d7 --- /dev/null +++ b/core/gallery/testdata/model_library/samples/empty-variants.gallery.yaml @@ -0,0 +1,56 @@ +- url: github:mudler/LocalAI/gallery/virtual.yaml@master + name: apodex-1.1-mini-q4-mtp + description: | + Apodex-1.1-mini with MTP speculative decoding enabled on the recommended + Q4_K_M GGUF. The model carries its native MTP head, so it needs no separate + draft model. The F16 vision projector supports multimodal prompts. + license: apache-2.0 + urls: + - https://huggingface.co/apodex/Apodex-1.1-mini + - https://huggingface.co/abenzerps/Apodex-1.1-mini-GGUF + tags: + - llm + - gguf + - cpu + - gpu + - qwen + - moe + - reasoning + - thinking + - coding + - agent + - tools + - vision + - multimodal + - long-context + - mtp + files: + - filename: llama-cpp/models/apodex-1.1-mini/Apodex-1.1-mini-Q4_K_M.gguf + sha256: 13a580b1ab9350b90085c221cf66e8715a594b2428e5a80a7a956d8e0420be16 + uri: huggingface://abenzerps/Apodex-1.1-mini-GGUF/Apodex-1.1-mini-Q4_K_M.gguf + - filename: llama-cpp/mmproj/apodex-1.1-mini/mmproj-F16.gguf + sha256: d0ccf814138020651bcab603d9ce5c080a0ada46f482c116f0aca0fbb84e091e + uri: huggingface://abenzerps/Apodex-1.1-mini-GGUF/mmproj-Apodex-1.1-mini-F16.gguf + overrides: + backend: llama-cpp + context_size: 262144 + function: + automatic_tool_parsing_fallback: true + grammar: + disable: true + known_usecases: + - chat + - vision + mmproj: llama-cpp/mmproj/apodex-1.1-mini/mmproj-F16.gguf + options: + - use_jinja:true + - spec_type:draft-mtp + - spec_n_max:3 + parameters: + model: llama-cpp/models/apodex-1.1-mini/Apodex-1.1-mini-Q4_K_M.gguf + repeat_penalty: 1.05 + temperature: 1 + top_p: 0.95 + template: + use_tokenizer_template: true + variants: [] diff --git a/core/gallery/testdata/model_library/samples/empty-variants.library.yaml b/core/gallery/testdata/model_library/samples/empty-variants.library.yaml new file mode 100644 index 000000000..74964b167 --- /dev/null +++ b/core/gallery/testdata/model_library/samples/empty-variants.library.yaml @@ -0,0 +1,64 @@ +- kind: model + id: apodex-1.1-mini-q4-mtp + name: apodex-1.1-mini-q4-mtp + version: 0.0.0-gallery.d6c37c37d4f9 + description: | + Apodex-1.1-mini with MTP speculative decoding enabled on the recommended + Q4_K_M GGUF. The model carries its native MTP head, so it needs no separate + draft model. The F16 vision projector supports multimodal prompts. + license: apache-2.0 + urls: + - https://huggingface.co/apodex/Apodex-1.1-mini + - https://huggingface.co/abenzerps/Apodex-1.1-mini-GGUF + tags: + - llm + - gguf + - cpu + - gpu + - qwen + - moe + - reasoning + - thinking + - coding + - agent + - tools + - vision + - multimodal + - long-context + - mtp + channel: gallery + policy: + requireSignature: false + schemaVersion: 1 + model: + url: github:mudler/LocalAI/gallery/virtual.yaml@master + files: + - filename: llama-cpp/models/apodex-1.1-mini/Apodex-1.1-mini-Q4_K_M.gguf + sha256: 13a580b1ab9350b90085c221cf66e8715a594b2428e5a80a7a956d8e0420be16 + uri: huggingface://abenzerps/Apodex-1.1-mini-GGUF/Apodex-1.1-mini-Q4_K_M.gguf + - filename: llama-cpp/mmproj/apodex-1.1-mini/mmproj-F16.gguf + sha256: d0ccf814138020651bcab603d9ce5c080a0ada46f482c116f0aca0fbb84e091e + uri: huggingface://abenzerps/Apodex-1.1-mini-GGUF/mmproj-Apodex-1.1-mini-F16.gguf + overrides: + backend: llama-cpp + context_size: 262144 + function: + automatic_tool_parsing_fallback: true + grammar: + disable: true + known_usecases: + - chat + - vision + mmproj: llama-cpp/mmproj/apodex-1.1-mini/mmproj-F16.gguf + options: + - use_jinja:true + - spec_type:draft-mtp + - spec_n_max:3 + parameters: + model: llama-cpp/models/apodex-1.1-mini/Apodex-1.1-mini-Q4_K_M.gguf + repeat_penalty: 1.05 + temperature: 1 + top_p: 0.95 + template: + use_tokenizer_template: true + variants: [] diff --git a/core/gallery/testdata/model_library/samples/float-override.gallery.yaml b/core/gallery/testdata/model_library/samples/float-override.gallery.yaml new file mode 100644 index 000000000..4be8d6806 --- /dev/null +++ b/core/gallery/testdata/model_library/samples/float-override.gallery.yaml @@ -0,0 +1,48 @@ +- url: github:mudler/LocalAI/gallery/virtual.yaml@master + name: thinkingcap-qwen3.8-27b + description: | + ThinkingCap is a 27B Qwen3.8 fine-tune trained to reduce reasoning tokens, with text and image input. + This Q4_K_M GGUF build uses llama.cpp, the embedded chat template, and the F16 vision projector. + Licensed under PolyForm Small Business 1.0.0 with the publisher's personal-use grant; see the model license for permitted use. + license: polyform-small-business-1.0.0 + urls: + - https://huggingface.co/bottlecapai/ThinkingCap-Qwen3.8-27B + - https://huggingface.co/bottlecapai/ThinkingCap-Qwen3.8-27B-GGUF + tags: + - llm + - gguf + - cpu + - gpu + - vision + - multimodal + - reasoning + files: + - filename: ThinkingCap-Qwen3.8-27B-Q4_K_M.gguf + sha256: fafa890ce2ce8531b4ade225c7dbd5f5d72a92303ca9ef72890c6cf78f19f299 + uri: https://huggingface.co/bottlecapai/ThinkingCap-Qwen3.8-27B-GGUF/resolve/108ff8f24ce8e9335fbf308844cd3c59c13380a4/ThinkingCap-Qwen3.8-27B-Q4_K_M.gguf + - filename: mmproj-ThinkingCap-Qwen3.8-27B-f16.gguf + sha256: 98fa9aad59b42449786a16bbce96bcd92204d03cac0aee0cdccca711c2adefd1 + uri: https://huggingface.co/bottlecapai/ThinkingCap-Qwen3.8-27B-GGUF/resolve/108ff8f24ce8e9335fbf308844cd3c59c13380a4/mmproj-ThinkingCap-Qwen3.8-27B-f16.gguf + overrides: + backend: llama-cpp + context_size: 32768 + function: + automatic_tool_parsing_fallback: true + grammar: + disable: true + known_usecases: + - chat + - vision + mmproj: mmproj-ThinkingCap-Qwen3.8-27B-f16.gguf + options: + - use_jinja:true + parameters: + min_p: 0.0 + model: ThinkingCap-Qwen3.8-27B-Q4_K_M.gguf + temperature: 1.0 + top_k: 20 + top_p: 0.95 + template: + use_tokenizer_template: true + variants: + - model: thinkingcap-qwen3.8-27b-q8 diff --git a/core/gallery/testdata/model_library/samples/float-override.library.yaml b/core/gallery/testdata/model_library/samples/float-override.library.yaml new file mode 100644 index 000000000..4b3ac521e --- /dev/null +++ b/core/gallery/testdata/model_library/samples/float-override.library.yaml @@ -0,0 +1,56 @@ +- kind: model + id: thinkingcap-qwen3.8-27b + name: thinkingcap-qwen3.8-27b + version: 0.0.0-gallery.741204929f7a + description: | + ThinkingCap is a 27B Qwen3.8 fine-tune trained to reduce reasoning tokens, with text and image input. + This Q4_K_M GGUF build uses llama.cpp, the embedded chat template, and the F16 vision projector. + Licensed under PolyForm Small Business 1.0.0 with the publisher's personal-use grant; see the model license for permitted use. + license: polyform-small-business-1.0.0 + urls: + - https://huggingface.co/bottlecapai/ThinkingCap-Qwen3.8-27B + - https://huggingface.co/bottlecapai/ThinkingCap-Qwen3.8-27B-GGUF + tags: + - llm + - gguf + - cpu + - gpu + - vision + - multimodal + - reasoning + channel: gallery + policy: + requireSignature: false + schemaVersion: 1 + model: + url: github:mudler/LocalAI/gallery/virtual.yaml@master + files: + - filename: ThinkingCap-Qwen3.8-27B-Q4_K_M.gguf + sha256: fafa890ce2ce8531b4ade225c7dbd5f5d72a92303ca9ef72890c6cf78f19f299 + uri: https://huggingface.co/bottlecapai/ThinkingCap-Qwen3.8-27B-GGUF/resolve/108ff8f24ce8e9335fbf308844cd3c59c13380a4/ThinkingCap-Qwen3.8-27B-Q4_K_M.gguf + - filename: mmproj-ThinkingCap-Qwen3.8-27B-f16.gguf + sha256: 98fa9aad59b42449786a16bbce96bcd92204d03cac0aee0cdccca711c2adefd1 + uri: https://huggingface.co/bottlecapai/ThinkingCap-Qwen3.8-27B-GGUF/resolve/108ff8f24ce8e9335fbf308844cd3c59c13380a4/mmproj-ThinkingCap-Qwen3.8-27B-f16.gguf + overrides: + backend: llama-cpp + context_size: 32768 + function: + automatic_tool_parsing_fallback: true + grammar: + disable: true + known_usecases: + - chat + - vision + mmproj: mmproj-ThinkingCap-Qwen3.8-27B-f16.gguf + options: + - use_jinja:true + parameters: + min_p: 0.0 + model: ThinkingCap-Qwen3.8-27B-Q4_K_M.gguf + temperature: 1.0 + top_k: 20 + top_p: 0.95 + template: + use_tokenizer_template: true + variants: + - model: thinkingcap-qwen3.8-27b-q8 diff --git a/core/gallery/testdata/model_library/samples/multiline-description.gallery.yaml b/core/gallery/testdata/model_library/samples/multiline-description.gallery.yaml new file mode 100644 index 000000000..bd726c61d --- /dev/null +++ b/core/gallery/testdata/model_library/samples/multiline-description.gallery.yaml @@ -0,0 +1,38 @@ +- url: github:mudler/LocalAI/gallery/virtual.yaml@master + name: adavar-3b-q8 + description: | + AdaVaR-3B is a Qwen2.5-VL-3B-Instruct fine-tune for visual reasoning + through text or image-grounded coordinates. This Q8_0 GGUF build + includes the F16 vision projector. Adaptive reasoning uses the publisher's + system prompt and question suffix; see the model card for these prompts. + license: apache-2.0 + urls: + - https://huggingface.co/ZejunLi/AdaVaR-3B + - https://huggingface.co/mradermacher/AdaVaR-3B-GGUF + tags: + - llm + - gguf + - vision + - reasoning + - cpu + - gpu + files: + - filename: AdaVaR-3B.Q8_0.gguf + sha256: 23495169a352b076dee53ffb74da1861b3f9670c7a081cbecd37788774c4b205 + uri: https://huggingface.co/mradermacher/AdaVaR-3B-GGUF/resolve/580d869e53b6338bf3dbafc5d8488217cbd28265/AdaVaR-3B.Q8_0.gguf + - filename: AdaVaR-3B.mmproj-f16.gguf + sha256: 1ac6d198b191101cf7e84977f1770b60190adbfa33cefaaf6a5ece6ea9270d98 + uri: https://huggingface.co/mradermacher/AdaVaR-3B-GGUF/resolve/580d869e53b6338bf3dbafc5d8488217cbd28265/AdaVaR-3B.mmproj-f16.gguf + overrides: + backend: llama-cpp + context_size: 32768 + known_usecases: + - chat + - vision + mmproj: AdaVaR-3B.mmproj-f16.gguf + options: + - use_jinja:true + parameters: + model: AdaVaR-3B.Q8_0.gguf + template: + use_tokenizer_template: true diff --git a/core/gallery/testdata/model_library/samples/multiline-description.library.yaml b/core/gallery/testdata/model_library/samples/multiline-description.library.yaml new file mode 100644 index 000000000..250b1cd2e --- /dev/null +++ b/core/gallery/testdata/model_library/samples/multiline-description.library.yaml @@ -0,0 +1,46 @@ +- kind: model + id: adavar-3b-q8 + name: adavar-3b-q8 + version: 0.0.0-gallery.4a2f0db86526 + description: | + AdaVaR-3B is a Qwen2.5-VL-3B-Instruct fine-tune for visual reasoning + through text or image-grounded coordinates. This Q8_0 GGUF build + includes the F16 vision projector. Adaptive reasoning uses the publisher's + system prompt and question suffix; see the model card for these prompts. + license: apache-2.0 + urls: + - https://huggingface.co/ZejunLi/AdaVaR-3B + - https://huggingface.co/mradermacher/AdaVaR-3B-GGUF + tags: + - llm + - gguf + - vision + - reasoning + - cpu + - gpu + channel: gallery + policy: + requireSignature: false + schemaVersion: 1 + model: + url: github:mudler/LocalAI/gallery/virtual.yaml@master + files: + - filename: AdaVaR-3B.Q8_0.gguf + sha256: 23495169a352b076dee53ffb74da1861b3f9670c7a081cbecd37788774c4b205 + uri: https://huggingface.co/mradermacher/AdaVaR-3B-GGUF/resolve/580d869e53b6338bf3dbafc5d8488217cbd28265/AdaVaR-3B.Q8_0.gguf + - filename: AdaVaR-3B.mmproj-f16.gguf + sha256: 1ac6d198b191101cf7e84977f1770b60190adbfa33cefaaf6a5ece6ea9270d98 + uri: https://huggingface.co/mradermacher/AdaVaR-3B-GGUF/resolve/580d869e53b6338bf3dbafc5d8488217cbd28265/AdaVaR-3B.mmproj-f16.gguf + overrides: + backend: llama-cpp + context_size: 32768 + known_usecases: + - chat + - vision + mmproj: AdaVaR-3B.mmproj-f16.gguf + options: + - use_jinja:true + parameters: + model: AdaVaR-3B.Q8_0.gguf + template: + use_tokenizer_template: true diff --git a/core/gallery/testdata/model_library/samples/no-files.gallery.yaml b/core/gallery/testdata/model_library/samples/no-files.gallery.yaml new file mode 100644 index 000000000..858dc9e8e --- /dev/null +++ b/core/gallery/testdata/model_library/samples/no-files.gallery.yaml @@ -0,0 +1,34 @@ +- url: github:mudler/LocalAI/gallery/virtual.yaml@master + name: wemm-embedding-2b + description: | + WeMM-Embedding-2B is Tencent's Apache-2.0 multilingual embedding model + built on Qwen3.5. This entry serves the original bfloat16 safetensors with + LocalAI's Transformers backend and produces 2,048-dimensional normalized + embeddings for text retrieval, semantic search, and RAG. + + The upstream model can also embed images and videos. LocalAI currently + exposes text input through its embeddings API for this backend. + license: apache-2.0 + urls: + - https://huggingface.co/tencent/WeMM-Embedding-2B + tags: + - embeddings + - safetensors + - transformers + - multilingual + - retrieval + - rag + - gpu + - cpu + overrides: + backend: transformers + embeddings: true + known_usecases: + - embeddings + parameters: + model: tencent/WeMM-Embedding-2B + trust_remote_code: true + type: SentenceTransformer + variants: + - model: wemm-embedding-4b + - model: wemm-embedding-9b diff --git a/core/gallery/testdata/model_library/samples/no-files.library.yaml b/core/gallery/testdata/model_library/samples/no-files.library.yaml new file mode 100644 index 000000000..1d459e78f --- /dev/null +++ b/core/gallery/testdata/model_library/samples/no-files.library.yaml @@ -0,0 +1,42 @@ +- kind: model + id: wemm-embedding-2b + name: wemm-embedding-2b + version: 0.0.0-gallery.947cd4b61bb2 + description: | + WeMM-Embedding-2B is Tencent's Apache-2.0 multilingual embedding model + built on Qwen3.5. This entry serves the original bfloat16 safetensors with + LocalAI's Transformers backend and produces 2,048-dimensional normalized + embeddings for text retrieval, semantic search, and RAG. + + The upstream model can also embed images and videos. LocalAI currently + exposes text input through its embeddings API for this backend. + license: apache-2.0 + urls: + - https://huggingface.co/tencent/WeMM-Embedding-2B + tags: + - embeddings + - safetensors + - transformers + - multilingual + - retrieval + - rag + - gpu + - cpu + channel: gallery + policy: + requireSignature: false + schemaVersion: 1 + model: + url: github:mudler/LocalAI/gallery/virtual.yaml@master + overrides: + backend: transformers + embeddings: true + known_usecases: + - embeddings + parameters: + model: tencent/WeMM-Embedding-2B + trust_remote_code: true + type: SentenceTransformer + variants: + - model: wemm-embedding-4b + - model: wemm-embedding-9b diff --git a/core/gallery/testdata/model_library/samples/no-url.gallery.yaml b/core/gallery/testdata/model_library/samples/no-url.gallery.yaml new file mode 100644 index 000000000..27e8e20a7 --- /dev/null +++ b/core/gallery/testdata/model_library/samples/no-url.gallery.yaml @@ -0,0 +1,28 @@ +- name: aurore-reveil_koto-small-7b-it + description: | + Koto-Small-7B-IT is an instruct-tuned version of Koto-Small-7B-PT, which was trained on MiMo-7B-Base for almost a billion tokens of creative-writing data. This model is meant for roleplaying and instruct usecases. + license: mit + urls: + - https://huggingface.co/Aurore-Reveil/Koto-Small-7B-IT + - https://huggingface.co/bartowski/Aurore-Reveil_Koto-Small-7B-IT-GGUF + icon: https://cdn-uploads.huggingface.co/production/uploads/634262af8d8089ebaefd410e/9Bnn2AnIjfQFWBGkhDNmI.png + tags: + - koto + - 7b + - gguf + - quantized + - llm + - text-to-text + - chat + - creative-writing + - roleplay + - instruct-tuned + files: + - filename: Aurore-Reveil_Koto-Small-7B-IT-Q4_K_M.gguf + sha256: c5c38bfa5d8d5100e91a2e0050a0b2f3e082cd4bfd423cb527abc3b6f1ae180c + uri: huggingface://bartowski/Aurore-Reveil_Koto-Small-7B-IT-GGUF/Aurore-Reveil_Koto-Small-7B-IT-Q4_K_M.gguf + overrides: + known_usecases: + - chat + parameters: + model: Aurore-Reveil_Koto-Small-7B-IT-Q4_K_M.gguf diff --git a/core/gallery/testdata/model_library/samples/no-url.library.yaml b/core/gallery/testdata/model_library/samples/no-url.library.yaml new file mode 100644 index 000000000..7636f933b --- /dev/null +++ b/core/gallery/testdata/model_library/samples/no-url.library.yaml @@ -0,0 +1,36 @@ +- kind: model + id: aurore-reveil_koto-small-7b-it + name: aurore-reveil_koto-small-7b-it + version: 0.0.0-gallery.7a65255bb4ce + description: | + Koto-Small-7B-IT is an instruct-tuned version of Koto-Small-7B-PT, which was trained on MiMo-7B-Base for almost a billion tokens of creative-writing data. This model is meant for roleplaying and instruct usecases. + license: mit + urls: + - https://huggingface.co/Aurore-Reveil/Koto-Small-7B-IT + - https://huggingface.co/bartowski/Aurore-Reveil_Koto-Small-7B-IT-GGUF + tags: + - koto + - 7b + - gguf + - quantized + - llm + - text-to-text + - chat + - creative-writing + - roleplay + - instruct-tuned + icon: https://cdn-uploads.huggingface.co/production/uploads/634262af8d8089ebaefd410e/9Bnn2AnIjfQFWBGkhDNmI.png + channel: gallery + policy: + requireSignature: false + schemaVersion: 1 + model: + files: + - filename: Aurore-Reveil_Koto-Small-7B-IT-Q4_K_M.gguf + sha256: c5c38bfa5d8d5100e91a2e0050a0b2f3e082cd4bfd423cb527abc3b6f1ae180c + uri: huggingface://bartowski/Aurore-Reveil_Koto-Small-7B-IT-GGUF/Aurore-Reveil_Koto-Small-7B-IT-Q4_K_M.gguf + overrides: + known_usecases: + - chat + parameters: + model: Aurore-Reveil_Koto-Small-7B-IT-Q4_K_M.gguf diff --git a/core/gallery/testdata/model_library/samples/plain.gallery.yaml b/core/gallery/testdata/model_library/samples/plain.gallery.yaml new file mode 100644 index 000000000..bd726c61d --- /dev/null +++ b/core/gallery/testdata/model_library/samples/plain.gallery.yaml @@ -0,0 +1,38 @@ +- url: github:mudler/LocalAI/gallery/virtual.yaml@master + name: adavar-3b-q8 + description: | + AdaVaR-3B is a Qwen2.5-VL-3B-Instruct fine-tune for visual reasoning + through text or image-grounded coordinates. This Q8_0 GGUF build + includes the F16 vision projector. Adaptive reasoning uses the publisher's + system prompt and question suffix; see the model card for these prompts. + license: apache-2.0 + urls: + - https://huggingface.co/ZejunLi/AdaVaR-3B + - https://huggingface.co/mradermacher/AdaVaR-3B-GGUF + tags: + - llm + - gguf + - vision + - reasoning + - cpu + - gpu + files: + - filename: AdaVaR-3B.Q8_0.gguf + sha256: 23495169a352b076dee53ffb74da1861b3f9670c7a081cbecd37788774c4b205 + uri: https://huggingface.co/mradermacher/AdaVaR-3B-GGUF/resolve/580d869e53b6338bf3dbafc5d8488217cbd28265/AdaVaR-3B.Q8_0.gguf + - filename: AdaVaR-3B.mmproj-f16.gguf + sha256: 1ac6d198b191101cf7e84977f1770b60190adbfa33cefaaf6a5ece6ea9270d98 + uri: https://huggingface.co/mradermacher/AdaVaR-3B-GGUF/resolve/580d869e53b6338bf3dbafc5d8488217cbd28265/AdaVaR-3B.mmproj-f16.gguf + overrides: + backend: llama-cpp + context_size: 32768 + known_usecases: + - chat + - vision + mmproj: AdaVaR-3B.mmproj-f16.gguf + options: + - use_jinja:true + parameters: + model: AdaVaR-3B.Q8_0.gguf + template: + use_tokenizer_template: true diff --git a/core/gallery/testdata/model_library/samples/plain.library.yaml b/core/gallery/testdata/model_library/samples/plain.library.yaml new file mode 100644 index 000000000..250b1cd2e --- /dev/null +++ b/core/gallery/testdata/model_library/samples/plain.library.yaml @@ -0,0 +1,46 @@ +- kind: model + id: adavar-3b-q8 + name: adavar-3b-q8 + version: 0.0.0-gallery.4a2f0db86526 + description: | + AdaVaR-3B is a Qwen2.5-VL-3B-Instruct fine-tune for visual reasoning + through text or image-grounded coordinates. This Q8_0 GGUF build + includes the F16 vision projector. Adaptive reasoning uses the publisher's + system prompt and question suffix; see the model card for these prompts. + license: apache-2.0 + urls: + - https://huggingface.co/ZejunLi/AdaVaR-3B + - https://huggingface.co/mradermacher/AdaVaR-3B-GGUF + tags: + - llm + - gguf + - vision + - reasoning + - cpu + - gpu + channel: gallery + policy: + requireSignature: false + schemaVersion: 1 + model: + url: github:mudler/LocalAI/gallery/virtual.yaml@master + files: + - filename: AdaVaR-3B.Q8_0.gguf + sha256: 23495169a352b076dee53ffb74da1861b3f9670c7a081cbecd37788774c4b205 + uri: https://huggingface.co/mradermacher/AdaVaR-3B-GGUF/resolve/580d869e53b6338bf3dbafc5d8488217cbd28265/AdaVaR-3B.Q8_0.gguf + - filename: AdaVaR-3B.mmproj-f16.gguf + sha256: 1ac6d198b191101cf7e84977f1770b60190adbfa33cefaaf6a5ece6ea9270d98 + uri: https://huggingface.co/mradermacher/AdaVaR-3B-GGUF/resolve/580d869e53b6338bf3dbafc5d8488217cbd28265/AdaVaR-3B.mmproj-f16.gguf + overrides: + backend: llama-cpp + context_size: 32768 + known_usecases: + - chat + - vision + mmproj: AdaVaR-3B.mmproj-f16.gguf + options: + - use_jinja:true + parameters: + model: AdaVaR-3B.Q8_0.gguf + template: + use_tokenizer_template: true diff --git a/core/gallery/testdata/model_library/samples/size.gallery.yaml b/core/gallery/testdata/model_library/samples/size.gallery.yaml new file mode 100644 index 000000000..0550f1b91 --- /dev/null +++ b/core/gallery/testdata/model_library/samples/size.gallery.yaml @@ -0,0 +1,21 @@ +- url: github:mudler/LocalAI/gallery/virtual.yaml@master + name: moonshine-tiny + description: | + Moonshine Tiny is a lightweight speech-to-text model optimized for fast transcription. It is designed for efficient on-device ASR with high accuracy relative to its size. + license: apache-2.0 + urls: + - https://github.com/moonshine-ai/moonshine + tags: + - stt + - speech-to-text + - asr + - audio-transcription + - cpu + - gpu + size: 108MB + overrides: + backend: moonshine + known_usecases: + - transcript + parameters: + model: moonshine/tiny diff --git a/core/gallery/testdata/model_library/samples/size.library.yaml b/core/gallery/testdata/model_library/samples/size.library.yaml new file mode 100644 index 000000000..58e754d27 --- /dev/null +++ b/core/gallery/testdata/model_library/samples/size.library.yaml @@ -0,0 +1,29 @@ +- kind: model + id: moonshine-tiny + name: moonshine-tiny + version: 0.0.0-gallery.a07d0dc76057 + description: | + Moonshine Tiny is a lightweight speech-to-text model optimized for fast transcription. It is designed for efficient on-device ASR with high accuracy relative to its size. + license: apache-2.0 + urls: + - https://github.com/moonshine-ai/moonshine + tags: + - stt + - speech-to-text + - asr + - audio-transcription + - cpu + - gpu + channel: gallery + policy: + requireSignature: false + schemaVersion: 1 + model: + url: github:mudler/LocalAI/gallery/virtual.yaml@master + size: 108MB + overrides: + backend: moonshine + known_usecases: + - transcript + parameters: + model: moonshine/tiny diff --git a/core/gallery/testdata/model_library/samples/variants.gallery.yaml b/core/gallery/testdata/model_library/samples/variants.gallery.yaml new file mode 100644 index 000000000..33b5be15e --- /dev/null +++ b/core/gallery/testdata/model_library/samples/variants.gallery.yaml @@ -0,0 +1,40 @@ +- url: github:mudler/LocalAI/gallery/virtual.yaml@master + name: adavar-3b-q4 + description: | + AdaVaR-3B is a Qwen2.5-VL-3B-Instruct fine-tune for visual reasoning + through text or image-grounded coordinates. This Q4_K_M GGUF build + includes the F16 vision projector. Adaptive reasoning uses the publisher's + system prompt and question suffix; see the model card for these prompts. + license: apache-2.0 + urls: + - https://huggingface.co/ZejunLi/AdaVaR-3B + - https://huggingface.co/mradermacher/AdaVaR-3B-GGUF + tags: + - llm + - gguf + - vision + - reasoning + - cpu + - gpu + files: + - filename: AdaVaR-3B.Q4_K_M.gguf + sha256: ab333b48b080d3f251d955c639a390691f7a44105c164fe58fa7a8d33b4fe51a + uri: https://huggingface.co/mradermacher/AdaVaR-3B-GGUF/resolve/580d869e53b6338bf3dbafc5d8488217cbd28265/AdaVaR-3B.Q4_K_M.gguf + - filename: AdaVaR-3B.mmproj-f16.gguf + sha256: 1ac6d198b191101cf7e84977f1770b60190adbfa33cefaaf6a5ece6ea9270d98 + uri: https://huggingface.co/mradermacher/AdaVaR-3B-GGUF/resolve/580d869e53b6338bf3dbafc5d8488217cbd28265/AdaVaR-3B.mmproj-f16.gguf + overrides: + backend: llama-cpp + context_size: 32768 + known_usecases: + - chat + - vision + mmproj: AdaVaR-3B.mmproj-f16.gguf + options: + - use_jinja:true + parameters: + model: AdaVaR-3B.Q4_K_M.gguf + template: + use_tokenizer_template: true + variants: + - model: adavar-3b-q8 diff --git a/core/gallery/testdata/model_library/samples/variants.library.yaml b/core/gallery/testdata/model_library/samples/variants.library.yaml new file mode 100644 index 000000000..8bcf6aad1 --- /dev/null +++ b/core/gallery/testdata/model_library/samples/variants.library.yaml @@ -0,0 +1,48 @@ +- kind: model + id: adavar-3b-q4 + name: adavar-3b-q4 + version: 0.0.0-gallery.aad216859953 + description: | + AdaVaR-3B is a Qwen2.5-VL-3B-Instruct fine-tune for visual reasoning + through text or image-grounded coordinates. This Q4_K_M GGUF build + includes the F16 vision projector. Adaptive reasoning uses the publisher's + system prompt and question suffix; see the model card for these prompts. + license: apache-2.0 + urls: + - https://huggingface.co/ZejunLi/AdaVaR-3B + - https://huggingface.co/mradermacher/AdaVaR-3B-GGUF + tags: + - llm + - gguf + - vision + - reasoning + - cpu + - gpu + channel: gallery + policy: + requireSignature: false + schemaVersion: 1 + model: + url: github:mudler/LocalAI/gallery/virtual.yaml@master + files: + - filename: AdaVaR-3B.Q4_K_M.gguf + sha256: ab333b48b080d3f251d955c639a390691f7a44105c164fe58fa7a8d33b4fe51a + uri: https://huggingface.co/mradermacher/AdaVaR-3B-GGUF/resolve/580d869e53b6338bf3dbafc5d8488217cbd28265/AdaVaR-3B.Q4_K_M.gguf + - filename: AdaVaR-3B.mmproj-f16.gguf + sha256: 1ac6d198b191101cf7e84977f1770b60190adbfa33cefaaf6a5ece6ea9270d98 + uri: https://huggingface.co/mradermacher/AdaVaR-3B-GGUF/resolve/580d869e53b6338bf3dbafc5d8488217cbd28265/AdaVaR-3B.mmproj-f16.gguf + overrides: + backend: llama-cpp + context_size: 32768 + known_usecases: + - chat + - vision + mmproj: AdaVaR-3B.mmproj-f16.gguf + options: + - use_jinja:true + parameters: + model: AdaVaR-3B.Q4_K_M.gguf + template: + use_tokenizer_template: true + variants: + - model: adavar-3b-q8 diff --git a/core/http/endpoints/addons/catalogui_test.go b/core/http/endpoints/addons/catalogui_test.go index d473f7aba..c9a4b7243 100644 --- a/core/http/endpoints/addons/catalogui_test.go +++ b/core/http/endpoints/addons/catalogui_test.go @@ -74,6 +74,23 @@ var _ = Describe("catalog and management actions", Label("catalogui"), func() { s = newAppsStack() }) + It("lists add-ons by default, and takes a kind that this host reads", func() { + s.each(func(name string, e http.Handler) { + admin := bearerOf(s.tokens["alice"]) + addons := send(e, "POST", "/api/addons/dispatch", dispatchBody("kind-addon-"+name, "", "catalog-search", 0, `{"kind":"addon"}`), admin) + Expect(addons.code).To(Equal(200), name) + Expect(payloadOf(addons)).To(HaveKeyWithValue("total", BeNumerically("==", 2)), name) + backends := send(e, "POST", "/api/addons/dispatch", dispatchBody("kind-backend-"+name, "", "catalog-search", 0, `{"kind":"backend"}`), admin) + Expect(backends.code).To(Equal(200), name) + Expect(payloadOf(backends)).To(HaveKeyWithValue("total", BeNumerically("==", 0)), name) + all := send(e, "POST", "/api/addons/dispatch", dispatchBody("kind-all-"+name, "", "catalog-search", 0, `{"kind":"all"}`), admin) + Expect(all.code).To(Equal(200), name) + Expect(payloadOf(all)).To(HaveKeyWithValue("total", BeNumerically("==", 2)), name) + model := send(e, "POST", "/api/addons/dispatch", dispatchBody("kind-model-"+name, "", "catalog-search", 0, `{"kind":"model"}`), admin) + Expect(model.code).To(Equal(403), name+": a kind this host does not read is a denied request") + }) + }) + It("serves catalog search, details and the installed management view to administrators only, the same from every frontend", func() { s.each(func(name string, e http.Handler) { admin := bearerOf(s.tokens["alice"]) diff --git a/core/http/endpoints/addons/gateway.go b/core/http/endpoints/addons/gateway.go index 4f1b94343..b47aaa267 100644 --- a/core/http/endpoints/addons/gateway.go +++ b/core/http/endpoints/addons/gateway.go @@ -169,7 +169,7 @@ func resultError(c echo.Context, e error) error { // Dispatch forwards typed operations to the explicitly configured owner. // @Summary Submit a typed addon lifecycle operation or read an addon resource -// @Description Authenticates the named caller, checks the addons feature, requires administration for every action except read, and forwards the typed request to the designated addon owner. A mutation is never retried: after an outcome_unknown response keep the operationId and poll operation-status instead of submitting a new mutation. Lifecycle actions are install, upgrade, enable, disable and uninstall (arguments sourceId and version; enable and disable take the generation that was listed). The management reads, all administrator-only and never mutations, are catalog-search (arguments text, sourceId, offset, limit up to 100), catalog-details (addonId plus arguments sourceId and version), catalog-sources and addons-installed. The library changes are catalog-source-save (arguments are one source: id, name, url, enabled, policy, authReference; removed true deletes it and never touches installed addons) and catalog-source-refresh (argument sourceId). A library names a credential only by a reference the owner configured, never a secret. Unknown argument fields are denied. The update actions are update-status and update-check (no arguments; the check fetches the library again and applies nothing) and update-upgrade (arguments expectedDigest and candidateDigest, the pinned upgrade); each answers with a payload {error: {type, message, status}} or {data}, the same from every frontend. The browser pages use the dedicated routes under /api/addons/{id}/update and /api/addons/{id}/upgrade, which accept only an administrator's own browser session. +// @Description Authenticates the named caller, checks the addons feature, requires administration for every action except read, and forwards the typed request to the designated addon owner. A mutation is never retried: after an outcome_unknown response keep the operationId and poll operation-status instead of submitting a new mutation. Lifecycle actions are install, upgrade, enable, disable and uninstall (arguments sourceId and version; enable and disable take the generation that was listed). The management reads, all administrator-only and never mutations, are catalog-search (arguments text, kind, sourceId, offset, limit up to 100; kind is addon by default, or backend, or all), catalog-details (addonId plus arguments sourceId and version), catalog-sources and addons-installed. The library changes are catalog-source-save (arguments are one source: id, name, url, enabled, policy, authReference; removed true deletes it and never touches installed addons) and catalog-source-refresh (argument sourceId). A library names a credential only by a reference the owner configured, never a secret. Unknown argument fields are denied. The update actions are update-status and update-check (no arguments; the check fetches the library again and applies nothing) and update-upgrade (arguments expectedDigest and candidateDigest, the pinned upgrade); each answers with a payload {error: {type, message, status}} or {data}, the same from every frontend. The browser pages use the dedicated routes under /api/addons/{id}/update and /api/addons/{id}/upgrade, which accept only an administrator's own browser session. // @Tags Addons // @Accept json // @Produce json diff --git a/core/http/endpoints/localai/api_instructions.go b/core/http/endpoints/localai/api_instructions.go index b32f3f42e..e6c1dd217 100644 --- a/core/http/endpoints/localai/api_instructions.go +++ b/core/http/endpoints/localai/api_instructions.go @@ -26,6 +26,7 @@ type instructionDef struct { var instructionDefs = []instructionDef{ {Name: "motion", Description: "Live human pose capture with Protobuf over WebSocket.", Tags: []string{"motion"}, Intro: "Create /api/motion/sessions and negotiate localai.motion.v2 on /poses for binary Protobuf RGB uploads and pose outputs with JSON flow credits. Browsers can POST /api/motion/sessions/{id}/tickets for a single-use 30-second WebSocket ticket. No SONIC controller or offline export."}, {Name: "addons", Description: "Owner-routed addon lifecycle and response relays", Tags: []string{"Addons"}, Intro: "POST /api/addons/dispatch submits typed lifecycle operations or reads actor-bound operation-status. POST /api/addons/relay serves status and coarse lifecycle progress on the receiving frontend. Named authentication and the addons feature are required; lifecycle operations require administration. Preserve operationId after outcome_unknown and poll status, never submit a new mutation. An add-on that refuses a request as invalid answers 400 invalid_request from every route, never an outage: nothing was applied, so correct the request instead of repeating it. Resource and output routes deny access until host admission and resolution providers are installed. Data and schema mutations are stored proposals: POST /api/addons/proposals previews and stores one (nothing is applied), GET /api/addons/proposals/{id} reads it, GET /api/addons/proposals?state=pending lists the caller's own pending proposals (newest first, at most 32; where a proposal made by a chat tool, an agent or a scheduled job waits for the proposer's own browser session), POST .../cancel withdraws one and POST .../reconcile resolves an unknown outcome by receipt lookup, and when no receipt can be found POST .../resolve lets the resource owner's own browser session abandon it with a reason (same confirmation-surface rules as confirm; nothing is applied again). The owner role finds what to resolve with GET /api/addons/resources/{resourceId}/proposals?state=unresolved (same rules, X-LocalAI-Confirm equals the resource ID): it lists the proposal ID, proposer, effects, digest and age of every unresolved proposal on the resource, never its arguments. A write blocked by an unresolved outcome is denied (403) and, for the owner role only, names it as outcome_blocked with blockedBy. POST .../confirm applies exactly the stored operation once and is accepted only from the proposer's own browser session (same-origin fetch, X-LocalAI-Confirm header equal to the proposal ID, digest of what was shown); API keys, MCP sessions and tool or agent calls can propose but never confirm, and no MCP tool maps to confirm. Sharing and database deletion are never proposals. A read that returns a file result gives private artifact IDs, never addon handles: GET /api/addons/artifacts/{id} returns the transfer state, name, size and expiry, and GET /api/addons/artifacts/{id}/download streams the complete file as an attachment. Only the requesting principal can read or download an artifact, an unknown, foreign or expired ID is the same 403, access to every source resource is checked again at completion and while streaming, and a disabled addon denies downloads until it is enabled again. No MCP tool maps to these routes. The Apps surface: GET /api/addons/apps lists the installed, enabled addons any caller with the addons feature may use, with title, description, icon URL, version, generation, state (running, starting, failed or stopped; an observation separate from enabled), a main page path only when the manifest declares a valid one, and a bounded tool summary; administrators also see disabled addons and per-app controls. GET /api/addons/apps/{id}/icon?generation=N serves the verified icon of a visible app. POST /api/addons/apps/{id}/start and .../stop are administrator-only, take {operationId, generation} with the generation that was listed, deny a stale generation and keep the lifecycle rules (preserve operationId after outcome_unknown). No MCP tool maps to the Apps routes. The listed ui entry of an app gives the same-origin URLs of its UI code: GET /api/addons/{id}/assets/{digest}/{path} streams one declared file (the entry module or a style sheet) of the current installed package, relayed from the owner, with Cache-Control private, max-age=31536000, immutable and nosniff. The digest is the package sha256 in lower-case hex; a file the manifest does not declare, a traversal, another addon, an older package and a disabled or uninstalled addon are all one 403, never cached. A credential in the URL is never accepted; the browser uses its same-origin session. No MCP tool maps to the asset route. Management (administrators only, through POST /api/addons/dispatch): the reads catalog-search, catalog-details, catalog-sources and addons-installed return catalog entries, one resolved entry, the configured libraries with their last fetch state and the installed addons with verified package facts, health, retained generations and storage; catalog-source-save stores or removes a library by reference only (a secret in place of a reference is denied) and catalog-source-refresh fetches one again; upgrade installs a newer release of an installed addon. Removing a library never touches installed addons. The installed view has an update object computed by the owner's update check (state, candidate version and digest, check and last-success time, reasons, redacted error class); an add-on the owner cannot answer for has none, and a failed check is never up-to-date. No MCP tool maps to these actions. UI-only resource management (never tools; no MCP tool maps to any of it): GET /api/addons/resources?addonId=tables lists the resources the caller owns or that were shared with the caller, with the caller's own role, the display name, the owner's display name for a shared one and, for the owner role only, the number of people it is shared with and the revision. POST /api/addons/resources creates one by the person's own action (operationId makes it idempotent; the arguments are the add-on's create tool arguments), POST .../{resourceId}/rename and .../delete rename and delete it (the owner role only; generation and revision must be the listed ones or the call is 409 stale; delete needs confirm equal to the display name, removes the data and every grant and never uninstalls the add-on), GET .../{resourceId}/grants, PUT/DELETE .../grants/{userId} and GET .../{resourceId}/users?q= list, set (viewer or editor, whole resource) and remove grants and search the people it can be shared with (immutable account ID and display name only; local-owner mode answers 409 sharing_disabled). All of them accept only the owner's own browser session with the X-LocalAI-Confirm header equal to the resource ID (the operation ID for a creation); API keys are refused. POST .../{resourceId}/apply changes the data or the schema by the person's own action with no card, through a write or schema tool the add-on declares ({operationId, generation, revision, tool, arguments} with the revision the caller read; editors write rows, only the owner changes the schema; 409 stale when the generation or revision moved; the same operationId with the same request is one change; reads, creations, rename, delete and undeclared tools are refused). GET .../resources/{resourceId}/operations/{operationId}?kind=rename|delete|apply reads the receipt of a rename, a deletion or a change after outcome_unknown, which carries the original operationId. GET/PUT/DELETE /api/addons/conversations/{conversationId}/selection/{addonId} keep the resource a conversation works on for the authenticated user; a chat tool call that names no resourceId uses it, authorized again by the owner on every call, and with none selected the tool answers an error result with code select_resource. Data recovery (administrators only, never tools; no MCP tool maps to any of it): GET /api/addons/{id}/recovery returns the recovery state of an add-on's data (ready, upgrading, restoring, needs-recovery or purging), its backups newest first with size, reason, mode and last verification result, the retention policy and the receipt of the last restore. POST /api/addons/{id}/recovery/backup makes a verified, consistent backup (the add-on is stopped while its SQLite files are copied with VACUUM INTO, admission is blocked and pending proposals are invalidated; nothing is left behind on failure; 503 insufficient_storage when it does not fit), .../verify reads one completely, .../restore restores one (the add-on must not be running, confirm is the add-on ID, mapping names the account that takes the data of a backup made in local-owner mode, the answer carries warnings and no share is given back that was removed since the backup or whose account is gone; 409 needs_recovery, addon_running, backup_corrupt, incompatible_format, identity_changed, mapping_required or downgrade_unsupported), .../delete-backup removes one (never the only verified copy, 409 sole_recovery_copy) and .../prune applies the retention policy. POST /api/addons/{id}/purge removes retained data by explicit scope (data, backups, recoveryCopies) with confirm equal to the add-on ID, for an add-on that is uninstalled or disabled; it is not a database deletion or an uninstall. Every mutation accepts only the administrator's own browser session (same-origin fetch, X-LocalAI-Confirm equal to the operationId); a repeated operationId returns the recorded result and never runs again; after outcome_unknown read the state and keep the operationId. An upgrade of an add-on that has data is backed up, migrated under exclusive ownership and published only when healthy; a failed migration that changes the data format leaves the add-on in needs-recovery with the previous package and the verified backup retained. Updates (never tools; no MCP tool maps to any of it): GET /api/addons/{id}/update reads the owner's update status of an installed add-on for every caller with the addons feature who may see it (administrators any installed add-on, others an enabled one; the same 403 otherwise). The state is unknown, up-to-date, update-available, incompatible (reasons: platform, host-version, api-version, protocol-version, sdk-version, data-format), check-failed (a redacted error class and lastSuccess, the time the library was last read; never shown as up-to-date) or integrity-error (an immutable version was listed again with another digest; never an update). A moving channel (development, a branch, latest) compares resolved digests, so a changed digest with the same version label is an update; an immutable version selects the highest compatible greater version of the same major. The library and the channel the add-on came from never change by themselves. Callers who are not administrators get the state, versions and times only. The route never uses the network. POST /api/addons/{id}/update/check (administrators, own browser session, X-LocalAI-Confirm equal to the operationId) fetches the library again and returns the status; it is rate limited and answers throttled true when it did not fetch, and it applies nothing. POST /api/addons/{id}/upgrade (administrators, own browser session) is the only request that applies an update: it carries operationId, expectedDigest (the installed package the caller saw) and candidateDigest (the candidate the check resolved), and the owner re-resolves, re-checks compatibility and refuses before it records anything with 409 stale_installed, candidate_changed, incompatible, integrity_error or upgrade_conflict (the same transition under another operationId); 503 check_failed when the library cannot be read. A failure keeps the last good generation or enters the recovery state; the previous installation is never deleted. The apps list marks an app update: update-pending from the owner's cached check only and never reaches a library."}, + {Name: "library-sources", Description: "Library sources of add-ons, backends and models", Tags: []string{"library"}, Intro: "Administrators only. GET /api/library/sources lists every source of the add-on, backend and model kinds, shipped defaults and removed defaults (tombstones) included, with kind, id, name, url, mirrors, enabled, default, removed, suspended, a conflict message and the last fetch state. POST /api/library/sources adds a source of your own ({kind: addon|backend|model, url, id, name, format: library|gallery}); the same kind and URL twice is a 409. POST /api/library/sources/{id}/enable and /disable turn one on or off (enabling a removed default brings it back). PUT /api/library/sources/{id} replaces the mirrors of a model or backend source ({mirrors: [..]}); POST also takes mirrors. Each mirror is an http(s), github:, oci:// or file:// address, at most 8. DELETE /api/library/sources/{id} removes a source; a shipped default stays as a tombstone so it does not return at the next start. The routes work on the store that `local-ai library` edits. The runtime setting official_libraries (default on) turns every shipped default off at once: they stay listed with suspended true. No MCP tool maps to these routes."}, {Name: "addon-navigation", Description: "The built-in tiles and the per-user pins of the Add-ons drawer", Tags: []string{"AddonNavigation"}, Intro: "GET /api/addons/builtin lists the page add-ons the caller may open. GET and PUT /api/addons/pins read and replace the caller's ordered pins. All of them need an authenticated caller; none needs the addons feature or the administrator role."}, { Name: "chat-inference", diff --git a/core/http/endpoints/localai/api_instructions_test.go b/core/http/endpoints/localai/api_instructions_test.go index 56dc78740..2738efbb0 100644 --- a/core/http/endpoints/localai/api_instructions_test.go +++ b/core/http/endpoints/localai/api_instructions_test.go @@ -39,7 +39,7 @@ var _ = Describe("API Instructions Endpoints", func() { instructions, ok := resp["instructions"].([]any) Expect(ok).To(BeTrue()) - Expect(instructions).To(HaveLen(25)) + Expect(instructions).To(HaveLen(26)) // Verify each instruction has required fields and correct URL format for _, s := range instructions { @@ -69,6 +69,7 @@ var _ = Describe("API Instructions Endpoints", func() { Expect(names).To(ContainElements( "addons", + "library-sources", "chat-inference", "moderation", "config-management", diff --git a/core/http/endpoints/localai/backend_library.go b/core/http/endpoints/localai/backend_library.go new file mode 100644 index 000000000..30886a1b8 --- /dev/null +++ b/core/http/endpoints/localai/backend_library.go @@ -0,0 +1,190 @@ +package localai + +import ( + "context" + "errors" + "fmt" + "net/http" + "sync" + "time" + + "github.com/google/uuid" + "github.com/labstack/echo/v4" + "github.com/mudler/LocalAI/core/http/middleware" + "github.com/mudler/LocalAI/core/schema" + "github.com/mudler/LocalAI/core/services/addons/backendlib" + "github.com/mudler/LocalAI/core/services/addons/catalog" + "github.com/mudler/LocalAI/core/services/galleryop" + "github.com/mudler/LocalAI/pkg/downloader" + "github.com/mudler/xlog" +) + +// BackendLibraryInstaller installs a backend from a library entry and lists +// the installed ones that have a newer build in their library. +type BackendLibraryInstaller interface { + Install(ctx context.Context, sourceID, backend, version string, progress backendlib.Progress) error + Updates(ctx context.Context) ([]backendlib.Update, error) +} + +// BackendLibraryJobs records the status of an install under a job ID. The +// gallery service is the one the backend gallery installs use, so the same +// route, GET /backends/jobs/{id}, answers for both. +type BackendLibraryJobs interface { + UpdateStatus(id string, op *galleryop.OpStatus) +} + +// BackendLibraryInstallRequest names one library entry of kind backend. +type BackendLibraryInstallRequest struct { + // SourceID is the library the entry comes from. + SourceID string `json:"sourceId"` + // Name is the backend name of the entry. + Name string `json:"name"` + // Version is the version or the channel of the entry. + Version string `json:"version"` +} + +// libraryInstallTimeout bounds one install that runs after its request ended. +const libraryInstallTimeout = time.Hour + +// InstallBackendFromLibraryEndpoint starts the install of a backend from a +// library entry on this node and answers at once with a job. The job reports +// the steps of the install (resolving, verifying, size, fetching, writing) as +// the phase of its status, with the byte progress of the fetch, and ends with +// the result or the reason of the refusal. The library resolves the entry, so +// the request cannot name an image, a digest or a policy. +// @Summary Install a backend from a library entry on this node. +// @Tags backends +// @Param request body BackendLibraryInstallRequest true "library, backend name and version" +// @Success 200 {object} schema.BackendResponse "the job; read its status at the status URL" +// @Failure 400 {object} schema.ErrorResponse "the request does not name an entry" +// @Failure 409 {object} schema.ErrorResponse "the same backend is already being installed" +// @Router /backends/library/install [post] +func InstallBackendFromLibraryEndpoint(installer BackendLibraryInstaller, jobs BackendLibraryJobs) echo.HandlerFunc { + var mu sync.Mutex + running := map[string]bool{} + return func(c echo.Context) error { + var in BackendLibraryInstallRequest + if err := c.Bind(&in); err != nil { + return libraryError(c, http.StatusBadRequest, "invalid request") + } + if in.SourceID == "" || in.Name == "" || in.Version == "" { + return libraryError(c, http.StatusBadRequest, "sourceId, name and version are required") + } + // One install of a name at a time: two would write the same directory. + mu.Lock() + if running[in.Name] { + mu.Unlock() + return libraryError(c, http.StatusConflict, "this backend is already being installed") + } + running[in.Name] = true + mu.Unlock() + + id := uuid.NewString() + jobs.UpdateStatus(id, &galleryop.OpStatus{Phase: backendlib.StepResolving, Message: stepMessage(backendlib.StepResolving), GalleryElementName: in.Name}) + // The request ends before the install does, so the install keeps the + // values of the request and drops its cancellation. + ctx, cancel := context.WithTimeout(context.WithoutCancel(c.Request().Context()), libraryInstallTimeout) + go func() { + defer cancel() + defer func() { + mu.Lock() + delete(running, in.Name) + mu.Unlock() + }() + runLibraryInstall(ctx, installer, jobs, id, in) + }() + return c.JSON(http.StatusOK, schema.BackendResponse{ID: id, StatusURL: fmt.Sprintf("%sbackends/jobs/%s", middleware.BaseURL(c), id)}) + } +} + +// stepMessage is the text of a step in the status of a job. +func stepMessage(step string) string { + switch step { + case backendlib.StepResolving: + return "Resolving the library entry" + case backendlib.StepVerifying: + return "Verifying the signature" + case backendlib.StepSize: + return "Checking the image size" + case backendlib.StepFetching: + return "Fetching the image" + case backendlib.StepWriting: + return "Writing the metadata" + } + return step +} + +func runLibraryInstall(ctx context.Context, installer BackendLibraryInstaller, jobs BackendLibraryJobs, id string, in BackendLibraryInstallRequest) { + var mu sync.Mutex + phase := backendlib.StepResolving + post := func(op *galleryop.OpStatus) { + op.GalleryElementName = in.Name + jobs.UpdateStatus(id, op) + } + err := installer.Install(ctx, in.SourceID, in.Name, in.Version, backendlib.Progress{ + Step: func(step string) { + mu.Lock() + phase = step + mu.Unlock() + post(&galleryop.OpStatus{Phase: step, Message: stepMessage(step)}) + }, + Bytes: func(file, current, total string, pct float64) { + mu.Lock() + p := phase + mu.Unlock() + // Bytes arrive while the image is fetched; a late tick must not + // move the job back from a step it has left. + if p != backendlib.StepFetching { + return + } + post(&galleryop.OpStatus{Phase: p, Message: stepMessage(p), FileName: file, Progress: pct, DownloadedFileSize: current, TotalFileSize: total}) + }, + }) + if err == nil { + post(&galleryop.OpStatus{Phase: "done", Message: "completed", Processed: true, Progress: 100}) + return + } + xlog.Warn("backend library install failed", "source", in.SourceID, "backend", in.Name, "error", err) + mu.Lock() + failed := phase + mu.Unlock() + // The phase stays at the step that failed, so the page can mark it. + post(&galleryop.OpStatus{Phase: failed, Error: err, Processed: true, Message: "error: " + libraryReason(err)}) +} + +// libraryReason words the failure of an install for the administrator. +func libraryReason(err error) string { + switch { + case errors.Is(err, catalog.ErrNotFound): + return "the library has no such entry for this host" + case errors.Is(err, backendlib.ErrCollision): + return err.Error() + case errors.Is(err, catalog.ErrUnavailable), errors.Is(err, catalog.ErrRefresh): + return "the library is not available: " + err.Error() + case errors.Is(err, downloader.ErrImageTooLarge): + return "the image is over the size limit: " + err.Error() + } + return err.Error() +} + +// BackendLibraryUpdatesEndpoint lists the installed library backends that have +// a newer build in their library. It reads the cached index and installs +// nothing. +// @Summary List the installed library backends with a newer build in their library. +// @Tags backends +// @Success 200 {object} map[string][]backendlib.Update "updates" +// @Router /backends/library/updates [get] +func BackendLibraryUpdatesEndpoint(installer BackendLibraryInstaller) echo.HandlerFunc { + return func(c echo.Context) error { + updates, err := installer.Updates(c.Request().Context()) + if err != nil { + return libraryError(c, http.StatusInternalServerError, err.Error()) + } + return c.JSON(http.StatusOK, map[string][]backendlib.Update{"updates": updates}) + } +} + +// libraryError answers in the error format of the other routes. +func libraryError(c echo.Context, status int, message string) error { + return c.JSON(status, schema.ErrorResponse{Error: &schema.APIError{Code: status, Message: message, Type: "backend_library"}}) +} diff --git a/core/http/endpoints/localai/backend_library_test.go b/core/http/endpoints/localai/backend_library_test.go new file mode 100644 index 000000000..8d9acfc7a --- /dev/null +++ b/core/http/endpoints/localai/backend_library_test.go @@ -0,0 +1,193 @@ +package localai_test + +import ( + "context" + "encoding/json" + "fmt" + "net/http" + "net/http/httptest" + "strings" + "sync" + + "github.com/labstack/echo/v4" + "github.com/mudler/LocalAI/core/http/endpoints/localai" + "github.com/mudler/LocalAI/core/services/addons/backendlib" + "github.com/mudler/LocalAI/core/services/addons/catalog" + "github.com/mudler/LocalAI/core/services/galleryop" + "github.com/mudler/LocalAI/pkg/downloader" + . "github.com/onsi/ginkgo/v2" + . "github.com/onsi/gomega" +) + +type fakeLibrary struct { + err error + steps []string + updates []backendlib.Update + last [3]string + block chan struct{} +} + +func (f *fakeLibrary) Install(_ context.Context, source, backend, version string, p backendlib.Progress) error { + f.last = [3]string{source, backend, version} + for _, s := range f.steps { + p.Step(s) + if s == backendlib.StepFetching { + p.Bytes("layer", "1 MB", "2 MB", 50) + } + } + if f.block != nil { + <-f.block + } + return f.err +} + +func (f *fakeLibrary) Updates(context.Context) ([]backendlib.Update, error) { + return f.updates, nil +} + +// fakeJobs keeps every status of every job, in order. +type fakeJobs struct { + mu sync.Mutex + logs map[string][]galleryop.OpStatus +} + +func (j *fakeJobs) UpdateStatus(id string, op *galleryop.OpStatus) { + j.mu.Lock() + defer j.mu.Unlock() + if j.logs == nil { + j.logs = map[string][]galleryop.OpStatus{} + } + j.logs[id] = append(j.logs[id], *op) +} + +func (j *fakeJobs) history(id string) []galleryop.OpStatus { + j.mu.Lock() + defer j.mu.Unlock() + return append([]galleryop.OpStatus(nil), j.logs[id]...) +} + +var allSteps = []string{backendlib.StepResolving, backendlib.StepVerifying, backendlib.StepSize, backendlib.StepFetching, backendlib.StepWriting} + +var _ = Describe("install a backend from a library", func() { + post := func(f *fakeLibrary, jobs *fakeJobs, body string) *httptest.ResponseRecorder { + e := echo.New() + req := httptest.NewRequest(http.MethodPost, "/backends/library/install", strings.NewReader(body)) + req.Header.Set("Content-Type", "application/json") + rec := httptest.NewRecorder() + Expect(localai.InstallBackendFromLibraryEndpoint(f, jobs)(e.NewContext(req, rec))).To(Succeed()) + return rec + } + jobID := func(rec *httptest.ResponseRecorder) string { + var out struct { + ID string `json:"id"` + StatusURL string `json:"status_url"` + } + Expect(json.Unmarshal(rec.Body.Bytes(), &out)).To(Succeed()) + Expect(out.ID).NotTo(BeEmpty()) + Expect(out.StatusURL).To(HaveSuffix("backends/jobs/" + out.ID)) + return out.ID + } + last := func(jobs *fakeJobs, id string) galleryop.OpStatus { + var op galleryop.OpStatus + Eventually(func() bool { + h := jobs.history(id) + if len(h) == 0 { + return false + } + op = h[len(h)-1] + return op.Processed + }).Should(BeTrue()) + return op + } + + It("answers with a job and reports every step, then the result", func() { + f := &fakeLibrary{steps: allSteps} + jobs := &fakeJobs{} + rec := post(f, jobs, `{"sourceId":"pilot","name":"cpu-demo","version":"latest"}`) + Expect(rec.Code).To(Equal(http.StatusOK)) + id := jobID(rec) + done := last(jobs, id) + Expect(done.Message).To(Equal("completed")) + Expect(done.Progress).To(BeEquivalentTo(100)) + Expect(done.Error).NotTo(HaveOccurred()) + Expect(f.last).To(Equal([3]string{"pilot", "cpu-demo", "latest"})) + phases := []string{} + for _, s := range jobs.history(id) { + if len(phases) == 0 || phases[len(phases)-1] != s.Phase { + phases = append(phases, s.Phase) + } + Expect(s.GalleryElementName).To(Equal("cpu-demo")) + } + Expect(phases).To(Equal(append(append([]string{}, allSteps...), "done"))) + // The fetch step carries the bytes of the image. + var fetch *galleryop.OpStatus + for _, s := range jobs.history(id) { + if s.Phase == backendlib.StepFetching && s.Progress > 0 { + fetch = &s + } + } + Expect(fetch).NotTo(BeNil()) + Expect(fetch.Progress).To(BeEquivalentTo(50)) + Expect(fetch.TotalFileSize).To(Equal("2 MB")) + }) + + It("keeps the failed step as the phase of the job and gives the reason", func() { + f := &fakeLibrary{steps: allSteps[:3], err: fmt.Errorf("image too big: %w", downloader.ErrImageTooLarge)} + jobs := &fakeJobs{} + id := jobID(post(f, jobs, `{"sourceId":"pilot","name":"cpu-demo","version":"latest"}`)) + done := last(jobs, id) + Expect(done.Phase).To(Equal(backendlib.StepSize)) + Expect(done.Error).To(MatchError(ContainSubstring(downloader.ErrImageTooLarge.Error()))) + Expect(done.Message).To(HavePrefix("error: ")) + }) + + It("words a collision and a missing entry for the administrator", func() { + for err, want := range map[error]string{ + fmt.Errorf("%w: %q", backendlib.ErrCollision, "cpu-demo"): "already installed from another origin", + catalog.ErrNotFound: "no such entry", + } { + jobs := &fakeJobs{} + id := jobID(post(&fakeLibrary{err: err}, jobs, `{"sourceId":"p","name":"n","version":"v"}`)) + Expect(last(jobs, id).Message).To(ContainSubstring(want)) + } + }) + + It("refuses a second install of a name that is still running", func() { + f := &fakeLibrary{block: make(chan struct{})} + jobs := &fakeJobs{} + body := `{"sourceId":"pilot","name":"cpu-demo","version":"latest"}` + e := echo.New() + handler := localai.InstallBackendFromLibraryEndpoint(f, jobs) + call := func() *httptest.ResponseRecorder { + req := httptest.NewRequest(http.MethodPost, "/backends/library/install", strings.NewReader(body)) + req.Header.Set("Content-Type", "application/json") + rec := httptest.NewRecorder() + Expect(handler(e.NewContext(req, rec))).To(Succeed()) + return rec + } + first := call() + Expect(first.Code).To(Equal(http.StatusOK)) + Expect(call().Code).To(Equal(http.StatusConflict)) + close(f.block) + last(jobs, jobID(first)) + Eventually(func() int { return call().Code }).Should(Equal(http.StatusOK)) + }) + + It("refuses a request that does not name an entry", func() { + for _, body := range []string{`{}`, `{"sourceId":"pilot","name":"x"}`, `not json`} { + Expect(post(&fakeLibrary{}, &fakeJobs{}, body).Code).To(Equal(http.StatusBadRequest), body) + } + }) + + It("lists the updates of the installed library backends", func() { + f := &fakeLibrary{updates: []backendlib.Update{{Name: "cpu-demo", SourceID: "pilot", InstalledDigest: "sha256:a", Version: "2", Digest: "sha256:b"}}} + rec := httptest.NewRecorder() + e := echo.New() + Expect(localai.BackendLibraryUpdatesEndpoint(f)(e.NewContext(httptest.NewRequest(http.MethodGet, "/backends/library/updates", nil), rec))).To(Succeed()) + var out struct { + Updates []backendlib.Update `json:"updates"` + } + Expect(json.Unmarshal(rec.Body.Bytes(), &out)).To(Succeed()) + Expect(out.Updates).To(Equal(f.updates)) + }) +}) diff --git a/core/http/endpoints/localai/library_sources.go b/core/http/endpoints/localai/library_sources.go new file mode 100644 index 000000000..97b84feb0 --- /dev/null +++ b/core/http/endpoints/localai/library_sources.go @@ -0,0 +1,277 @@ +package localai + +import ( + "errors" + "net/http" + "strings" + + "github.com/labstack/echo/v4" + "github.com/mudler/LocalAI/core/library" + "github.com/mudler/LocalAI/core/services/addons/catalog" + "github.com/mudler/xlog" +) + +// LibrarySourcesEndpoints serve the library sources of all three kinds +// (add-ons, backends and models). They work on the store `local-ai library` +// edits, through the same functions, so the command and the routes cannot +// drift. The routes are registered behind the administrator middleware. +type LibrarySourcesEndpoints struct { + // Store returns the one store of the running server. + Store func() (*catalog.Sources, error) + // Official says whether the official libraries are on. + Official func() bool + // Applied runs after a change, so the server reads the new state. + Applied func(dropped ...string) error +} + +type LibrarySourcesResponse struct { + Sources []library.Info `json:"sources"` + OfficialLibraries bool `json:"officialLibraries"` +} + +type addLibrarySourceRequest struct { + Kind string `json:"kind"` + URL string `json:"url"` + ID string `json:"id"` + Name string `json:"name"` + Format string `json:"format"` + // Mirrors are fallback addresses of a model or backend source. + Mirrors []string `json:"mirrors,omitempty"` +} + +type updateLibrarySourceRequest struct { + Mirrors []string `json:"mirrors"` +} + +func librarySourceError(c echo.Context, code int, message string) error { + return c.JSON(code, map[string]any{"error": map[string]any{"code": code, "message": message}}) +} + +func (e LibrarySourcesEndpoints) open(c echo.Context) (*catalog.Sources, error) { + store, err := e.Store() + if err != nil { + xlog.Warn("library sources are not available", "error", err) + return nil, librarySourceError(c, http.StatusServiceUnavailable, "the library sources are not available") + } + return store, nil +} + +func (e LibrarySourcesEndpoints) applied(dropped ...string) { + if e.Applied == nil { + return + } + if err := e.Applied(dropped...); err != nil { + xlog.Warn("could not apply the library sources", "error", err) + } +} + +func (e LibrarySourcesEndpoints) official() bool { + if e.Official == nil { + return true + } + return e.Official() +} + +// storeError maps a store error to the status the caller sees. +func storeError(c echo.Context, err error, id string) error { + switch { + case errors.Is(err, catalog.ErrNotFound): + return librarySourceError(c, http.StatusNotFound, "no source with id "+id) + case errors.Is(err, catalog.ErrExists), errors.Is(err, library.ErrDuplicate): + return librarySourceError(c, http.StatusConflict, err.Error()) + case errors.Is(err, catalog.ErrInvalid): + return librarySourceError(c, http.StatusBadRequest, "the id must be lowercase letters, digits and dashes and start with a letter, and a library index URL must be http or https (use format gallery for a gallery index)") + } + xlog.Warn("library source change failed", "error", err) + return librarySourceError(c, http.StatusInternalServerError, "the change could not be stored") +} + +// List godoc +// @Summary List the library sources +// @Description Every library source of the add-on, backend and model kinds, with its state: kind, id, name, url, enabled (what the host does with it), default (shipped), removed (a default the user removed; a tombstone), suspended (a default while the official libraries are off), the conflict message when it clashes with another source, and the last fetch state when there is one. Administrators only. +// @Tags library +// @Produce json +// @Success 200 {object} localai.LibrarySourcesResponse +// @Router /api/library/sources [get] +func (e LibrarySourcesEndpoints) List() echo.HandlerFunc { + return func(c echo.Context) error { + store, err := e.open(c) + if store == nil { + return err + } + return c.JSON(http.StatusOK, LibrarySourcesResponse{Sources: library.List(store), OfficialLibraries: e.official()}) + } +} + +// cleanMirrors trims the mirrors and checks them as a gallery address is +// checked. An add-on source takes none. +func cleanMirrors(kind string, in []string) ([]string, error) { + var out []string + for _, m := range in { + if m = strings.TrimSpace(m); m != "" { + out = append(out, m) + } + } + if len(out) > 0 && kind == string(catalog.KindAddon) { + return nil, errors.New("an add-on source takes no mirrors") + } + if err := catalog.ValidateMirrors(out); err != nil { + return nil, err + } + return out, nil +} + +// Update godoc +// @Summary Change the mirrors of a library source +// @Description Replaces the mirrors of a model or backend source; an empty list clears them. Each mirror is an http(s), github:, oci:// or file:// address. Administrators only. +// @Tags library +// @Accept json +// @Produce json +// @Param id path string true "Source id" +// @Success 200 {object} library.Info +// @Router /api/library/sources/{id} [put] +func (e LibrarySourcesEndpoints) Update() echo.HandlerFunc { + return func(c echo.Context) error { + id := c.Param("id") + var req updateLibrarySourceRequest + if err := c.Bind(&req); err != nil { + return librarySourceError(c, http.StatusBadRequest, "the request is not valid JSON") + } + store, err := e.open(c) + if store == nil { + return err + } + kind := "" + for _, in := range library.List(store) { + if in.ID == id { + kind = string(in.Kind) + } + } + mirrors, err := cleanMirrors(kind, req.Mirrors) + if err != nil { + return librarySourceError(c, http.StatusBadRequest, err.Error()) + } + if err := store.SetMirrors(id, mirrors); err != nil { + return storeError(c, err, id) + } + e.applied() + for _, in := range library.List(store) { + if in.ID == id { + return c.JSON(http.StatusOK, in) + } + } + return c.NoContent(http.StatusNoContent) + } +} + +// Add godoc +// @Summary Add a library source +// @Description Adds a source of your own. kind is addon, backend or model; format is library (default) or gallery. The id is derived from the name or URL when it is empty. A source with the same kind and URL is refused (409), as is a taken id. Administrators only. +// @Tags library +// @Accept json +// @Produce json +// @Success 201 {object} library.Info +// @Router /api/library/sources [post] +func (e LibrarySourcesEndpoints) Add() echo.HandlerFunc { + return func(c echo.Context) error { + var req addLibrarySourceRequest + if err := c.Bind(&req); err != nil { + return librarySourceError(c, http.StatusBadRequest, "the request is not valid JSON") + } + req.URL, req.ID, req.Name = strings.TrimSpace(req.URL), strings.TrimSpace(req.ID), strings.TrimSpace(req.Name) + switch req.Kind { + case string(catalog.KindAddon), string(catalog.KindBackend), string(catalog.KindModel): + default: + return librarySourceError(c, http.StatusBadRequest, "kind must be addon, backend or model") + } + format := "" + switch req.Format { + case "", "library": + case "gallery": + format = catalog.FormatGallery + default: + return librarySourceError(c, http.StatusBadRequest, "format must be library or gallery") + } + if req.URL == "" { + return librarySourceError(c, http.StatusBadRequest, "url is required") + } + mirrors, err := cleanMirrors(req.Kind, req.Mirrors) + if err != nil { + return librarySourceError(c, http.StatusBadRequest, err.Error()) + } + store, err := e.open(c) + if store == nil { + return err + } + src, err := library.AddWithMirrors(store, catalog.Kind(req.Kind), req.URL, req.ID, req.Name, format, mirrors) + if err != nil { + return storeError(c, err, req.ID) + } + e.applied() + for _, in := range library.List(store) { + if in.ID == src.ID { + return c.JSON(http.StatusCreated, in) + } + } + return c.JSON(http.StatusCreated, library.Info{Kind: src.Kind, ID: src.ID, Name: src.Name, URL: src.URL, Enabled: true}) + } +} + +// SetEnabled godoc +// @Summary Turn a library source on or off +// @Description Enabling a removed default brings it back. Administrators only. +// @Tags library +// @Produce json +// @Param id path string true "Source id" +// @Success 200 {object} library.Info +// @Router /api/library/sources/{id}/enable [post] +// @Router /api/library/sources/{id}/disable [post] +func (e LibrarySourcesEndpoints) SetEnabled(enabled bool) echo.HandlerFunc { + return func(c echo.Context) error { + id := c.Param("id") + store, err := e.open(c) + if store == nil { + return err + } + if err := store.SetEnabled(id, enabled); err != nil { + return storeError(c, err, id) + } + e.applied() + for _, in := range library.List(store) { + if in.ID == id { + return c.JSON(http.StatusOK, in) + } + } + return c.NoContent(http.StatusNoContent) + } +} + +// Remove godoc +// @Summary Remove a library source +// @Description A source of your own is deleted. A shipped default is not: it stays as a tombstone (removed true), so it does not come back at the next start; enabling it brings it back. Administrators only. +// @Tags library +// @Produce json +// @Param id path string true "Source id" +// @Success 200 {object} map[string]any +// @Router /api/library/sources/{id} [delete] +func (e LibrarySourcesEndpoints) Remove() echo.HandlerFunc { + return func(c echo.Context) error { + id := c.Param("id") + store, err := e.open(c) + if store == nil { + return err + } + url := library.URLOf(store, id) + wasDefault, err := library.Remove(store, id) + if err != nil { + return storeError(c, err, id) + } + // A tombstone keeps its record, so only a deleted source is dropped by address. + if wasDefault { + e.applied() + } else { + e.applied(url) + } + return c.JSON(http.StatusOK, map[string]any{"id": id, "default": wasDefault, "tombstone": wasDefault}) + } +} diff --git a/core/http/endpoints/localai/library_sources_test.go b/core/http/endpoints/localai/library_sources_test.go new file mode 100644 index 000000000..d6630b72c --- /dev/null +++ b/core/http/endpoints/localai/library_sources_test.go @@ -0,0 +1,258 @@ +package localai_test + +import ( + "encoding/json" + "net/http" + "net/http/httptest" + "strings" + + "github.com/labstack/echo/v4" + "github.com/mudler/LocalAI/core/http/auth" + . "github.com/mudler/LocalAI/core/http/endpoints/localai" + "github.com/mudler/LocalAI/core/library" + "github.com/mudler/LocalAI/core/services/addons/catalog" + . "github.com/onsi/ginkgo/v2" + . "github.com/onsi/gomega" +) + +// The routes sit behind auth.RequireAdmin, as RegisterLocalAIRoutes wires them. +var _ = Describe("Library source routes", func() { + var ( + app *echo.Echo + dir string + store *catalog.Sources + applied int + official bool + dropped []string + ) + + // call sends one request as the given role ("" = not signed in). + call := func(role, method, path, body string) *httptest.ResponseRecorder { + req := httptest.NewRequest(method, path, strings.NewReader(body)) + req.Header.Set("Content-Type", "application/json") + if role != "" { + req.Header.Set("X-Test-Role", role) + } + rec := httptest.NewRecorder() + app.ServeHTTP(rec, req) + return rec + } + list := func() (sources []map[string]any) { + rec := call(auth.RoleAdmin, http.MethodGet, "/api/library/sources", "") + Expect(rec.Code).To(Equal(http.StatusOK), rec.Body.String()) + var resp struct { + Sources []map[string]any `json:"sources"` + } + Expect(json.Unmarshal(rec.Body.Bytes(), &resp)).To(Succeed()) + return resp.Sources + } + find := func(id string) map[string]any { + for _, s := range list() { + if s["id"] == id { + return s + } + } + return nil + } + + BeforeEach(func() { + dir = GinkgoT().TempDir() + var err error + store, err = library.Open(dir, true, false) + Expect(err).NotTo(HaveOccurred()) + applied, official, dropped = 0, true, nil + app = echo.New() + app.Use(func(next echo.HandlerFunc) echo.HandlerFunc { + return func(c echo.Context) error { + if role := c.Request().Header.Get("X-Test-Role"); role != "" { + c.Set("auth_user", &auth.User{ID: "u-" + role, Role: role}) + } + return next(c) + } + }) + e := LibrarySourcesEndpoints{ + Store: func() (*catalog.Sources, error) { return store, nil }, + Official: func() bool { return official }, + Applied: func(d ...string) error { applied++; dropped = append(dropped, d...); return nil }, + } + admin := auth.RequireAdmin() + app.GET("/api/library/sources", e.List(), admin) + app.POST("/api/library/sources", e.Add(), admin) + app.POST("/api/library/sources/:id/enable", e.SetEnabled(true), admin) + app.POST("/api/library/sources/:id/disable", e.SetEnabled(false), admin) + app.PUT("/api/library/sources/:id", e.Update(), admin) + app.DELETE("/api/library/sources/:id", e.Remove(), admin) + }) + + It("refuses every route to a caller who is not an administrator", func() { + routes := [][2]string{ + {http.MethodGet, "/api/library/sources"}, + {http.MethodPost, "/api/library/sources"}, + {http.MethodPost, "/api/library/sources/localai-backends/enable"}, + {http.MethodPost, "/api/library/sources/localai-backends/disable"}, + {http.MethodDelete, "/api/library/sources/localai-backends"}, + } + for _, r := range routes { + Expect(call(auth.RoleUser, r[0], r[1], `{"kind":"model","url":"https://example.org/m.yaml"}`).Code).To(Equal(http.StatusForbidden), r[0]+" "+r[1]) + Expect(call("", r[0], r[1], `{}`).Code).To(Equal(http.StatusUnauthorized), r[0]+" "+r[1]) + } + // Nothing was changed by the refused calls. + Expect(applied).To(BeZero()) + Expect(find("localai-backends")["enabled"]).To(BeTrue()) + Expect(find("localai-backends")["removed"]).To(BeFalse()) + }) + + It("lists the sources of all three kinds with their flags", func() { + kinds := map[any]bool{} + for _, s := range list() { + kinds[s["kind"]] = true + Expect(s["default"]).To(BeTrue()) + Expect(s["removed"]).To(BeFalse()) + Expect(s["suspended"]).To(BeFalse()) + } + Expect(find("official")["enabled"]).To(BeTrue()) + Expect(find("localai-backends")["enabled"]).To(BeTrue()) + Expect(kinds).To(HaveKey("addon")) + Expect(kinds).To(HaveKey("backend")) + Expect(kinds).To(HaveKey("model")) + }) + + It("adds a model source of the user and refuses the same URL twice", func() { + rec := call(auth.RoleAdmin, http.MethodPost, "/api/library/sources", `{"kind":"model","format":"gallery","name":"Team Models","url":"https://example.org/models.yaml"}`) + Expect(rec.Code).To(Equal(http.StatusCreated), rec.Body.String()) + var created map[string]any + Expect(json.Unmarshal(rec.Body.Bytes(), &created)).To(Succeed()) + Expect(created).To(HaveKeyWithValue("id", "team-models")) + Expect(created).To(HaveKeyWithValue("kind", "model")) + Expect(created).To(HaveKeyWithValue("default", false)) + Expect(applied).To(Equal(1)) + + // The file the CLI reads has it. + again, err := library.Open(dir, true, false) + Expect(err).NotTo(HaveOccurred()) + found := false + for _, i := range library.List(again) { + found = found || i.ID == "team-models" + } + Expect(found).To(BeTrue()) + + dup := call(auth.RoleAdmin, http.MethodPost, "/api/library/sources", `{"kind":"model","format":"gallery","id":"other","url":"https://example.org/models.yaml"}`) + Expect(dup.Code).To(Equal(http.StatusConflict), dup.Body.String()) + taken := call(auth.RoleAdmin, http.MethodPost, "/api/library/sources", `{"kind":"model","id":"team-models","url":"https://example.org/other.yaml"}`) + Expect(taken.Code).To(Equal(http.StatusConflict), taken.Body.String()) + }) + + It("refuses a bad kind, format, id or URL", func() { + for _, body := range []string{ + `{"kind":"nope","url":"https://example.org/m.yaml"}`, + `{"kind":"model","format":"zip","url":"https://example.org/m.yaml"}`, + `{"kind":"model","url":""}`, + `{"kind":"model","id":"Bad Id","url":"https://example.org/m.yaml"}`, + `{"kind":"model","url":"ftp://example.org/m.yaml"}`, + `not json`, + } { + Expect(call(auth.RoleAdmin, http.MethodPost, "/api/library/sources", body).Code).To(Equal(http.StatusBadRequest), body) + } + Expect(applied).To(BeZero()) + }) + + It("disables and enables a default without removing it", func() { + rec := call(auth.RoleAdmin, http.MethodPost, "/api/library/sources/localai-backends/disable", "") + Expect(rec.Code).To(Equal(http.StatusOK), rec.Body.String()) + Expect(find("localai-backends")).To(And(HaveKeyWithValue("enabled", false), HaveKeyWithValue("removed", false))) + Expect(call(auth.RoleAdmin, http.MethodPost, "/api/library/sources/localai-backends/enable", "").Code).To(Equal(http.StatusOK)) + Expect(find("localai-backends")).To(HaveKeyWithValue("enabled", true)) + Expect(call(auth.RoleAdmin, http.MethodPost, "/api/library/sources/nope/disable", "").Code).To(Equal(http.StatusNotFound)) + }) + + It("leaves a tombstone for a removed default, as the CLI does, and deletes a source of the user", func() { + rec := call(auth.RoleAdmin, http.MethodDelete, "/api/library/sources/localai-backends", "") + Expect(rec.Code).To(Equal(http.StatusOK), rec.Body.String()) + Expect(rec.Body.String()).To(ContainSubstring(`"tombstone":true`)) + tomb := find("localai-backends") + Expect(tomb).To(And(HaveKeyWithValue("removed", true), HaveKeyWithValue("enabled", false), HaveKeyWithValue("default", true))) + + // A restart seeds the defaults again; the tombstone stays. + again, err := library.Open(dir, true, false) + Expect(err).NotTo(HaveOccurred()) + for _, i := range library.List(again) { + if i.ID == "localai-backends" { + Expect(i.Removed).To(BeTrue()) + } + } + // Removing it again finds nothing to remove; enabling brings it back. + Expect(call(auth.RoleAdmin, http.MethodDelete, "/api/library/sources/localai-backends", "").Code).To(Equal(http.StatusNotFound)) + Expect(call(auth.RoleAdmin, http.MethodPost, "/api/library/sources/localai-backends/enable", "").Code).To(Equal(http.StatusOK)) + Expect(find("localai-backends")).To(And(HaveKeyWithValue("removed", false), HaveKeyWithValue("enabled", true))) + + Expect(call(auth.RoleAdmin, http.MethodPost, "/api/library/sources", `{"kind":"backend","format":"gallery","id":"mine","url":"https://example.org/b.yaml"}`).Code).To(Equal(http.StatusCreated)) + del := call(auth.RoleAdmin, http.MethodDelete, "/api/library/sources/mine", "") + Expect(del.Code).To(Equal(http.StatusOK)) + Expect(del.Body.String()).To(ContainSubstring(`"tombstone":false`)) + // The server drops the gallery of a deleted source by its address; a + // tombstone keeps its record, so nothing is dropped for it. + Expect(dropped).To(Equal([]string{"https://example.org/b.yaml"})) + Expect(find("mine")).To(BeNil()) + }) + + It("shows the defaults as off and suspended while the official libraries are off", func() { + store.SetOfficial(false) + official = false + for _, s := range list() { + Expect(s).To(HaveKeyWithValue("enabled", false)) + Expect(s).To(HaveKeyWithValue("suspended", true)) + Expect(s).To(HaveKeyWithValue("default", true)) + } + rec := call(auth.RoleAdmin, http.MethodGet, "/api/library/sources", "") + Expect(rec.Body.String()).To(ContainSubstring(`"officialLibraries":false`)) + }) + + It("carries the conflict message for sources that list one entry", func() { + serve := func(id string) string { + srv := httptest.NewServer(http.HandlerFunc(func(w http.ResponseWriter, _ *http.Request) { + _ = catalog.WriteIndex(w, []catalog.Release{{ID: id, Name: id, Version: "1.0.0", Artifact: "oci://registry.example/" + id, Digest: "sha256:" + strings.Repeat("a", 64), OS: "linux", Arch: "amd64"}}) + })) + DeferCleanup(srv.Close) + return srv.URL + } + for _, id := range []string{"first", "second"} { + rec := call(auth.RoleAdmin, http.MethodPost, "/api/library/sources", `{"kind":"addon","id":"`+id+`","url":"`+serve("tables")+`"}`) + Expect(rec.Code).To(Equal(http.StatusCreated), rec.Body.String()) + _, err := store.Refresh(GinkgoT().Context(), id) + Expect(err).NotTo(HaveOccurred()) + } + for _, id := range []string{"first", "second"} { + msg, _ := find(id)["conflict"].(string) + Expect(msg).To(ContainSubstring(`"tables"`)) + Expect(msg).To(ContainSubstring("two of your library sources")) + } + Expect(find("first")).NotTo(BeNil()) + }) + + It("stores mirrors on add, returns them in the list and replaces them with a PUT", func() { + rec := call(auth.RoleAdmin, http.MethodPost, "/api/library/sources", `{"kind":"model","format":"gallery","id":"team","url":"https://example.org/m.yaml","mirrors":[" https://mirror.example/m.yaml ","github:org/repo/m.yaml@main",""]}`) + Expect(rec.Code).To(Equal(http.StatusCreated), rec.Body.String()) + Expect(find("team")["mirrors"]).To(Equal([]any{"https://mirror.example/m.yaml", "github:org/repo/m.yaml@main"})) + rec = call(auth.RoleAdmin, http.MethodPut, "/api/library/sources/team", `{"mirrors":["oci://registry.example/m"]}`) + Expect(rec.Code).To(Equal(http.StatusOK), rec.Body.String()) + Expect(find("team")["mirrors"]).To(Equal([]any{"oci://registry.example/m"})) + rec = call(auth.RoleAdmin, http.MethodPut, "/api/library/sources/team", `{"mirrors":[]}`) + Expect(rec.Code).To(Equal(http.StatusOK), rec.Body.String()) + Expect(find("team")).NotTo(HaveKey("mirrors")) + }) + + It("refuses a mirror that is not an accepted address, and mirrors on an add-on source", func() { + for _, body := range []string{ + `{"kind":"model","url":"https://example.org/m.yaml","mirrors":["ftp://x/m.yaml"]}`, + `{"kind":"model","url":"https://example.org/m.yaml","mirrors":["https://a b/m.yaml"]}`, + `{"kind":"model","url":"https://example.org/m.yaml","mirrors":["1","2","3","4","5","6","7","8","9"]}`, + `{"kind":"addon","url":"https://example.org/a.yaml","mirrors":["https://mirror.example/a.yaml"]}`, + } { + rec := call(auth.RoleAdmin, http.MethodPost, "/api/library/sources", body) + Expect(rec.Code).To(Equal(http.StatusBadRequest), body+" "+rec.Body.String()) + } + Expect(call(auth.RoleAdmin, http.MethodPut, "/api/library/sources/localai-backends", `{"mirrors":["file"]}`).Code).To(Equal(http.StatusBadRequest)) + Expect(call(auth.RoleAdmin, http.MethodPut, "/api/library/sources/nope", `{"mirrors":[]}`).Code).To(Equal(http.StatusNotFound)) + Expect(find("localai-backends")).NotTo(HaveKey("mirrors")) + }) +}) diff --git a/core/http/endpoints/localai/settings.go b/core/http/endpoints/localai/settings.go index 485e6b86c..d95800317 100644 --- a/core/http/endpoints/localai/settings.go +++ b/core/http/endpoints/localai/settings.go @@ -195,6 +195,12 @@ func UpdateSettingsEndpoint(app *application.Application) echo.HandlerFunc { watchdogChanged := appConfig.ApplyRuntimeSettings(&settings) restartRequired := prevDevelopmentPreference != appConfig.PreferDevelopmentBackends gallery.ResetGalleryModelCacheIfChanged(prevGalleries, prevBackendGalleries, appConfig) + if settings.OfficialLibraries != nil { + // The shipped default sources of every kind follow the switch now. + if err := app.ApplyLibraries(); err != nil { + xlog.Warn("could not apply the official libraries setting", "error", err) + } + } if settings.VRAMPersistentCache != nil || settings.AutoloadGalleries != nil { if appConfig.VRAMPersistentCache && appConfig.AutoloadGalleries { vram.ConfigurePersistentCache(filepath.Join(appConfig.SystemState.Model.ModelsPath, "..", "cache", "vram"), 24*time.Hour) diff --git a/core/http/react-ui/e2e/addons-backend-library.spec.js b/core/http/react-ui/e2e/addons-backend-library.spec.js new file mode 100644 index 000000000..f757ac682 --- /dev/null +++ b/core/http/react-ui/e2e/addons-backend-library.spec.js @@ -0,0 +1,228 @@ +import { test, expect } from '@playwright/test' +import { ADMIN, release, sessionFor, mockAddons } from './addons-fixtures.js' + +// Backends in the library (phase 1): an entry has a kind, the Browse tab shows +// it, and a backend installs through the backend route, not the add-on +// lifecycle. The server is the authority, so these specs drive the page +// against a stand-in and assert what the page sent. + +const POLICY = { requireSignature: true, issuer: 'https://token.actions.githubusercontent.com', identityRegex: '^https://github\\.com/o/r/\\.github/workflows/w\\.yml@refs/(heads/master|tags/.+)$' } +const backend = (over = {}) => release('cpu-local-store', { + kind: 'backend', name: 'cpu-local-store', alias: 'local-store', description: 'A vector store.', version: '0.0.0-latest.0a1056fd8633', + sourceId: 'official-backends', artifact: 'oci://registry.example/backends:latest-cpu-local-store', policy: POLICY, ...over, +}) + +async function signIn(page) { + await page.route('**/api/auth/status', route => route.fulfill({ json: sessionFor(ADMIN) })) +} + +// The backend routes of the host. `installed` is the mutable list GET /backends +// answers. An install is a job: the request answers with its ID and the job +// route reports the steps in `phases`, one per read, then the result. `fail` +// ends the job with that error at the last step reached. +async function mockBackends(page, { installed = [], phases = ['resolving', 'size', 'fetching', 'writing'], fail, refuse } = {}) { + const state = { installed: [...installed], installs: [], reads: 0 } + await page.route(/\/backends$/, route => route.fulfill({ json: state.installed })) + await page.route(/\/backends\/library\/install$/, route => { + const body = route.request().postDataJSON() + state.installs.push(body) + state.reads = 0 + if (refuse) return route.fulfill(refuse) + return route.fulfill({ json: { id: 'job-1', status_url: '/backends/jobs/job-1' } }) + }) + await page.route(/\/backends\/jobs\/job-1$/, route => { + const body = state.installs.at(-1) + const at = state.reads++ + const phase = phases[Math.min(at, phases.length - 1)] + const last = at >= phases.length + if (last && fail) return route.fulfill({ json: { phase, processed: true, error: fail, message: `error: ${fail}` } }) + if (last) { + state.installed.push({ Name: body.name, Metadata: { library: body.sourceId } }) + return route.fulfill({ json: { phase: 'done', processed: true, progress: 100, message: 'completed' } }) + } + return route.fulfill({ json: { phase, processed: false, progress: phase === 'fetching' ? 40 : 0 } }) + }) + return state +} + +test.describe('Library backends', () => { + test('browse: an entry shows its kind, and add-ons are still add-ons', async ({ page }) => { + await signIn(page) + const state = await mockAddons(page, { installed: [], releases: [release('tables'), backend()] }) + await mockBackends(page) + await page.goto('/app/addons?tab=browse') + await expect(page.locator('.cat-item')).toHaveCount(2) + await expect(page.locator('.cat-item', { hasText: 'Tables' }).getByTestId('entry-kind')).toHaveText('Add-on') + const row = page.locator('.cat-item', { hasText: 'cpu-local-store' }) + await expect(row.getByTestId('entry-kind')).toHaveText('Backend') + await expect(row.getByTestId('entry-kind')).toHaveAttribute('data-kind', 'backend') + // The page asks for every kind this host reads. + expect(state.log.dispatch.find(d => d.action === 'catalog-search').arguments.kind).toBe('all') + }) + + test('browse: a backend installs through the backend route and never through the add-on lifecycle', async ({ page }) => { + await signIn(page) + const state = await mockAddons(page, { installed: [], releases: [backend()] }) + const backends = await mockBackends(page) + await page.goto('/app/addons?tab=browse') + const row = page.locator('.cat-item', { hasText: 'cpu-local-store' }) + await row.getByRole('button', { name: 'Install' }).click() + const dialog = page.getByRole('alertdialog') + await expect(dialog).toContainText('Install cpu-local-store?') + await expect(dialog).toContainText('backend gallery is not changed') + await expect(dialog).toContainText('native code') + expect(backends.installs).toHaveLength(0) + await dialog.getByRole('button', { name: 'Install' }).click() + // The steps show while the job runs: a signed library lists the signature step. + const steps = row.getByTestId('install-steps') + await expect(steps.locator('[data-step]')).toHaveCount(5) + await expect(steps.locator('[data-step="fetching"]')).toHaveAttribute('data-state', /active|done/) + await expect(row.getByText('Installed as a backend on this node')).toBeVisible() + await expect(steps).toHaveCount(0) + expect(backends.installs).toEqual([{ sourceId: 'official-backends', name: 'cpu-local-store', version: '0.0.0-latest.0a1056fd8633' }]) + expect(state.log.dispatch.filter(d => d.action === 'install')).toHaveLength(0) + // Once installed the entry says so and offers no second install. + await expect(row.getByText('Installed', { exact: true })).toBeVisible() + await expect(row.getByRole('button', { name: 'Install' })).toBeDisabled() + }) + + test('browse: a refusal of the host is shown with its own reason', async ({ page }) => { + await signIn(page) + await mockAddons(page, { installed: [], releases: [backend()] }) + await mockBackends(page, { + phases: ['resolving'], + fail: 'backend is already installed from another origin: "cpu-local-store"', + }) + await page.goto('/app/addons?tab=browse') + const row = page.locator('.cat-item', { hasText: 'cpu-local-store' }) + await row.getByRole('button', { name: 'Install' }).click() + await page.getByRole('alertdialog').getByRole('button', { name: 'Install' }).click() + await expect(row.getByRole('alert')).toContainText('The backend was not installed.') + await expect(row.getByRole('alert')).toContainText('already installed from another origin') + await expect(row.getByRole('button', { name: 'Install' })).toBeEnabled() + // The step that failed stays marked. + await expect(row.locator('[data-step="resolving"]')).toHaveAttribute('data-state', 'failed') + await expect(row.locator('[data-step="fetching"]')).toHaveAttribute('data-state', 'pending') + }) + + test('browse: a request the host refuses is shown with its reason', async ({ page }) => { + await signIn(page) + await mockAddons(page, { installed: [], releases: [backend()] }) + await mockBackends(page, { refuse: { status: 409, json: { error: { type: 'backend_library', code: 409, message: 'this backend is already being installed' } } } }) + await page.goto('/app/addons?tab=browse') + const row = page.locator('.cat-item', { hasText: 'cpu-local-store' }) + await row.getByRole('button', { name: 'Install' }).click() + await page.getByRole('alertdialog').getByRole('button', { name: 'Install' }).click() + await expect(row.getByRole('alert')).toContainText('already being installed') + }) + + test('browse: the details give the kind, the alias and the signer pattern', async ({ page }) => { + await signIn(page) + await mockAddons(page, { installed: [], releases: [backend()] }) + await mockBackends(page) + await page.goto('/app/addons?tab=browse') + await page.locator('.cat-item', { hasText: 'cpu-local-store' }).getByRole('button', { name: 'Details' }).click() + await expect(page.getByTestId('details-kind')).toHaveText('Backend') + await expect(page.getByText('local-store', { exact: true })).toBeVisible() + await expect(page.getByText('workflows/w', { exact: false })).toBeVisible() + }) + + test('libraries: a signer pattern is edited and saved without an exact identity, and skipped entries are reported', async ({ page }) => { + await signIn(page) + const state = await mockAddons(page, { + sources: [{ id: 'official-backends', name: 'Official backends', url: 'https://catalog.example/backends.yaml', enabled: true, policy: POLICY, refresh: { checkedAt: new Date().toISOString(), lastSuccess: new Date().toISOString(), count: 1, skipped: 2, skippedKinds: ['model'], failed: false } }], + }) + await mockBackends(page) + await page.goto('/app/addons?tab=libraries') + await expect(page.getByTestId('skipped-kinds')).toContainText('2 entries skipped: kind model') + await page.getByRole('button', { name: 'Edit' }).click() + const pattern = page.getByLabel('Signer identity pattern (optional)') + await expect(pattern).toHaveValue(POLICY.identityRegex) + await page.getByRole('button', { name: 'Save' }).click() + await expect.poll(() => state.log.dispatch.filter(d => d.action === 'catalog-source-save').length).toBe(1) + const saved = state.log.dispatch.find(d => d.action === 'catalog-source-save').arguments + expect(saved.policy).toEqual(POLICY) + }) +}) + +// The Backends page (phase 2): a backend that came from a library says so, and +// a newer build in its library is an update the administrator starts. +const PINNED = 'sha256:' + 'a1'.repeat(32) +const NEWER = 'sha256:' + 'b2'.repeat(32) + +async function mockBackendsPage(page, { updates = true, phases = ['resolving', 'verifying', 'size', 'fetching', 'writing'] } = {}) { + const state = { digest: PINNED, updates: updates ? [{ name: 'cpu-local-store', sourceId: 'official-backends', installedVersion: '0.0.0-latest.0a1056fd8633', installedDigest: PINNED, version: '0.0.0-latest.0b2', digest: NEWER, signed: true }] : [], installs: [], reads: 0 } + await page.route('**/api/backends?*', route => route.fulfill({ json: { backends: [] } })) + await page.route('**/api/backends/upgrades', route => route.fulfill({ json: { 'llama-cpp': { backend_name: 'llama-cpp', installed_version: '1', available_version: '2' } } })) + await page.route(/\/backends$/, route => route.fulfill({ + json: [ + { Name: 'cpu-local-store', Metadata: { name: 'cpu-local-store', library: 'official-backends', digest: state.digest, version: '0.0.0-latest.0a1056fd8633' } }, + { Name: 'llama-cpp', Metadata: { name: 'llama-cpp', gallery_url: 'https://gallery.example/index.yaml', version: '1' } }, + ], + })) + await page.route(/\/backends\/library\/updates$/, route => route.fulfill({ json: { updates: state.updates } })) + await page.route(/\/backends\/library\/install$/, route => { + state.installs.push(route.request().postDataJSON()) + state.reads = 0 + return route.fulfill({ json: { id: 'job-2', status_url: '/backends/jobs/job-2' } }) + }) + await page.route(/\/backends\/jobs\/job-2$/, route => { + const at = state.reads++ + if (at >= phases.length) { + state.digest = NEWER + state.updates = [] + return route.fulfill({ json: { phase: 'done', processed: true, progress: 100, message: 'completed' } }) + } + return route.fulfill({ json: { phase: phases[at], processed: false, progress: 0 } }) + }) + return state +} + +test.describe('Backends page and libraries', () => { + test('a library backend carries its library and the digest it pinned; a gallery backend does not', async ({ page }) => { + await signIn(page) + await mockBackendsPage(page) + await page.goto('/app/backends?view=installed') + const row = page.locator('[data-entity="cpu-local-store"]') + await expect(row.getByTestId('backend-library')).toContainText('Library: official-backends') + await expect(page.locator('[data-entity="llama-cpp"]').getByTestId('backend-library')).toHaveCount(0) + await row.click() + const detail = page.getByTestId('backend-detail') + await expect(detail.getByTestId('library-id')).toHaveText('official-backends') + await expect(detail).toContainText('Pinned digest') + await expect(detail).toContainText(PINNED) + }) + + test('a newer build in the library shows as an update and is installed only on request', async ({ page }) => { + await signIn(page) + const state = await mockBackendsPage(page) + await page.goto('/app/backends?view=installed') + const row = page.locator('[data-entity="cpu-local-store"]') + await expect(row).toContainText('Update available') + // Nothing is installed by looking at the page. + expect(state.installs).toHaveLength(0) + await row.click() + await expect(page.getByTestId('library-update-facts')).toContainText('sha256:b2b2b2b2b2b2') + await row.getByTestId('backend-library-update').click() + await expect.poll(() => state.installs).toEqual([{ sourceId: 'official-backends', name: 'cpu-local-store', version: '0.0.0-latest.0b2' }]) + // The steps of the install show in the detail while it runs. + await expect(page.getByTestId('backend-detail').getByTestId('install-steps').locator('[data-step]')).toHaveCount(5) + // When it ends the row is current and pins the new digest. + await expect(row).not.toContainText('Update available', { timeout: 15000 }) + await expect(page.getByTestId('backend-detail')).toContainText(NEWER) + await expect(row.getByTestId('backend-library-update')).toHaveCount(0) + }) + + test('with no newer build the library backend is current, and gallery upgrades are unchanged', async ({ page }) => { + await signIn(page) + const state = await mockBackendsPage(page, { updates: false }) + await page.goto('/app/backends?view=installed') + await expect(page.locator('[data-entity="cpu-local-store"]')).toContainText('Current') + await expect(page.locator('[data-entity="cpu-local-store"]').getByTestId('backend-library-update')).toHaveCount(0) + // The gallery backend keeps the gallery upgrade state and button. + const gallery = page.locator('[data-entity="llama-cpp"]') + await expect(gallery).toContainText('Update') + await expect(gallery.getByRole('button', { name: 'Update llama-cpp' })).toBeVisible() + expect(state.installs).toHaveLength(0) + }) +}) diff --git a/core/http/react-ui/e2e/addons-fixtures.js b/core/http/react-ui/e2e/addons-fixtures.js index 12907ec47..7ba7a20b4 100644 --- a/core/http/react-ui/e2e/addons-fixtures.js +++ b/core/http/react-ui/e2e/addons-fixtures.js @@ -51,7 +51,7 @@ export async function mockAddons(page, options = {}) { installed: options.installed || [installedAddon()], sources: options.sources || [{ id: 'main', name: 'Main', url: 'https://catalog.example/releases.json', enabled: true, policy: { requireSignature: false }, refresh: { checkedAt: new Date().toISOString(), lastSuccess: new Date().toISOString(), count: 2, failed: false } }], releases: options.releases || [release('notes'), release('tables', { policy: { requireSignature: true, issuer: 'https://issuer.example', identity: 'release@catalog.example' } })], - log: { appsList: 0, start: [], stop: [], dispatch: [], check: [], upgrade: [] }, + log: { appsList: 0, start: [], stop: [], dispatch: [], check: [], upgrade: [], library: [] }, // Overrides for the update routes: each takes the parsed body. check: options.check || null, upgrade: options.upgrade || null, @@ -116,6 +116,37 @@ export async function mockAddons(page, options = {}) { if (a && a.update) { a.generation += 1; a.version = a.update.version; a.digest = a.update.digest; delete a.update } return route.fulfill(ok({ OperationID: body.operationId, AddonID: id, Phase: 'completed', Generation: a?.generation })) }) + // The library source routes (all three kinds). The records in state.sources + // are listed as they are, with the flags the host adds filled in; a removed + // default stays listed as a tombstone, as the host does. + await page.route(/\/api\/library\/sources(\/[^/]+(\/(enable|disable))?)?$/, route => { + const req = route.request() + const parts = new URL(req.url()).pathname.split('/') + const id = parts[4] || '' + const verb = parts[5] || '' + const body = req.postData() ? JSON.parse(req.postData()) : null + state.log.library.push({ method: req.method(), id, verb, body }) + const json = (status, payload) => route.fulfill({ status, contentType: 'application/json', body: JSON.stringify(payload) }) + const find = () => state.sources.find(x => x.id === id) + if (req.method() === 'GET') { + return json(200, { sources: state.sources.map(x => ({ kind: 'addon', default: false, removed: false, suspended: false, ...x })), officialLibraries: !state.sources.some(x => x.suspended) }) + } + if (req.method() === 'POST' && !id) { + if (state.sources.some(x => x.kind === body.kind && x.url === body.url)) return json(409, { error: { code: 409, message: `${body.url} is already a ${body.kind} source` } }) + const added = { kind: body.kind, id: body.id || (body.name || body.url).toLowerCase().replace(/[^a-z0-9]+/g, '-').replace(/^-|-$/g, ''), name: body.name || body.id, url: body.url, format: body.format === 'gallery' ? 'gallery' : undefined, enabled: true, policy: { requireSignature: false } } + state.sources = [...state.sources, added] + return json(201, { default: false, removed: false, suspended: false, ...added }) + } + const source = find() + if (!source) return json(404, { error: { code: 404, message: `no source with id ${id}` } }) + if (req.method() === 'POST') { + source.enabled = verb === 'enable' + if (source.removed) source.removed = false + return json(200, { default: false, removed: false, suspended: false, ...source }) + } + if (source.default) { source.removed = true; source.enabled = false } else state.sources = state.sources.filter(x => x.id !== id) + return json(200, { id, default: Boolean(source.default), tombstone: Boolean(source.default) }) + }) await page.route(/\/api\/addons\/dispatch$/, route => { const body = JSON.parse(route.request().postData() || '{}') state.log.dispatch.push(body) diff --git a/core/http/react-ui/e2e/addons-gallery.spec.js b/core/http/react-ui/e2e/addons-gallery.spec.js index 4a3160486..da558b041 100644 --- a/core/http/react-ui/e2e/addons-gallery.spec.js +++ b/core/http/react-ui/e2e/addons-gallery.spec.js @@ -548,9 +548,9 @@ test.describe('Add-ons: libraries', () => { await expect(dialog).toContainText('stay installed and keep running') await dialog.getByRole('button', { name: 'Remove' }).click() await expect(page.locator('[data-source="main"]')).toHaveCount(0) - const removal = state.log.dispatch.find(d => d.action === 'catalog-source-save') - expect(removal.arguments.removed).toBe(true) - expect(removal.arguments.id).toBe('main') + // A removal goes through the library route, the same one the other kinds use. + const removal = state.log.library.find(c => c.method === 'DELETE') + expect(removal.id).toBe('main') await tab(page, 'Installed').click() await expect(page.locator('[data-addon="notes"]')).toBeVisible() expect(state.installed).toHaveLength(1) diff --git a/core/http/react-ui/e2e/library-sources.spec.js b/core/http/react-ui/e2e/library-sources.spec.js new file mode 100644 index 000000000..582cac081 --- /dev/null +++ b/core/http/react-ui/e2e/library-sources.spec.js @@ -0,0 +1,196 @@ +import { test, expect } from './coverage-fixtures.js' + +// Library sources of all three kinds: add-ons on the Add-ons Libraries tab, +// models on the Models page and backends on the Backends page, each in the +// panel its "Manage libraries" button opens, against a real +// server that starts like a normal install (playwright.library.config.js): the +// default sources of the add-on, backend and model kinds are in the store, and +// the routes change the store the `local-ai library` command edits. The specs +// share one server and change its sources, so they run in order. +// +// The conflict message needs two sources whose fetched indexes list one entry, +// which a test server without a network cannot give; that spec answers the list +// call itself and checks what the page shows of the message. + +test.describe.configure({ mode: 'serial' }) + +const ROW = (page, id) => page.locator(`[data-source="${id}"]`) +// The defaults this build enables. The model gallery index `localai` is a default +// too, but a build reads the model library or the gallery, not both, so it is +// listed turned off. +const OFFICIAL = { addon: 'official', backend: 'localai-backends', model: 'official-models' } + +const PAGES = { addon: '/app/addons?tab=libraries', model: '/app/models', backend: '/app/backends' } + +async function openLibraries(page, kind = 'addon') { + await page.goto(PAGES[kind]) + if (kind !== 'addon') await page.getByRole('button', { name: 'Manage libraries' }).click() + await expect(page.getByRole('list', { name: 'Libraries' })).toBeVisible() +} + +async function sources(page) { + const res = await page.request.get('/api/library/sources') + expect(res.ok()).toBe(true) + return (await res.json()) +} + +test.describe('Library sources: all three kinds', () => { + test('each page lists only its own kind, with a Default badge and no kind filter', async ({ page }) => { + const expected = { addon: ['official'], backend: ['localai-backends'], model: ['official-models', 'localai'] } + for (const [kind, ids] of Object.entries(expected)) { + await openLibraries(page, kind) + await expect(page.locator('[data-source]')).toHaveCount(ids.length) + for (const id of ids) { + const row = ROW(page, id) + await expect(row).toBeVisible() + await expect(row).toHaveAttribute('data-kind', kind) + await expect(row.getByTestId('source-default')).toHaveText('Default') + } + await expect(ROW(page, OFFICIAL[kind]).getByTestId('source-state')).toHaveText('Enabled') + await expect(page.getByRole('group', { name: 'Filter by kind' })).toHaveCount(0) + } + await openLibraries(page, 'model') + await expect(ROW(page, 'localai').getByTestId('source-state')).toHaveText('Disabled') + }) + + test('adds a model source of your own, which has no Default badge and stays after a reload', async ({ page }) => { + await openLibraries(page, 'model') + await page.getByRole('button', { name: 'Add a library' }).click() + const sheet = page.getByTestId('source-editor') + await expect(sheet.getByLabel('Kind')).toHaveCount(0) + await sheet.getByLabel('Index format').selectOption('gallery') + await sheet.getByLabel('Name').fill('Team models') + await sheet.getByLabel('Catalog URL').fill('https://models.example.org/index.yaml') + await sheet.getByRole('button', { name: 'Save' }).click() + const row = ROW(page, 'team-models') + await expect(row).toBeVisible() + await expect(row).toHaveAttribute('data-kind', 'model') + await expect(row.getByTestId('source-default')).toHaveCount(0) + await expect(row.getByTestId('source-state')).toHaveText('Enabled') + + const stored = (await sources(page)).sources.find(s => s.id === 'team-models') + expect(stored).toMatchObject({ kind: 'model', format: 'gallery', default: false, enabled: true, url: 'https://models.example.org/index.yaml' }) + await page.reload() + await page.getByRole('button', { name: 'Manage libraries' }).click() + await expect(ROW(page, 'team-models')).toBeVisible() + + // The same address twice is refused with the reason. + await page.getByRole('button', { name: 'Add a library' }).click() + const again = page.getByTestId('source-editor') + await again.getByLabel('Name').fill('Same address') + await again.getByLabel('Catalog URL').fill('https://models.example.org/index.yaml') + await again.getByRole('button', { name: 'Save' }).click() + await expect(page.getByRole('alert').filter({ hasText: 'already a model source' })).toBeVisible() + }) + + test('turns a default off and removes it: it stays listed as removed, and restoring brings it back', async ({ page }) => { + await openLibraries(page, 'model') + const row = ROW(page, 'official-models') + await row.locator('[data-action="disable"]').click() + await expect(row.getByTestId('source-state')).toHaveText('Disabled') + await expect(row).toHaveAttribute('data-state', 'disabled') + expect((await sources(page)).sources.find(s => s.id === 'official-models')).toMatchObject({ enabled: false, removed: false, default: true }) + + await row.locator('[data-action="remove"]').click() + const dialog = page.getByRole('alertdialog') + await expect(dialog).toContainText('stays removed at the next start') + await dialog.getByRole('button', { name: 'Remove' }).click() + await expect(row).toHaveAttribute('data-state', 'removed') + await expect(row.getByTestId('source-state')).toHaveText('Removed') + await expect(row.getByTestId('source-default')).toHaveText('Default') + // The tombstone is in the store the CLI reads, not only on the page. + expect((await sources(page)).sources.find(s => s.id === 'official-models')).toMatchObject({ removed: true, enabled: false, default: true }) + await page.reload() + await page.getByRole('button', { name: 'Manage libraries' }).click() + await expect(ROW(page, 'official-models')).toHaveAttribute('data-state', 'removed') + + await ROW(page, 'official-models').locator('[data-action="restore"]').click() + await expect(ROW(page, 'official-models')).toHaveAttribute('data-state', 'enabled') + expect((await sources(page)).sources.find(s => s.id === 'official-models')).toMatchObject({ removed: false, enabled: true }) + + // A source of your own is deleted, not kept as a tombstone. + await ROW(page, 'team-models').locator('[data-action="remove"]').click() + await page.getByRole('alertdialog').getByRole('button', { name: 'Remove' }).click() + await expect(ROW(page, 'team-models')).toHaveCount(0) + expect((await sources(page)).sources.find(s => s.id === 'team-models')).toBeUndefined() + }) + + test('shows the conflict message the store gives next to the source that clashes', async ({ page }) => { + const message = 'the addon "tables" is listed by two of your library sources, "first" and "second"; disable or remove one of them (local-ai library disable second)' + await page.route('**/api/library/sources', route => route.request().method() === 'GET' + ? route.fulfill({ + json: { + officialLibraries: true, + sources: [ + { kind: 'addon', id: 'first', name: 'First', url: 'https://one.example/index.yaml', enabled: true, default: false, removed: false, suspended: false, conflict: message }, + { kind: 'addon', id: 'second', name: 'Second', url: 'https://two.example/index.yaml', enabled: true, default: false, removed: false, suspended: false, conflict: message }, + { kind: 'addon', id: 'official', name: 'Official', url: 'https://off.example/index.yaml', enabled: true, default: true, removed: false, suspended: false, conflict: 'the addon "tables" is provided by your source "first", so this default source is ignored for it' }, + ], + }, + }) + : route.fallback()) + await openLibraries(page) + await expect(ROW(page, 'first').getByTestId('source-conflict')).toContainText('two of your library sources') + await expect(ROW(page, 'second').getByTestId('source-conflict')).toContainText('disable or remove one of them') + await expect(ROW(page, 'official').getByTestId('source-conflict')).toContainText('this default source is ignored for it') + }) +}) + +test.describe('Library sources: Use official libraries', () => { + const settingRow = page => page.locator('[data-field="official_libraries"]') + + async function setOfficial(page, on) { + await page.goto('/app/settings') + await page.getByRole('button', { name: /^Backends and galleries/ }).click() + const toggle = settingRow(page).getByRole('switch') + await expect(settingRow(page)).toContainText('Use official libraries') + await expect(toggle).toHaveAttribute('aria-checked', on ? 'false' : 'true') + await toggle.click() + await page.getByRole('button', { name: 'Apply' }).click() + await expect(page.getByText('Settings saved successfully')).toBeVisible() + } + + const settings = async page => (await (await page.request.get('/api/settings')).json()) + + test('turning it off hides the default galleries and shows the defaults as off, and on brings them back', async ({ page }) => { + // On: the default model and backend galleries are read. + const on = await settings(page) + expect(on.official_libraries).toBe(true) + expect(on.galleries.length).toBeGreaterThan(0) + expect(on.backend_galleries.length).toBeGreaterThan(0) + const defaultUrls = [...on.galleries, ...on.backend_galleries].map(g => g.url) + + // A source of your own, so there is something that must stay. + const added = await page.request.post('/api/library/sources', { data: { kind: 'model', format: 'gallery', id: 'mine', name: 'Mine', url: 'https://mine.example.org/index.yaml' } }) + expect(added.status()).toBe(201) + + await setOfficial(page, false) + const off = await settings(page) + expect(off.official_libraries).toBe(false) + expect(off.galleries.map(g => g.url)).toEqual(['https://mine.example.org/index.yaml']) + expect(off.backend_galleries).toEqual([]) + + // The Libraries tab lists the defaults, shown as off; the source of your own is on. + for (const [kind, id] of Object.entries(OFFICIAL)) { + await openLibraries(page, kind) + await expect(page.getByTestId('official-off')).toBeVisible() + await expect(ROW(page, id)).toHaveAttribute('data-state', 'suspended') + await expect(ROW(page, id).getByTestId('source-default')).toBeVisible() + await expect(ROW(page, id).getByTestId('source-state')).toContainText('Off') + } + await openLibraries(page, 'model') + await expect(ROW(page, 'mine')).toHaveAttribute('data-state', 'enabled') + + await setOfficial(page, true) + const back = await settings(page) + expect(back.official_libraries).toBe(true) + expect(back.galleries.map(g => g.url)).toEqual(expect.arrayContaining([...on.galleries.map(g => g.url), 'https://mine.example.org/index.yaml'])) + expect(back.backend_galleries.map(g => g.url)).toEqual(on.backend_galleries.map(g => g.url)) + for (const [kind, id] of Object.entries(OFFICIAL)) { + await openLibraries(page, kind) + await expect(page.getByTestId('official-off')).toHaveCount(0) + await expect(ROW(page, id)).toHaveAttribute('data-state', 'enabled') + } + await page.request.delete('/api/library/sources/mine') + }) +}) diff --git a/core/http/react-ui/e2e/settings-fixtures.js b/core/http/react-ui/e2e/settings-fixtures.js index 90017e552..f25b2b4f9 100644 --- a/core/http/react-ui/e2e/settings-fixtures.js +++ b/core/http/react-ui/e2e/settings-fixtures.js @@ -8,7 +8,7 @@ export function settingsFixture(overrides = {}) { return { watchdog_enabled: true, watchdog_idle_enabled: true, watchdog_busy_enabled: false, watchdog_idle_timeout: '15m0s', watchdog_busy_timeout: '5m0s', watchdog_interval: '500ms', - max_active_backends: 0, auto_upgrade_backends: false, auto_upgrade_addons: false, prefer_development_backends: false, + max_active_backends: 0, official_libraries: true, auto_upgrade_backends: false, auto_upgrade_addons: false, prefer_development_backends: false, memory_reclaimer_enabled: true, memory_reclaimer_threshold: 0.9, force_eviction_when_busy: false, size_aware_eviction: false, lru_eviction_max_retries: 50, lru_eviction_retry_interval: '1s', diff --git a/core/http/react-ui/e2e/settings-page.spec.js b/core/http/react-ui/e2e/settings-page.spec.js index 5256b740d..7780141c7 100644 --- a/core/http/react-ui/e2e/settings-page.spec.js +++ b/core/http/react-ui/e2e/settings-page.spec.js @@ -284,17 +284,13 @@ test.describe('Settings: fields with a different wire form', () => { await expect(hist.getByRole('button', { name: 'Revert' })).toHaveCount(0) }) - test('a gallery list is parsed, and bad JSON stops Apply', async ({ page }) => { + test('the gallery lists are read-only views with a link to the Manage libraries panel', async ({ page }) => { await group(page, 'Backends and galleries').click() - const box = row(page, 'galleries').getByRole('textbox') - await box.fill('{oops') - await page.getByRole('button', { name: 'Show diff' }).click() - await expect(page.getByLabel('Checks')).toContainText('this must be a JSON list') - await expect(page.getByRole('button', { name: 'Apply' })).toBeDisabled() - await box.fill('[{"url":"https://example.org/models","name":"mine"}]') - await page.getByRole('button', { name: 'Apply' }).click() - await expect(page.getByTestId('settings-undo-toast')).toBeVisible() - expect(state.posts[0]).toEqual({ galleries: [{ url: 'https://example.org/models', name: 'mine' }] }) + const models = row(page, 'galleries') + await expect(models.getByRole('textbox')).toHaveCount(0) + await expect(models.getByTestId('settings-sources-model')).toBeVisible() + await expect(models.getByRole('link', { name: 'Manage libraries' })).toHaveAttribute('href', '/app/models?libraries=1') + await expect(row(page, 'backend_galleries').getByRole('link', { name: 'Manage libraries' })).toHaveAttribute('href', '/app/backends?libraries=1') }) test('the GPU memory budget is checked the way the server checks it', async ({ page }) => { diff --git a/core/http/react-ui/playwright.config.js b/core/http/react-ui/playwright.config.js index 87e3e1387..e831ebec3 100644 --- a/core/http/react-ui/playwright.config.js +++ b/core/http/react-ui/playwright.config.js @@ -6,12 +6,13 @@ export default defineConfig({ // add-on owner and a ready file the matching runner passes in an ADDONS_* // variable; each reads it when the file loads, so the default run must not // load them. Every one has its own config (playwright..config.js) and - // is started by scripts/addons/*.sh. + // is started by scripts/addons/*.sh. The library sources spec needs a server + // started with --library-sources and runs from playwright.library.config.js. testIgnore: [ '**/addons-foundation.spec.js', '**/addons-gallery.spec.js', '**/addons-proposals.spec.js', '**/addons-recovery.spec.js', '**/addons-runtime.spec.js', '**/addons-slots.spec.js', '**/addons-upgrade.spec.js', '**/tables-acceptance.spec.js', '**/tables-artifacts.spec.js', - '**/tables-ui.spec.js', + '**/tables-ui.spec.js', '**/library-sources.spec.js', ], globalSetup: './e2e/global-setup.js', timeout: 30_000, diff --git a/core/http/react-ui/playwright.library.config.js b/core/http/react-ui/playwright.library.config.js new file mode 100644 index 000000000..cd5c78f50 --- /dev/null +++ b/core/http/react-ui/playwright.library.config.js @@ -0,0 +1,22 @@ +import { defineConfig } from '@playwright/test' +import base from './playwright.config.js' + +// The library sources spec runs against a real server that starts like a normal +// install (default galleries and default sources of the three kinds), on its +// own port, with a fresh data directory. LIBRARY_UI_PORT and LIBRARY_UI_LOG +// change the port and the server log. +const port = Number(process.env.LIBRARY_UI_PORT || 8097) + +export default defineConfig({ + ...base, + testIgnore: [], + testMatch: ['**/library-sources.spec.js'], + globalSetup: undefined, + use: { ...base.use, baseURL: `http://127.0.0.1:${port}` }, + webServer: process.env.PLAYWRIGHT_EXTERNAL_SERVER ? undefined : { + command: `../../../tests/e2e-ui/ui-test-server --mock-backend=../../../tests/e2e/mock-backend/mock-backend --port=${port} --library-sources > ${process.env.LIBRARY_UI_LOG || '/dev/null'} 2>&1`, + port, + timeout: 120_000, + reuseExistingServer: false, + }, +}) diff --git a/core/http/react-ui/public/locales/de/addons.json b/core/http/react-ui/public/locales/de/addons.json index 55e8c8dd7..7c46a4dbe 100644 --- a/core/http/react-ui/public/locales/de/addons.json +++ b/core/http/react-ui/public/locales/de/addons.json @@ -76,7 +76,18 @@ "installedSame": "Installiert {{version}}", "installedState": "Installiert", "installing": "Wird installiert", - "search": "Bibliotheken durchsuchen" + "search": "Bibliotheken durchsuchen", + "kind": { + "addon": "Add-on", + "backend": "Backend" + }, + "installedBackend": "Installed", + "installedBackendNote": "Installed as a backend on this node. Models can use it now.", + "confirmBackendBody": "Version {{version}} of the backend from the library {{library}} will be downloaded, checked against its digest and signature, and installed on this node. The backend gallery is not changed.", + "confirmBackendNote": "A backend runs native code with the rights of LocalAI. Install it only from a library you trust.", + "backendFailed": "The backend was not installed.", + "alias": "Alias", + "kindLabel": "Kind" }, "catalog": { "allLibraries": "Alle Bibliotheken", @@ -156,7 +167,9 @@ "required": "Erforderlich, wenn eine Signatur verlangt wird.", "url": "Gib eine http- oder https-Adresse ein.", "urlCredentials": "Die Adresse darf keinen Benutzernamen und kein Passwort enthalten.", - "urlQuery": "Die Adresse darf keinen Query-String und kein Fragment enthalten." + "urlQuery": "Die Adresse darf keinen Query-String und kein Fragment enthalten.", + "either": "Use the exact identity or the pattern, not both.", + "urlEmpty": "Enter the address of the index." }, "fields": { "enabled": "Aktiviert", @@ -166,12 +179,17 @@ "name": "Name", "reference": "Zugangsdaten-Referenz (optional)", "requireSignature": "Signatur verlangen", - "url": "Katalog-URL" + "url": "Katalog-URL", + "identityRegex": "Signer identity pattern (optional)", + "kind": "Kind", + "format": "Index format" }, "hints": { "id": "Kleinbuchstaben, Ziffern und Bindestriche. Kann später nicht geändert werden.", "reference": "Der Name einer Zugangsdaten-Konfiguration des Betreibers. Füge hier nie ein Token oder Passwort ein.", - "url": "Eine https-Adresse ohne Zugangsdaten und ohne Query-String." + "url": "Eine https-Adresse ohne Zugangsdaten und ohne Query-String.", + "identityRegex": "An anchored pattern, from ^ to $, used instead of the exact identity. Backend libraries use it so builds from master and from tags both verify.", + "format": "A library index uses the shared library entry shape. A gallery index is a model or backend gallery, as the gallery flags name it." }, "lastRefresh": "Aktualisiert {{when}}, {{count}} Einträge", "lead": "Eine Bibliothek ist ein Katalogdokument, das Add-ons auflistet. Zugangsdaten werden hier nie eingetippt: Eine private Bibliothek nennt eine Zugangsdaten-Referenz, die der Betreiber eingerichtet hat.", @@ -187,7 +205,43 @@ "removeTitle": "{{name}} entfernen?", "removed": "{{name}} entfernt.", "save": "Speichern", - "saved": "{{name}} gespeichert." + "saved": "{{name}} gespeichert.", + "skipped_one": "{{count}} entry skipped: kind {{kinds}} is not read by this version", + "skipped_other": "{{count}} entries skipped: kind {{kinds}} is not read by this version", + "default": "Default", + "emptyKindBody": "Add a library of this kind, or pick another filter.", + "emptyKindTitle": "No libraries of this kind", + "formats": { + "library": "Library index", + "gallery": "Gallery index" + }, + "gallery": "Gallery index", + "kind": { + "addon": "Add-on", + "backend": "Backend", + "model": "Model" + }, + "kindFilter": "Filter by kind", + "kinds": { + "all": "All", + "addon": "Add-ons", + "backend": "Backends", + "model": "Models" + }, + "officialOff": "Official libraries are off in Settings. The default libraries stay listed, shown as off, and are not read. Libraries you added are not affected.", + "removeDefaultBody": "This is a default library that comes with LocalAI. It is removed from the list and stays removed at the next start. You can restore it from the list. Installed items are not touched.", + "removedDefault": "Removed {{name}}. It stays removed at the next start; restore it to bring it back.", + "restore": "Restore", + "state": { + "enabled": "Enabled", + "disabled": "Disabled", + "removed": "Removed", + "suspended": "Off (official libraries are off)" + }, + "turnOff": "Turn off", + "turnOn": "Turn on", + "turnedOff": "Turned off {{name}}.", + "turnedOn": "Turned on {{name}}." }, "manage": { "api": "Add-on-API", diff --git a/core/http/react-ui/public/locales/en/addons.json b/core/http/react-ui/public/locales/en/addons.json index 043de95a3..d3f4cbba0 100644 --- a/core/http/react-ui/public/locales/en/addons.json +++ b/core/http/react-ui/public/locales/en/addons.json @@ -67,7 +67,7 @@ "details": "Details", "detailsLead": "Library entry for {{id}}", "emptyBody": "Add a library on the Libraries tab, then refresh it.", - "emptyTitle": "No add-ons found", + "emptyTitle": "No library entries found", "fromLibrary": "from {{library}}", "install": "Install", "installedDetail": "Version {{version}}, generation {{generation}}", @@ -76,7 +76,18 @@ "installedSame": "Installed {{version}}", "installedState": "Installed", "installing": "Installing", - "search": "Search the libraries" + "search": "Search the libraries", + "kind": { + "addon": "Add-on", + "backend": "Backend" + }, + "installedBackend": "Installed", + "installedBackendNote": "Installed as a backend on this node. Models can use it now.", + "confirmBackendBody": "Version {{version}} of the backend from the library {{library}} will be downloaded, checked against its digest and signature, and installed on this node. The backend gallery is not changed.", + "confirmBackendNote": "A backend runs native code with the rights of LocalAI. Install it only from a library you trust.", + "backendFailed": "The backend was not installed.", + "alias": "Alias", + "kindLabel": "Kind" }, "catalog": { "allLibraries": "All libraries", @@ -143,10 +154,13 @@ "libraries": { "add": "Add a library", "addTitle": "Add a library", + "default": "Default", "disabled": "Disabled", "edit": "Edit", "editTitle": "Edit {{name}}", - "emptyBody": "Add a library to browse and install add-ons.", + "emptyBody": "Add a library to browse and install add-ons, backends and models.", + "emptyKindBody": "Add a library of this kind, or pick another filter.", + "emptyKindTitle": "No libraries of this kind", "emptyTitle": "No libraries", "enabled": "Enabled", "errors": { @@ -156,7 +170,10 @@ "required": "Required when a signature is required.", "url": "Enter an http or https address.", "urlCredentials": "The address must not contain a user name or password.", - "urlQuery": "The address must not contain a query string or fragment." + "urlQuery": "The address must not contain a query string or fragment.", + "either": "Use the exact identity or the pattern, not both.", + "urlEmpty": "Enter the address of the index.", + "mirrors": "Each mirror must start with https://, http://, github:, oci:// or file://, and at most 8 are allowed." }, "fields": { "enabled": "Enabled", @@ -166,28 +183,74 @@ "name": "Name", "reference": "Credential reference (optional)", "requireSignature": "Require a signature", - "url": "Catalog URL" + "url": "Catalog URL", + "identityRegex": "Signer identity pattern (optional)", + "kind": "Kind", + "format": "Index format", + "mirrors": "Mirrors" }, + "formats": { + "library": "Library index", + "gallery": "Gallery index" + }, + "gallery": "Gallery index", "hints": { "id": "Lowercase letters, digits and hyphens. It cannot change later.", "reference": "The name of a credential the owner configured. Never paste a token or password here.", - "url": "An https address without credentials or a query string." + "url": "An https address without credentials or a query string.", + "identityRegex": "An anchored pattern, from ^ to $, used instead of the exact identity. Backend libraries use it so builds from master and from tags both verify.", + "format": "A library index uses the shared library entry shape. A gallery index is a model or backend gallery, as the gallery flags name it.", + "mirrors": "Fallback addresses, one per line, tried in order when the main address cannot be fetched." + }, + "kind": { + "addon": "Add-on", + "backend": "Backend", + "model": "Model" + }, + "kindFilter": "Filter by kind", + "kinds": { + "all": "All", + "addon": "Add-ons", + "backend": "Backends", + "model": "Models" }, "lastRefresh": "Refreshed {{when}}, {{count}} entries", - "lead": "A library is a catalog document that lists add-ons. Credentials are never typed here: a private library names a credential the owner configured.", + "lead": "A library is an index that lists add-ons, backends or models. Credentials are never typed here: a private add-on library names a credential the owner configured.", "listLabel": "Libraries", "loading": "Loading libraries", "notRefreshed": "Not refreshed yet", + "officialOff": "Official libraries are off in Settings. The default libraries stay listed, shown as off, and are not read. Libraries you added are not affected.", "reference": "Credential reference: {{name}}", "refresh": "Refresh", "refreshFailed": "Last refresh failed", "refreshed": "Refreshed {{name}}.", "remove": "Remove", "removeBody": "The library is removed from this list. Add-ons that were installed from it stay installed and keep running.", + "removeDefaultBody": "This is a default library that comes with LocalAI. It is removed from the list and stays removed at the next start. You can restore it from the list. Installed items are not touched.", "removeTitle": "Remove {{name}}?", "removed": "Removed {{name}}.", + "removedDefault": "Removed {{name}}. It stays removed at the next start; restore it to bring it back.", + "restore": "Restore", "save": "Save", - "saved": "Saved {{name}}." + "saved": "Saved {{name}}.", + "skipped_one": "{{count}} entry skipped: kind {{kinds}} is not read by this version", + "skipped_other": "{{count}} entries skipped: kind {{kinds}} is not read by this version", + "state": { + "enabled": "Enabled", + "disabled": "Disabled", + "removed": "Removed", + "suspended": "Off (official libraries are off)" + }, + "turnOff": "Turn off", + "turnOn": "Turn on", + "turnedOff": "Turned off {{name}}.", + "turnedOn": "Turned on {{name}}.", + "manage": "Manage libraries", + "manageTitle": { + "backend": "Backend libraries", + "model": "Model libraries", + "addon": "Add-on libraries" + } }, "manage": { "api": "Add-on API", @@ -534,5 +597,27 @@ "network": "The network is not reachable.", "unavailable": "The add-on owner is not available. Try again." } + }, + "install": { + "stepsLabel": "Install steps", + "step": { + "resolving": "Resolve the library entry", + "verifying": "Verify the signature", + "size": "Check the image size", + "fetching": "Fetch the image", + "writing": "Write the metadata" + }, + "state": { + "pending": "Waiting", + "active": "Running", + "done": "Done", + "failed": "Failed" + } + }, + "settingsView": { + "loadFailed": "The library sources could not be read.", + "none": "No library sources of this kind.", + "listLabel": "Library sources", + "mirrors": "Mirrors: {{list}}" } } diff --git a/core/http/react-ui/public/locales/en/models.json b/core/http/react-ui/public/locales/en/models.json index 8559e7889..e2b1b84ea 100644 --- a/core/http/react-ui/public/locales/en/models.json +++ b/core/http/react-ui/public/locales/en/models.json @@ -180,6 +180,7 @@ "empty": { "title": "No models found", "withFilters": "No models match your current search or filters.", + "library": "The library {{name}} has no models on this page.", "collapsedVariantsHint": "Alternative builds that another entry already offers are hidden. Turn off \"One row per model\" to include them.", "noFilters": "The model gallery is empty." }, diff --git a/core/http/react-ui/public/locales/en/operate.json b/core/http/react-ui/public/locales/en/operate.json index b88747fc2..55877c256 100644 --- a/core/http/react-ui/public/locales/en/operate.json +++ b/core/http/react-ui/public/locales/en/operate.json @@ -376,6 +376,7 @@ "clear": "Clear", "clearFilters": "Clear filters", "noMatches": "No installed backends match the current search and filters.", + "libraryEmpty": "The library {{name}} has no backends here.", "emptyTitle": "No backends installed yet", "emptyBody": "Install a backend from the Catalog to give this host a runtime for models.", "openCatalog": "Open the catalog", @@ -423,7 +424,9 @@ "repository": "Repository", "license": "License", "tags": "Tags", - "links": "Links" + "links": "Links", + "library": "Library", + "pinnedDigest": "Pinned digest" }, "nodeRemoval": { "action": "Remove from {{node}}…", @@ -440,6 +443,12 @@ "refreshFailed": "Backend data could not be refreshed. Displayed data may be stale. Retry refresh.", "stale": "Deletion succeeded, but backend data could not be refreshed. Displayed data may be stale. Retry refresh; do not repeat deletion.", "refresh": "Retry backend refresh" + }, + "library": { + "from": "Library: {{library}}", + "pinned": "Pinned to {{digest}}", + "updated": "{{name}} updated from its library.", + "updateFailed": "The update failed. {{message}}" } }, "logs": { diff --git a/core/http/react-ui/public/locales/es/addons.json b/core/http/react-ui/public/locales/es/addons.json index 632d6d27c..8cf122a32 100644 --- a/core/http/react-ui/public/locales/es/addons.json +++ b/core/http/react-ui/public/locales/es/addons.json @@ -76,7 +76,18 @@ "installedSame": "Instalado {{version}}", "installedState": "Instalado", "installing": "Instalando", - "search": "Buscar en las bibliotecas" + "search": "Buscar en las bibliotecas", + "kind": { + "addon": "Add-on", + "backend": "Backend" + }, + "installedBackend": "Installed", + "installedBackendNote": "Installed as a backend on this node. Models can use it now.", + "confirmBackendBody": "Version {{version}} of the backend from the library {{library}} will be downloaded, checked against its digest and signature, and installed on this node. The backend gallery is not changed.", + "confirmBackendNote": "A backend runs native code with the rights of LocalAI. Install it only from a library you trust.", + "backendFailed": "The backend was not installed.", + "alias": "Alias", + "kindLabel": "Kind" }, "catalog": { "allLibraries": "Todas las bibliotecas", @@ -156,7 +167,9 @@ "required": "Obligatorio cuando se exige una firma.", "url": "Escribe una dirección http o https.", "urlCredentials": "La dirección no debe contener usuario ni contraseña.", - "urlQuery": "La dirección no debe contener cadena de consulta ni fragmento." + "urlQuery": "La dirección no debe contener cadena de consulta ni fragmento.", + "either": "Use the exact identity or the pattern, not both.", + "urlEmpty": "Enter the address of the index." }, "fields": { "enabled": "Habilitada", @@ -166,12 +179,17 @@ "name": "Nombre", "reference": "Referencia de credencial (opcional)", "requireSignature": "Exigir una firma", - "url": "URL del catálogo" + "url": "URL del catálogo", + "identityRegex": "Signer identity pattern (optional)", + "kind": "Kind", + "format": "Index format" }, "hints": { "id": "Letras minúsculas, dígitos y guiones. No se puede cambiar después.", "reference": "El nombre de una credencial que configuró el propietario. Nunca pegues aquí un token ni una contraseña.", - "url": "Una dirección https sin credenciales ni cadena de consulta." + "url": "Una dirección https sin credenciales ni cadena de consulta.", + "identityRegex": "An anchored pattern, from ^ to $, used instead of the exact identity. Backend libraries use it so builds from master and from tags both verify.", + "format": "A library index uses the shared library entry shape. A gallery index is a model or backend gallery, as the gallery flags name it." }, "lastRefresh": "Actualizada {{when}}, {{count}} entradas", "lead": "Una biblioteca es un documento de catálogo que enumera complementos. Las credenciales nunca se escriben aquí: una biblioteca privada nombra una credencial que configuró el propietario.", @@ -187,7 +205,43 @@ "removeTitle": "¿Quitar {{name}}?", "removed": "{{name}} quitada.", "save": "Guardar", - "saved": "{{name}} guardada." + "saved": "{{name}} guardada.", + "skipped_one": "{{count}} entry skipped: kind {{kinds}} is not read by this version", + "skipped_other": "{{count}} entries skipped: kind {{kinds}} is not read by this version", + "default": "Default", + "emptyKindBody": "Add a library of this kind, or pick another filter.", + "emptyKindTitle": "No libraries of this kind", + "formats": { + "library": "Library index", + "gallery": "Gallery index" + }, + "gallery": "Gallery index", + "kind": { + "addon": "Add-on", + "backend": "Backend", + "model": "Model" + }, + "kindFilter": "Filter by kind", + "kinds": { + "all": "All", + "addon": "Add-ons", + "backend": "Backends", + "model": "Models" + }, + "officialOff": "Official libraries are off in Settings. The default libraries stay listed, shown as off, and are not read. Libraries you added are not affected.", + "removeDefaultBody": "This is a default library that comes with LocalAI. It is removed from the list and stays removed at the next start. You can restore it from the list. Installed items are not touched.", + "removedDefault": "Removed {{name}}. It stays removed at the next start; restore it to bring it back.", + "restore": "Restore", + "state": { + "enabled": "Enabled", + "disabled": "Disabled", + "removed": "Removed", + "suspended": "Off (official libraries are off)" + }, + "turnOff": "Turn off", + "turnOn": "Turn on", + "turnedOff": "Turned off {{name}}.", + "turnedOn": "Turned on {{name}}." }, "manage": { "api": "API del complemento", diff --git a/core/http/react-ui/public/locales/id/addons.json b/core/http/react-ui/public/locales/id/addons.json index 7705b9d90..d8c89219b 100644 --- a/core/http/react-ui/public/locales/id/addons.json +++ b/core/http/react-ui/public/locales/id/addons.json @@ -76,7 +76,18 @@ "installedSame": "Terpasang {{version}}", "installedState": "Terpasang", "installing": "Memasang", - "search": "Cari di pustaka" + "search": "Cari di pustaka", + "kind": { + "addon": "Add-on", + "backend": "Backend" + }, + "installedBackend": "Installed", + "installedBackendNote": "Installed as a backend on this node. Models can use it now.", + "confirmBackendBody": "Version {{version}} of the backend from the library {{library}} will be downloaded, checked against its digest and signature, and installed on this node. The backend gallery is not changed.", + "confirmBackendNote": "A backend runs native code with the rights of LocalAI. Install it only from a library you trust.", + "backendFailed": "The backend was not installed.", + "alias": "Alias", + "kindLabel": "Kind" }, "catalog": { "allLibraries": "Semua pustaka", @@ -156,7 +167,9 @@ "required": "Wajib diisi bila tanda tangan diwajibkan.", "url": "Masukkan alamat http atau https.", "urlCredentials": "Alamat tidak boleh berisi nama pengguna atau kata sandi.", - "urlQuery": "Alamat tidak boleh berisi query string atau fragmen." + "urlQuery": "Alamat tidak boleh berisi query string atau fragmen.", + "either": "Use the exact identity or the pattern, not both.", + "urlEmpty": "Enter the address of the index." }, "fields": { "enabled": "Aktif", @@ -166,12 +179,17 @@ "name": "Nama", "reference": "Referensi kredensial (opsional)", "requireSignature": "Wajibkan tanda tangan", - "url": "URL katalog" + "url": "URL katalog", + "identityRegex": "Signer identity pattern (optional)", + "kind": "Kind", + "format": "Index format" }, "hints": { "id": "Huruf kecil, angka, dan tanda hubung. Tidak dapat diubah nanti.", "reference": "Nama kredensial yang dikonfigurasi pemilik. Jangan pernah menempelkan token atau kata sandi di sini.", - "url": "Alamat https tanpa kredensial dan tanpa query string." + "url": "Alamat https tanpa kredensial dan tanpa query string.", + "identityRegex": "An anchored pattern, from ^ to $, used instead of the exact identity. Backend libraries use it so builds from master and from tags both verify.", + "format": "A library index uses the shared library entry shape. A gallery index is a model or backend gallery, as the gallery flags name it." }, "lastRefresh": "Disegarkan {{when}}, {{count}} entri", "lead": "Pustaka adalah dokumen katalog yang mendaftar add-on. Kredensial tidak pernah diketik di sini: pustaka privat menyebut kredensial yang dikonfigurasi pemilik.", @@ -187,7 +205,43 @@ "removeTitle": "Hapus {{name}}?", "removed": "{{name}} dihapus.", "save": "Simpan", - "saved": "{{name}} disimpan." + "saved": "{{name}} disimpan.", + "skipped_one": "{{count}} entry skipped: kind {{kinds}} is not read by this version", + "skipped_other": "{{count}} entries skipped: kind {{kinds}} is not read by this version", + "default": "Default", + "emptyKindBody": "Add a library of this kind, or pick another filter.", + "emptyKindTitle": "No libraries of this kind", + "formats": { + "library": "Library index", + "gallery": "Gallery index" + }, + "gallery": "Gallery index", + "kind": { + "addon": "Add-on", + "backend": "Backend", + "model": "Model" + }, + "kindFilter": "Filter by kind", + "kinds": { + "all": "All", + "addon": "Add-ons", + "backend": "Backends", + "model": "Models" + }, + "officialOff": "Official libraries are off in Settings. The default libraries stay listed, shown as off, and are not read. Libraries you added are not affected.", + "removeDefaultBody": "This is a default library that comes with LocalAI. It is removed from the list and stays removed at the next start. You can restore it from the list. Installed items are not touched.", + "removedDefault": "Removed {{name}}. It stays removed at the next start; restore it to bring it back.", + "restore": "Restore", + "state": { + "enabled": "Enabled", + "disabled": "Disabled", + "removed": "Removed", + "suspended": "Off (official libraries are off)" + }, + "turnOff": "Turn off", + "turnOn": "Turn on", + "turnedOff": "Turned off {{name}}.", + "turnedOn": "Turned on {{name}}." }, "manage": { "api": "API add-on", diff --git a/core/http/react-ui/public/locales/it/addons.json b/core/http/react-ui/public/locales/it/addons.json index 5106a4903..27b18c933 100644 --- a/core/http/react-ui/public/locales/it/addons.json +++ b/core/http/react-ui/public/locales/it/addons.json @@ -76,7 +76,18 @@ "installedSame": "Installato {{version}}", "installedState": "Installato", "installing": "Installazione", - "search": "Cerca nelle librerie" + "search": "Cerca nelle librerie", + "kind": { + "addon": "Add-on", + "backend": "Backend" + }, + "installedBackend": "Installed", + "installedBackendNote": "Installed as a backend on this node. Models can use it now.", + "confirmBackendBody": "Version {{version}} of the backend from the library {{library}} will be downloaded, checked against its digest and signature, and installed on this node. The backend gallery is not changed.", + "confirmBackendNote": "A backend runs native code with the rights of LocalAI. Install it only from a library you trust.", + "backendFailed": "The backend was not installed.", + "alias": "Alias", + "kindLabel": "Kind" }, "catalog": { "allLibraries": "Tutte le librerie", @@ -156,7 +167,9 @@ "required": "Obbligatorio quando è richiesta una firma.", "url": "Inserisci un indirizzo http o https.", "urlCredentials": "L'indirizzo non deve contenere nome utente o password.", - "urlQuery": "L'indirizzo non deve contenere una stringa di query o un frammento." + "urlQuery": "L'indirizzo non deve contenere una stringa di query o un frammento.", + "either": "Use the exact identity or the pattern, not both.", + "urlEmpty": "Enter the address of the index." }, "fields": { "enabled": "Abilitata", @@ -166,12 +179,17 @@ "name": "Nome", "reference": "Riferimento credenziale (facoltativo)", "requireSignature": "Richiedi una firma", - "url": "URL del catalogo" + "url": "URL del catalogo", + "identityRegex": "Signer identity pattern (optional)", + "kind": "Kind", + "format": "Index format" }, "hints": { "id": "Lettere minuscole, cifre e trattini. Non può cambiare in seguito.", "reference": "Il nome di una credenziale configurata dal proprietario. Non incollare mai un token o una password qui.", - "url": "Un indirizzo https senza credenziali né stringa di query." + "url": "Un indirizzo https senza credenziali né stringa di query.", + "identityRegex": "An anchored pattern, from ^ to $, used instead of the exact identity. Backend libraries use it so builds from master and from tags both verify.", + "format": "A library index uses the shared library entry shape. A gallery index is a model or backend gallery, as the gallery flags name it." }, "lastRefresh": "Aggiornata {{when}}, {{count}} voci", "lead": "Una libreria è un documento di catalogo che elenca componenti. Le credenziali non si digitano mai qui: una libreria privata indica una credenziale configurata dal proprietario.", @@ -187,7 +205,43 @@ "removeTitle": "Rimuovere {{name}}?", "removed": "{{name}} rimossa.", "save": "Salva", - "saved": "{{name}} salvata." + "saved": "{{name}} salvata.", + "skipped_one": "{{count}} entry skipped: kind {{kinds}} is not read by this version", + "skipped_other": "{{count}} entries skipped: kind {{kinds}} is not read by this version", + "default": "Default", + "emptyKindBody": "Add a library of this kind, or pick another filter.", + "emptyKindTitle": "No libraries of this kind", + "formats": { + "library": "Library index", + "gallery": "Gallery index" + }, + "gallery": "Gallery index", + "kind": { + "addon": "Add-on", + "backend": "Backend", + "model": "Model" + }, + "kindFilter": "Filter by kind", + "kinds": { + "all": "All", + "addon": "Add-ons", + "backend": "Backends", + "model": "Models" + }, + "officialOff": "Official libraries are off in Settings. The default libraries stay listed, shown as off, and are not read. Libraries you added are not affected.", + "removeDefaultBody": "This is a default library that comes with LocalAI. It is removed from the list and stays removed at the next start. You can restore it from the list. Installed items are not touched.", + "removedDefault": "Removed {{name}}. It stays removed at the next start; restore it to bring it back.", + "restore": "Restore", + "state": { + "enabled": "Enabled", + "disabled": "Disabled", + "removed": "Removed", + "suspended": "Off (official libraries are off)" + }, + "turnOff": "Turn off", + "turnOn": "Turn on", + "turnedOff": "Turned off {{name}}.", + "turnedOn": "Turned on {{name}}." }, "manage": { "api": "API del componente", diff --git a/core/http/react-ui/public/locales/ko/addons.json b/core/http/react-ui/public/locales/ko/addons.json index 603dbdc1b..3620ffdf5 100644 --- a/core/http/react-ui/public/locales/ko/addons.json +++ b/core/http/react-ui/public/locales/ko/addons.json @@ -76,7 +76,18 @@ "installedSame": "{{version}} 설치됨", "installedState": "설치됨", "installing": "설치 중", - "search": "라이브러리 검색" + "search": "라이브러리 검색", + "kind": { + "addon": "Add-on", + "backend": "Backend" + }, + "installedBackend": "Installed", + "installedBackendNote": "Installed as a backend on this node. Models can use it now.", + "confirmBackendBody": "Version {{version}} of the backend from the library {{library}} will be downloaded, checked against its digest and signature, and installed on this node. The backend gallery is not changed.", + "confirmBackendNote": "A backend runs native code with the rights of LocalAI. Install it only from a library you trust.", + "backendFailed": "The backend was not installed.", + "alias": "Alias", + "kindLabel": "Kind" }, "catalog": { "allLibraries": "모든 라이브러리", @@ -156,7 +167,9 @@ "required": "서명을 요구할 때는 필수입니다.", "url": "http 또는 https 주소를 입력하세요.", "urlCredentials": "주소에 사용자 이름이나 비밀번호를 넣을 수 없습니다.", - "urlQuery": "주소에 쿼리 문자열이나 프래그먼트를 넣을 수 없습니다." + "urlQuery": "주소에 쿼리 문자열이나 프래그먼트를 넣을 수 없습니다.", + "either": "Use the exact identity or the pattern, not both.", + "urlEmpty": "Enter the address of the index." }, "fields": { "enabled": "활성화됨", @@ -166,12 +179,17 @@ "name": "이름", "reference": "자격 증명 참조(선택)", "requireSignature": "서명 요구", - "url": "카탈로그 URL" + "url": "카탈로그 URL", + "identityRegex": "Signer identity pattern (optional)", + "kind": "Kind", + "format": "Index format" }, "hints": { "id": "소문자, 숫자, 하이픈. 나중에 변경할 수 없습니다.", "reference": "소유자가 구성한 자격 증명의 이름. 토큰이나 비밀번호를 여기에 붙여넣지 마세요.", - "url": "자격 증명과 쿼리 문자열이 없는 https 주소." + "url": "자격 증명과 쿼리 문자열이 없는 https 주소.", + "identityRegex": "An anchored pattern, from ^ to $, used instead of the exact identity. Backend libraries use it so builds from master and from tags both verify.", + "format": "A library index uses the shared library entry shape. A gallery index is a model or backend gallery, as the gallery flags name it." }, "lastRefresh": "{{when}}에 새로 고침, 항목 {{count}}개", "lead": "라이브러리는 애드온을 나열하는 카탈로그 문서입니다. 자격 증명은 여기에 입력하지 않습니다. 비공개 라이브러리는 소유자가 구성한 자격 증명을 이름으로 가리킵니다.", @@ -187,7 +205,43 @@ "removeTitle": "{{name}}을(를) 제거할까요?", "removed": "{{name}}을(를) 제거했습니다.", "save": "저장", - "saved": "{{name}}을(를) 저장했습니다." + "saved": "{{name}}을(를) 저장했습니다.", + "skipped_one": "{{count}} entry skipped: kind {{kinds}} is not read by this version", + "skipped_other": "{{count}} entries skipped: kind {{kinds}} is not read by this version", + "default": "Default", + "emptyKindBody": "Add a library of this kind, or pick another filter.", + "emptyKindTitle": "No libraries of this kind", + "formats": { + "library": "Library index", + "gallery": "Gallery index" + }, + "gallery": "Gallery index", + "kind": { + "addon": "Add-on", + "backend": "Backend", + "model": "Model" + }, + "kindFilter": "Filter by kind", + "kinds": { + "all": "All", + "addon": "Add-ons", + "backend": "Backends", + "model": "Models" + }, + "officialOff": "Official libraries are off in Settings. The default libraries stay listed, shown as off, and are not read. Libraries you added are not affected.", + "removeDefaultBody": "This is a default library that comes with LocalAI. It is removed from the list and stays removed at the next start. You can restore it from the list. Installed items are not touched.", + "removedDefault": "Removed {{name}}. It stays removed at the next start; restore it to bring it back.", + "restore": "Restore", + "state": { + "enabled": "Enabled", + "disabled": "Disabled", + "removed": "Removed", + "suspended": "Off (official libraries are off)" + }, + "turnOff": "Turn off", + "turnOn": "Turn on", + "turnedOff": "Turned off {{name}}.", + "turnedOn": "Turned on {{name}}." }, "manage": { "api": "애드온 API", diff --git a/core/http/react-ui/public/locales/pt-BR/addons.json b/core/http/react-ui/public/locales/pt-BR/addons.json index 8db1c0079..b2e2a5c56 100644 --- a/core/http/react-ui/public/locales/pt-BR/addons.json +++ b/core/http/react-ui/public/locales/pt-BR/addons.json @@ -76,7 +76,18 @@ "installedSame": "Instalado {{version}}", "installedState": "Instalado", "installing": "Instalando", - "search": "Pesquisar nas bibliotecas" + "search": "Pesquisar nas bibliotecas", + "kind": { + "addon": "Add-on", + "backend": "Backend" + }, + "installedBackend": "Installed", + "installedBackendNote": "Installed as a backend on this node. Models can use it now.", + "confirmBackendBody": "Version {{version}} of the backend from the library {{library}} will be downloaded, checked against its digest and signature, and installed on this node. The backend gallery is not changed.", + "confirmBackendNote": "A backend runs native code with the rights of LocalAI. Install it only from a library you trust.", + "backendFailed": "The backend was not installed.", + "alias": "Alias", + "kindLabel": "Kind" }, "catalog": { "allLibraries": "Todas as bibliotecas", @@ -156,7 +167,9 @@ "required": "Obrigatório quando uma assinatura é exigida.", "url": "Informe um endereço http ou https.", "urlCredentials": "O endereço não deve conter nome de usuário nem senha.", - "urlQuery": "O endereço não deve conter string de consulta nem fragmento." + "urlQuery": "O endereço não deve conter string de consulta nem fragmento.", + "either": "Use the exact identity or the pattern, not both.", + "urlEmpty": "Enter the address of the index." }, "fields": { "enabled": "Habilitada", @@ -166,12 +179,17 @@ "name": "Nome", "reference": "Referência de credencial (opcional)", "requireSignature": "Exigir assinatura", - "url": "URL do catálogo" + "url": "URL do catálogo", + "identityRegex": "Signer identity pattern (optional)", + "kind": "Kind", + "format": "Index format" }, "hints": { "id": "Letras minúsculas, dígitos e hifens. Não pode mudar depois.", "reference": "O nome de uma credencial que o proprietário configurou. Nunca cole um token ou senha aqui.", - "url": "Um endereço https sem credenciais nem string de consulta." + "url": "Um endereço https sem credenciais nem string de consulta.", + "identityRegex": "An anchored pattern, from ^ to $, used instead of the exact identity. Backend libraries use it so builds from master and from tags both verify.", + "format": "A library index uses the shared library entry shape. A gallery index is a model or backend gallery, as the gallery flags name it." }, "lastRefresh": "Atualizada {{when}}, {{count}} entradas", "lead": "Uma biblioteca é um documento de catálogo que lista complementos. Credenciais nunca são digitadas aqui: uma biblioteca privada indica uma credencial que o proprietário configurou.", @@ -187,7 +205,43 @@ "removeTitle": "Remover {{name}}?", "removed": "{{name}} removida.", "save": "Salvar", - "saved": "{{name}} salva." + "saved": "{{name}} salva.", + "skipped_one": "{{count}} entry skipped: kind {{kinds}} is not read by this version", + "skipped_other": "{{count}} entries skipped: kind {{kinds}} is not read by this version", + "default": "Default", + "emptyKindBody": "Add a library of this kind, or pick another filter.", + "emptyKindTitle": "No libraries of this kind", + "formats": { + "library": "Library index", + "gallery": "Gallery index" + }, + "gallery": "Gallery index", + "kind": { + "addon": "Add-on", + "backend": "Backend", + "model": "Model" + }, + "kindFilter": "Filter by kind", + "kinds": { + "all": "All", + "addon": "Add-ons", + "backend": "Backends", + "model": "Models" + }, + "officialOff": "Official libraries are off in Settings. The default libraries stay listed, shown as off, and are not read. Libraries you added are not affected.", + "removeDefaultBody": "This is a default library that comes with LocalAI. It is removed from the list and stays removed at the next start. You can restore it from the list. Installed items are not touched.", + "removedDefault": "Removed {{name}}. It stays removed at the next start; restore it to bring it back.", + "restore": "Restore", + "state": { + "enabled": "Enabled", + "disabled": "Disabled", + "removed": "Removed", + "suspended": "Off (official libraries are off)" + }, + "turnOff": "Turn off", + "turnOn": "Turn on", + "turnedOff": "Turned off {{name}}.", + "turnedOn": "Turned on {{name}}." }, "manage": { "api": "API do complemento", diff --git a/core/http/react-ui/public/locales/zh-CN/addons.json b/core/http/react-ui/public/locales/zh-CN/addons.json index e4e80df7a..81c1a50be 100644 --- a/core/http/react-ui/public/locales/zh-CN/addons.json +++ b/core/http/react-ui/public/locales/zh-CN/addons.json @@ -76,7 +76,18 @@ "installedSame": "已安装 {{version}}", "installedState": "已安装", "installing": "正在安装", - "search": "搜索库" + "search": "搜索库", + "kind": { + "addon": "Add-on", + "backend": "Backend" + }, + "installedBackend": "Installed", + "installedBackendNote": "Installed as a backend on this node. Models can use it now.", + "confirmBackendBody": "Version {{version}} of the backend from the library {{library}} will be downloaded, checked against its digest and signature, and installed on this node. The backend gallery is not changed.", + "confirmBackendNote": "A backend runs native code with the rights of LocalAI. Install it only from a library you trust.", + "backendFailed": "The backend was not installed.", + "alias": "Alias", + "kindLabel": "Kind" }, "catalog": { "allLibraries": "所有库", @@ -156,7 +167,9 @@ "required": "要求签名时必填。", "url": "请输入 http 或 https 地址。", "urlCredentials": "地址不能包含用户名或密码。", - "urlQuery": "地址不能包含查询字符串或片段。" + "urlQuery": "地址不能包含查询字符串或片段。", + "either": "Use the exact identity or the pattern, not both.", + "urlEmpty": "Enter the address of the index." }, "fields": { "enabled": "已启用", @@ -166,12 +179,17 @@ "name": "名称", "reference": "凭据引用(可选)", "requireSignature": "要求签名", - "url": "目录 URL" + "url": "目录 URL", + "identityRegex": "Signer identity pattern (optional)", + "kind": "Kind", + "format": "Index format" }, "hints": { "id": "小写字母、数字和连字符,之后不能更改。", "reference": "所有者已配置的凭据名称。切勿在此粘贴令牌或密码。", - "url": "不含凭据和查询字符串的 https 地址。" + "url": "不含凭据和查询字符串的 https 地址。", + "identityRegex": "An anchored pattern, from ^ to $, used instead of the exact identity. Backend libraries use it so builds from master and from tags both verify.", + "format": "A library index uses the shared library entry shape. A gallery index is a model or backend gallery, as the gallery flags name it." }, "lastRefresh": "{{when}} 已刷新,{{count}} 个条目", "lead": "库是列出附加组件的目录文档。凭据绝不在此输入:私有库只引用所有者配置的凭据。", @@ -187,7 +205,43 @@ "removeTitle": "移除 {{name}}?", "removed": "已移除 {{name}}。", "save": "保存", - "saved": "已保存 {{name}}。" + "saved": "已保存 {{name}}。", + "skipped_one": "{{count}} entry skipped: kind {{kinds}} is not read by this version", + "skipped_other": "{{count}} entries skipped: kind {{kinds}} is not read by this version", + "default": "Default", + "emptyKindBody": "Add a library of this kind, or pick another filter.", + "emptyKindTitle": "No libraries of this kind", + "formats": { + "library": "Library index", + "gallery": "Gallery index" + }, + "gallery": "Gallery index", + "kind": { + "addon": "Add-on", + "backend": "Backend", + "model": "Model" + }, + "kindFilter": "Filter by kind", + "kinds": { + "all": "All", + "addon": "Add-ons", + "backend": "Backends", + "model": "Models" + }, + "officialOff": "Official libraries are off in Settings. The default libraries stay listed, shown as off, and are not read. Libraries you added are not affected.", + "removeDefaultBody": "This is a default library that comes with LocalAI. It is removed from the list and stays removed at the next start. You can restore it from the list. Installed items are not touched.", + "removedDefault": "Removed {{name}}. It stays removed at the next start; restore it to bring it back.", + "restore": "Restore", + "state": { + "enabled": "Enabled", + "disabled": "Disabled", + "removed": "Removed", + "suspended": "Off (official libraries are off)" + }, + "turnOff": "Turn off", + "turnOn": "Turn on", + "turnedOff": "Turned off {{name}}.", + "turnedOn": "Turned on {{name}}." }, "manage": { "api": "附加组件 API", diff --git a/core/http/react-ui/src/components/addons/AddonBits.jsx b/core/http/react-ui/src/components/addons/AddonBits.jsx index c2c9122f4..08b2added 100644 --- a/core/http/react-ui/src/components/addons/AddonBits.jsx +++ b/core/http/react-ui/src/components/addons/AddonBits.jsx @@ -1,6 +1,8 @@ import { useTranslation } from 'react-i18next' import Icon from '../Icon' import { stateChip } from './addonState' +import { installSteps } from './installSteps' +import './addons.css' // The process state of an add-on as a chip. The colour is never the only // signal: the text says it and the label names what it is the state of. @@ -73,3 +75,24 @@ export function UnknownNotice({ addonId, actions, className = 'ad-entry__note' } ) } + +// The steps of a backend install and where the job is among them. The host +// names the step; the page marks the ones before it as left, the one it is in +// as running and the one that failed as failed. The text says it as well as +// the mark does. +export function InstallSteps({ job, signed }) { + const { t } = useTranslation('addons') + const steps = installSteps(job, { signed }) + return ( +
    + {steps.map(step => ( +
  1. + + {t(`install.step.${step.id}`)} + {step.progress !== undefined && {step.progress}%} + {t(`install.state.${step.state}`)} +
    2. + ))} +
+ ) +} diff --git a/core/http/react-ui/src/components/addons/BrowseView.jsx b/core/http/react-ui/src/components/addons/BrowseView.jsx index 8f70f38fb..bcf4ce10a 100644 --- a/core/http/react-ui/src/components/addons/BrowseView.jsx +++ b/core/http/react-ui/src/components/addons/BrowseView.jsx @@ -7,7 +7,7 @@ import ConfirmDialog from '../ConfirmDialog' import SideSheet from '../SideSheet' import CatalogView from '../catalog/CatalogView' import { paramsToQuery, queryToParams } from '../catalog/catalogState' -import { AppIcon, Fact, UnknownNotice } from './AddonBits' +import { AppIcon, Fact, InstallSteps, UnknownNotice } from './AddonBits' import { shortDigest } from './addonState' import { updateView } from './updateState' import { describeError, describeOutcome } from './errors' @@ -20,6 +20,10 @@ export default function BrowseView({ api, adapter }) { const { t } = useTranslation('addons') const [params, setParams] = useSearchParams() const [installed, setInstalled] = useState({}) + // Backends are installed by the backend code of the host, not by the add-on + // owner, so they have their own installed list and their own install state. + const [installedBackends, setInstalledBackends] = useState({}) + const [backendWork, setBackendWork] = useState({}) const [reload, setReload] = useState(0) const [confirm, setConfirm] = useState(null) const [details, setDetails] = useState(null) @@ -43,9 +47,34 @@ export default function BrowseView({ api, adapter }) { return () => ctl.abort() }, [api, reload]) + useEffect(() => { + const ctl = new AbortController() + api.backends.installed(ctl.signal) + .then(list => setInstalledBackends(Object.fromEntries(list.map(b => [b.id, b])))) + .catch(() => { if (!ctl.signal.aborted) setInstalledBackends({}) }) + return () => ctl.abort() + }, [api, reload]) + const actions = useAddonActions(api, { onSettled: () => setReload(n => n + 1) }) + const installBackend = async (entry) => { + setConfirm(null) + const key = `install:${entry.key}` + setBackendWork(w => ({ ...w, [key]: { phase: 'working', job: { phase: 'resolving' } } })) + try { + const job = await api.backends.install( + { sourceId: entry.sourceId, name: entry.id, version: entry.version }, undefined, + { onStatus: status => setBackendWork(w => ({ ...w, [key]: { phase: 'working', job: status } })) }, + ) + setBackendWork(w => ({ ...w, [key]: { phase: 'done', job } })) + } catch (error) { + setBackendWork(w => ({ ...w, [key]: { phase: 'failed', error, job: { phase: error.phase, processed: true, error: error.message } } })) + } + setReload(n => n + 1) + } + const install = (entry) => { + if (entry.kind === 'backend') return installBackend(entry) setConfirm(null) actions.run(`install:${entry.key}`, { addonId: entry.id, @@ -57,11 +86,13 @@ export default function BrowseView({ api, adapter }) { } const renderEntry = (entry) => { - const have = installed[entry.id] + const isBackend = entry.kind === 'backend' + const have = isBackend ? installedBackends[entry.id] : installed[entry.id] const key = `install:${entry.key}` - const st = actions.state[key] - const pending = Boolean(actions.unknown[entry.id]) - const working = st?.phase === 'working' + const bw = isBackend ? backendWork[key] : null + const st = isBackend ? null : actions.state[key] + const pending = !isBackend && Boolean(actions.unknown[entry.id]) + const working = isBackend ? bw?.phase === 'working' : st?.phase === 'working' return (
@@ -76,19 +107,28 @@ export default function BrowseView({ api, adapter }) {

{entry.description &&

{entry.description}

}
+ {t(`browse.kind.${entry.kind}`, { defaultValue: entry.kind })} {entry.platform.os}/{entry.platform.arch} {entry.policy.requireSignature ? t('trust.signatureRequired') : t('trust.digestOnly')} {entry.channel && {entry.channel}} - {have && {have.version === entry.version ? t('browse.installedSame', { version: have.version }) : t('browse.installedOther', { version: have.version })}} - {have && updateView(have.update).state === 'update-available' && {t('updates.badge.available', { version: updateView(have.update).version })}} + {isBackend && have && {t('browse.installedBackend')}} + {!isBackend && have && {have.version === entry.version ? t('browse.installedSame', { version: have.version }) : t('browse.installedOther', { version: have.version })}} + {!isBackend && have && updateView(have.update).state === 'update-available' && {t('updates.badge.available', { version: updateView(have.update).version })}}
{pending && } {!pending && st && !working && st.outcome !== 'completed' && (

{describeOutcome(st.outcome, t, st.error)}

)} {st && st.outcome === 'completed' &&

{t('browse.installedNotEnabled')}

} + {bw && bw.phase !== 'done' && } + {bw?.phase === 'failed' && ( +

+ {t('browse.backendFailed')} {(bw.error?.kind === 'install' || bw.error?.status >= 400) && bw.error.message && bw.error.message !== bw.error.kind ? bw.error.message : describeError(bw.error, t)} +

+ )} + {bw?.phase === 'done' &&

{t('browse.installedBackendNote')}

}
+ {chips.map(s => ( + + ))} +
+ )} + + {open && ( + setOpen(false)} closeLabel={t('catalog.close')} labelId="kind-libraries-title" testId="kind-libraries-panel" wide> + describeError(e, t)} onChanged={changed} /> + + )} + + ) +} diff --git a/core/http/react-ui/src/components/catalog/SourcesView.jsx b/core/http/react-ui/src/components/catalog/SourcesView.jsx index 9280b928f..b950a9070 100644 --- a/core/http/react-ui/src/components/catalog/SourcesView.jsx +++ b/core/http/react-ui/src/components/catalog/SourcesView.jsx @@ -6,34 +6,40 @@ import LoadingSpinner from '../LoadingSpinner' import ConfirmDialog from '../ConfirmDialog' import SideSheet from '../SideSheet' import CatalogEmpty from './CatalogEmpty' -import { createOperationBook, draftToSource, slugify, sourceToDraft, validateSourceDraft } from './catalogState' +import { SOURCE_KINDS, canRefresh, countByKind, createOperationBook, draftToLibrarySource, draftToSource, filterSources, mirrorList, slugify, sourceKind, sourceState, sourceToDraft, validateSourceDraft } from './catalogState' import './catalog.css' import '../addons/addons.css' -const BLANK = { id: '', name: '', url: '', enabled: true, requireSignature: false, issuer: '', identity: '', authReference: '', allowLoopbackHTTP: false } +const BLANK = { mirrors: '', kind: 'addon', format: 'library', id: '', name: '', url: '', enabled: true, requireSignature: false, issuer: '', identity: '', identityRegex: '', authReference: '', allowLoopbackHTTP: false } function seen(iso) { const d = new Date(iso) return Number.isNaN(d.getTime()) || d.getFullYear() < 2000 ? null : d } -// The libraries a catalog reads from: list, edit, refresh, remove. Resource +// The library sources of all three kinds (add-ons, backends and models): list +// with a kind filter, add, turn on and off, edit, refresh, remove. Resource // neutral. The adapter owns what a save means; this view owns the form, the // operation identity of each action and honest reporting of its outcome. // // adapter { listSources, saveSource(source, signal, operationId), -// refreshSource(id, signal, operationId) } +// refreshSource(id, signal, operationId), +// addSource(body, signal), setSourceEnabled(id, on, signal), +// removeSource(id, signal) } // describeError (error) => string // onChanged called after a change was confirmed // // A library is saved with a credential REFERENCE by name. The form has no field // for a secret, and the server refuses anything that is not a reference. -export default function SourcesView({ adapter, describeError, onChanged }) { +export default function SourcesView({ adapter, describeError, onChanged, kind: fixedKind, sourceId }) { const { t, i18n } = useTranslation('addons') const [state, setState] = useState({ status: 'loading', sources: [], error: null }) const [reload, setReload] = useState(0) const [editing, setEditing] = useState(null) const [removing, setRemoving] = useState(null) + const [pickedKind, setKind] = useState('all') + // A fixed kind scopes the whole view: the list, the counts and the add form. + const kind = fixedKind || pickedKind const [busy, setBusy] = useState({}) const [notice, setNotice] = useState(null) const book = useRef(null) @@ -77,16 +83,31 @@ export default function SourcesView({ adapter, describeError, onChanged }) { }, [onChanged, describeError]) const save = async (draft) => { - const ok = await act(`save:${draft.id}`, (operationId, signal) => adapter.saveSource(draftToSource(draft), signal, operationId), t('libraries.saved', { name: draft.name })) + // A backend or model source is added through the library route; an + // add-on source keeps its form with a policy and a credential reference. + // A saved backend or model source changes only its mirrors. + const write = draft.kind !== 'addon' + ? (draft.isNew + ? (operationId, signal) => adapter.addSource(draftToLibrarySource(draft), signal) + : (operationId, signal) => adapter.updateSource(draft.id, { mirrors: mirrorList(draft.mirrors) }, signal)) + : (operationId, signal) => adapter.saveSource(draftToSource(draft), signal, operationId) + const ok = await act(`save:${draft.id || draft.url}`, write, t('libraries.saved', { name: draft.name || draft.url })) if (ok) setEditing(null) return ok } const remove = async (source) => { setRemoving(null) - await act(`remove:${source.id}`, (operationId, signal) => adapter.saveSource({ id: source.id, name: source.name, url: source.url, enabled: source.enabled, removed: true }, signal, operationId), t('libraries.removed', { name: source.name })) + await act(`remove:${source.id}`, (operationId, signal) => adapter.removeSource(source.id, signal), + source.default ? t('libraries.removedDefault', { name: source.name }) : t('libraries.removed', { name: source.name })) } + const toggle = (source, on) => act(`toggle:${source.id}`, (operationId, signal) => adapter.setSourceEnabled(source.id, on, signal), + on ? t('libraries.turnedOn', { name: source.name }) : t('libraries.turnedOff', { name: source.name })) const refresh = (source) => act(`refresh:${source.id}`, (operationId, signal) => adapter.refreshSource(source.id, signal, operationId), t('libraries.refreshed', { name: source.name })) + const counts = countByKind(state.sources) + const shown = filterSources(state.sources, kind).filter(s => !sourceId || s.id === sourceId) + const scoped = fixedKind ? filterSources(state.sources, fixedKind) : state.sources + if (state.status === 'loading') return
if (state.status === 'error') { return ( @@ -104,7 +125,7 @@ export default function SourcesView({ adapter, describeError, onChanged }) {

{t('libraries.lead')}

-
@@ -114,49 +135,87 @@ export default function SourcesView({ adapter, describeError, onChanged }) { {notice.text}
)} - {state.sources.length === 0 ? ( + {scoped.some(x => x.suspended) && ( +

{t('libraries.officialOff')}

+ )} + {!fixedKind && state.sources.length > 0 && ( +
+ {['all', ...SOURCE_KINDS].map(k => ( + + ))} +
+ )} + {scoped.length === 0 ? ( + ) : shown.length === 0 ? ( + ) : (
    - {state.sources.map(source => { + {shown.map(source => { const last = source.refresh ? seen(source.refresh.lastSuccess) : null - const working = Boolean(busy[`refresh:${source.id}`] || busy[`remove:${source.id}`] || busy[`save:${source.id}`]) + const st = sourceState(source) + const sk = sourceKind(source) + const working = Boolean(busy[`refresh:${source.id}`] || busy[`remove:${source.id}`] || busy[`save:${source.id}`] || busy[`toggle:${source.id}`]) return ( -
  • +

  • {source.name} {source.id}

    {source.url}

    - {source.enabled ? t('libraries.enabled') : t('libraries.disabled')} + {t(`libraries.kind.${sk}`)} + {source.default && {t('libraries.default')}} + {t(`libraries.state.${st}`)} + {source.format === 'gallery' && {t('libraries.gallery')}} {source.policy?.requireSignature && } {source.authReference && } {source.refresh?.failed && {t('libraries.refreshFailed')}} - {!source.refresh && source.enabled && {t('libraries.notRefreshed')}} + {!source.refresh && canRefresh(source) && {t('libraries.notRefreshed')}} + {source.refresh?.skipped > 0 && !source.refresh.failed && ( + {t('libraries.skipped', { count: source.refresh.skipped, kinds: (source.refresh.skippedKinds || []).join(', ') })} + )} {last && !source.refresh.failed && {t('libraries.lastRefresh', { when: last.toLocaleString(i18n.language), count: source.refresh.count })}}
    + {source.conflict && ( +

    + )}
    - - - + {st === 'removed' ? ( + + ) : ( + <> + {st !== 'suspended' && ( + + )} + + + + + )}
    • ) })}
)} - {editing && setEditing(null)} saving={Boolean(busy[`save:${editing.id}`])} t={t} />} + {editing && setEditing(null)} saving={Boolean(busy[`save:${editing.id}`])} t={t} />} {t('libraries.removeBody')}

} + message={

{removing?.default ? t('libraries.removeDefaultBody') : t('libraries.removeBody')}

} confirmLabel={t('libraries.remove')} onConfirm={() => remove(removing)} onCancel={() => setRemoving(null)} @@ -165,10 +224,13 @@ export default function SourcesView({ adapter, describeError, onChanged }) { ) } -function SourceEditor({ draft, onSave, onClose, saving, t }) { +function SourceEditor({ kinds, draft, onSave, onClose, saving, t }) { const [form, setForm] = useState(draft) const [touched, setTouched] = useState(false) const isNew = Boolean(draft.isNew) + const addon = form.kind === 'addon' + // A saved backend or model source changes only its mirrors. + const lockedIdentity = !isNew && !addon const errors = touched ? validateSourceDraft(form) : {} const set = (patch) => setForm(f => ({ ...f, ...patch })) const submit = (e) => { @@ -201,20 +263,52 @@ function SourceEditor({ draft, onSave, onClose, saving, t }) { )} >
- {field('name', t('libraries.fields.name'), { autoComplete: 'off', onChange: e => set({ name: e.target.value, ...(isNew && !form.idTouched ? { id: slugify(e.target.value) } : {}) }) })} + {isNew && kinds.length > 1 && ( +
+ + +
+ )} + {isNew && form.kind !== 'addon' && ( +
+ + +

{t('libraries.hints.format')}

+
+ )} + {field('name', t('libraries.fields.name'), { autoComplete: 'off', readOnly: lockedIdentity, onChange: e => set({ name: e.target.value, ...(isNew && !form.idTouched ? { id: slugify(e.target.value) } : {}) }) })} {field('id', t('libraries.fields.id'), { autoComplete: 'off', readOnly: !isNew, onChange: e => set({ id: e.target.value, idTouched: true }) }, t('libraries.hints.id'))} - {field('url', t('libraries.fields.url'), { type: 'url', autoComplete: 'off', inputMode: 'url', placeholder: 'https://' }, t('libraries.hints.url'))} - - - {form.requireSignature && field('issuer', t('libraries.fields.issuer'), { autoComplete: 'off' })} - {form.requireSignature && field('identity', t('libraries.fields.identity'), { autoComplete: 'off' })} - {field('authReference', t('libraries.fields.reference'), { autoComplete: 'off', spellCheck: false }, t('libraries.hints.reference'))} + {field('url', t('libraries.fields.url'), { type: 'url', autoComplete: 'off', inputMode: 'url', placeholder: 'https://', readOnly: lockedIdentity }, t('libraries.hints.url'))} + {!addon && ( +
+ +