Alex Cheema e6f387a690 handle is_finished

2024-07-13 23:27:34 -07:00

inference

add support for multiple concurrent requests with request ids

2024-07-13 23:11:01 -07:00

networking

handle is_finished

2024-07-13 23:27:34 -07:00

orchestration

handle is_finished

2024-07-13 23:27:34 -07:00

topology

collect global topology with local peer visibility, ring memory weighted partitioning strategy

2024-06-25 12:32:16 +01:00

.gitignore

make StatefulShardedModel callable, add some tests for mlx sharded inference

2024-07-13 15:41:15 -07:00

example_user_2.py

handle is_finished

2024-07-13 23:27:34 -07:00

example_user.py

collect global topology with local peer visibility, ring memory weighted partitioning strategy

2024-06-25 12:32:16 +01:00

main_dynamic.py

graceful node shutdown

2024-07-13 20:43:37 -07:00

main.py

collect global topology with local peer visibility, ring memory weighted partitioning strategy

2024-06-25 12:32:16 +01:00

requirements.txt

add requirements.txt

2024-06-24 21:00:04 +01:00

Description

No description provided

Apache-2.0 46 MiB

Languages

Python 61.4%

Svelte 23.4%

Swift 7.1%

TypeScript 4.3%

Rust 1.7%

Other 2%