Alex Cheema 490fa102a4 tinygrad inference engine

2024-07-14 13:07:37 -07:00

..

mlx

a generic test for every inference engine

2024-07-13 18:25:26 -07:00

tinygrad

tinygrad inference engine

2024-07-14 13:07:37 -07:00

__init__.py

make StatefulShardedModel callable, add some tests for mlx sharded inference

2024-07-13 15:41:15 -07:00

inference_engine.py

add support for multiple concurrent requests with request ids

2024-07-13 23:11:01 -07:00

shard.py

mlx sharded implementation with example of distributed inference

2024-06-24 19:35:57 +01:00

test_inference_engine.py

tinygrad inference engine

2024-07-14 13:07:37 -07:00