10 Commits

Author	SHA1	Message	Date
Aaron Pham	8c2867d26d	style: define experimental guidelines (#168)	2023-07-31 07:54:26 -04:00
Aaron Pham	ef94c6b98a	feat(container): vLLM build and base image strategies (#142)	2023-07-31 02:44:52 -04:00
Aaron Pham	7eabcd4355	feat: vLLM integration for PagedAttention (#134)	2023-07-24 15:42:17 -04:00
aarnphm-ec2-dev	8b340559aa	fix(tests): skip running models tests on CI ... The runners don't have enough space to run all tests Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>	2023-07-19 22:40:40 +00:00
HeTaoPKU	09b0787306	feat(models): Baichuan (#115) ... Co-authored-by: the <tao.he@hulu.com> Co-authored-by: Aaron <29749331+aarnphm@users.noreply.github.com>	2023-07-15 22:01:37 -04:00
Aaron Pham	c7f4dc7bb2	feat(test): snapshot testing (#107) ... Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>	2023-07-10 17:23:19 -04:00
Aaron Pham	bd4cc9b3ff	fix: loading local (#87) ... Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>	2023-06-28 11:25:54 -04:00
Aaron Pham	f8ebb36e15	tests: fastpath (#17) ... added fastpath cases for configuration and Flan-T5 fixes respecting model_id into lifecycle hooks. update CLI to cleanup models info	2023-06-12 14:18:26 -04:00
Aaron	ec941c95d5	chore: add license header ... Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>	2023-06-04 16:22:37 -07:00
Chaoyu	dd8b6050b2	feat: FLAN-T5 supports ... - add infrastructure, to be implemented: cache, chat history - Base Runnable Implementation, that fits LangChain API - Added a Prompt descriptor and utils. feat: license headers and auto factory impl and CLI Auto construct args from pydantic config Add auto factory for ease of use only provide `/generate` to streamline UX experience CLI > envvar > input contract for configuration fix: serve from a thread fix CLI args chore: cleanup names and refactor imports Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>	2023-05-03 17:50:14 -07:00