mirror of
https://github.com/bentoml/OpenLLM.git
synced 2026-02-02 03:42:03 -05:00
move model_ids and default_id to config class declaration, cleanup dependencies between config and LLM implementation lazy load module during LLM creation to llm_post_init fix post_init hooks to run load_in_mha. Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>