ai-proxy plugin #13385
ai-proxy plugin
#13385
-
|
Can the ai-proxy plugin currently perform load balancing and health checks freely between multiple models? For example, my colleague started multiple llama3 models and balanced the load between them. |
Beta Was this translation helpful? Give feedback.
Answered by
subnetmarco
Jul 17, 2024
Replies: 1 comment
-
|
Replied here. |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
subnetmarco
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Replied here.