Commit 5d539e10 by Jonathan Thomas

Adding RateLimiter to LLM unit tests, plus improving system-chat prompt to work…

Adding RateLimiter to LLM unit tests, plus improving system-chat prompt to work better for both llama 70b, gpt-3.5-turbo, and gpt-4o-mini.
parent 7e892cf6
Pipeline #13246 passed with stages
in 2 minutes 10 seconds