Load Testing with Koi Pond
How we used Koi Pond leading up to a large customer milestone Manual QA combined with Koi Pond. We are working on making Koi Pond as close as possible to the real Slack's behavior, but in the meantime, manual testing helps us ensure that all the nuanced actions are realistically tested. Each week, we increased the number of koi we simulated and improved the fidelity of our testing by making our test workspace as close as possible to our expectation of the actual customer's workspace. We gave teams the option to have us boot up koi while they ran their API Blast load test. Koi Pond on its own, without other load testing tools. An example is with one of our API Blast + Koi Pond endeavors - while testing our SSO flow, we were originally using a single SSO token but calling it at a high rate. We are working on a process for having koi running all the time to alleviate these issues and unlock possibilities such as load testing on deploys and more realistic timezone/region testing.