FileMaker/FMS stress testing tools?

Questions
1

For APIs, I generally use either Apache JMeter or (for Python), Locust to stress test.

Wanted to know what folks use to stress test FileMaker/FMS apps for 50, 100, 500 users.

Thanks,

2

At least a couple of community members have put some dedicated work/thought into stress testing. What immediately comes to mind is the work that Wim Decorte put into a tool named "Punisher". I have not personally used it, but knowing the high level of quality that Wim puts into everything that he does, I have no hesitation in recommending checking it out.

Of note is that, per the notes about Punisher, I believe that it is a tool which aims to measure the capacity/effectiveness of a server installation, as opposed to a tool which aims to measure the same qualities for a particular FileMaker solution.

3

@OliverBarrett, would you say more about the type of testing that you are performing when you use these tools?

4

We are just trying to measure how many users our FileMaker application can use with reasonable performance.

Yesterday, without any special configuration our REST service on the server was easily handling 1,000 simultaneous connections with 0.25 seconds per request (using the free LOCUST python testing tool) with no errors. We could add multiple Tomcat installs with a front-end load balancer for multiples of 1,000 connections if needed.

However, .... when we tested REST endpoints that hit the FMP database, our performance quickly plummeted after about 50 users.

Since we may need to massively scale our application, we're currently planning a migration to PostgresSQL for this app.

Thanks,

5

Awesome, Steve. Thank you.