Let me expand a little more. In order to access my injectors that run on Linux, I have to ssh through 2 other machines to reach it, 1 is a security layer the other is the environment gateway, this is to ensure nothing on the injectors can affect the corporate network or system under test. The logs are pushed up to a reporting tool using dedicated routes and ports (standard network stuff) but this cannot parse epoch timestamps present in simulator.log. The injector does not run a desktop so any access to another Web based reporting tool viewed locally is off the table.
The console shows the number of pass and fail but provides no indication of actual application performance. Some of our tests can run for a couple of hours and at present in Gatling we have to wait for the test to finish before identifying any end user impact.
In all honesty I have worked for a number of large or security conscious organisations where very similar restrictions and complexity exist and I have been faced with and able to overcome similar problems using jMeter so either Gatling is not being used in such environments as a rule or internal development has worked around them, something not available to me.
I am also aware of the importance of percentile from a reporting aspect, however in regards to real time monitoring, percentile will not be affected by a small subset of poor results that could point to areas of concern, especially in a test environment, if you are looking at 90th and 1 of your 10 load balancers is playing up you are not really going to see it.
This is easily comparable to a baseline, so if your 90th is 100ms and your average is 150ms, this means that run is looking good but your next run could be 90th percentile at 100ms and average is 300ms, this is because the top 10% have increased substantially. Not debunking percentile completely but each have their own uses in terms of reporting and I have uses for both.
To be honest I only wanted a yes it can’t be done in the native tool or no it can’t with these questions not a discussion as to what I am doing is right, because it is how we do it now and for Gatling to work it has to fit in with our existing infrastructure.
We have existing policies and restrictions in place that demand certain data formats and restrict our capabilities so telling me something I am forced to do is wrong is not helping (also based on experience what I am asking is completely reasonable), I am asking if something is possible in the native tool not what other tools do I need to deliver it. At present I have 1 product that fills our needs but makes development difficult. Gatling is easier to develop but supports none of our reporting needs.
I understand this may seem quite specific but a lot of large and governmental organisations have similar restrictions both in security and infrastructure so if Gatling is looking to stand up to the likes of LoadRunner and jMeter, it needs to be able to address similar needs. Questioning the requirement does not dilute it’s validity.