Comparing Two Gatling html report files

Hi all,

Just getting ramped up with gatling and its working great so far. The reports are great as well.

I was wondering if there is a way (already existing) to compare the output of two different simulation output files and output as the table showing the test1/test2 comparison for response times? I am still not there with the genkins plugin, as it still says it cannot find the results folder. I even made sure that is the only directory in there before starting the test. Any help is much appreciated. Thanks much!

Generating reports...
Reports generated in 1s.
Please open the following file : /xx/xx/xx/xx-20140521112618/index.html
Archiving Gatling reports...
ERROR: Publisher com.excilys.ebi.gatling.jenkins.GatlingPublisher aborted due to exception
[java.lang.IllegalArgumentException](http://stacktrace.jenkins-ci.org/search?query=java.lang.IllegalArgumentException): Could not find a Gatling report in results folder.

Hi,

I was wondering if there is a way (already existing) to compare the output
of two different simulation output files and output as the table showing
the test1/test2 comparison for response times?

No.

I am still not there with the genkins plugin, as it still says it cannot
find the results folder. I even made sure that is the only directory in
there before starting the test. Any help is much appreciated. Thanks much!

Did you check that you don't have some spaces in the path?

I just got back to working on this. The simulation runs successfully and I can see the report in the specified folder. It is failing at archiving the reports. There are no spaces in the path as well. How should I go about debugging this? thanks in advance.

Simulation finished.
Simulation successful.
Generating reports...
Reports generated in 0s.
Please open the following file : /test/testgatling/results/testsimulation-20140707155141/index.html
Archiving Gatling reports...
ERROR: Publisher com.excilys.ebi.gatling.jenkins.GatlingPublisher aborted due to exception
[java.lang.IllegalArgumentException](http://stacktrace.jenkins-ci.org/search?query=java.lang.IllegalArgumentException): Could not find a Gatling report in results folder.
	at [com.excilys.ebi.gatling.jenkins.GatlingPublisher.saveFullReports(GatlingPublisher.java:97)](http://stacktrace.jenkins-ci.org/search/?query=com.excilys.ebi.gatling.jenkins.GatlingPublisher.saveFullReports&entity=method)
	at [com.excilys.ebi.gatling.jenkins.GatlingPublisher.perform(GatlingPublisher.java:65)](http://stacktrace.jenkins-ci.org/search/?query=com.excilys.ebi.gatling.jenkins.GatlingPublisher.perform&entity=method)
	at [hudson.tasks.BuildStepMonitor$3.perform(BuildStepMonitor.java:45)](http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.BuildStepMonitor$3.perform&entity=method)
	at [hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:784)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.perform&entity=method)
	at [hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:756)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps&entity=method)
	at [hudson.model.Build$BuildExecution.post2(Build.java:183)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Build$BuildExecution.post2&entity=method)
	at [hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:705)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.post&entity=method)
	at [hudson.model.Run.execute(Run.java:1695)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Run.execute&entity=method)
	at [hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.FreeStyleBuild.run&entity=method)
	at [hudson.model.ResourceController.execute(ResourceController.java:88)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.ResourceController.execute&entity=method)
	at [hudson.model.Executor.run(Executor.java:231)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Executor.run&entity=method)
Notifying upstream projects of job completion
Finished: FAILURE

I am using a shell script to build from Jenkins (not using maven) and made sure that I have cleared the reports inside the simulation results directory (in proper format), I tried just getting the reports only option (creates the index.html under the /results/mysimulation-xxx directlry on the remote host, but still seeing the same exception for the ‘Archiving Gatling Reports…’ step.

ssh RemoteHostname ‘/test/testgatling/bin/gatling.sh -ro /mysimulation-20140707155141’

Is this a case of file path being incorrect? I would appreciate some guidance on troubleshooting this. Thanks for your patience.

I am likewise using the bin/gatling.sh script (using version2 .0.0-RC2) to launch tests from Jenkins on Ubuntu, and also getting the error:

Please open the following file: results/webprosimulation-1409071038949/index.html
Archiving Gatling reports...
ERROR: Publisher com.excilys.ebi.gatling.jenkins.GatlingPublisher aborted due to exception
[java.lang.IllegalArgumentException](http://stacktrace.jenkins-ci.org/search?query=java.lang.IllegalArgumentException): Could not find a Gatling report in results folder.
	at [com.excilys.ebi.gatling.jenkins.GatlingPublisher.saveFullReports(GatlingPublisher.java:97)](http://stacktrace.jenkins-ci.org/search/?query=com.excilys.ebi.gatling.jenkins.GatlingPublisher.saveFullReports&entity=method)
	at [com.excilys.ebi.gatling.jenkins.GatlingPublisher.perform(GatlingPublisher.java:65)](http://stacktrace.jenkins-ci.org/search/?query=com.excilys.ebi.gatling.jenkins.GatlingPublisher.perform&entity=method)
	at [hudson.tasks.BuildStepMonitor$3.perform(BuildStepMonitor.java:45)](http://stacktrace.jenkins-ci.org/search/?query=hudson.tasks.BuildStepMonitor$3.perform&entity=method)
	at [hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:772)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.perform&entity=method)
	at [hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:736)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps&entity=method)
	at [hudson.model.Build$BuildExecution.post2(Build.java:183)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Build$BuildExecution.post2&entity=method)
	at [hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:685)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractBuildExecution.post&entity=method)
	at [hudson.model.Run.execute(Run.java:1757)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Run.execute&entity=method)
	at [hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.FreeStyleBuild.run&entity=method)
	at [hudson.model.ResourceController.execute(ResourceController.java:88)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.ResourceController.execute&entity=method)
	at [hudson.model.Executor.run(Executor.java:234)](http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Executor.run&entity=method)

In this case the results are in /home/myuser/gatling/results/results/webprosimulation-1409071038949 - is that where the plugin is looking? ( I though it might be looking in the Jenkins job directory, but I've tried copying the resuilts files to the Jenkins job directory with the same result). I've looked through the Google Group here for similar issues and this is the closest I've found. I'd like to understand where the plugin is looking for the results so I can make sure to get them into the right path
many thanks
tom

I am also getting the same error when running through the Gatling Maven plugin in Jenkins

[JENKINS] Archiving /home/myuser/gatling/pom.xml to io.gatling/gatling-maven-plugin-demo/2.0.0-RC2/gatling-maven-plugin-demo-2.0.0-RC2.pom
/home/myuser/gatling/pom.xml is not inside /var/lib/jenkins/jobs/MavenTestJob/workspace/home/myuser/gatling/; will archive in a separate pass
channel stopped
Archiving Gatling reports...
ERROR: Publisher com.excilys.ebi.gatling.jenkins.GatlingPublisher aborted due to exception
[java.lang.IllegalArgumentException](http://stacktrace.jenkins-ci.org/search?query=java.lang.IllegalArgumentException): Could not find a Gatling report in results folder.
	at [com.excilys.ebi.gatling.jenkins.GatlingPublisher.saveFullReports(GatlingPublisher.java:97)](http://stacktrace.jenkins-ci.org/search/?query=com.excilys.ebi.gatling.jenkins.GatlingPublisher.saveFullReports&entity=method)

Hi Tom,

Sorry, I forgot to update this thread on my issue. Once I started running gatling from the same box as Jenkins runs and also after manually updating the Workspace to point to the Results folder location, it was able to execute and plot my results for several runs. Hope this helps.

I’ll try to investigate tomorrow. What’s your Jenkins version?

Hi Rama,

How were you running Gatling? On a Jenkins slave? Or connection on a remote box on ssh and then directly launching the script?

I’m running Jenkins 1.573 on Ubuntu.

Rama - can you provide more detail about “manually updating the workspace to point to the results folder”?
thanks
tom

Tom,

Earlier you mentioned that your simulation.log file is inside /home/myuser/gatling/results/results/webprosimulation-1409071038949 (note results/results/ directory in the path)

In gatling/conf/gatling.conf what is the value of gatling/directory/results? Is it commented out and defaulting to “results” ?

If so, then gatling is looking for simulation.log in /home/myuser/gatling/results/webprosimulation-1409071038949

That must have been a typo. The results are actually in
/home/myuser/gatling/results/

the gatling.conf directory ‘results’ is commented out and the pom.xml results folder is
results
so the results are indeed put where the test reports that they are (for example: Reports generated in 0s.
Please open the following file: /home/myuser/gatling/results/samplesimulation-1409094504830/index.html), but still

Archiving Gatling reports...
ERROR: Publisher com.excilys.ebi.gatling.jenkins.GatlingPublisher aborted due to exception
[java.lang.IllegalArgumentException](http://stacktrace.jenkins-ci.org/search?query=java.lang.IllegalArgumentException): Could not find a Gatling report in results folder.

In the build step, the shell script is:
cd /home/myuser/gatling
mvn gatling:execute -Dgatling.simulationClass=basic.SampleSimulation

Sorry, couldn’t find time to investigate today.
Will try tomorrow, friday otherwise.

Cheers,

Stéphane

I worked this out. Rama’s hint about manually configuring the results folder was the key

In the pom.xml, I edited the
/var/lib/jenkins/jobs/MavenJob/workspace

to direct the results into the Maven job’s workspace. This was not particularly intuitive. May I suggest that the Exception raised in GatlingPublisher also emit the “FilePath workspace” value where the plugin is looking for the results. That would be helpful for debugging.
thank you all