01 - Launch a first benchmark

Owned by Maeva Rondeau
Last updated: Aug 28, 2024
3 min read

update 28 aug 2024

Benchmark is the fastest way to get result with an automated test execution. However, it does not give a personalized analysis with a precise user journey.

All the benchmark procedure takes place on core-saas-prod.greenspector.com/testbench/jobs/new. Please visit this site and log in.

Launch a benchmark

  • First, click on Benchmark in the side menu:

An application in Greenspector Studio regroups all tests of different versions of a measured application or website.

 

  • Choose + Add an application, enter name and validate. Description field is optional.

Versions allow to compare different updates of the same application:

  • For an application, version number is often used (ex: 1.02.03)

  • For a website, the measurement date is often used (ex: 06_12_2023 with format dd_mm_yyyy)

 

  • Choose + Add a version, and give a version name:

 

  • Choose a test environment. The list shows the available devices on our testbench. For this first try, it is recommended to choose the most available device: Samsung - Galaxy S9 (mobile with android 10):

  • Specify the type of the item to measure: Website or Mobile app

  • For website, enter the URL for a website

  • For application, enter:

    • A link to the .apk file

    • A package name which will be downloaded on Google Playstore

  • Enter the amount of times the benchmark has to be executed:

    • The higher the number, the better the precision, but also the longer the execution time.

  • For a website, specify the browser to use

Firefox is not available anymore for the moment. Sorry for the inconvenience.

Follow the measurement process

The Tests tracking tab allows to verify if the test is taking into account by the testbench:

  • When Pending, the test is waiting for an available device in testbench

  • When Running, the test is currently running on a device

  • When Finished, the results are available

Waiting time depends of the availability of testbench devices.

At the end, click on the test to get more information, as logs, screenshots or dump. They stay available for 7 days.

Show benchmark dashboard

After the test is complete, the results are available in the dashboard tab, with a global Ecoscore from network and client resources grades.