CustomTest
The ‘CustomTest’ plugin for VBOX Test Suite allows the user to complete a wide range of tests to a set of conditions defined by the user. Once a test has been defined, the software will automatically produce results at any time these conditions are met. The results can then be compared, analysed and exported to a customised report.
Ribbon Bar
The Custom test has a unique 'Test Setup' ribbon bar, from which the test and test area can be configured.
Note: Ribbon bar icons may move/ resize dependent on the Software window size.
Test Setup
Configure
The 'Configure' button displays a pop up window whereby the parameters of the test can be defined.
Report
The 'Report' button creates a report from the current test results.
Maths Channel
Allows the user to create unique maths channels. For more information on maths channels, please see the ‘Maths Channels’ section.
Save Settings
The 'Save Settings' button will save this individual test setup and will appear in the ‘Saved Settings’ area of the ‘Add Test’ window.
This test will also be added to the list of Custom tests under the 'CustomTest' icon on the 'Home' tab for easy switching of the current test.
Export (Ctrl+E)
The 'Export' button displays a drop down menu which allows the user to export either the selected results or line results to either a .csv or .txt file. It is also possible to export the data to a .vbo file for later analysis without the need to take the file from the VBOX's compact flash card. This can also be accessed by using the keyboard shortcut 'Ctrl+E'.
Export/Import
Allows the user to either export the created gate(s) as a .spl file for reusing at a later date or using with another VBOX product, or import a previously saved or provided .spl gates file. When imported, gates will be added in the order in which they were saved within the .spl file.
Data Column
Add
The 'Add' button adds a column to the test results area. Selecting this button will bring up a drop down window where the user can select a channel to display in the test results window.
Sort Ascending/Sort Descending
The Sort Ascending and Sort Descending buttons will sort the values based on the currently selected column in the results area.
Run
Select All (Ctrl+A)
The 'Select All' button allows the user to tick every run in the results area at once. This can also be accessed by using the keyboard shortcut 'Ctrl+A'.
Deselect All (Ctrl+E)
The 'Deselect All' button allows the user to de select every run in the results area at once. This can also be accessed by using the keyboard shortcut 'Ctrl+E'.
Edit Data
The 'Edit Data' button allows the user to enter session specific data such as driver name, track facility and weather data.
Help (F1)
Pressing this 'Help' button will automatically open an internet browsing window and load the relevant section of the Racelogic Support Centre. This page will only be displayed if there is a valid internet connection. If there is no valid internet connection, a cached version of the relevant section (from the last software update) will be presented in PDF form. This can also be accessed by using the keyboard shortcut 'F1'.
Test Configuration
Selecting the 'Configure' button will display a pop up window where the user can define the parameters of the test. These include the start and end conditions, as well as the pass conditions and line conditions.
Use the up and down buttons to the right of the parameters to Expand and Collapse the parameter headings.
Start Conditions(s)
The start conditions denote the circumstances that the test will start.
By using the drop down list, it is possible to select any logged channel as well as the ability to start the test when a gate is crossed, a trigger is activated/deactivated or immediately. If a channel has been selected, the user can then define the positive or negative value at which the test should start.
Note: If a trigger is used as the start condition, the test will not restart if the trigger is activated within 1 second of the previous trigger activation.
By pressing the ‘+’ button, it is possible to define an ‘AND’ condition, for example 'Start when Speed is 40 km/h AND Speed is decreasing'. Pressing the ‘x’ button will remove that condition.
As well as the ‘AND’ condition’ it is also possible to add an ‘OR’ condition. Pressing the ‘Add’ button will add a new box that allows the user to define another set of criteria at which the test can also start.
End Conditions(s)
The End conditions denote the criteria at which the test will end.
By using the drop down list, it is possible to select any logged channel as well as the ability to end the test at the end of the session, when a gate is crossed, a trigger is activated/deactivated, after a set time or after a set distance. If a channel has been selected, the user can then define the positive or negative value at which the test should start.
Similar to the start conditions, it is possible to set ‘AND’ and ‘OR’ conditions for when the test will end.
Note: An ‘AND’ condition cannot be used if 'End of session' is selected.
Pass Conditions(s)
VBOX Test Suite allows the user to specify a channel that can be used to easily identify if certain parameters have exceeded a set threshold, and as such will highlight the run red to mark it as ‘Failed’. The pass conditions can be set so that the run fails whenever the threshold is exceeded, either at the start of the test, at the end of the test, anytime during the test or averaged during the test.
To do this, the user must select a channel from the drop down list and specify a low and high threshold value. More channels can be added by selecting the ‘+’ button.
Interim result(s)
The software allows the user to display intermediary results called ‘Interim results’. The Interim results are determined by adding in ‘Interim Conditions’. Pressing the '+' button will add a new interim result. It is possible to have this line appear at ‘Every’ instance of the value (e.g. Every 10 km/h), ‘At’ an instance of a value (e.g. Only at 10 km/h) or 'Between' values (e.g. Between 30 km/h and 50 km/h). When 'Columns' is selected, each interim result is shown as a column within the right hand side of the results table, if 'Separate Table' is selected, each interim result is shown as a row in a separate table next to the results table. |
Frequency Distribution
Test results can now be further analysed by using the Frequency Distribution option to see distance or time spent within a channel value range, or how often the channel was within a value range. Use the drop down list to set the desired condition, available options include Total time spent, Total distance travelled, Count of samples, Count at time intervals, and Count at distance intervals.
Select a channel from the drop down list and specify an interval. You can also add an offset to that value and specify whether this is an absolute value or not. More channels can be added by selecting the ‘+’ button.
Each channel selected will then be added as a separate table next to the test results table. The distribution can be toggled by count or by percentage using the options on the table header or by using the Frequency Distribution buttons within the Test Setup ribbon bar.
This is particularly useful for applications such as economy testing where the frequency of time spent at certain speeds has a direct impact on the test outcomes.
Wheel Slip Calculation
The test can automatically calibrate wheels speeds before producing a % wheel slip channel. To achieve this, the user must first select the wheel speed source from a list of CAN Channels. The user can then add extra wheel speed channels by selecting the ‘+’ icon. |
Advanced
The advanced area allows the user to control when a test will ‘reset’.
By default, the test will reset every time one or more of the start conditions are met. However unticking the ‘Reset when Start Condition is met’ will mean that the test will start when the start conditions are first met, and continue until the end condition is met.
It is also possible to choose whether an added ‘Time Since Run’ gauge on the dashboard is measured from the 'Last completed run' (default) or the 'Last started or completed run' (covering situations where a test has been started but then aborted) by selecting the desired option.
When the ‘Expect Continuous Brake Trigger’ option is ticked (only available when Trigger is selected as a condition), the test will only run when a trigger is active and remains active. If the trigger is released during the test, the test will reset.
Completing a Test
To start an online test, the user must first select the correct COM port from the ‘Online’ drop down menu in home tab. Once connected to a VBOX, the dashboard will change to show the 'START', 'STOP' and 'RESET' buttons.
Starting, Stopping and Resetting a Test
By pressing the 'START' button, the software will add a tab to the Test Results area ready to be populated with results once the start and end criteria have been met. The 'START' button will also change to a 'PAUSE' button, allowing the user to pause the test. To resume the test, simply press the 'RESUME' button.
To finish a test, simply press the 'STOP' button. This will stop all open tests. Once the stop button has be pressed, future results cannot be added to that results tab. Pressing the 'START' button will open up a new results tab, however once the stop button has been pressed, the user will be required to calibrate the wheel speeds again (if wheel speed channel(s) are selected) before a new test can be started.
If, for any reason, a mistake has been made during the test, it is possible to restart the test by pressing the 'RESET' button and again this will require a calibration of the wheel speeds.
Calibrating the Wheel Speeds
To allow for different wheel diameters to be easily and consistently used in the test, the software has an auto calibrate function that automatically applies a scaling factor to the CAN Wheel Speeds to match the GPS Speed. This process is only required when a wheel speed channel(s) has been specified in the 'Test Configuration' menu.
When the user first presses the 'START' button, a dialogue window will appear that contains the calibration instructions.
To successfully calibrate the wheel speeds, the user must drive at constant speed of 20 km/h (+/- 2 km/h) for 5 seconds, ensuring not to rapidly accelerate, decelerate or any other manoeuvre that may induce wheel slip. Once this period has been completed, the software will display a ‘Calibrated’ message and the test is able to be started.
Once calibrated, the user will be able to show and analyse both a calibrated wheel speed and a Wheel Slip %.
IMPORTANT - The calibration period is also required when in ‘Offline’ mode, so it is extremely important that the unit is logging before the calibration procedure is carried out, otherwise the software will not produce any test results.
Test Results Area
The test results area is the area that displays all of the results from the current test. Within this area it is possible to include/exclude results from the chart area, display the average/max/min values and also easily identify any runs which have not met the pass criteria.
Every time a new test is started (via the 'START' button on the dashboard), or a new file is loaded, a new tab will be added to the test results area, allowing the user to switch between separate tests or files and compare runs from each. A session can be removed from the results area by pressing the ‘x’ icon on the tab.
Rename file
It is possible to rename the session tab by double clicking on the tab header. Changing the session tab within the software will automatically change the name of the locally saved .vbo file.
Session Data
By pressing the 'Edit Data' button next to the name of the file/run or in the ‘Test Setup' ribbon bar, a new window will be displayed whereby the user can add various different pieces of vehicle and test information, such as:
- Test
- Test Date
- Time Zone
- Test Track
- Test Facility
- Comments
- Vehicle
- Vehicle Model
- Vehicle Number
- Driver Name
- Conditions
- Weather
- Temperature
- Wind Speed
When in 'Offline' mode, this information will be saved into the .vbo file meaning that this information will be recalled every time the file is loaded into VBOX Test Suite.
When in 'Online' mode, a newly-created session will be populated with session data from the previous session.
This information will be included in the test report to allow the user to understand under what conditions the test was conducted.
Note: This data is purely optional and has no effect on the test or test result.
To save time, it is possible for the user to import and export the session information for use in other sessions.
Once the session information has been completed, it is possible to export the data to a .vbses file. This file will contain all the session information that can then be imported into the open session information field.
Result Columns
Along the top of the Test results area are some default columns. These columns are:-
- Run – Indicates which run number the results relate to, with run one being the first run completed. There is also a selection box that, when ticked, includes that run in the graph and into the Average/Max/Min/Standard Deviation calculations. Once selected, a coloured square will appear to indicate which colour this run is displayed as on the graph.
Note: If you are loading a file offline, all valid runs are ticked automatically. - Time – The total time the run has taken.
- Distance – The total distance travelled in that run.
Adding a Column
It is possible to add columns to the test results area by selecting the ‘Add’ button on the ‘Test Setup' tab in the ribbon bar. Selecting this button will display a drop down list of all available channels which the user can select to display as a results column. By default, this value is displayed as an ‘At End’ value, whereby the column will display the value of that parameter at the end of the run.
It is also possible to right click anywhere in the test results area and select the ‘Add’ option from the dropdown menu.
To remove a column, simply select the ‘x’ icon that appears when you hover over the column title. If a column has been removed, it can be added again by selecting the ‘Add’ button and choosing the desired channel.
Editing a Column
As default, a column is added as an ‘At End’ condition. It is possible to change this by selecting the column title you wish to edit (once selected, the column will be highlighted in yellow) and changing the condition in the ‘data column’ area in the ‘Test Setup’ tab of the ribbon bar.
It is possible to choose the following conditions for the main results:-
- Avg – The mean average of the parameter during the run.
- Max – The maximum value of the parameter during the run.
- Min – The minimum value of the parameter during the run.
- Delta – The difference between the start and end value of the parameter.
- Std Dev – The standard deviation of the parameter during the run.
- At Start – The value of the parameter at the start of the run.
- At End – The value of the parameter at the end of the run.
- Gate (if a gate has been added) – The value of the parameter at the crossing of the specified gate line (e.g. Start/Finish).
It is also possible to change the displayed parameter, by using the other drop down menu on the ribbon tab and selecting the desired parameter.
Sorting the Results
It is possible to either sort the result in either ascending or descending order. To do this, first select the desired column and then click either the ‘Sort Ascending’ or ‘Sort Descending’ buttons from the ribbon bar. This action can also be performed by right clicking in the test results area.
Filters
It is possible to filter results by right clicking on a value within the cell results table (e.g. Time (s)). You can then choose to include only results with a value equal to the selected value or that have a value that is <= than or >= than the selected value for that channel. Multiple channels can be filtered, a notification bar above the results shows which filters are applied. To remove the filters, click on the 'x' within this bar.
Copying Cells (Ctrl+C), Rows or Columns
Individual results cells can be copied so that they can be pasted into another piece of software. To copy a cell, select the required cell, right click and then select ‘Copy’ or use the keyboard shortcut 'Ctrl+C'. To select multiple cells, either left click with the mouse and drag or hold down the 'Ctrl' when selecting. To select all cells between 2 cells, hold down the 'Shift' key when selecting.
It is also possible to copy an individual row, column or the entire results table. This is achieved by right clicking the required row or column and selecting ‘Copy Row’, ‘Copy column’ or ‘Copy all’.
Renaming a Column (F2)
To rename a column, you can either Double Click on the column title, right click the required column and select ‘Rename Column’ or use the keyboard shortcut 'F2' whilst the column is highlighted. Renamed columns will be included within an exported file and a generated report.
Export
Right clicking anywhere in the test results area and selecting the ‘Export’ option from the dropdown menu will replicate the function of 'Export' within the Ribbon Bar.
Average/Max/Min/Standard Deviation Values
It is possible for the software to automatically calculate the Average/Max/Min/Standard Deviation values of all relevant runs by ticking the selection box next to the relevant run number.
Once more than one result has been selected, the average, maximum and minimum values will be displayed, and once more than two results have been selected, the standard deviation of the selected runs will be also be displayed.
Selecting the tick box next to the ‘Avg’ line will add a moving average ‘best fit’ curve to all of the selected runs.
Interim Results
Columns
When Interim result(s) have been specified in the Test Configuration as 'Columns', each interim result is shown as a column within the right hand side of the results table in the order it has been specified. If multiple 'At' or 'Between' conditions are met within a run, only the first result will be displayed.
To change the channel used for an interim result(s), select the result and click on the existing channel used within the ‘Test Setup' tab in the ribbon bar or right click on the result and and selecting the existing channel from the dropdown menu. Selecting this will display a list of all available channels.
It is also possible to add columns to the interim result(s) by selecting the result and clicking on the ‘Add’ button on the ‘Test Setup' tab in the ribbon bar or by right clicking on the result and and selecting the ‘Add’ option from the dropdown menu. Selecting this will display a list of all available channels which the user can select to display as a results column associated to that particular interim result.
To remove a column, simply select the ‘x’ icon that appears when you hover over the column title.
Note: If a channel has been changed or extra columns have been added to the interim result(s) and the Test Configuration is then Saved, the changed or extra columns will be applied to all interim results when that file is then reloaded back in to the software, not just the results specified.
Separate Table
When Interim result(s) have been specified in the Test Configuration as a 'Separate Table', a new window will appear in the results area that will display the interim results from a selected run. If multiple runs are selected, this window will display the interim results from the last selected run. As well as displaying interim results, the start conditions are also shown.
The standard columns in the Interim Results window are:-
- Description – This will explain why this line result was reported.
- Speed – The speed at the time the line condition was met.
- Distance – The distance travelled from the start until the line condition was met.
- Time – The total time from the start of the test run until the line condition was met.
- Distance (Delta) – The distance difference between the line result and the previous line result.
- Time (Delta) – The time difference between the line result and the previous line result.
- Speed (Delta) – The speed difference between the line result and the previous line result.
Columns can be added, edited and sorted in the same way as the results window can be, however the Line results have slightly different reporting conditions. These are:-
- Avg – The mean average of the parameter during the run.
- Max – The maximum value of the parameter during the run.
- Min – The minimum value of the parameter during the run.
- Delta – The difference between the start and end value of the parameter.
- At Line – The value of the parameter when the line condition was met.
Dashboard
Along with the usual dashboard functionality, the test has some extra options which can be displayed to the user.
By selecting the 'Add Gauge' button from the dashboard tab, a drop down menu will appear whereby the user can select 'Test' and then the desired parameter to be displayed. On selection, a gauge will be automatically added to the dashboard. Any gauges displaying a result of a test, such as an average or maximum value, will have a 'Result' icon to the left of the gauge name to indicate that it is either a result of the previous run if viewing live data, or the currently selected run if viewing a saved file.
All Result Column parameters are also available as a gauge.
Showing Test Results on the Dashboard
It is possible to display the time and distance test results from the last run completed as a gauge on the dashboard.
It is also possible to show the current run number on the dashboard to give an easy, clear indication of the amount of runs completed. An 'OK Runs' gauge can be added to indicate how many runs have met any specified pass conditions.
Run Status
A 'Run Status' gauge is available for use when conducting live testing to show the status of the last completed run with regards to the Pass Conditions. It will display as a green 'PASS' when the last run has met all Pass Conditions and a red 'FAIL' when any of the Pass Conditions limits have been exceeded.
Distance/Time Since Run
The user can also add gauges to the dashboard that show a live value of either time or distance since the completion of the last run.