The increasing levels of software- and data-intensive driving automation call for an evolution of automotive soft-ware testing. As a recommended practice of the Verification and Validation (V&V) process of ISO/PAS 21448, a candidate standard for safety of the intended functionality for road vehicles, simulation-based testing has the potential to reduce both risks and costs. There is a growing body of research on devising test automation techniques using simulators for Advanced Driver-Assistance Systems (ADAS). However, how similar are the results if the same test scenarios are executed in different simulators? We conduct a replication study of applying a Search-Based Software Testing (SBST) solution to a real-world ADAS (PeVi, a pedes-trian vision detection system) using two different commercial simulators, namely, TASS/Siemens PreScan and ESI Pro-SiVIC. Based on a minimalistic scene, we compare critical test scenarios generated using our SBST solution in these two simulators. We show that SBST can be used to effectively generate critical test scenarios in both simulators, and the test results obtained from the two simulators can reveal several weaknesses of the ADAS under test. However, executing the same test scenarios in the two simulators leads to notable differences in the details of the test outputs, in particular, related to (1) safety violations revealed by tests, and (2) dynamics of cars and pedestrians. Based on our findings, we recommend future V&V plans to include multiple simulators to support robust simulation-based testing and to base test objectives on measures that are less dependant on the internals of the simulators.

Training Aganda培训日程

Day 1

•Introduction to PreScan

更多

PreScan软件介绍

•PreScanBasics

PreScan基础

•Experiment Building

实验场景建模

Day 2

•Sensors

传感器建模

•Miscellaneous Features

其他功能模块

•Active safety & ADAS Applications

主动安全系统&ADAS系统应用

收起

CarMaker can be interfaced with Matlab on the level of which inputs to the vehicle (driver inputs) and the vehicle outputs (vehicle dynamics data) can be made available. This interface can be used for a co-simulation with PreScan exploiting the potential of a dedicated vehicle dynamics tool when simulating ADA systems.

更多

An S-function is provided by IPG and is responsible for establishing the communication between CarMaker and Matlab.

IPG claimed that this S-function can be used to transfer the vehicle motion data to PreScan and was therefore the main point of interest during the testing activities (IPG had been provided with the compilation sheet of the Demo_PreScanCarSim2D, to which the S-function had been adapted).

收起

所有PreScan actor均可使用CarSim车辆动力学运行。在此演示中，以PreScan演员Audi A8为例

所有PreScan actor均可使用CarSim车辆动力学运行。在此演示中，以PreScan演员Audi A8为例