Search

KR-20260064210-A - Integrated Scenario-based Simulation Evaluation System and Method

KR20260064210AKR 20260064210 AKR20260064210 AKR 20260064210AKR-20260064210-A

Abstract

The purpose of the present invention is to provide a system and method capable of simultaneously evaluating the driving performance of a human driver and an autonomous driving system in the same scenario by integrating Driver-In-the-Loop (DIL) and Vehicle-In-the-Loop (VIL) techniques. To this end, the invention comprises: an evaluation scenario generation device that generates and provides an evaluation scenario; and a simulation device that receives the evaluation scenario and includes a Vehicle-In-The-Loop Simulation (VILS) platform and a Driver-In-The-Loop Simulation (DILS) platform, wherein the VILS platform generates a VILS scenario from the evaluation scenario and provides it to a target vehicle, and receives VILS driving information corresponding to the VILS scenario from the target vehicle, and the DILS platform generates a DILS scenario from the evaluation scenario and provides it to the target vehicle, and receives DILS driving information corresponding to the DILS scenario from the target vehicle, and provides a simulation result including the VILS driving information and the DILS driving information to an integrated evaluation cloud server. The integrated scenario-based simulation evaluation system includes an integrated evaluation cloud server that provides control commands through a human driver to the simulation device, receives simulation results from the simulation device, and compares, verifies, and stores the driving performance of the target vehicle according to the VILS scenario and the driving performance of the target vehicle according to the DILS scenario.

Inventors

  • 황영서
  • 손대호
  • 최봉석
  • 김봉섭
  • 윤윤기
  • 윤경수

Assignees

  • 재단법인 지능형자동차부품진흥원

Dates

Publication Date
20260507
Application Date
20241031

Claims (8)

  1. Evaluation scenario generation device that generates and provides evaluation scenarios; A simulation device that receives the above evaluation scenario and includes a VILS (Vehicle-In-The-Loop-Simulation) platform and a DILS (Driver-In-The-Loop-Simulation) platform, wherein the VILS platform generates a VILS scenario from the above evaluation scenario and provides it to a target vehicle, and receives VILS driving information corresponding to the VILS scenario from the target vehicle, and the DILS platform generates a DILS scenario from the above evaluation scenario and provides it to the target vehicle, and receives DILS driving information corresponding to the DILS scenario from the target vehicle, and provides a simulation result including the VILS driving information and the DILS driving information to an integrated evaluation cloud server; and An integrated evaluation cloud server that provides control commands through a human driver to the simulation device, receives the simulation results from the simulation device, and compares, verifies, and stores the driving performance of the target vehicle according to the VILS scenario and the driving performance of the target vehicle according to the DILS scenario; An integrated scenario-based simulation evaluation system including
  2. In paragraph 1, An integrated scenario-based simulation evaluation system characterized by the above VILS scenario being a driving simulation for autonomous driving of the target vehicle, wherein virtual driving vehicle control is performed according to the evaluation scenario to provide a virtual driving environment, and the autonomous driving algorithm controls the target vehicle according to the virtual driving environment.
  3. In paragraph 1, An integrated scenario-based simulation evaluation system characterized by the above DILS scenario being a driving simulation for driving a target vehicle controlled by a human driver, wherein virtual driving vehicle control is performed according to the evaluation scenario to provide a virtual driving environment, thereby enabling the human driver to control the target vehicle according to the virtual driving environment.
  4. In paragraph 1, In addition to the above VILS/DILS combined scenario, The above VILS/DILS combined scenario is a driving simulation designed to provide a virtual driving environment closer to actual conditions than the above evaluation scenario, and An integrated scenario-based simulation evaluation system characterized by providing a complex virtual driving environment in which the target vehicle is controlled by an autonomous driving algorithm, and a virtual driving vehicle that affects the driving of the target vehicle is controlled by the human driver.
  5. A step of generating an evaluation scenario in an evaluation scenario generation device; A step of receiving the above evaluation scenario in a simulation device; A step of generating a VILS scenario from the evaluation scenario in the VILS (Vehicle-In-The-Loop-Simulation) platform of the simulation device, and generating a DILS scenario from the evaluation scenario in the DILS (Driver-In-The-Loop-Simulation) platform of the simulation device; A step in which a target vehicle performs vehicle operation according to the above VILS (Vehicle-In-The-Loop-Simulation) scenario, and the same or a different target vehicle performs vehicle operation according to the above DILS (Driver-In-The-Loop-Simulation) scenario; The above VILS platform receives VILS driving information generated by a target vehicle that has performed driving according to the VILS scenario, and the above DILS platform receives DILS driving information generated by a target vehicle that has performed driving according to the DILS scenario; The step of the simulation device transmitting a simulation result including the VILS driving information and the DILS driving information to an integrated evaluation cloud server; and The integrated evaluation cloud server uses the received simulation results to compare, verify, and store the driving performance of the target vehicle according to the VILS scenario and the driving performance of the target vehicle according to the DILS scenario; An integrated scenario-based simulation evaluation method including
  6. In paragraph 5, An integrated scenario-based simulation evaluation method characterized by the above VILS scenario being a driving simulation for autonomous driving of the target vehicle, wherein virtual driving vehicle control is performed according to the evaluation scenario to provide a virtual driving environment, and the autonomous driving algorithm controls the target vehicle according to the virtual driving environment.
  7. In paragraph 5, An integrated scenario-based simulation evaluation method characterized by the above DILS scenario being a driving simulation for driving a target vehicle controlled by a human driver, wherein virtual driving vehicle control is performed according to the evaluation scenario to provide a virtual driving environment, and the human driver is configured to control the target vehicle according to the virtual driving environment.
  8. In paragraph 5, A step of generating a VILS/DILS composite scenario that provides a composite virtual driving environment in which the target vehicle is controlled by an autonomous driving algorithm and a virtual driving vehicle affecting the driving of the target vehicle is controlled by the human driver; and An integrated scenario-based simulation evaluation method characterized by further including the step of the integrated evaluation cloud server verifying, evaluating, and storing the driving performance of a target vehicle according to the VILS/DILS composite scenario.

Description

Integrated Scenario-based Simulation Evaluation System and Method The present invention relates to an integrated scenario-based simulation evaluation system and method, and more specifically, to an integrated scenario-based simulation evaluation system and method capable of simultaneously evaluating the driving performance of a human driver and an autonomous driving system in the same scenario by integrating Driver-In-the-Loop (DIL) and Vehicle-In-the-Loop (VIL) techniques. Simulation-based autonomous vehicle evaluation methods include procedures for systematically verifying the performance and safety of autonomous driving systems in a virtual environment. These methods evaluate the response capabilities of autonomous driving algorithms by reproducing various situations that may occur on actual roads. Representative methods include the Vehicle-In-the-Loop (VIL) platform and the Driver-In-the-Loop (DIL) platform. The VIL (Vehicle-In-the-Loop) platform uses actual vehicles to drive on a test track, but replaces the sensors mounted on the vehicle with virtual sensors in a simulation. This allows the test vehicle to perceive and judge situations based on scenarios within the simulation rather than recognizing objects or events in the real environment, thereby providing an environment to evaluate situations that may occur on actual roads. The DIL (Driver-In-the-Loop) platform is a platform where a human driver directly operates vehicle control devices (steering, acceleration/deceleration pedals, etc.) to control a virtual vehicle within a simulation connected to those devices. It provides an environment where the human driver can evaluate situations based on vehicle and road conditions by reacting to virtual driving simulations provided according to various evaluation scenarios executed within the simulation. However, the aforementioned platforms have limitations in directly comparing and evaluating the driving characteristics of autonomous vehicles and human drivers, as existing autonomous vehicle evaluation methods rely primarily on evaluating autonomous driving systems through predefined scenarios in virtual simulation environments, and fail to sufficiently reflect the complex judgment and reaction patterns of human drivers in actual driving environments. In addition, current simulations often control target vehicles based on algorithms, which limits the ability to implement natural vehicle movements similar to real-world situations. FIG. 1 is a diagram illustrating an integrated scenario-based simulation evaluation system as an embodiment of the present invention. FIG. 2 is a diagram illustrating the operation of a VILS platform as an embodiment of the present invention. FIG. 3 is a diagram illustrating the operation of a DILS platform as an embodiment of the present invention. FIG. 4 is a diagram illustrating the combined operation of a VILS platform and a DILS platform as an embodiment of the present invention. FIG. 5 is a diagram illustrating the configuration of a VILS platform as an embodiment of the present invention. FIG. 6 is a diagram illustrating the configuration of a DILS platform as an embodiment of the present invention. FIG. 7 is a diagram illustrating the configuration of an integrated cloud server as an embodiment of the present invention. FIGS. 8 and 9 are drawings illustrating an integrated scenario-based simulation evaluation method as an embodiment of the present invention. The advantages and features of the present invention and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below but will be implemented in various different forms. The embodiments described in this specification are provided to ensure that the disclosure of the invention is complete and to fully inform those skilled in the art of the scope of the invention. And the present invention is defined only by the scope of the claims. Accordingly, in some embodiments, well-known components, well-known operations, and well-known techniques are not specifically described to avoid the invention being interpreted ambiguously. Additionally, throughout the specification, the same reference numerals refer to the same components, and the terms used (mentioned) in this specification are for describing embodiments and are not intended to limit the invention. In this specification, the singular form includes the plural form unless specifically stated otherwise in the text, and components and operations referred to as 'comprising (or comprising)' do not exclude the presence or addition of one or more other components and operations. Unless otherwise defined, all terms used in this specification (including technical and scientific terms) may be used in a meaning that is commonly understood by those skilled in the art to which the present invention belongs. Furthermore,