Intelligent vehicles: integration and issues Z. Alsayed, G. Bresson, P. Merdrignac, P. Morignot, F. Nashashibi, E. Pollard, G. Trehard
IMARA Informatique, Mathématiques, Automatique, pour la Route Automatisée
became
RITS Robotics & Intelligent Transportation Systems
Praxitèle
Imara
Rits
1990
2002
2014
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
-2
Robotics vs. Artificial Intelligence (AI) Robotics: science of perceiving and manipulating the physical world through computer-controlled mechanical devices
AI: any computer program which would be said "intelligent" if the same observed behavior would be so qualified when performed by a human.
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
3
Robotics • “ Robotics is the science of perceiving and manipulating the physical world through computer-controlled mechanical devices.” [S. Thrun, 2006]
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
4
An attempt to define an intelligent robot • Ultimate goal: ensure its survival in its environment • Ensure its energy independence • Diagnose its own state • Evaluate its perception abilities
• Achieve a mission • React properly to an unknown/abnormal situation • Learn from experience
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
5
Work in progress with intelligent cars • Ultimate goal: ensure its survival in its environment • Ensure its energy independence • Diagnose its own state • Evaluate its perception abilities
• Achieve a mission: move safely from a point A to B • React properly to an unknown/abnormal situation • Learn from experience
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
6
Inputs
Automation loop Process
Sensors Exteroceptive
Knowledge base
Camera LIDAR RADAR
Perception
Odometry Inertial GPS
Communications
Supervision
Proprioceptive
Planning Global Planning (Route Planning)
Local Planning (Trajectory Planning + Trajectory Coordination)
Outputs
HMI Actuators Steering/Direction
Control (Trajectory Execution)
Speed/Propulsion
How to introduce intelligence (human behavior) into the driving process? Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
7
How do we introduce intelligence into the driving process? 1. Supervision through Software Architectures: a unified framework 2. Dealing with uncertainty 3. Increase the perception using communication 4. Limit the combination explosion
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
8
Supervision through software architectures: a unified framework
Inputs
• reaching a full autonomous driving mode in all situations impossible • self-assessment for the vehicle of its own perception abilities Process
Sensors Exteroceptive
Know. base
Camera LIDAR RADAR
Odometry Inertial GPS
Outputs
Communications
Supervision
Perception Proprioceptive
Planning Global Planning
Local Planning
HMI Actuators Steering/Direction
Control
Speed/Propulsion
E. Pollard et al., An Ontology-based Model to Determine the Automation Level of an Automated Vehicle for Co-Driving Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
9
E. Pollard, An Ontology-based Model to Determine the Automation Level of an Automated Vehicle for Co-Driving
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
10
Longitudinal control layer Levels of automation in terms of decisions to make about…
0: fully driving
P1
Long1: Cruise
Longitudinal control
control
Long2: Dynamic Set Speed Type
P2
Long3: Autonomous CC
P3
Long4: Stop&Go
CLong: Cooperative cruise control communication
C1
Increasing needs in terms of perception and communication Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
11
Dealing with uncertainty
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
12
Dealing with uncertainty
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
13
Supervision: dealing with real time Supervision
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
14
Multi-sensor fusion: • To combine properly data from multiple sensors • Deal with the problem of track spatial and temporal correlation
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
[H. Li, et al, 2013] Track-to-Track Fusion Using Split Covariance Intersection Filter-Information Matrix Filter (SCIF-IMF) for Vehicle Surrounding Environment Perception Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
16
Perception with Transferable Belief Model
[Trehard 2014] Credibilist simultaneous localization and mapping (C-SLAM) with a lidar Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
17
Dealing with uncertainty and building generic architectures SLAM
Low level High Level
Landmark queue Drift handling
Drift estimation Absolute information (GPS, V2I…)
Loop EKF SLAM [Bresson 2013] , A General Consistent Decentralized SLAM Solution
Information from another vehicle (V2V)
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
18
Increasing perception using communications Decorrelated maps Send
v b1 l1
Decentralized map
1
Pv Pb
vu1
Pl
b1
Receive
v
2
Pv
b1 l1
lu1 vu2
Pb
Pl
b2
Pvu1
Pb1 Pb 1
Pau1 Plu1 Pvu2 Pvu2 Pb2 Pb2
vu3
Receive
v b1
3
Pv
Pvu3 Pvu3
Pb 3
b3
Pb
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
19
Limit the combinatorial explosion: SLAM stretching compacted grid map:
• Dedicated to “open” areas • Load in memory only the local neighborhood map slots, since the rest of the map is saved on the hard disc • a coding technique to compact and save the old or non-used far slots
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
20
SLAM stretching compacted grid map
Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
30/06/2014
21
Conclusion • The main issues related to autonomous vehicles can be summarized like this: • •
• •
Deal with integration problems Using redundancy and complementary information to achieve very precise state estimation Using the fact that a vehicle should know that it does not know Imitate human behavior for decision process
More experiment results on: https://team.inria.fr/rits/ Thank you for your attention! Intelligent vehicles: integration and issues – Equipe-projet RITS – E. Pollard
Turing test (see Introduction section) on the long term. Unfortunately, A.I. is often only considered as a library of algorithms, in which Robotics researchers dig as ...
Graphical Environments : X/Motif, basics of ILOG VIEWS .... Consultant in optimization. Scheduling the test campaign of L'OREAL products (ILOG SCHEDULER).
which includes the available sensori-motor control loops of the robotic agent. ... has been proposed for intelligent transportation systems, such as automated cars in ... for later computing the detailed voltage to give to electrical effectors (e.g.
Feb 8, 2012 - Constraint Satisfaction Problems (CSPs). ⢠UML / OCL. ⢠Principles for using ... Cost f: Constraint Satisfaction and Optimization Problem (CSOP).
people (end users and care takers) very intuitively in a domestic setting. Keywords. .... impairments, such as those in an early stage of the Alzheimer's disease. ... another partner in the project, the robot is able to plan his path through the hous
Mar 28, 2011 - with an A.I. task planner, to represent these scenarios in a high level language and to ... there are many scenarios which would have to be manually written in real ..... 01/08/2008-03/08/2008, Munich, Germany. [21] V. Vidal, H.
operations, vehicle subsystems, and the MMS of other UCAV. .... Download ..... enough fuel to finish the mission are checked. It ...... cdc03/cdc03b_ros_rmm.pdf ...
Jul 8, 2013 - Constraint programming is one paradigm for ... The variables involved in constraint C k. ⢠R ..... optimization to compute; And (ii) the optimum.
its name (âCarâ class), an internal class (âDriverEmotionâ) and its possible motion (âMotionâ class, with sub-classes ..... http://code.google.com/p/swoop/.
reified constraints without any extension; 3) it opens up constraint propa- ... global store, and specify optimization procedures such as Branch-and-Bound. In.
Apr 29, 2016 - April 29, 2016. Seminar VEH08, VEDECOM. 4 f. 1 f. 2 ⦠f n g. 1 g. 2 ⦠g l. State. Goals ? ⦠... Universal quantifications? ⢠Qualification problem .... Using (forward) search in a plan space (A. Barrett). ⢠Using evolutionnar
follow a path of timed waypoints provided by a C2 interface. ..... RAM on a virtual machine. .... ity in CP is the CSP solver CHOCO (Prud'homme, Fages,.
Jun 26, 2018 - constraint optimization problem. ⢠Search for a path (timed waypoints in a topological map) for multiple coordinated agents, while optimizing a ...
Oct 25, 2013 - Example: for the sudoku game, a coarse evaluation of the number of combinations is (8!) ..... http://afpc.greyc.fr/web/. P. Morignot - Softshake'13.
Example (1/3). ⢠Sudoku: P. Morignot - Softshake'14. 4 ... Example: for the sudoku game, a coarse evaluation of the number of ..... http://afpc.greyc.fr/web/.
Feb 18, 2015 - February 18, 2015. Planning Domain Definition Language: problem. LifeWare ... (:goal (and. (ON L C) (ON C P) (ON P Q) (ON Q M) (ON M B).
function, tests are conducted on a single Sun Blade. 1500 computer. ... 100. Time (s). E fficien cy no attack. 1 target. 2 targets. 3 targets. 4 targets. Fig. 7.
results with both synthetic data and real data prove the high accuracy, low .... stereojvision based obstacle detection[5] is used to remove .... time is unavoidable by using deadjreckoning, all the ... environments are campus, urban roads, and highw
Wireless communications are realized by the terminologies ZigBee and GPRS: ZigBee is used for the wireless communication between vehicles (V2V), and the.
l'utilisation des communications, ainsi que la gestion des ressources. Mots Clef .... ware architecture as a structure to organize the various al- gorithms inside a ...
l'utilisation des communications, ainsi que la gestion des ressources. Mots Clef .... ware architecture as a structure to organize the various al- gorithms inside a ...
