An autonomous race car must understand its surroundings in milliseconds while moving at very high speed. Its perception system turns raw sensor data into useful information about track edges, other cars, barriers, cones, and debris. This matters because racing decisions depend on knowing where the car can safely drive and how quickly the scene is changing.
A small delay or wrong detection can lead to a missed braking point or a collision.
Key Facts
- Sensor fusion combines camera, lidar, radar, GPS, and IMU data to improve reliability.
- Range from time of flight is d = vt/2, where v is signal speed and t is round trip time.
- Relative speed from radar Doppler shift can be estimated using v = Δfλ/2 for a reflected wave.
- Stopping distance is approximately d = v^2/(2a) when braking with constant deceleration a.
- Perception latency matters because distance traveled during delay is d = vt.
- Object tracking often predicts motion with x_next = x_current + vt for short time steps.
Vocabulary
- Perception system
- A set of sensors and algorithms that detect, locate, and classify important features around the car.
- Sensor fusion
- The process of combining measurements from multiple sensors to create a more accurate view of the environment.
- Lidar
- A sensor that measures distance by timing how long laser pulses take to reflect back from objects.
- Detection box
- A labeled region in sensor or camera data that marks the estimated location of an object such as a car or obstacle.
- Latency
- The time delay between sensing the environment and using that information to make a driving decision.
Common Mistakes to Avoid
- Treating camera images as enough by themselves, which is wrong because lighting, glare, and motion blur can hide track edges or obstacles.
- Ignoring sensor latency, which is wrong because a race car may travel several meters before the perception result is used.
- Confusing detection with tracking, which is wrong because detection finds an object in one frame while tracking estimates how it moves over time.
- Assuming every sensor sees all objects equally well, which is wrong because radar, lidar, and cameras have different strengths, weaknesses, ranges, and failure cases.
Practice Questions
- 1 A race car travels at 60 m/s and its perception pipeline has a latency of 0.08 s. How far does the car move before the processed sensor information is available?
- 2 A lidar pulse returns after 100 ns. Using the speed of light as 3.0 x 10^8 m/s, how far away is the reflecting object?
- 3 A camera can clearly see painted track edges, but heavy glare appears near a corner exit. Explain why adding lidar or radar data can make the perception system safer and more reliable.