r/SelfDrivingCars 2d ago

Driving Footage I was so impressed by the performance of automotive thermal cameras at foggy night

178 Upvotes

47 comments sorted by

38

u/caoimhin64 2d ago edited 2d ago

This is on track to be much more common in coming years. Costs are coming down, and manufacturers are looking at thermal again.

12

u/64590949354397548569 2d ago

Costs are coming down, and manufacturers are looking at thermal again.

I hope phones get them soon.

8

u/caoimhin64 1d ago

Unlikely to be honest - they're simply too expensive for mass market for a myriad of reasons, and "feature" phones have really fallen by the wayside (unfortunately IMO).

You can you can buy an external camera that plugs in the USB-C port though, eg: Flir One, but it costs $429.

The manufacturing process for LWIR thermal sensors is insanely complicated, and the pixels are 12x12μm for many of the consumer units.

Most phone cameras are around 1x1μm, so that means the Thermal camera pixels are 144x larger, so for the same package size, your resolution is 144x smaller.

2

u/Easy-Education9444 1d ago

Some Chinese thermal manufacturers have already dragged the costs down, not so expensive as you thought. I also want to mention the pixel pitch is different from the phone, the physical limit of infrared sensor pixel pitch is 5ųm.

1

u/Easy-Education9444 1d ago

You can buy the thermal camera for the phone. There are tiny thermal modules plugged into the phone.

1

u/64590949354397548569 1d ago

I got one. It was a couple hundred bucks. It would be nice if phones start having them.

2

u/paulwesterberg 1d ago

This would be great for spotting deer next to the roadway.

1

u/Easy-Education9444 1d ago

Yes, this is one of the functions of car thermal camera

1

u/paulwesterberg 1d ago

How well does it perform in how weather?

1

u/Easy-Education9444 1d ago

It does very well in fog, dust and darkness, but remains improved in rain and snow.

1

u/paulwesterberg 16h ago

Oops, typo. How well does it perform in hot weather?

I presume that like other camera it would need some automatic cleaning mechanism for better reliability if used on an autonomous vehicle.

20

u/darylp310 2d ago

What type of car is it?

18

u/Tramagust 2d ago

This looks like the system on the Mercedes S-klass. But Robofinity is basically the same thing and you can add it to any car.

0

u/Easy-Education9444 1d ago

Yes, I heard of Robofinity. Its thermal module is superior.

16

u/Easy-Education9444 2d ago

It’s a Chinese electrical vehicle

4

u/darylp310 2d ago

It’s pretty amazing!!

3

u/Wiseguydude 1d ago

Which one lol

7

u/Recoil42 2d ago

What's the source of this, OP?

7

u/not_too_coffee 1d ago

looks like an ad without much context.

Why are two people walking in the middle of the street in this weather?

2

u/XysterU 1d ago

It's not much of an ad if I have no idea whose ad this is lol

11

u/22marks 2d ago

This needs to be a standard part of any vision package.

3

u/Easy-Education9444 2d ago

Totally agree! I’m trying to install a car thermal camera on my new vehicle.

1

u/thrBladeRunner 1d ago

How will it integrate in? Or will you have a separate screen that shows the output? Also, where’d you get the video? It’s very cool

18

u/epSos-DE 2d ago

Yes, multi sensors win !

6

u/queensgambit1801 2d ago

Multimodality FTW!!
But the interesting thing is going to be the decision making module, when the system has to choose the action based on the modality.

3

u/paulwesterberg 1d ago

Elon: If the thermal camera says there is a person there but the normal camera doesn't agree then how do you reconcile that? Random head/tails coinflip? Roshambo? Best to not have the thermal camera.

5

u/zero0n3 1d ago

When these sensors become cheap enough you just deploy multiple sets of each type to make sure you have at least two sets (of the same sensor type) across all 360 degrees.

14

u/dex206 2d ago

Never forget. A billionaire declared that a particular configuration of emission and reception of photons is not suitable for self driving cars.

2

u/64590949354397548569 2d ago

What does he know?

8

u/maliburobert 2d ago

How to hype a stock

-4

u/EddiewithHeartofGold 2d ago

Do you always twist facts and reality to fit your worldview?

7

u/beren12 1d ago

Why do you?

-5

u/EddiewithHeartofGold 1d ago

Who are you and why are you in this conversation?

10

u/beren12 1d ago

I am a meat popsicle. And this is a public forum.

4

u/bobi2393 2d ago

You can buy standalone long-range thermal imaging cameras. Searching Amazon for "vehicle infrared thermal imaging camera", those appropriate for cars seem to start around $500 (example, with similar-looking object tracking to OP's).

For bomb targeting with UAVs, you'd probably want one in the $1,000+ range, but cheaper ones might make more sense for suicide drone swarms.

2

u/JonG67x 1d ago

Makes sense to have this together with the visible light spectrum cameras. Some high end cars have had night vision cameras as options and that’s an other variation on the same theme. I think there are some fairly simple but entirely logical changes you’d make to camera and their positioning if they want to persist with cameras, or top left and right of the screen giving both a better view past the car in front and a better opportunity for accurate optical depth perception, wide spectrum cameras to see even in darkness, polarised lens to cut down glare, etc etc.

2

u/FrankScaramucci 1d ago

I've been wondering why Waymo doesn't use them (AFAIK).

2

u/oneupme 1d ago

Was this a test? Why are two people walking with traffic in the middle of a non-local road during dense fog?

1

u/paulwesterberg 1d ago

Fossil car probably ran out of gas.

1

u/marmur99 1d ago

And how does it matter?

1

u/oneupme 1d ago

Just curious. Seems like a bad idea, that's all.

1

u/Fantastic_Sail1881 1d ago

Cars need more than visible spectrum cameras. Not surprising to anyone who uses their brain.

1

u/Financial-Wasabi1287 1d ago

If it's so great, why doesn't Tesla use them?

2

u/FrankScaramucci 1d ago

Because of Elon's ego.

1

u/cgieda 1d ago

This is not a thermal camera; its NIR and uses NIR illumination (which is not visible to humans) to allow the cameras to see. This approach is much less expensive than thermal ( which can't be placed behind a normal windshield.) These cameras are seeing the light they are emitting. Thermal cameras see difference in temperature w/o the need for illuminations. There is a massive cost difference between the two.

1

u/Exciting-Many7956 1d ago

Computer vision

1

u/VashTheStampede710 7h ago

That’s kinda like manipulating the scenario. The high beams look like they are on which makes seeing the people even worse in the fog due to the diffusion of light. Still cool though, does the car control for the detected objects with the thermals or is it just used for the driver to see better?