Quick peak into FSD's Ai reward and punishment system

[REM]

This is probably the very best channel to follow for extremely interesting insights into how the close we are to explosive growth in FSD capabilities. A funny little tidbit about the rewards and punishment systems for Tesla FSD is that we (owners/drivers) are the ones dishing it out!

Every time you disengage and give them feedback, you are either rewarding or punishing the AI. When you get back to home base, the interaction is sent straight to Dojo via your home wifi. They capture and label the tone of your voice and probably even heart rate with that insanely accurate in cabin radar. (psst. Congratulations on finally realizing the main reason why they have radar installed there in the first place). Of course if they publicly put this out there, people wouldn't think it's creepy. But, hey ... Literally all big-data companies are doing this right now. Your cellphone is doing much worse.

Sry for the rambling, but it cracks me up to know that the people who complain about FSD all the time just suck at driving in the first place lol. FWIW, the CT FSD model just isn't ready for mainstream yet. Need many more miles because of the vector steering. Much tougher physics to simulate.

Sponsored

 

[Gigahorse]

Hopefully CT drivers are taking the time to REPORT disengagements etc. Things like lane hugging etc specifically, THEN we need more CTs on the road with it for a bigger data set.

 

[koolio]

Hopefully CT drivers are taking the time to REPORT disengagements etc. Things like lane hugging etc specifically, THEN we need more CTs on the road with it for a bigger data set.

That's a good point. The more we use FSD (which I use it a ton) and the more we report issues, the faster they can refine the model for CT.

Sometimes, I disengage due to a pothole or multiple potholes on a crappy street. I'll provide voice feedback telling them why I disengaged.

 

[Gigahorse]

That's a good point. The more we use FSD (which I use it a ton) and the more we report issues, the faster they can refine the model for CT.

Sometimes, I disengage due to a pothole or multiple potholes on a crappy street. I'll provide voice feedback telling them why I disengaged.

Yea, I do my best to report when it happens, I do feel like a bit of an unpaid beta tester but hopeful that the end product and the fact that I have FSD locked in to my CT will pay off long term.

 

[Seribus]

How do you structure your reports? Do you give it context/issue or some variation? For example {rural driving - failed to recognize and maneuver pothole}. I was trying to come up with a quick system for myself to keep from flubbing a response.

 

[monkeyboy]

CT FSD slows down and stops too late for my comfort especially when stopping behind a stopped vehicle. It always seems to require application of the actual brakes versus using pure regeneration. After driving a Model 3 today, it seems to me that the Cybertruck FSD is behaving in a way that may be appropriate for a Model 3/Y but not for the larger/heavier Cybertruck.

 

[REM]

How do you structure your reports? Do you give it context/issue or some variation? For example {rural driving - failed to recognize and maneuver pothole}. I was trying to come up with a quick system for myself to keep from flubbing a response.

It's a bit of an art since you have only one chance to get it right lol. No need to add context unless you think it may not be apparent from the video footage (that is sent along with the note). I keep it as simple as possible, and add a priority keyword only if it was something serious. For example (hypotheticals):

"Too fast over train tracks"

"Turned down the wrong side of the street. High priority"

"Failed to yield for emergency vehicle, critical priority"

I submitted a lot of high priority notes a few months ago due to the truck not braking early enough and cutting it way too close to a stopped car ahead.

A LLM transcribes your notes, but there's always a chance that your note gets reviewed by a human at some point. Having said that, the simplest thing to do is just speak clearly.

 

[Seribus]

So, "Get in the right f@#king lane" will suffice?...lol

 

[REM]

So, "Get in the right f@#king lane" will suffice?...lol

Actually, I do suspect that harsh language is a part of the tagged note so their training sims are as verbose and precise as possible. Though, id put more weight in detected stress levels than tone of voice.

 

[dalton108]

I’ve never been really that big of a fan of AI driver. I gave him more of a shot this time because of your recommendation. I still prefer DirtyTesla and BlackTesla, but I’ll continue to give him more of a shot.

 

[REM]

I’ve never been really that big of a fan of AI driver. I gave him more of a shot this time because of your recommendation. I still prefer DirtyTesla and BlackTesla, but I’ll continue to give him more of a shot.

He seems to have a better core understanding than most of the others.

I'm extremely excited to get Grok in the vehicles. I will pay extra to pick the brain of the car that's driving me down the road.

 

[dalton108]

He seems to have a better core understanding than most of the others.

I'm extremely excited to get Grok in the vehicles. I will pay extra to pick the brain of the car that's driving me down the road.

I think Chuck Cook kinda gets it the most but his videos get real long! But as far as Grok I’m a hard no.

An AI with a hard coded political agenda and forced perspective is not going to work for me.

I’m gonna be out on Optimus, as well, if it has opinions curated by EM.

 

[FarAway]

I had a critical disengagement a few weeks ago that left me with some questions.

The FSD was set up to go to an address. Approaching the home's driveway the CT started making a left turn into the wrong driveway, literally one driveway too early.... (I could clearly see numbers on the mailboxes) at the last second it seemed to realize the mistake and turned aggressively and sharply to the right to proceed to the correct driveway, approximately 50' ahead. The only problem is we were now in the wrong (left) lane with oncoming traffic head-on. I quickly disengaged and made positive corrections, apologized with a hand wave to the equally surprised other driver and finally pulled into the proper driveway. By this time, the que to post my reason for disengagement had disappeared. I was a little too busy to address anytime sooner. I also wondered if the oncoming driver had been a traffic cop how the maneuver would have been received. Yikes!

So, my questions...
-Is there any way to post a narrative after the disengagement que has disappeared for an event?
-Without the narrative is this event still a viable input to the AI team?

 

[REM]

I had a critical disengagement a few weeks ago that left me with some questions.

The FSD was set up to go to an address. Approaching the home's driveway the CT started making a left turn into the wrong driveway, literally one driveway too early.... (I could clearly see numbers on the mailboxes) at the last second it seemed to realize the mistake and turned aggressively and sharply to the right to proceed to the correct driveway, approximately 50' ahead. The only problem is we were now in the wrong (left) lane with oncoming traffic head-on. I quickly disengaged and made positive corrections, apologized with a hand wave to the equally surprised other driver and finally pulled into the proper driveway. By this time, the que to post my reason for disengagement had disappeared. I was a little too busy to address anytime sooner. I also wondered if the oncoming driver had been a traffic cop how the maneuver would have been received. Yikes!

So, my questions...
-Is there any way to post a narrative after the disengagement que has disappeared for an event?
-Without the narrative is this event still a viable input to the AI team?

Yeah, there are still tough navigation errors at destinations that are not well known or marked. Telsa has been more cautious about this previously, but they are tending to let FSD try more often. I'm starting to see my truck park at some locations when it reasonably determines it can find a correct space. Side street unmarked parking as well as a marked lot.

They still get reports for hard disengagements even if you don't leave a note; but if you miss it you can submit a note to them by saying "bug report" into the voice command.

Sponsored