Tesla's 'Full Self-Driving Capability' Falls Short of Its Name

TruckElectric

Well-known member
First Name
Bryan
Joined
Jun 16, 2020
Threads
769
Messages
2,482
Reaction score
3,273
Location
Texas
Vehicles
Dodge Ram diesel
Occupation
Retired
Country flag
Video link : master.m3u8


The $8,000 option doesn’t make the car self-driving, though it does offer a host of advanced features. CR evaluated all of them.

The features might be cutting edge, even cool, but we think buyers should be wary of shelling out $8,000 for what electric car company Tesla calls its Full Self-Driving Capability option. Tesla claims every new vehicle it builds includes all the hardware necessary to be fully autonomous, and the company says that through future over-the-air software updates, its cars should eventually be capable of driving themselves.

But for now, Full Self-Driving Capability, which includes features that can assist the driver with parking, changing lanes on the highway, and even coming to a complete halt at traffic lights and stop signs, remains a misnomer.


Tesla has distinguished itself from other carmakers for almost a decade by building sleek electric cars with industry-leading driving ranges and by developing new technology aimed at one day creating a fully autonomous, self-driving car. Though it has made significant strides in automated driving, owners should not rely on Tesla’s driver assistance features to necessarily add safety or to make driving easier, based on Consumer Reports’ extensive testing and experience.

TESLA ROAD TESTS
Tesla Model 3
Tesla Model S
Tesla Model X
First Drive: Tesla Model Y

“Despite the name, the Full Self-Driving Capability suite requires significant driver attention to ensure that these developing-technology features don’t introduce new safety risks to the driver, or other vehicles out on the road,” says Jake Fisher, senior director of auto testing at Consumer Reports. “Not only that, in our evaluations we determined that several of the features don’t provide much in the way of real benefits to customers, despite the extremely high purchase price.”

We assessed the Full Self-Driving Capability features on Tesla vehicles we previously purchased for our regular testing program. The features, each designed to work only in certain situations, such as in a private parking lot or during highway driving, can be turned on and off by the driver. We put each feature in the suite to the test, and the results, detailed below, were mixed, to say the least.

We contacted Tesla with a series of questions for this article, and the company did not respond to repeated requests for comment.

Read on for more details on our findings, and check out the video above.

Highlights From Our Testing
  • Most features within Tesla’s Full Self-Driving Capability suite worked inconsistently, including the Autopark self-parking system that has been around for several years. Sometimes it would recognize a parking space as suitable, and we’d park in it. But when we drove by the same space again later, it was as if the parking spot didn’t exist. It also often didn’t park straight between the parking lines.
  • Smart Summon, which allows the car to drive remotely to a location within a private parking lot, would sometimes drive on the wrong side of parking lot driving lanes, and it didn’t always stop at stop signs in the lot.
  • Navigate on Autopilot, when activated, allows a Tesla traveling on the highway to autonomously take on- and off-ramps and make lane changes as long as a destination has been programmed into the navigation system. We found the performance to be inconsistent, with the system sometimes ignoring exit ramps on the set route, driving in the carpool lane, and staying in the passing lane for long periods of time. The feature also would completely disengage at times for no apparent reason.
  • Traffic Light and Stop Sign Control is designed to come to a complete stop at all stoplights, even when they are green, unless the driver overrides the system. We found several problems with this system, including the basic idea that it goes against normal driving practice for a car to start slowing to a stop for a green light. At times, it also drove through stop signs, slammed on the brakes for yield signs even when the merge was clear, and stopped at every exit while going around a traffic circle.
Tesla’s active driving assistance systems are split into two parts: The first, Autopilot—which includes adaptive cruise control (Tesla refers to this as Traffic-Aware Cruise Control) and lane keeping assistance capabilities (Autosteer in Tesla terminology)—is now standard on every new Tesla.
For this evaluation, we focused on the optional Full Self-Driving Capability suite of driving assistance systems: Autopark, Auto Lane Change, Summon, Smart Summon, Navigate on Autopilot, and Traffic Light and Stop Sign Control.
Below, we explain each feature in the suite, its intended use, and how each performed in our tests.
Tesla Cybertruck Tesla's 'Full Self-Driving Capability' Falls Short of Its Name CR-Cars-Inline-Tesla-Driving-08-20


How We Did the Testing

We ran our tests of the Full Self-Driving Capability features at various times of the day, in a variety of weather conditions, and in many different locations. We also made sure we had the most up-to-date hardware and software available, which during our testing was version 2020.24.6.4 running on Hardware 3. This is important to note, because Tesla’s over-the-air software updates can alter the way these features perform.
The first three features we evaluated for this story—Autopark, Auto Lane Change, and Summon—have been around for a few years, and some have improved over that time. However, Tesla’s most recent features—Smart Summon, Navigate on Autopilot, and Traffic Light and Stop Sign Control—gave us some significant concerns about their usefulness and safety.

Autopark

Autopark “helps automatically parallel or perpendicular park your car, with a single touch,” according to information on Tesla’s website.

Here’s how the system works: As you cruise by either a regular or parallel parking spot in a parking lot, a “P” will pop up on the center display screen indicating that the system has found an appropriate spot. Tap the “P” on the touch screen and shift the gear selector into Reverse, and the system will automatically handle everything involved with parking the car, including steering and braking.

We found that it often worked as advertised, but other times it had difficulty engaging. In those cases, it wouldn’t recognize spots that seemed appropriate as you drove past them. This is a problem because you can’t “force” the system to work—it has to recognize an appropriate spot on its own. There seemed to be no consistent reason for it to sometimes recognize a parking spot as we drove by it and then not notice the exact same spot on another drive-by. Similar features have been around for years on cars from other automakers, and they can suffer from the same problems.

“Autopark also often didn’t park straight between the lines, to the point that we’d be embarrassed of ourselves if we got out of the car and realized we parked in such a cockeyed fashion,” says Kelly Funkhouser, head of connected and automated vehicle testing at CR.

Auto Lane Change

While not unique to Tesla vehicles, this feature is straightforward and works as advertised. It “assists in moving to an adjacent lane on the highway when Autosteer is engaged,” according to Tesla.
If the driver hits the turn-signal stalk to change lanes when Autopilot is activated, the car will perform the lane-change maneuver without any steering input needed from the driver. An animation appears on screen that shows where the car will move to, and it will wait to make the lane change if there is a car in the lane you want to move into.
“Ultimately, though, the safety of each lane change is still the driver’s responsibility,” Fisher says.

Summon

This feature is designed to allow the car to drive a short distance forward or backward without a driver behind the wheel. Summon “moves your car in and out of a tight space using the mobile app or key,” according to Tesla’s website.

When using the Tesla app on a smartphone, you can direct the car slowly forward or backward into a spot by pressing the corresponding button on the phone or key fob, and it can even be programmed to open and close your garage door. We found that it did, in fact, perform these functions, and we did some tests to mimic squeezing the car into a fairly tight parking spot between cars that were crowding the parking lane lines slightly, and it was able to complete the maneuver.

It works inconsistently, though. Our testers found that sometimes the system would line up well within the parking space but then back only halfway into the spot, leaving part of the car sticking out. Other times it would pull into the parking spot at an angle and call it a day.

It’s logical to think that Summon’s most practical use is to help deal with tight parking spaces so that you won’t have to squeeze yourself into or out of the car. However, the owner’s manual of CR’s Tesla Model 3 says that “parking in a narrow space limits the ability of the sensors to accurately detect the location of obstacles, increasing the risk of damage to Model 3 and/or surrounding objects.”

“Unfortunately, Tesla doesn’t give a best-use case for Summon, which leaves us perplexed as to what the system is really intended for if it’s not for parking in tight spaces—other than to impress your friends that your car can drive remotely,” Funkhouser says. “You also need to keep a very close eye on the car during these maneuvers to make sure it doesn’t run into anything.”
Tesla Cybertruck Tesla's 'Full Self-Driving Capability' Falls Short of Its Name CR-Cars-Tesla-Smart-Summon-08-20


Smart Summon

As the name implies, Smart Summon is intended to be a considerably more advanced feature than regular Summon. Tesla says it is “designed to allow your car to drive to you or a location of your choosing.” Tesla’s website further states that with Smart Summon, “your car will navigate more complex environments and parking spaces, maneuvering around objects as necessary to come find you in a parking lot.”
Using the Tesla smartphone app, the driver can either pinpoint a destination spot on the map for the car, or have the car drive to them using the Come to Me button.

We tried out Smart Summon in a number of scenarios, including the parking lot at CR headquarters in Yonkers, N.Y. Overall, the system proved to be unreliable. At times it would take overly complicated routes to reach us, and in other situations it might get stuck on an incline, then deactivate completely.

Even when Smart Summon was able to arrive at the specified location, it would spend time in the wrong lane of the parking lot, not pause for parking-lot stop signs, or take wide turns and head toward parked cars and then drive in Reverse to avoid a collision, as shown in the animation above. These are all situations that could cause confusion to other drivers, as well as be a potential hazard for any pedestrians in the car’s path.

Tesla states clearly on its website that “Smart Summon is only intended for use in private parking lots and driveways. You are still responsible for your car and must monitor it and its surroundings at all times and be within your line of sight because it may not detect all obstacles.” Private parking lots can include those for stores or restaurants, which means you can think of Smart Summon as your own personal valet service.
We can see the benefits of this feature, for instance having your car drive to meet you and your groceries near the store entrance on a rainy day. But Tesla doesn’t have all the bugs worked out yet, our testing shows. “At times it appeared erratic,” Funkhouser says. “We think after a customer experiences the system’s inconsistent behavior, they will likely not use it again.”

Navigate on Autopilot

This feature expands the existing Autopilot system, adding the ability for a Tesla that’s traveling on the highway to take on- and off-ramps, and make lane changes without driver input when a destination has been programmed into the car’s navigation system. It “actively guides your car from a highway’s on-ramp to off-ramp, including suggesting lane changes, navigating interchanges, automatically engaging the turn signal and taking the correct exit,” according to Tesla.

While the system can, in fact, do all of those things, it was far from consistent. In one case, the system completely ignored the exit it was supposed to take; this not only put our tester off of their route but also stuck the car in a carpool lane with only one person in the vehicle.

In another example, the system suddenly disengaged, causing confusion for our driver in a heavily trafficked area with an on-ramp quickly approaching. Yet it’s in situations exactly like this that a driver needs to be focused on the environment around them, not distracted with a driving feature suddenly having an problem.
We also found that Navigate on Autopilot would occasionally leave us driving in the passing lane on a highway for long periods of time, when the safest course of action—not to mention proper lane etiquette and some state laws—requires moving back over to the center or right lane in that situation.

We are also concerned that Navigate on Autopilot can allow a driver to set the feature to automatically make lane changes on its own, without the driver activating the turn-signal stalk and without the system giving a warning to the driver that a lane change is about to happen.

“The setting that allows the driver to turn off the system’s lane-change confirmations and warnings is worrying, if not downright dangerous,” Fisher says. “It could lead to drivers becoming startled by an unexpected and unsafe lane change while driving at highway speeds.”
Tesla Cybertruck Tesla's 'Full Self-Driving Capability' Falls Short of Its Name CR-Cars-Inline-Tesla-Stop-Sign-08-20


Traffic Light and Stop Sign Control

This is the most recent feature to join the Full Self-Driving Capability package, and it is used in conjunction with adaptive cruise control and lane keeping assistance. Tesla says when Autopilot is engaged, this system “identifies stop signs and traffic lights and automatically slows your car to a stop on approach, with your active supervision.” If an intersection is clear, the driver can tap the accelerator pedal or pull down on the gear selector stalk to keep the car going.

By Tesla’s own design, this feature will bring the car to a complete stop at any traffic light, regardless of whether the light is red, yellow, or green. The only time the Tesla will drive through a green light without stopping on its own is if there is a lead vehicle in front that it can follow through the light—or if you override the system.
In addition to the fact that it goes against normal driving etiquette for a car to start slowing to a stop for a green light, we also found that our Tesla would occasionally hit the brakes too far away from a stop sign, causing our driver to have to keep hitting the accelerator pedal or the gear selector stalk multiple times to move the car all the way to the stop sign. In other circumstances, the car simply wouldn’t recognize the stop sign at all, forcing our tester to have to hit the brakes to avoid driving right through the stop sign and into the intersection. In the animation above, it recognized the sign too late, slammed on the brakes, and came to a stop in the middle of the intersection.

The system also had problems navigating a roundabout, stopping at each exit as it went around the traffic circle. Other times it would slam on the brakes when approaching a yield sign, even if the merge was clear.
“In its current iteration, we think Tesla’s Traffic Light and Stop Sign Control will create more confusion and distraction for the driver,” Fisher says.

Beta Testing

Tesla labels the Navigate on Autopilot and Traffic Light and Stop Sign Control features as “Beta” on the center display screen, which usually means the computer software is still in development. While you do have to opt in to use these features, our testing demonstrated a number of problems with using them in everyday driving.
For this article, we asked Tesla in an email for its definition of Beta and we asked how a driver can tell what separates features listed as Beta from those that are not. Tesla did not respond.

“Tesla has repeatedly rolled out crude beta features, some of which can put people’s safety at risk and shouldn’t be used anywhere but on a private test track or proving ground,” says William Wallace, manager of safety policy for Consumer Reports.

Tesla says these features will improve over time, but at this point they don’t seem worth the hefty $8,000 price tag.

“It seems like Tesla is focused on being the automaker with the most features rather than ensuring that the features work well,” Funkhouser says. “Its time and energy could be better spent on developing a driver monitoring system for Autopilot to significantly improve the safety and usefulness of that system.”
Tesla collects data from those who buy its cars to help improve it, but using developing technology like this on the road does not come without risk for you and other drivers. We’ll continue to evaluate these and other active driving assistance systems as they are available.

Source: Consumer Reports
Sponsored

 

IceCold

Member
Joined
Aug 22, 2020
Threads
0
Messages
11
Reaction score
21
Location
United States
Vehicles
Cybertruck
Tesla has the most full featured stage 2 self driving, which requires active driver engagement. Some feel they are aggressive but they are collecting lots of data. I think for the amount of miles driven Teslas have proven very safe even though there have been a couple sad examples of what happened when things went wrong. Commercial airplanes are safer than cars, but accidents still happen.

There might be a couple others that offer stage 3 on top models and use map data for major interstates like a couple top model Cadillacs that require no hands at all, but you must still be ready to takeover.

To have a true Cybertaxi that is not just on major highways and a few stretches of major cities we need major changes and higher quality and consistent streets and signs, lots of laws and probably a way for cars to communicate with each other as well as traffic lights and parking lots etc. The car alone is probably not enough

We will continue to see progress on self driving but how soon we fully get there where we are all just passengers is anyones guess. Many thought maybe even by 2030 10 years ago, I now think many experts think perhaps 2050 give or take a decade is more realistic timeline.

That does not mean that there will not be some really cool things that happen along the way as we get closer and closer. There will be certain countries and cities that are more progressive also and may get there a bit sooner.
 
Last edited:

CyberMoose

Well-known member
First Name
Jacob
Joined
Aug 19, 2020
Threads
1
Messages
820
Reaction score
1,415
Location
Canada
Vehicles
Model 3
Country flag
I agree with IceCold, except that other companies have L3. Cadillac can do handsfree but only because they are actively tracking your eyes while this is engaged to make sure they are paying attention all of the time. That is still L2 as long as the driver has to constantly supervise the vehicle, L3 will be when you can relax in the driver seat and maybe play a game on the Tesla screen, watch some youtube, or even read a book, as long as you are able to take over when a Tesla alerts you to.

Mercedes says it will have L3 for traffic jams and L4 for parking, which wouldn't require you to be in the vehicle at all. These are definitely possible; I feel like Tesla could almost certainly be able to handle full control of the vehicle when there is bumper to bumper traffic, and as for L4 parking, I think we are a little further away from but within a couple years once Tesla perfects it.

But above all, Tesla has two major advantages over any other manufacturer, which are hundreds of thousands of camera equipped vehicles collecting data, and a system that already drives off the highway. The problem with other manufacturers systems is that they are only for highways and only for approved highways that have already been mapped out so their cars know exactly what's happening. This might help them catch up to what Tesla can do on a highway but it is a crutch that won't help them in the long run. Tesla doesn't just map every road and use the data it collects to tell the cars that a stop sign is coming up, Tesla can drive on roads that it has never seen before and still do what it would do on any other road. When other systems like cadillac gets close to anything that isn't approved, it requires you to take over; In fact, apparently is a Cadilliac notices changes in a road that is approved, it will make you take over.
 
Last edited:

BillyGee

Well-known member
First Name
Bill
Joined
Jan 22, 2020
Threads
8
Messages
708
Reaction score
1,534
Location
Northern California
Vehicles
Model Y P, Model 3 LR, Founders CT (Ordered)
Occupation
Technician
Country flag

CyberMoose

Well-known member
First Name
Jacob
Joined
Aug 19, 2020
Threads
1
Messages
820
Reaction score
1,415
Location
Canada
Vehicles
Model 3
Country flag
Isn't there a huge update coming this quarter for fsd (link below)? Why not wait until after that? Hopefully they at least do an updated article when the new version drops.

https://www.google.com/amp/s/cleant...t-fsd-development-updates-from-elon-musk/amp/
FSD isn't just getting a huge update, it's getting a rework that is supposed to be leaps and bounds better. Elon also confirmed months ago that the next BIG update which will probably be this rework we hope, will include turns at intersections.

Elon says he uses this new system in his Tesla and has almost no input between his home and work.
 


CyberMoose

Well-known member
First Name
Jacob
Joined
Aug 19, 2020
Threads
1
Messages
820
Reaction score
1,415
Location
Canada
Vehicles
Model 3
Country flag
Tesla's autopilot system is 10 times safer than humans already.
While I do agree that autopilot is safer than humans. I wouldn't say 10x safer. If you are refering to accidents per miles driver where the average person was somewhere in 400,000's and while autopilot was engaged it was in the 4,000,000's, that information is good but it's also flawed.

First of all, we have to have to look at human intervention. If auto pilot drives 50 miles with no accident, is about to get in one, the driver takes over, puts it back in auto pilot and drives 50 miles more on autopilot; that will result in 100 miles of autopilot driving with no accident. Also the accidents are most common on left hand turns, something that Tesla hasn't released the update for yet. Now it is still an impressive number because Tesla isn't like other autopilot systems, it can drive on regular roads, it can now go through traffic lights and stop at stop signs. I am curious to see how that update and the upcoming street intersection turn update will affect the miles driven per accident. Will it be a big change or will it hardly move, it's hard to tell. FSD doesn't really have blind spots and i'm sure for turning left will make the system very cautious
 

CappyJax

Well-known member
Joined
Aug 2, 2020
Threads
4
Messages
137
Reaction score
100
Location
Bakersfield, Ca
Vehicles
Subaru Forester
Occupation
Pilot
Country flag
If auto pilot drives 50 miles with no accident, is about to get in one, the driver takes over, puts it back in auto pilot and drives 50 miles more on autopilot; that will result in 100 miles of autopilot driving with no accident.
That doesn't matter because if the driver is more aware of the impending accident from the autopilot alerting them, or even lets them rest more, it is still a function of the autopilot assisting the driver. It isn't even L3 yet, so the driver is still ultimately responsible, and the autopilot reduces accidents overall.
 

CyberMoose

Well-known member
First Name
Jacob
Joined
Aug 19, 2020
Threads
1
Messages
820
Reaction score
1,415
Location
Canada
Vehicles
Model 3
Country flag
I see what you are saying but I can't agree. I love the autopilot system and I've seen countless videos of it driving perfectly on long stretches of highway, but at the same time i've also seen plenty of times where it's made common mistakes that people have had to continuously correct. The data is misleading that the autopilot is driving that well. If anything I would give more credit to the safety features that know ahead of time that the driver needs to take over.

The bigger point to what I was saying was still where it was driving. Primarily these are highway mils that peope use the autopilot. While the Tesla can go on city roads with autopilot, it's less common.

I would have more faith in the statistic if it could show miles driven on highway between autopilot with no human intervention and a human driver. Or at least show some sort of figure for how often human intervention on autopilot has avoided an incident.

Not that I doubt the autopilot system at all. When I get my Cybertruck, I suspect we will probably be at L3 and I plan to let my Cybertruck drive me around while I watch a movie. I guess we'll see where we are at when the new FSD rewrite comes out hopefully near the end of the month or early October.
Sponsored

 
 




Top