The future of computer-driven cars and deliverbots
Plans are underway to ask for a legal mandate to install radio communications devices in all new cars, starting around 2020. These radios would do "vehicle to vehicle" (v2v) and vehicle to infrastructure communication using a wifi-derived protocol called DSRC.
Waymo (Google) has announced a pilot project in Phoenix offering a full ride service, with daily use, in their new minivans. Members of the public can sign up -- the link is sure to be overwhelmed with applicants, but it has videos and more details -- and some families are already participating. There's also a Waymo Blog post. I was in Phoenix this morning as it turns out, but to tell real estate developers about robocars, not for this.
There are several things notable about Waymo's pilot:
There has been much speculation recently because of some departures from Apple's car team that they had given up. In fact, last week they applied for self-driving car test plates for California. I never thought they had left the game.
Luminar, a bay area startup, has revealed details on their new LIDAR. Unlike all other commercial offerings, this is a LIDAR using 1.5 micron infrared light. They hope to sell it for $1,000.
A new report from Navigant Research includes the chart shown below, ranking various teams on the race to robocar deployment. It's causing lots of press headlines about how Ford is the top company and companies like Google and Uber are far behind.
I elected not to buy the $3800 report, but based on the summary I believe their conclusions are ill founded to say the least.
The recently released national noise map makes it strikingly clear just how much air travel contributes to the noise pollution in our lives. In my previous discussion of flying cars I expressed the feeling that the noise of flying cars is one of their greatest challenges.
Recently we've seen a series of startups arise hoping to make robocars with just computer vision, along with radar. That includes recently unstealthed AutoX, the off-again, on-again efforts of comma.ai and at the non-startup end, the dedication of Tesla to not use LIDAR because it wants to sell cars today, before LIDARs can be bought at automotive quantities and prices.
California has published updated draft regulations for robocars whose most notable new feature is rules for testing and operating unmanned cars, including cars which have no steering wheel, such as Google, Navya, Zoox and others have designed.
This is a big step forward from earlier plans which would have banned testing and deploying those vehicles. That that they are ready to deploy, but once you ban something it's harder to un-ban it.
Caltrain is the commuter rail line of the San Francisco peninsula. It's not particularly good, and California is the land of the car commuter, but a plan was underway to convert it from diesel to electric. This made news this week as the California Republican house members announced they want to put a stop to both this project, and the much larger California High Speed Rail that hopes to open in 2030.
California published its summary of all the reports submitted by vendors testing robocars in the state. You can read the individual reports -- and they are interesting, but several other outlines have created summaries of the reports calculating things like the number of interventions per mile.
I generally pay very little attention when companies issues a press release about an "alliance." It's usually not a lot more than a press release unless there are details on what will actually be built.
Earlier I posted my gallery of CES gadgets, and included a photo of the eHang 184 from China, a "personal drone" able, in theory, to carry a person up to 100kg.
Whether the eHang is real or not, some version of the personal automated flying vehicle is coming, and it's not that far away. When I talk about robocars, I am often asked "what about flying cars?" and there will indeed be competition between them. There are a variety of factors that will affect that competition, and many other social effects not yet much discussed.
There are two visions of the flying car. The most common is VTOL -- vertical takeoff and landing -- something that may have no wheels at all because it's more a helicopter than a car or airplane. The recent revolution in automation and stability for multirotor helicopters -- better known as drones -- is making people wonder when we'll get one able to carry a person. Multirotors almost exclusively use electric motors because you must adjust speed very quickly to get stability and control. You also want the redundancy of multiple motors and power systems, so you can lose a rotor or a battery and still fly.
This creates a problem because electric batteries are heavy. It takes a lot of power to fly this way. Carrying more batteries means more weight -- and thus more power needed to carry the batteries. There are diminishing returns, and you can't get much speed, power or range before the batteries are dead. OK in a 3 kilo drone, not OK in a 150 kilo one.
Lots of people are experimenting with combining multirotor for takeoff and landing, and traditional "fixed wing" (standard airplane) designs to travel any distance. This is a great deal more efficient, but even so, still a challenge to do with batteries for long distance flight. Other ideas including using liquid fuels some way. Those include just using a regular liquid fuel motor to run a generator (not very efficient) or combining direct drive of a master propeller with fine-control electric drive of smaller propellers for the dynamic control needed.
Another interesting option is the autogyro, which looks like a helicopter but needs a small runway for takeoff.
Some "flying car" efforts have made airplanes whose wings fold up so they can drive on the road. These have never "taken off" -- they usually end up a compromise that is not a very good car or a very good plane. They need airports but you can keep driving from the airport. They are not, for now, autonomous.
Some want to fly most of their miles, and drive just short distances. Some other designs are mostly for driving, but have an ability to "short hop" via parasailing or autogyro flying when desired.
NHTSA released the report from their Office of Defects Investigation on the fatal Tesla crash in Florida last spring. It's a report that is surprisingly favorable to Tesla. So much so that even I am surprised. While I did not think Tesla would be found defective, this report seems to come from a different agency than the one that recently warned comma.ai that:
Recently we've seen two essays by people I highly respect in the field of AI and robotics. Their points are worthy of reading, but in spite of my respect, I have some differences of course.
The first essay comes from Andrew Ng, head of AI (and thus the self-driving car project) at Baidu. You will find few who can compete with Andrew when it comes to expertise on AI. (Update: This essay is not recent, but I only came upon it recently.)
CES has become the big event for major car makers to show off robocar technology. Most of the north hall, and a giant and valuable parking lot next to it, were devoted to car technology and self-driving demos.
Earlier I posted about many of the pre-CES announcements and it turns out there were not too many extra events during the show. I went to visit many of the booths and demos and prepared some photo galleries. The first is my gallery on cars. In this gallery, each picture has a caption so you need to page through them to see the actual commentary at the bottom under the photo. Just 3 of many of the photos are in this post.
To the left you see BMW's concept car, which starts to express the idea of an ultimate non-driving machine. Inside you see that the back seat has a bookshelf in it. Chances are you will just use your eReader, but this expresses and important message -- that the car of the future will be more like a living, playing or working space than a transportation space.
The main announcement during the show was from Nissan, which outlined their plans and revealed some concept cars you will see in the gallery. The primary demo they showed involved integration of some technology worked on by Nissan's silicon valley lab leader, Maarten Sierhuis in his prior role at NASA. Nissan is located close to NASA Ames (I myself work at Singularity University on the NASA grounds) and did testing there.
Their demo showed an ability to ask a remote control center to assist a car with a situation it doesn't understand. When the car sees something it can't handle, it stops or pulls over, and people in the remote call center can draw a path on their console to tell the car where to go instead. For example, it can be drawn how to get around an obstacle, or take a detour, or obey somebody directing traffic. If the same problem happens again, and it is approved, the next car can use the same path if it remains clear.
I have seen this technology a number of places before, including of course the Mars rovers, and we use something like it at Starship Technologies for our delivery robots. This is the first deployment by a major automaker.
Nissan also committed to deployment in early 2020 as they have before -- but now it's closer.
You can also see Nissan's more unusual concepts, with tiny sensor pods instead of side-view mirrors, and steering wheels that fold up.
Several startups were present. One is AIMotive, from Hungary. They gave me a demo ride in their test car. They are building a complete software suite, primarily using cameras and radar but also able to use LIDAR. They are working to sell it to automotive OEMs and already work with Volvo on DriveMe. The system uses neural networks for perception, but more traditional coding for path planning and other functions. It wasn't too fond of Las Vegas roads, because the lane markers are not painted there -- lanes are divided only with Bott's Dots. But it was still able to drive by finding the edge of the road. They claim they now have 120 engineers working on self-driving systems in Hungary.
You may have seen a lot of press around a dashcam video of a car accident in the Netherlands. It shows a Tesla in AutoPilot hitting the brakes around 1.4 seconds before a red car crashes hard into a black SUV that isn't visible from the viewpoint of the dashcam. Many press have reported that the Tesla predicted that the two cars would hit, and because of the imminent accident, it hit the brakes to protect its occupants. (The articles most assuredly were not saying the Tesla predicted the accident that never happened had the Tesla failed to brake, they are talking about predicting the dramatic crash shown in the video.)
The accident is brutal but apparently nobody was hurt.
The press speculation is incorrect. It got some fuel because Elon Musk himself retweeted the report linked to, but Telsa has in fact confirmed the alternate and more probable story which does not involve any prediction of the future accident. In fact, the red car plays little to no role in what took place.
Tesla's autopilot uses radar as a key sensor. One great thing about radar is that it tells you how fast every radar target is going, as well as how far away it is. Radar for cars doesn't tell you very accurately where the target is (roughly it can tell you what lane a target is in.) Radar beams bounce off many things, including the road. That means a radar beam can bounce off the road under a car that is in front of you, and then hit a car in front of it, even if you can't see the car. Because the radar tells you "I see something in your lane 40m ahead going 20mph and something else 30m ahead going 60mph" you know it's two different things.
Thursday night I am heading off to CES, and it's become the main show it seems for announcing robocar news. There's already a bunch.
The California DMV got serious in their battle with Uber and revoked the car registrations for Uber's test vehicles. Uber had declined to register the cars for autonomous testing, using an exemption in that law which I described earlier. The DMV decided to go the next step and pull the more basic licence plate every car has to have if based in California. Uber announced it would take the cars to another state.
For a few months, Uber has been testing their self-driving prototypes in Pittsburgh, giving rides to willing customers with a safety driver (or two) in the front seat monitoring the drive and ready to take over.
When Uber came to do this in San Francisco, starting this week, it was a good step to study new territory and new customers, but the real wrinkle was they decided not to get autonomous vehicle test permits from the California DMV. Google/Waymo and most others have such permits. Telsa has such permits but claims it never uses them.
Google's car project (known as "Chauffeur") really kickstarted the entire robocar revolution, and Google has put in more work, for longer, than anybody. The car was also the first project of what became Google "X" (or just "X" today under Alphabet. Inside X, a lab devoted to big audacious "moonshot" projects that affect the physical world as well as the digital, they have promoted the idea that projects should eventually "graduate," moving from being research to real commercial efforts.
Robocars are broadly going to be a huge boon for many people with disabilities, especially disabilities which make it difficult to drive or those that make it hard to get in and out of vehicles. Existing disability regulations and policies were written without robocars in mind, and there are probably some improvements that need to be made.