Luminar, a bay area startup, has revealed details on their new LIDAR. Unlike all other commercial offerings, this is a LIDAR using 1.5 micron infrared light. They hope to sell it for $1,000.
There's a lot of bad information circulating on the famous United/Republic "passenger drag" so I wanted to consolidate a 2nd post with some of them.
It turns out the flight was probably not oversold. A UA spokesman said it wasn't. It was a fully sold flight, but a sudden need arose to move 4 flight attendants to SDF (Louisville) and they arrived at the gate after the flight had boarded. In United's contract of carriage, it defines an oversold flight as a flight where there are more passengers with confirmed reservations checked in by the check-in deadline than they have seats on the plane. That does not appear to be the case on this flight, but Republic and UA got confused about it.
That, in turn, means Republic did not have the right to invoke the clauses of the contract for oversold flights. If so, they are just plain in the wrong, and this becomes a case with far less interesting nuance. United has changed their tune (of course due to public pressure) and are going full mea culpa.
Airline reservation computers oversell all the time, and carefully calculate exactly how much to oversell. It looks like the algorithms decided to not oversell this flight. And they were right -- when they called for volunteers, nobody accepted, even at a very high price ($800 to $1,000) for a flight where most tickets are under $200. The algorithms performed perfectly.
Technically it was Republic Airline, a small regional airline dba "United Express." However, United sells and and manages the tickets and they use the brand, and it's under United's contract, so United certainly gets a lot of the responsibility. And I am impressed that UA has not tried to throw Republic under the bus here.
Republic Airways actually operates lots of regional flights for United, AA and Delta, so this could have probably happened to any of them. I don't know if they have a lot of airline specific training on bumping procedure for their teams. United may have just gotten some very bad luck of the draw here -- and then made it worse by defending it at first. And it may be that the bumping policies UA gives to Republic might have made this more likely than the ones Delta and AA give it, but I don't think they are tremendously different. Some hinges on whether the flight crew was a Republic crew, or a United crew.
But still, though it was not United, the buck stops with United, and at least now, they are not resisting that at all.
If this had been an oversold flight, their contract still does not let them remove passengers from the plane involuntarily. It says they can "deny boarding." Deny boarding does not mean remove -- there is another section of the contract on removal. More bad news for United/Republic, but again, it makes the case less interesting as it's an example of something you sort of expect -- junior employees of a regional affiliate not being properly trained on what to do in an unusual situation and thus screwing up. That happens in 100 different ways all the time, but each particular incident is rare and probably does not indicate a systemic problem. That's good -- but it is only systemic problems that are of interest to the public, and which would make you boycott a company. If the junior employees make mistakes like this too often, then you have a systemic problem to worry about. (United does not have a good reputation on this count, of course.)
New information reveals the flight crew declared themselves "must ride." I don't have a lot of details, but this is a special designation in the law (not the UA contract) which declares the crew are needed somewhere to avoid cancellation of a flight. Once a passenger is declared "must ride" the plane is required, reports say, to do everything possible to get that passenger to their destination, including delaying the plane and apparent, yes, even involuntary bumping. I am waiting for more information on this status, which would invalidate partly what I say above. They can't pull you for an oversell, but they may be able to pull you for a must-ride. The law is there to keep the aviation system humming. Once flight crews don't get to flights, it can mean disruption to more than just that flight.
No, but that's the best joke on this that I've seen.
With the mistaken impression that overselling was the cause here, a lot of people are stating overselling is evil, and Chris Christie has even called to prohibit it. That's a big mistake. Overselling is very good for airlines and the flying public. I explained that in yesterday's post but I will go into more details below. You want an airline that does at least some overselling, though one can debate how much you want.
In this situation, it needed to move those employees to crew a flight first thing out of SDF. If they had not gotten a crew there, that flight gets cancelled. Roughly 70 paying passengers get stranded against their will. While clearly nobody wants to be stranded against their will, the hard truth is you want to fly an airline that will strand (with good compensation) 4 people to avoid doing it to 70. (Here I am talking about the normal approach, which is to deny boarding to 4 people, not to try do drag people off the plane.) Still, I have to view it as prioritizing 70 passengers over 4, not employees over passengers.
This is possibly true but possibly not. First of all, these airlines are all about procedure. They don't authorize junior employees to be innovative or authorize them to spend money. So chances are if somebody thought of that, they had no system with which to do it. That is a fault of the airline but the sad norm of corporate bureaucracy.
Secondly, while I don't know this to be true, all flight crew operate under a set of complex rules about required rest. You don't want a sleepy pilot landing your plane, or a sleepy flight attendant helping people get onto the evacuation slides. These rules are very hard and fast. I suspect trying to sleep in a car doesn't count, and an overnight ground ride is out of the question. Had they acted very quickly, and had a system in place, they could have probably gotten the crew there a bit after 11 -- not long after the flight actually landed due to the chaos -- so that might have worked, in hindsight.
They could have offered the passengers a limo ride, but again probably had no way to do something that out of the ordinary.
The same applies to an air charter. Getting an air charter on short notice is difficult, but they could have gotten one for the flight crew (or another flight crew) in the early morning if they had a system in place. This is very expensive of course, and so not likely to be in their playbook.
Airlines move flight crews a lot. There are airline pilots who live on one coast and mostly work on the other, commuting by "deadheading" on one of their airlines planes.
When you design a system that needs various parts -- planes and flight crew -- you have to "overprovision," which is to say leave some wiggle room. That means you have some number of planes, crews and other resources sitting idle or on call, and you use them when something else fails. Everybody does it because you don't want to run so close to the wire all the time. If you do, the slightest problem causes a cascade of cancellations. Airlines have to worry not just about small problems but even big ones like storms that cancel or delay many flights.
It's not practical, however, to overprovision to the point that you never fail. You can do it, but it's really expensive. You have to waste a lot of money, and you don't have a competitive company. So every systems designer tries to figure out how to overprovision just the right amount. An amount that will have a few failures, but not too many. On top of that, you try to plan so you handle those failures with the least amount of pain, but you accept they will still happen.
What that means -- and I don't have any specific facts about this flight -- is that sometimes you will be skating the edge, and sometimes you will fail. Sometimes you will find that crew are not going to make a flight unless you do something a little extra.
The bumping law, I think, is where the airlines find their "extra." They don't want to bump paying customers -- it's expensive and hurts customer relations. But they don't want to cancel flights even more. So every so often, every airline has to find a solution. The bumping law offers them that solution. They can legally deny boarding to paying passengers against their will to make room for crew. This is much more workable, and under their control, than other options like using charter jets, or if distances are short, ground service.
That's true -- but only in hindsight. No playbook for these situations is going to say, "If you have to, spend $10,000 rather than bumping passengers just in case it turns into the PR nightmare of the year." By definition, nobody knew that would happen.
In reality, airlines involuntarily bump 50,000 pax per year and while they grumble, this is the first time it's ever gone done like this, with eviction from the plane, blood, camera phones and Facebook. So I don't blame them for not seeing this could happen. I do blame them, however, for not understanding that any time you bring the police into a situation you bump the risk of something bad happening.
They should have known, but I can suspect why they didn't -- because they actually do this all the time and don't have PR problems. Flight crews face unruly passengers reasonably often. They have training for it and procedures. And those procedures do call for getting the police, even knowing how that can go south. What those plans obviously did not account for was doing this when it was completely clear the passenger was the victim, that they only removed him because they wanted his seat. The rules for removing passengers mostly deal with safety issues. When they declare a passenger a safety risk, and the passenger makes trouble and even (rarely) causes a scuffle they are protected if the passenger was really a safety risk, or they can even come up with a credible lie why they thought he was a safety risk. No such story is possible here. Sure, the law says anybody who refuses a flight crew order can be removed from the plane. Technically it says this. In reality, it's insane to think you can remove somebody for refusing the order "leave the plane" when the order is not given for a valid reason. The law says obey, but every sense of justice goes the other way. In fact, more than that, I don't think a court would convict somebody for refusing that order, even if they are guilty, because society does not intend to grant the airlines that sort of power.
Put another way, three things are true:
As such, it's clear that "we removed him because he disobeyed our order to leave" is a loophole that would never stand up to scrutiny.
Well, I have to concede this is true -- part of this did happen to me! The first flight I took with Kathryn, the airline came up to us after we had boarded, and insisted she give up her seat for a deadheading pilot. The pilot never sat there -- instead he went up to use the jumpseat in the cockpit. We were quite angry, especially when her later flight lost an engine in the middle of the Pacific.
But a lot had to go wrong for this to happen. Here's my guess as to the list of things that went wrong:
Because so many things had to go wrong, the particular situation is not important. Rare things go wrong all the time. Junior staff at small airlines are not fully trained on contract nuances. Because things had never gone south like this before (and not in the way the plane was supposed to literally fly south) nobody had ever thought to write up procedures to remind gate crews that they can't remove passengers, and that they can't bump at all if it's not actually oversold.
Those of us writing so much about this online only really want to care about systemic problems. What is wrong with the system, not just one gate crew or flight crew. If there is a pattern of errors, what can be done to fix it.
I am hesitant to include this one, because I don't want to give the impression that I am defending in any way what happened to him, but it is an important fact. I am not saying anybody should be forcibly removed from a plane because the airline wants his seat. This was not just your ordinary passenger. Reports claim Dr. Dao lost his licence to practice medicine from 2003 to 2016 because he was convicted of trading prescription painkillers for sex, and his psych evaluations listed him as having anger management issues. One reason this escalated is that normally nobody dares to defy orders from the flight crew and especially from police. The orders were improper, and the bumped passengers deserve lots of compensation, but you have to attribute some portion of the blame for how far it escalated to Dr. Dao.
The big question I have found most interesting is the subject of overbooking. Almost all airlines sell more seats on a plane than it actually has. They give you what they call a "confirmed reservation" and that name certainly makes people imagine they have a guaranteed seat on the plane. They don't, but they almost do, and that's as I will explain, a good thing for the flying public.
One basic statistic -- the no-show rate on flights is around 8%. So a plane with 100 seats, if it is considered "sold out" after 100 reservations. On average, with no overselling or standby pax, it would take off with 8 empty seats. The number is not the same for every flight. Complex algorithms predict the actual number based on history of that flight and the passengers.
Turns out, when people don't fill their seat, only rarely does the airline get any money, or a profit from them. Airlines do make money from overbooking, but not the way you think. Most of those no-shows are because of late or cancelled connections. Those are money losers for the airline, big time. They have to rush to find another flight for that passenger, and get no money. Some of them are people who did free same-day changes or otherwise switched off the flight for low fee. A few have tickets with no change fees. A few more did a late flight change and paid a change fee. The change fee is sometimes as high as the ticket, but sometimes it's much less. The airline pockets the change fee, but not without cost -- the biggest one being they turned away passengers they would not have turned away because of the booking.
Update: More careful reading of United's Contract suggests both that this didn't fit the definition of an oversold flight, and that even if it did, they only have the power to "deny boarding" to a bumped passenger, not to remove them from an aircraft. If this is true, then this case is simple and much less interesting: UA/Republic should admit fault and compensate those involved and retrain staff. End of that part of the story. Later-update: This might might have involved a special "Must ride" classification put on the flight crew which changes the rule yet again.
I have a follow-on post on misconceptions and realities about these issues.
The viral video of the day is that of police pulling a main from a United Airlines flight. He doesn't want to go, and they pull him out, and bash his head on the armrest, then drag out his unconscious body. It's a nightmare for everybody, and the video sends clear chills into every viewer. (Once, after I changed my flight to fly home from Hawai`i with Kathryn, they involuntarily removed her from the plane for a crew member. I spent the flight next to an empty seat as the crew member went to the cockpit jumpseat, and she flew on a later flight that lost an engine. We've never flown on that airline again.)
In spite of that, I have some sympathy for both sides, and while clearly things went very wrong here, as even United will eventually admit, the more interesting question for me is "what should airlines do to make this work better"? I do believe that UA clearly didn't want this to happen, though their policies created a small risk that it would. I am sure they don't want it to happen again. So if you were the person writing the policy for these situations, what would you do?
The situation:
New information reveals that a whole bunch of things went wrong at once, which does not excuse police manhandling a passenger, but helps us understand why it went pear-shaped.
Most flights these days are oversold, because a lot of people don't show for their flights. The system of overselling, then calling for volunteers when too many show up makes the planes fly mostly full these days on many routes. It's a fact of flying and allowed in the law. It makes flight more efficient, perhaps 5-10% more. On competitive routes, that makes tickets cheaper for everybody. It has another benefit to the flying public -- more people get to fly on the flight they want, because the airline is willing to sell you a seat on a "full" flight, knowing that 99% of the time you and everybody else will actually get to fly. The alternative is that an empty seat flies, and you wastefully take another flight. Passengers really like more availability, though they don't directly see how it happens. The reality is many of the flights you see in your web search are technically oversold. If it is really sold out, it's actually oversold past their limit.
Airlines could elect to not oversell, or not oversell as much, but that comes with a cost. More people denied the flight they want. More expensive tickets. More emissions per passenger. The world doesn't want that, so the world allows and the law regulates, overselling.
Of course, there is a way to avoid ever being bumped. Pay more for your ticket, or be an elite flyer, as I am. (In fact, as an elite, they actually guarantee me a seat on "really, really sold out" flights 24 hours in advance, which really means they push their oversell percentage by plus-one for elites. If I do this -- I never have -- they just decide it is cheaper to pay a volunteer to get off the flight than to deny one of their elites the flight they need.)
So the most obvious solution, "Don't oversell," comes with a cost I don't think the airlines or flying public actually want. Consider it this way. A flight you need with 100 seats has had 100 bookings. The airline knows that on average 7 of them won't show up. Do you want the airline to let you "reserve" on that plane, or tell you "sorry, fly the next day?" Do you want them to only offer you a standby ticket because other people, who paid far less than you for their tickets and who barely fly on their airline, got there first? (And yes, those people who buy late pay a premium.) The airline hates taking off with an empty seat, but you hate being told you can't get on a flight that ended up with empty seats even more.
Airlines are getting quite good at it. In 2015, only .09% of passengers were bumped, and only .01% involuntarily.
Turns out, it's in the public interest that flight crew needed for another flight have higher priority than we do, even to the point of removing us from planes we already boarded. That may not be allowed, but one has to consider the difference between one person removed (voluntarily or not) with compensation and the very large group of people who will have their flight cancelled (sometimes with no compensation) if the flight crew doesn't get there, properly rested and ready. You don't want to be either, and utilitarianism is not always the right philosophy, but here the numbers are overwhelming. One guy doesn't fly or 70 people don't. So we want a system where that can happen, but smoothly and ideally voluntarily.
Usually, the system of offering fat compensation -- $800, a hotel and meals for a $180 flight is a pretty good deal -- works fine. There are people who actually relish it. I met one guy who says he deliberately tries to get bumped the day before Thanksgiving -- when the offers get very high. But nobody was taking it. Most would miss a day of work, which is not an easy thing to do.
The law then allows the airlines to do an involuntary bumping. They have an algorithm that picks people and they are "denied boarding." The law specifies compensation. In this case 4 times the ticket price and other compensations. And this is cash, not flight coupons. Cash is worth a lot more.
This law is one of the culprits here. The law effectively puts a cap on the offer you will get. The airlines, in a move they thought at first was rational, don't want to offer you a lot more than the price the law defines for an involuntary bump. Why give a passenger $2,000 when you can do it for $1,000 under the law. Well, one reason is bad PR -- which is true in spades here.
The airlines don't want to do this. About 1 in 1,000 passengers are bumped, and 1 in 10,000 are involuntarily bumped, and has been going down as they get better at working their systems. But it happens.
Without the involuntary rule, the airline might have considered the next solution...
This problem would have been defused if they had kept increasing the offer until somebody took it. (Those who took it early will of course be upset, but that's how it goes.) While there is a practical limit, a volunteer should be found long before it.
They could also consider other things that are not money. Often bump offers come with things like first class upgrades which can be cheap for the airline and very nice to the passenger. They could offer a very coveted thing to some passengers -- elite qualification. At the extreme, if they offered 20,000 elite qualification miles or a full-tier bump in elite status, I could see even elite passengers jumping up to volunteer. We don't usually. We know we will never get involuntarily bumped. We usually have places to go. But we crave that elite status so much that some people fly "mileage runs" -- flights to nowhere just to accumulate miles -- to keep and increment it. If UA said, "get off this plane and we'll make you 1K" they would have had a line out the door of volunteers.
A new report from Navigant Research includes the chart shown below, ranking various teams on the race to robocar deployment. It's causing lots of press headlines about how Ford is the top company and companies like Google and Uber are far behind.
I elected not to buy the $3800 report, but based on the summary I believe their conclusions are ill founded to say the least.
One of the key flaws in the US political system is gerrymandering. I have written about this before even proposing my own method of redistricting, but such proposals only have a limited utility.
In this article I present why court solutions have had trouble, and a potentially new approach using an interstate compact.
Gerrymandering is particularly bad in the USA, but it's a general "bug" in many democratic systems. The flaw is often summed up with the phrase "The politicians pick the voters instead of vice versa." When the incumbent legislators and parties can draw the districts, they can bias the system heavily in their favour. In the USA, the house of representatives is currently highly biased towards the Republican party. It is often cited that the Republicans won 49.9% of popular votes for congress but got 55% of the seats. You can't actually add the individual house votes, because people vote (or rather stay away) differently in safe districts than they do in contested one, but the margin is large enough that the trend is clear.
This is in large part due to Operation Redmap which is documented in the book Ratfucked. It truly fits the description "fiendishly clever plan" and exploits the bug to the level of making it close to permanent.
How districts are drawn is left to the states both in the constitution and the law. Some states have moved to create more fair districting rules, the sort of rules you would make up if you were doing it from a nonpartisan standpoint. However, the hard fact is that those states which do this are chumps. It does not make the system more fair if one side stops cheating -- and I do think of gerrymandering as cheating -- and the other side keeps on cheating. It just assures victory for the cheating side going forward. At the same time, having all sides cheat indefinitely is not a good solution either.
The constitution says very little about districting. In fact, it doesn't even demand districts! States could have, if they chose, selected their representatives in a statewide proportional vote. Later federal laws, however, have demanded each person have one congress member, which demands geographic districts. About half the states require the districts be contiguous, but the others don't. The voting rights act and other principles have forbidden drawing the lines on racial or minority grounds, but not on the grounds of "this helps incumbents keep their seats" -- that's still largely within the rules.
In any event, as long as gerrymandering is benefiting the GOP, they are not going to commit political suicide to remove it. States controlled strongly by one party or the other will resist willfully hurting their own parties, though there are exceptions when states have ballot resolutions. The supreme court ruled, barely, that the public can supersede the legislatures on this matter with a ballot proposition, and so that has happened. While the public belong to parties, they are actually more interested in fairness than party loyalty.
A constitutional amendment could fix this, but that's not going to happen. And strong federal law could probably fix it, but that's not coming from houses controlled by the people which benefit from the cheating.
As such, the solution can only come from the courts, or ballot propositions in a balanced set of states.
A good summary of the rules around districting in the different states can be found at this site.
Justices of the supreme court have reportedly all denounced gerrymandering to cement political control. They agree that it violates the principles of the constitution of one person one vote and equal protection, as it effectively eliminates for partisan reasons the voting power of many. Even agreeing with this, for now they feel powerless to stop it.
We can all see gerrymandering happen, but for the courts to do something about it, they would need to define fair and unbiased test which says when it is happening. This is hard, as courts are reluctant to write sets of rules like that -- that is the province of the other branches of government. Courts don't make the rules, they just decide if people are playing fairly by the rules that the other branches created.
So while it's easy for you or I to propose fair rules for districting -- rectangular districts or my own convexity test above -- these just aren't the sort of rules courts are willing to make up. You can't extract them from the constitution. A court can look at a crazily shaped district and know "this is unfair" but it has to come up with a way that the states can objectively know what is fair and what isn't, without being the author of its own rules.
One proposed rule that's been advocated is the voting efficiency gap. Here, they try to measure how many votes were "wasted" because of district design. If a district went 80% for one party and 20% for the other, 30% of party A's votes are wasted, and20% of party Bs, and the difference between these numbers tells how biased that election was.
It's a nice test but one can see immediate flaws. For example, in a state biased 55% to 45%, a "perfect" districting where every district has the same balance as the state would result in 100% of seats for the dominant party. Since one party is strong in cities and the other strong in the country, any geographic set of districts is going to have these "inefficiencies" with inner cities voting 80% Democratic in the same state as a rural district votes 80% Republican -- without any intent to cheat in how the lines are drawn. As noted, proportional non-geographic districts are not going to happen.
The courts, if they are to help us, need a test which will clearly let them tell states, "If you don't draw your districts to match this test, they will be ruled invalid." It's easy to come up with fair, non-partisan tests to use, but the problem is that it is easy and so there are several you could use -- and why should one be chosen over another? The legislatures can choose one option from many, but the courts are not to be arbitrary in that way. Their test has to clearly match some principle they find in the law.
You can propose convexity, or straight lines, or random selection -- but none of them answer the question of "why does the law demand that particular one, vs. another?" They will ask this because any system, even if non-partisan, will benefit one party more than a different choice and thus have the appearance of being chosen from the pool for a partisan reason. And perhaps more than the appearance.
Individual states deciding to play fair just cede their power. Perhaps another option is possible -- through a compact of states dedicated to fair districting.
The recently released national noise map makes it strikingly clear just how much air travel contributes to the noise pollution in our lives. In my previous discussion of flying cars I expressed the feeling that the noise of flying cars is one of their greatest challenges.
Recently we've seen a series of startups arise hoping to make robocars with just computer vision, along with radar. That includes recently unstealthed AutoX, the off-again, on-again efforts of comma.ai and at the non-startup end, the dedication of Tesla to not use LIDAR because it wants to sell cars today, before LIDARs can be bought at automotive quantities and prices.
California has published updated draft regulations for robocars whose most notable new feature is rules for testing and operating unmanned cars, including cars which have no steering wheel, such as Google, Navya, Zoox and others have designed.
This is a big step forward from earlier plans which would have banned testing and deploying those vehicles. That that they are ready to deploy, but once you ban something it's harder to un-ban it.
I have so much paper that I've been on a slow quest to scan things. So I have high speed scanners and other tools, but it remains a great deal of work to get it done, especially reliably enough that you would throw away the scanned papers. I have done around 10 posts on digitizing and gathered them under that tag.
Recently, I was asked by a friend who could not figure out what to do with the papers of a deceased parent. Scanning them on your own or in scanning shops is time consuming and expensive, so a new thought came to me.
Set up a scanning table by mounting a camera that shoots 4K video looking down on the table. I have tripods that have an arm that extends out but there are many ways to mount it. Light the table brightly, and bring your papers. Then start the 4K video and start slapping the pages down (or pulling them off) as fast as you can.
There is no software today that can turn that video into a well scanned document. But there will be. Truth is, we could write it today, but nobody has. If you scan this way, you're making the bet that somebody will. Even if nobody does, you can still go into the video and find any page and pull it out by hand, it will just be a lot of work, and you would only do this for single pages, not for whole documents. You are literally saving the document "for the future" because you are depending on future technology to easily extract it.
Sooner than most expected, the Trump administration is in trouble. Many are talking about how to end it, or hasten that end.