Sh*t In, Sh*t Out? the Problem of Mortgage Data Corruption & Empirical Analysis
Empirical economic analysis is a powerful tool. It can elucidate correlations and sometimes even get us to causual explanations. But it has a serious weak-spot: its value is entirely dependent upon the integrity of the data analyzed. To put the problem succinctly: sh*t in, sh*t out.
This brings us to analyses of the housing bubble. There's a sizeable academic literature on the housing bubble (and relatedly also expert witness reports on loss causation in MBS litigation) that rely on loan-level data. The problem is that a lot of that loan-level data is suspect. That should hardly be a surprise: the industry even referred to some products as "liar loans". And there were also FBI Mortgage Fraud reports indicating an uptick in mortgage fraud. But it was easy for economists to ignore the data integrity problem as long as the problems were merely anecdotal (e.g., the mariachi musician with the six-figure income), and could be blissfully assumed to only affect a small number of loans.
No longer. It's hard to show mortgage fraud empirically, but there's a growing empirical literature about mortgage fraud. There are now a couple of academic studies demonstrating significant inflation of borrower income on loan applications (here and here and here and here and here). (To be clear, this does not mean that the income was inflated by the borrowers. It could be inflated by either borrowers or lenders, including loan brokers.) There's also a Fitch Ratings report from late 2007 that shows questionable stated income, employment, FICO scores, property occupancy status, and appraisals on a large percentage of a small sample of subprime loans.
I want to emphasize that this literature does not undermine all empirical work on the housing market during the bubble years. But it should give us pause when considering any analysis that relies on either loan-level or pool-level loan characteristics such as income, DTI, FICO, occupancy status, and LTV/CLTV. I suspect that the empirical mortgage fraud literature will not deter many economists from plowing ahead whenever their data produces a regression with statistical significance. And the studies might well be right in the end. But it should tell the rest of us to consume the studies with a grain of salt.
As to your title I think the question mark should be replaced by and exclamation point (Shi*t in Sh*t out!)
I also think the article ending with "But it should tell the rest of us to consume the studies with a grain of salt" should also state "if you believe this study, I have a bridge for you in Brooklyn."
Very good succinct title----says it all.
Posted by: Richard Davet | February 12, 2015 at 12:01 PM
I would hope that we can get some scholarly comments to help the Supreme Court of Ohio here:
http://www.legallyspeakingohio.com/2015/02/guest-post-standing-and-subject-matter-jurisdiction-in-ohio-foreclosure-actions-a-third-way/
Posted by: Richard Davet | February 12, 2015 at 12:05 PM
I think the proper phrase is GIGO (Garbage in, Garbage Out). I am glad to see continued scholarship in this area. It was a real surprise when it happened.
Posted by: John | February 15, 2015 at 01:36 PM
The courts are absolutely refusing even to acknowledge a fundamental standing issue, namely that effectively every REMIC from the period (and all these mortgages went into REMICs) had a clause in its creation documents voiding all transfers into the REMIC made after the closing date, that most of these mortgages were transferred late, and that the transfers are void. If the transfer of the mortgage was void, how does the REMIC and its servicer bank get to enforce it? You can talk all you want about being a holder, but that just gives the creditor the note and the right to enforce a debt, not the authority to reach the collateral securing it. Even the bankruptcy courts are ignoring the issue and simply log-rolling motions for relief from stay. So long as we keep ignoring the issues these messes have created, all we'll get is GIGO. On a good day.
Posted by: Knute Rife | February 26, 2015 at 08:25 PM