(This is cross-posted on Taking Note.)
Avik Roy is an creative and engaging blogger. So is Austin Frakt. In addition, though, Frakt is a highly-skilled empirical health services researcher. So it’s a bit odd that Roy chooses to mix things up with Austin regarding instrumental variables studies that explore the impact of Medicaid coverage on health outcomes.
It is odder still that Roy writes a piece called “Why Medicaid is a Humanitarian Catastrophe.” He cites a useful but readily-misinterpreted surgical study which finds notably higher adjusted mortality rates among Medicaid patients than among the privately insured. Estimated mortality rates among Medicaid patients were also higher than that found among Medicare patients and the uninsured. Roy concludes the following from these findings:
This is, simply put, the greatest scandal in America. Bigger than Madoff, bigger than the Wall Street bailout, bigger even than the plight of the uninsured.
For all of TARP’s flaws, the government actually made money—$22 billion—bailing out the banks. For Medicaid, in contrast, we spend half a trillion dollars every year to provide the poor with worse care than is gained by the uninsured. How is this even possible? …
After I wrote about the issue, I expected many left-of-center policy types to share my concern. But instead I met indifference, denial, resistance, and even an accusation: that I was using the UVa study as a pretext to abandon the poor. In fact, the truth was and is quite the opposite. I want the poor to have great health care. On the other hand, very few people on the Left were willing to take on the challenging task of exploring why Medicaid patients fare worse than the uninsured, and how we might make Medicaid better.
I am just baffled by Roy’s essay. The study he cites cannot show what Roy claims it shows. (Along the way, Roy gratuitously insults Jonathan Gruber’s exemplary two-decade record of Medicaid policy research. I’ll let Jonathan respond for himself if he chooses.)
Roy calls this a landmark study, suggesting that is shows that people fare worse on Medicaid than they can by going uninsured and getting what people can on their own. In fairness, the study is titled “Primary payer status affects mortality for major surgical operations.” That title should not have passed peer review.
This is a valuable descriptive study which demonstrates that adjusted mortality is high among Medicaid surgical patients, even after one sensibly corrects for the kinds of potential confounders readily available in large-scale clinical databases. Indeed Medicaid patients have higher adjusted mortality than the uninsured. (The authors’ reported statistical findings compare Medicare, Medicaid, and uninsured patients to the privately-insured rather than each other. The authors don’t seem to report the statistical significance of the rather modest differences between Medicaid patients and the uninsured.)
As Austin notes, Medicare patients also fare worse than the uninsured on many outcomes. This pattern-and others reported in the paper-suggests that we are seeing straightforward selection bias. Medicaid patients face more difficult personal risk-factors and circumstances that lead to worse outcomes. The original paper even includes a postscript in which experts identify many ways in which such selection biases could arise.
In this study sample, Medicaid patients receive more costly care and had longer lengths of stay, which is consistent with some selection bias account. Some patients are enrolled into Medicaid during their hospital stay. Hospital staff and social service agencies may have greater motivation to pursue such processes when patients are especially sick or needy. Medicaid patients likely face greater economic, family, and educational obstacles. They use different hospitals and live in different communities. Some receive Medicaid because they have specific disabilities. Privately insured patients with minor issues may have better access to surgery. Some of these factors can be controlled in the statistical analysis. Others are unobserved. (See Austin for more on why this is an inherently dicey study design to test the causal impact of insurance coverage.)
Don’t get me wrong. The fact that Medicaid patients exhibit high mortality rates is an important descriptive finding. If this is more than an artifact of the data, understanding why this is happening may point the way to better policies.
I share Roy’s dismay that we don’t see better health outcomes among Medicaid patients. We don’t actually spend $500 billion on Medicaid. We do spend $373 billion, which is no small amount. We can do better.
The Affordable Care Act includes some elements to improve Medicaid-namely large subsidies to states and measures to raise primary care reimbursement rates. I’d like to see much more. Addressing the programs flaws will require more money spent on Medicaid-precisely the opposite of what is now being contemplated in Washington and across the states.
Expanding public insurance is not the only or the most powerful way to improve population health, but it’s important. Roy is correct that the evidence we have to-date regarding the health impact of Medicaid could be much better. Still, misinterpreting observational studies to disparage the program doesn’t advance this debate.
It’s Forbes - any columnist being correct there is an accident.
Harold:
Please don’t grace this study with dignity of being described as designed in any scientific sense of the word. What they did was to trawl through a large, pre-existing data set. They post-stratified by the patient’s payor status and ran a bunch of regression models.
Designed studies, by comparison, use randomization or random selection on the stratification on an a priori basis. I can’t get past the pay-wall, so I can’t evaluate the paper beyond the abstract. I do and teach this stuff for my living. The results are interesting, but (as you describe well) not definitive in any sense.
If some/many patients are enrolled into medicaid during their hospital stay, then it follows pretty much directly that the “uninsured” category is going to be biased toward those without significant prior hospitalizations, or indeed without significant prior contact with the public health infrastructure. I would blench at working through that confounder without notes-level data.
This is the 2nd time I’ve come across this site in the past couple years, and I’m just very glad you authors and contributors are here and writing and thinking and doing what you do. I think the hundred or so people in AZ who were kicked off their Medicaid by Jan Brewer (or at least kept from getting their needed organ transplants), used to find having it was better than being uninsured. I’m not saying this is terribly relevant to your discussion of Roy’s interpretations, but it’s the best I’ve got and I wanted to add something here, just this once.
I have “MaineCare”, ME’s Medicaid, and one or two of those “more difficult personal…circumstances that lead to worse outcomes”, but what bites most for my health is that even when a place does accept this insurance, there can be a “simmer” in the air that conveys they wish they didn’t have to. I know they don’t get reimbursed enough, so I go minimal or below on the office visits instead of trying harder to get what I need. And now we have a new tea partier-backed gov, LePage, adored by every non-principled conservative we got here, who makes me cringe. He makes me angry and embarrassed for my state, and distressed about whatever frameworks they are working up for the future.
I am heartened that there are people, you here, for instance, who have the capacity and energy and desire to understand things I can’t, seriously, so thanks! (very much!) It matters a lot. I like trying to read stuff here every once in a while.