Link Post

Link Post – January 2019

Power generation and distribution is used in economics textbooks as the classic example of a natural monopoly. Lebanon proves this doesn’t have to be the case, with a mostly functional (and mostly illegal) parallel power distribution system that many people rely on to supplement the official system. I don’t think this should be used more generally – having a bunch of small generators is definitely more polluting – but it’s interesting to see that markets can work even in cases where people normally expect them to fail.

On the advice of a high school teacher, I once read most of the epic fantasy series “The Malazan Book of the Fallen”. One thing it made clear to me was just how dangerous and difficult it is to be an absolute ruler. Anyone who controls the information flow to you can essentially control you. By this token, it should be worrying that Xi Jinping is centralizing China around himself – leaving the government vulnerable to serious missteps if he’s given inaccurate information.

Speaking of China, here’s a story about two journalists accidentally winning a car chase in Xinjiang. Xinjiang is one of the most surveilled places in the world and up to one million Uighurs are currently held in concentration camps, which explains why the Chinese government is so on edge when journalists poke around.

Jackie Cochran had a life that reads like a novel; she founded the Women’s Airforce Service Pilots in World War II (which handled routine flying tasks, like airplane delivery, so more men could be fighter pilots), was instrumental in convincing Eisenhower to run for president, and served as a test pilot after the war. She was the first woman to break the sound barrier and holds more aviation height and distance records than anyone else who has ever lived. She also ran her own cosmetics company, charmed one of the ten richest men in the world, and helped kill the female astronaut program in the ’60s, probably “out of concern that she would no longer be the most prominent female aviator”. Fittingly, there’s a play about her unbelievable life.

Strangely touching recollections of working on Black Friday.

Tighter pollution laws can make cities much more livable – and be a boon to anyone with respiratory disease. But maybe they’re going too far when they threaten to destroy Montreal’s legendary bagel bakeries.

It’s almost a cliché to talk about how divided America is. This NYMag article takes the cliché to its (il-)logical conclusion and imagines an America divided between two interstate compacts (and a handful of neutrals). I don’t think it’s quite plausible, but there are many ways it seems better than the status quo?

I was surprised to find out that chicken pox is now considered a vaccine preventable disease and outbreaks of it are notable. I vaguely knew there was a vaccine now, but I didn’t realize that there’s now a whole generation of kids who never got chicken pox. Unfortunately, some parents dislike vaccines, so their kids are at risk of outbreaks (as well as shingles later in life).

Falsifiable

2019 Predictions

Here are my 95 predictions about the next year. If you’d like to make you own predictions, you can download my blank template. Like previous years (2017, 2017 results, 2018, 2018 results), I’ve broken them down by region.

Canada

  1. Liberals win the next Canadian election – 60%
  2. Majority government in the next Canadian election – 60%
  3. NDP loses seats in the next Canadian election – 80%
  4. Conservatives gain seats in the next Canadian election – 70%
  5. Jagmeet Singh is not in parliament at the end of 2019 – 51%
  6. No court finds the assisted dying bill isn’t in line with Carter v Canada in 2019 – 80%
  7. No court rules on carbon tax constitutionality in 2019 – 90%
  8. No terrorist attack in Canada that kills > 10 Canadians in 2019 – 90%
  9. Opioid poisoning deaths decline from 2018 levels in Canada – 80%
  10. Construction on the Trans Mountain pipeline does not begin again in 2019 – 90%
  11. Canadian unemployment rate at or below 6% at the end of 2019 – 60%
  12. Health Canada still doesn’t allow Soylent to enter the country by the end of 2019 – 70%

America

  1. Less than 100km of concrete wall (or steel slat wall) on the border with Mexico will be constructed – 80%
  2. No registry of Muslims created – 90%
  3. No department of the Federal Government is eliminated – 90%
  4. Congress and Trump do not sign into law an extension of DACA – 60%
  5. Mueller’s investigation finishes in 2019 – 70%
  6. Impeachment proceedings aimed at Trump are not started in 2019 – 60%
  7.  More than a dozen credible (having held past elected office representing at least 100,000 people) candidates declared for the Democratic primary by the end of 2019 – 80%
  8. Less than two dozen credible candidates declared for the democratic primary by the end of 2019 – 70%
  9. Trump is still president at the end of 2019 – 90%
  10. No terrorist attack in America that kills > 10 Americans – 70%
  11. No terrorist attack in America that kills > 100 Americans – 90%
  12. Opioid poisoning deaths decline from 2018 levels in America – 70%
  13. NGDP growth below 5% for 2019 – 60%
  14. US unemployment rate at or below 4% at the end of 2019 – 60%
  15. Some form of North American free trade deal still in effect at the end of 2019 – 80%
  16. At least two metros beyond Phoenix see open, commercial self-driving car services by the end of 2019 – 51%
  17. More than one month of cumulative government shut downs in 2019 – 51%

South America

  1. FARC peace deal remains in place on January 1, 2020 – 60%
  2. Inflation in Venezuela is above 10,000% for the year of 2019 (as measured by DolarToday) – 80%
  3. Venezuelan GDP continues to contract in 2019 – 90%
  4. United Socialist party retains control of the Venezuelan presidency in 2019 – 80%
  5. Protests (and the official response to those protests) result in more than 100 fatalities in Venezuela in 2019 – 51%
  6. Major Venezuelan opposition groups do not enter any sort of power sharing agreement with the Venezuelan regime in 2019 – 90%
  7. No successful coup in Venezuela in 2019 – 90%
  8. Venezuelan oil production below 750,000 bpd by the end of 2019 – 60%
  9. Brazilian Real down against the US dollar at the end of 2019 – 51%
  10. Argentina meets its 17% inflation target by ±2% – 70%
  11. Argentina meets its IMF target of primary budget balance by the start of 2020 – 51%

Middle East

  1. No Israeli politician is indicted by the ICC over settlement activity in 2019 – 90%
  2. Netanyahu is no longer prime minister of Israel at the end of 2019 – 51%
  3. No Palestinian led Intifada in Israel that results in the deaths of >1000 combined attackers, security forces, and civilians (this is a conflict characterized by suicide bombing and police responses) – 90%
  4. No Israeli led operation in the West Bank or Gaza that results in the deaths of >1000 combined soldiers, civilians, and militants (this is a conflict characterized by rocket fire and military strikes) – 80%
  5. Fatah and Hamas do not meaningfully reconcile in 2019 (e.g. Fatah still doesn’t control Gaza by January 1, 2020) – 70%
  6. No significant resurgence in ISIL in 2019 (e.g. it does not gain territory over the next year) – 90%
  7. Fewer casualties in the Syrian Civil War in 2019 than in 2018 – 70%
  8. No power sharing agreement or durable ceasefire (typified by the three months following the agreement each having less than 500 fatalities) in Syria in 2019 – 80%
  9. Bashar Al Assad is still President of Syria on January 1, 2020 – 90%
  10. Protests in Iran do not result in more than 100 fatalities by the end of 2019 – 70%
  11. Hassan Rouhani is still President of Iran on January 1, 2020 – 90%
  12. No new international sanctions against Iran (does not include adding new organizations or individuals to old categories and requires coordinated participation of at least two countries) – 80%
  13. America does not rejoin the JCPA – 90%
  14. No attack on the Iranian nuclear program by Israel – 90%
  15. Iran does not withdraw from the deal limiting its nuclear program – 80%
  16. Conditional on Iran remaining in the nuclear deal, inspectors find no evidence of violations after the deal began – 90%
  17. Yemen Civil War continues – 90%
  18. The Hodeidah ceasefire in Yemen is maintained for 2019 – 51%
  19. America withdraws support for Saudi Arabia in the Yemeni civil war – 51%
  20. Mohammed bin Salman either remains as crown prince of Saudi Arabia, or becomes king (i.e. no coup or succession shake-up) – 80%
  21. No resolution or lifting of embargo in the Qatar crisis – 80%
  22. OPEC production cuts continue through to the end of 2019 – 70%

Africa

  1. South Sudan peace deal holds – 60%
  2. Libya still has two rival governments on January 1, 2020 – 60%
  3. No protests, riots, or rebellion in Egypt that kills >100 people in a one week period – 80%
  4. No protests, riots, or rebellion in Tunisian kills >50 people in a one week period – 90%
  5. No terrorist attack in Tunisia kills >20 people – 80%
  6. ANC wins South African elections – 80%
  7. Botswana’s Transparency International rating closest to January 1, 2020 shows improvement under president Masisi – 60%

Asia

  1.  Inflation rate in Japan remains below 2% in 2019 – 90%
  2. Japanese constitutional reform (removing pacifism) does not occur in 2019 – 80%
  3. At least two more countries ratify the CPTPP in 2019 – 51%
  4. All signatories have not ratified the CPTPP by the end of 2019 – 90%
  5. North Korean détente with Trump last through 2019 (typified by no new sanctions or missile tests) – 51%
  6. Xi Jinping visits North Korea in 2019 – 80%
  7. US-China trade war ends – 51%
  8. Modi wins elections in India – 70%
  9. No return to democracy in Thailand in 2019 – 90%
  10. Legal deadlock on same-sex marriage in Taiwan not resolved this year – 51%

Europe

  1. No resolution to the crisis in Ukraine – 80%
  2. Ukrainian elections are held – 70%
  3. Poroshenko no longer president of Ukraine by end of 2019 – 60%
  4. Russian GDP growth is less than 3% – 80%
  5. No gain of greater than 20% in the value of the ruble vs. the dollar – 90%
  6. Fall of more than 10% in the value of the ruble vs. the dollar – 51%
  7. Sanctions against Russia are not significantly rolled back (e.g. sanctions remain in place against Rosneft, Novate, Gazprombank and Vnesheconombank by all members of the G7 remain in place at the end of 2019) – 90%
  8. Teresa May remains prime minister of the United Kingdom – 70%
  9. Brexit does not occur on or by March 29, 2019 – 60%
  10. No snap election/vote of no-confidence in the UK in 2019 – 60%
  11. No resolution to the Julian Assange situation – 60%
  12. Poland’s EU voting rights aren’t suspended – 70%
  13. Euroskeptics make gains in 2019 EU elections – 80%
  14. The average of the last 5 opinion polls of Macron collected on Wikipedia have his net favourability below -30% – 80%
  15. Italy keeps its budget within the agreed upon EU boundaries (triggering no fines or other disciplinary action) – 80%
  16. DeepMind releases an algorithm that can beat top humans in StarCraft II – 51%
Falsifiable

Grading My 2018 Predictions

In what is becoming a New Year’s tradition, let’s look at how accurately I predicted the future a year ago.

Canada

  1. Liberals remain ahead in the CBC Poll Tracker seat projection – 70%
  2. Trudeau has a higher net favorability rating than Andrew Scheer according to the CBC Leader Meter on January 1, 2019 – 80%
  3. Marijuana is legalized in time for Canada Day – 60%
  4. Marijuana is legalized in 2018 – 90%
  5. At least one court finds the assisted dying bill isn’t in line with Carter v Canada – 70%
  6. Ontario PC party wins the election – 60%
  7. The Ontario election results in a minority government – 80%
  8. The Quebec election results in a minority government – 80%
  9. No BC snap election in 2018 – 90%
  10. No terrorist attack in Canada that kills > 10 Canadians in 2018 – 90%
  11. More Canadian opioid poisoning deaths in 2018 than in 2017 – 60%
  12. Canada does better at the 2018 Winter Olympics (in both gold medals and total medals) than in 2014 – 90%
  13. Canada does not win a gold medal in men’s hockey at the 2018 Olympics – 70%
  14. Canada does win a gold medal in women’s hockey at the 2018 Olympics – 51%

America

  1. Trump announces that the US is pulling out of NAFTA and begins the process of putting the US withdrawal into motion – 51%
  2.  Less than 100km of concrete wall on the border with Mexico will be constructed – 90%
  3. No registry of Muslims created – 90%
  4. Congress doesn’t take action to extend DACA – 80%
  5. No department of the Federal Government is eliminated – 90%
  6. There isn’t a government shutdown before the midterm elections – 60%
  7. Democrats take back the house in the 2018 midterm elections – 80%
  8. Democrats take back the senate in the 2018 midterm elections – 60%
  9. Mueller’s investigation finishes in 2018 – 60%
  10. Impeachment proceedings aimed at Trump are not started in 2018 – 80%
  11. Trump is still president at the end of 2018 – 90%
  12. No terrorist attack in America that kills > 10 Americans – 70%
  13. No terrorist attack in America that kills > 100 Americans – 90%
  14. Susan Collins doesn’t get the Obamacare stabilization measures she was promised – 70%
  15. More US opioid poisoning deaths in 2018 than in 2017 – 80%

South America

  1. FARC peace deal remains in place on January 1, 2019 – 80%
  2. The black market exchange rate for Venezuelan Bolivars is above 110,000 to the US dollar on January 1, 2019 (as measured by DolarToday) – 80%
  3. Inflation in Venezuela is above 100% for the year of 2018 (as measured by DolarToday) – 90%
  4. United Socialist party retains control of the Venezuelan presidency in 2018 – 90%
  5. Protests (and the official response to those protests) result in more than 100 fatalities in Venezuela in 2018 – 60%
  6. Protests (and the official response to those protests) do not result in more than 1000 fatalities in Venezuela in 2018 – 70%
  7. Major Venezuelan opposition groups do not enter any sort of power sharing agreement with the Venezuelan regime in 2018 – 80%

Middle East

  1. No Israeli politician is indicted by the ICC over settlement activity in 2018 – 90%
  2. There isn’t an election in Israel in 2018 – 80%
  3. US does not physically relocate its embassy to Jerusalem in 2018 – 90%
  4. No Palestinian led Intifada in Israel that results in the deaths of >1000 combined attackers, security forces, and civilians (this is a conflict characterized by suicide bombing and police responses) – 70%
  5. No Israeli led operation in the West Bank or Gaza that results in the deaths of >1000 combined soldiers, civilians, and militants (this is a conflict characterized by rocket fire and military strikes) – 70%
  6. Fatah and Hamas do not meaningfully reconcile in 2018 (e.g. Fatah still doesn’t control Gaza by January 1, 2019) – 51%
  7. No significant resurgence in ISIL in 2018 (e.g. it does not gain territory over the next year) – 80%
  8. Fewer casualties in the Syrian Civil War in 2018 than in 2017 – 70%
  9. No power sharing agreement or durable ceasefire (typified by the three months following the agreement each having less than 500 fatalities) in Syria in 2018 – 80%
  10. Bashar Al Assad is still President of Syria on January 1, 2019 – 90%
  11. Protests in Iran do not result in more than 1000 fatalities by the end of 2018 – 70%
  12. Protests in Iran do not result in more than 100 fatalities by the end of 2018 – 51%
  13. Hassan Rouhani is still President of Iran on January 1, 2019 – 90%
  14. No new international sanctions against Iran (does not include adding new organizations or individuals to old categories and requires coordinated participation of at least two countries) – 80%
  15. No new US sanctions against Iran (does not include adding new organizations or individuals to old categories) – 51%
  16. No attack on the Iranian nuclear program by Israel – 90%
  17. Iran does not withdraw from the deal limiting its nuclear program – 90%
  18. Conditional on Iran remaining in the nuclear deal, inspectors find no evidence of violations after the deal began – 90%
  19. Yemen Civil War continues – 60%
  20. Saudi Arabia pulls troops out of Yemen – 51%
  21. Mohammed bin Salman either remains as crown prince of Saudi Arabia, or becomes king (i.e. no coup or succession shake-up) – 80%
  22. Rockets fired from Yemen cause casualties in another country – 51%
  23. No resolution or lifting of embargo in the Qatar crisis – 80%
  24. OPEC production cuts continue through to the end of 2018 – 60%

Africa

  1. No power sharing between ZANU-PF and the opposition will happen in Zimbabwe before the elections (if they occur) in 2018 – 80%
  2. Zimbabwe will hold election in 2018 – 70%
  3. No peace deal ends South Sudan fighting – 70%
  4. Libya still has two rival governments on January 1, 2019 – 70%
  5. No protests, riots, or rebellion in Egypt that kills >100 people in a one week period – 80%
  6. No protests, riots, or rebellion in Tunisian kills >50 people in a one week period – 90%
  7. No terrorist attack in Tunisia kills >20 people – 80%
  8. Zuma is not impeached in 2018 – 51%

Asia

  1.  Inflation rate in Japan still remains below 1% in 2018 – 70%
  2. Japanese constitutional reform (removing pacifism) does not occur in 2018 – 51%
  3. China will not deploy its military against Taiwan or Hong Kong in 2018 – 90%
  4. North Korea will test a submarine launched ballistic missile in 2018 – 70%
  5. North Korea will not test nuclear weapons or launch any missiles during the 2018 Olympics – 80%
  6. North Korea will test a nuclear weapon in 2018 – 51%
  7. No country will attempt to shoot down a North Korean missile test in 2018 – 80%
  8. If there is an attempt, it will succeed – 51%
  9. North Korea tests a missile that is judged by experts at 38 North as likely able to carry a plausible North Korean nuclear weapon to the United States – 60%
  10. No current member of China’s Politburo Standing Committee visits North Korea in 2018 – 70%
  11. No meeting between Kim Jung-un and Moon Jae-in in 2018 – 90%

Europe

  1. No resolution to the crisis in Ukraine – 80%
  2. Russian GDP growth is less than 3% – 80%
  3. No gain of greater than 20% in the value of the ruble vs. the dollar – 70%
  4. Sanctions against Russia are not significantly rolled back (e.g. sanctions remain in place against Rosneft, Novate, Gazprombank and Vnesheconombank by all members of the G7 remain in place at the end of 2018) – 90%
  5. Angela Merkel remains chancellor of Germany – 60%
  6. Germany holds another election before a government can be formed – 51%
  7. No date set for another Scottish referendum in 2018 – 80%
  8. Teresa May remains prime minister of the United Kingdom – 70%
  9. The UK does not terminate the process of Brexit in 2018 – 90%
  10. There is no final Brexit withdrawal deal reached in 2019 (Donald Tusk wishes to have one by October) – 51%
  11. No snap election/vote of no-confidence in the UK in 2018 – 80%
  12. Poland’s EU voting rights aren’t suspended – 90%
  13. Poland and Hungary continue to refuse to accept migrant quotas – 90%

Notes

  • I originally worried that I’d missed the mark with my Venezuelan devaluation predictions (South America #2), as DolarToday gave an exchange rate of 730.29 BsS. to the dollar. But it turns out the BsS. is a new currency, with each one equivalent to 100,000 of the old bolivars. This means the current exchange rate is 73,029,000 old bolivars to the USD. Inflation was 4305%. It is now an unfortunate fact that some online video game currencies are worth more than the old Venezuelan bolivar.
  • For Middle East #3, I got conflicting information from Wikipedia as to whether the embassy was officially moved, or just moved in name pending the ambassador finding a place to live in Jerusalem. I decided that it should count as moved for all practical purposes.
  • With respect to Middle East #15, I believe that the US withdrawing from the P5+1 deal and restarting sanctions should probably count as new sanctions.
  • I think Africa #8 is technically correct, because Zuma wasn’t impeached, but forced out by his party. Still, I think I will aim to make broader predictions about embattled leaders leaving in the future.
  • I calculate Japan’s inflation rate at around 1.05% based off the most recent statistics I could find, although this may need to be adjusted once December’s numbers are out and further adjusted once we have the year-end numbers. I got Asia #1 wrong, but not by much!
  • I was worried that no member of the standing committee had visited North Korea, potentially making Asia #10 a technical success, despite it obviously being falsified in spirit (by the three meetings in China by Xi Jinping and Kim Jong-un). Luckily, Li Zhanshu, a Standing Committee member, visited to commemorate the founding of North Korea.
  • I’m a bit unsure how I should treat Europe #10; the UK negotiated a Brexit deal, but no one actually believes in can pass parliament. I’m going to tentatively mark this as correct, but will revise if parliament passes this deal unaltered.
  • EDITED TO ADD: I originally didn’t mark America #6 as failed because I totally forgot about the one day government shutdown in January. I’ve since updated everything to add this in.

Calibration

The whole point of having predictions with binned probabilities (here, 51%, 60%, 70%, 80%, 90%) is that you can then check your accuracy; an individual prediction can be right or wrong, but when you pool several predictions you were equally sure of, you can tell if you were right or wrong to be that sure. Here’s how I did:

  • Of my predictions at a 51%confidence level, I got right and 6 wrong (50%).
  • Of my predictions at a 60%confidence level, I got 4 right and 7 wrong (36%).
  • Of my predictions at a 70%confidence level, I got 13 right and 5 wrong (72%).
  • Of my predictions at an 80%confidence level, I got 19 right and 5 wrong (79%).
  • Of my predictions at a 90%confidence level, I got 23 right and 2 wrong (92%).
  • Two predictions were invalid, because they were predicated on a North Korean missile test that never occurred.

Some people prefer to look at this graphically. Here I’ve plotted my answers versus what you’d expect if I was perfectly calibrated (something I say is 70% likely to happen happens 70% of the time). Whenever the blue line labelled “Mine” is below the red line labelled “Perfect”, I was overconfident. Whenever it’s above the red line, I was under-confident.

Like last year, I’m pleased with these results. Most of my probability bins were very well calibrated, although I seem to have become rather overconfident at the 60% level. I was under-confident at that level last year by a significant amount, so this might just be normal variance. I’ll keep an eye on this for next year.

In terms of specific classes of failed predictions, I can identify two.

First, I tend to overestimate how quickly bureaucratic processes will finish (see: 3, 5, 23). Second, I tend to assume the future will look much like the present (see: 11, 29, 72, 74-79). This might be because of the availability heuristic; the present is more available than alternative futures, so I might be viewing it as more likely than I should.

I hope to account for these biases in my soon to be released predictions for 2019. Stay tuned!

All About Me, Politics

Knocking on a thousand more doors – political campaigns revisited

“Hi, I’m Zach! I’m out here knocking on doors for Tenille Bonoguore, who is running to represent you in Ward 7. Do you have any questions for her, or concerns that you’d like her to know about…” is now a sentence I have said more than possibly any other.

Ontario had municipal elections on October 22nd. I looked at the bios of my local candidates, emailed all of them to find out more about their platforms, met with two of them, and ultimately decided that I wanted to help Tenille. Soon after that, I had been drafted to help manage canvassing efforts (although my colleague Tanya did more of that work than I did) and I was out knocking on doors again.

I knocked on countless doors and talked to an incredible variety of people. I don’t even know how many times I went out canvassing, but it was lots. More, I think, than the last time I did this.

This blog post outlines the differences (I found) between municipal politics and provincial politics, as well as the difference between volunteering for a campaign and being part of the core campaign team. I hope it can be informative for other people looking to get involved in politics any level.

The first thing I should mention about municipal campaigns is that they are (in many cities; Toronto is one notable exception) much smaller than campaigns for provincial or national government. If you’re volunteering for one, you will probably frequently meet and talk with the candidate. This was a big contrast to my volunteering at the provincial level, where I met the candidate only once (and that was brief), despite regularly canvassing on her behalf.

This, along with the non-partisan nature of many municipal elections means that volunteering at the municipal level is a much better way to get your voice heard. When there’s no party line to toe, your perspective (or a voter’s perspective as relayed by you) can change someone’s mind and lead to a (potential) city councillor voting differently.

Money also goes a lot further in municipal elections. Waterloo had a spending limit of around $12,000 (and I don’t know how many candidates even hit that). This means that donating a couple hundred dollars could make you one of the largest donors to a candidate. I don’t recommend this as a way of influencing policy – I didn’t see anyone act differently because of who donated and I sure as heck didn’t see donors get any sort of special “access”. Trying to get “access” is more or less pointless anyways; municipal boundaries are often small enough that a simple email is all you need to get real, detailed answers right from a candidate (or sitting counsellor).

That said donating is a great way to support a candidate you care about and help them get their message out.

The smaller scale of municipal campaigns also means that any past experience will probably make you the resident expert in something. When you volunteer for a provincial campaign, you’re a small cog in a big machine. When you volunteer municipally, it’s not like that.

Although not all campaigns need your help to the same degree. Incumbents almost never lose races municipally. Only one incumbent (out of 4 who stood for re-election) lost in Waterloo. In Cambridge, no incumbent counsellor lost re-election. Incumbent counsellors are also more likely to have an experienced existing team, potentially limiting the responsibility you could hold. This isn’t necessarily a bad thing! There’s lots to be said for learning skills from more experienced people.

Still, if your main goal is to maximize your contribution towards the election of candidates who you trust, you should focus on open seat races (a seat where there’s no incumbent, due to retirement, scandal, etc.). Second to open seat races might be challengers who are unusually good candidates (e.g. they have extensive community ties and recognition, or other political experience).

(This is speculative. Local conditions may vary. You, or a sitting counsellor you trust might be best positioned to figure out where you can do the most good)

The ease in which you can find yourself in a position of responsibility in a municipal campaign comes with one drawback if you accept it – it can be stressful to be responsible. I don’t want to discourage anyone from getting involved, but I did find even my limited leadership role a source of stress.

From my point of view, three things make being part of a campaign team stressful:

  1. It’s a lot of work; the emotion work of listening to people’s concerns can be emotionally draining and the walking physically taxing. This leads to you trying to do admin work when tired and worn-out.
  2. The outcome is uncertain. Many people like certainty and the combination of caring about a specific outcome a lot and being unsure if it will come about can wear you down.
  3. The buck stops with you. When you’re a simple canvasser, you just need to show up; everything else is taken care of. When people asked me to do things, they wouldn’t get done unless I took care of them.

Now there were two further factors that probably made this more stressful for me than the average volunteer. First, I was working around my blogging French practice. If I was exhausted from campaigning and didn’t work on them, I’d beat myself up about it. People who respond to exhaustion in healthier ways (hint: any other way) wouldn’t have this stressor.

Second, one of the other candidates may have been engaging in underhanded tactics. As a young idealist, I took this rather hard and wasted a lot of energy being angry about it.

Now, I want to be clear that me being such a ball of stress wasn’t the fault of the campaign or anyone else in it.

I read an article a few months ago (that I’m now no longer able to find) about a campaign run and almost entirely staffed by women in California. The women who worked on it talked about how supportive the environment was and how useful it was to have things like “what are times you need off for childcare?” and “please let us know if you feel like you’re taking on too much” asked explicitly at the start.

Tenille’s campaign wasn’t run entirely by women, but it was pretty close (there was only myself and her husband on the core team). And just like the campaign I read about in California, Tenille and Zivy (our campaign manager) did an excellent job checking in with everyone and doing their best to make sure no one took on too much. If I pushed myself past the point I should have, it wasn’t for lack of them trying to create a campaign that didn’t encourage that.

I don’t want to get all gender essentialist here, but working on this campaign made me genuinely believe that women might bring something important and different to the political process. Previously, I’d wanted to see gender balance in elected representatives for basic fairness reasons. Now I find myself even more committed to it.

I think there were two things that made the stress all worth it. The first was getting Tenille elected. I was continually floored by just how good she will be as a counsellor. She knows so much about how Waterloo’s weird two-level government works, has been very involved in the community, and has a journalist’s instinct for hard questions. The second upside is all the other people I met.

There’s this branch of decision theory called functional decision theory that claims the key component of decision making is the algorithm that people use to make decisions. Functional decision theory holds that you can coordinate with someone without talking to them, as long as you can make an accurate guess as to what their decision-making algorithm will be.

This is relevant to campaigning, because you can coordinate with other cool people with similar beliefs to all end in the same room. All you have to do is figure out what candidate they’ll volunteer for and get on her campaign team. Then you’ll all show up in that candidate’s living room, drink coffee, and figure out how to get her elected.

(This can also be a general piece of advice; if you want to meet people you’ll find cool, go do whatever you think a 10% cooler version of you would do. Being part of a core campaign team works so well for this because you’ll spend a lot of time with the other members and be in a social context that provides lots of stuff for you all to talk about. This beats being a canvassing volunteer, where you’ll only see the same people intermittently and have less of a context that encourages mingling.)

Most of the people I met through the campaign are in a rather different stage of life than I am; they aren’t all young techies like most of my other friends. Many of them had kids. Some of them even had jobs outside of tech! Despite the fact that our lives looked rather different, I found I really liked them. They were universally kind, thoughtful, and willing to listen to other perspectives.

(It is rare that I get to hear multiple people talk about why that had kids, what they expected to get out of it, and how they were surprised, but it turns out I really enjoy it when I do. Knowing people at other stages of life is great because you can get advice about your stage of life.)

We had a potluck and reunion a month after the campaign was over and I found myself giddy afterwards; it wasn’t just the stress of the campaign that made me like them. They’re just cool people.

The social scientist Jonathon Haidt wrote in The Righteous Mind that many of the experiences people highlight as the most meaningful in their life happen in the context of some shared struggle. Whatever the depredations, working together for some important cause feels good. In my last post on canvassing, I also quoted Hannah Arendt, who talked about the “extreme pleasure” of working in a group. She was right. Haidt is right as well. Canvassing, volunteering, trying to get someone elected – these are all things that you will look back on and feel proud about.

It’s for these reasons – and because politics needs good, dedicated, decent people – that I recommend becoming involved at any and all levels of government. You don’t have to run yourself. There are plenty of excellent candidates out there who need help, money, and time. If you’re new to politics, consider volunteering to knock on doors. If you’re an old hand, consider taking on a leadership role.

You might change the world. And you might make amazing friends.

Model, Quick Fix

When QALYs Are Wrong – Thoughts on the Gates Foundation

Every year, I check in to see if we’ve eradicated polio or guinea worm yet. Disease eradications are a big deal. We’ve only successfully eradicated one disease – smallpox – so being so close to wiping out two more is very exciting.

Still, when I looked at how much resources were committed to polio eradication (especially by the Gates Foundation), I noticed they seemed incongruent with its effects. No polio eradication effort can be found among GiveWell’s top charities, because it is currently rather expensive to prevent polio. The amount of quality-adjusted life years (QALYs, a common measure of charity effectiveness used in the Effective Altruism community) you can save with a donation to preventing malaria is just higher than for polio.

I briefly wondered if it might not be better for all of the effort going to polio eradication to instead go to anti-malaria programs. After thinking some more, I’ve decided that this would be a grave mistake. Since I haven’t seen why explained anywhere else, I figured I’d share my thinking, so that anyone else having the same thought can see it.

A while back, it was much cheaper to buy QALYs using the polio vaccines. As recently as 1988, there were more than 350,000 cases of polio every year. It’s a testament to the excellent work of the World Health Organization and its partners that polio has become so much rarer – and therefore so much more expensive to prevent each new case of. After all, when there are few new cases, you can’t prevent thousands.

It is obviously very good that there are few cases of polio. If we decided that this was good enough and diverted resources towards treating other diseases, we might quickly find that this would no longer be the case. Polio could once again become a source of easy QALY improvements – because it would be running rampant in unvaccinated populations. When phrased this way, I hope it’s clear that polio becoming a source of cheap QALY improvements isn’t a good thing; the existence of cheap QALY improvements means that we’ve dropped the ball on a potentially stoppable disease.

If polio is eradicated for good, we can stop putting any effort into fighting it. We won’t need any more polio vaccines or any more polio monitoring. It’s for this reason that we’re much better off if we finish the eradication effort.

What I hadn’t realized was that a simple focus on present QALYs obscures the potential effects our actions can have on future QALYs. Abandoning diseases until treatments for them save many lives cheaply might look good for our short term effectiveness, but in the long term, the greatest gains come from following through with our eradication efforts, so that we can repurpose all resources from an eradicated disease to the fight against another, forever.

Link Post

Link Post – December 2018

This true crime story ticks a lot of my boxes. The villain is created by the slow entropic decay of corruption and temptation, while the hero chose to prosecute white collar crimes because he wanted to go after crimes of greed, not desperation. I continue to believe that as a society, we’re too lenient on crimes of greed and too harsh on crimes of desperation, so it was easy to cheer the prosecution on.

This post claims that the pharmaceutical industry is soon going to fall apart because returns on R&D aren’t keeping up; all the low hanging fruit is gone and none of the harder to reach stuff is profitable. If anyone can give me a sense of how deeply I should be worried by this, I’ll be deeply appreciative.

If your restaurant is failing, or if you want to maximize your chances of success when you open a new location, you can apparently turn to restaurant consultants. I was especially appreciative of their weird specialized vocabulary.

The first commercial flight to circumnavigate the world did so accidentally, soon after the attack on Pearl Harbour made its return flight over the Pacific too dangerous. This is one of the cases where you want to yell at reality for being too unrealistic with its tropes; it features everything from an accidental passenger to a near miss in a mine field.

When I wrote about scrip stamp currencies, I joked that if they lasted more than a couple years, they’d melt down in some bizarre way. Alberta provides a real life example, where the scrip stamp system broke down within a month.

I’m young enough that I kind of just assumed the food item known as “the wrap” always existed. Turns out this is not the case! This article tracks the rise of wraps and the mania that surrounded them, as well as their inevitable fall and strange afterlife as a bland staple in catered lunches.

In 1994, Paul Krugman wrote the famous “Myth of Asia’s Miracle“, which claimed that Asian countries could not maintain their high growth rates indefinitely, especially because they lacked high productivity growth. 15 years later, another economist revisits this assertion and shows that massive re-investment can more than make up for slow productivity growth and drive strong overall growth. Turns out that in nation-building, quantity can have a quality all of its own.

LASIK side-effects worse, more common than most people realize.

I found a record of important political events from 1890 and I have to say, I’m glad we’ve come so far since the 19th century. Back then, the rest of the world was ganging up on America for taking a sudden protectionist turn, which doesn’t remind me of anything current at all.

I find I really enjoy it when judges are acerb, which makes this paper written by a judge about how annoying lawyers like catnip to me. It contains the line: ‘On mornings when I am scheduled to hear a family case, if someone greets me in the court house hallway with, “Have a good morning, Your Honour,” I typically reply, “Thank you, but I have other plans.” I adhere to the view that a legal system without Family Court is like Christianity without Hell.’, in the introduction, so you can tell right away that it’s going to be good.

Economics, Model

Why External Debt is so Dangerous to Developing Countries

I have previously written about how to evaluate and think about public debt in stable, developed countries. There, the overall message was that the dangers of debt were often (but not always) overhyped and cynically used by certain politicians. In a throwaway remark, I suggested the case was rather different for developing countries. This post unpacks that remark. It looks at why things go so poorly when developing countries take on debt and lays out a set of policies that I think could help developing countries that have high debt loads.

The very first difference in debt between developed and developing countries lies in the available terms of credit; developing countries get much worse terms. This makes sense, as they’re often much more likely to default on their debt. Interest scales with risk and it just is riskier to lend money to Zimbabwe than to Canada.

But interest payments aren’t the only way in which developing countries get worse terms. They are also given fewer options for the currency they take loans out in. And by fewer, I mean very few. I don’t think many developing countries are getting loans that aren’t denominated in US dollars, Euros, or, if dealing with China, Yuan. Contrast this with Canada, which has no problem taking out loans in its own currency.

When you own the currency of your debts, you can devalue it in response to high debt loads, making your debts cheaper to pay off in real terms (that is to say, your debt will be equivalent to fewer goods and services than it was before you caused inflation by devaluing your currency). This is bad for lenders. In the event of devaluation, they lose money. Depending on the severity of the inflation, it could be worse for them than a simple default would be, because they cannot even try and recover part of the loan in court proceedings.

(Devaluations don’t have to be large to be reduce debt costs; they can also take the form of slightly higher inflation, such that interest is essentially nil on any loans. This is still quite bad for lenders and savers, although less likely to be worse than an actual default. The real risk comes when a country with little economic sophistication tries to engineer slightly higher inflation. It seems likely that they could drastically overshoot, with all of the attendant consequences.)

Devaluations and inflation are also politically fraught. They are especially hard on pensioners and anyone living on a fixed income – which is exactly the population most likely to make their displeasure felt at the ballot box. Lenders know that many interest groups would oppose a Canadian devaluation, but these sorts of governance controls and civil society pressure groups often just doesn’t exist (or are easily ignored by authoritarian leaders) in the developing world, which means devaluations can be less politically difficult [1].

Having the option to devalue isn’t the only reason why you might want your debts denominated in your own currency (after all, it is rarely exercised). Having debts denominated in a foreign currency can be very disruptive to the domestic priorities of your country.

The Canadian dollar is primarily used by Canadians to buy stuff they want [2]. The Canadian government naturally ends up with Canadian dollars when people pay their taxes. This makes the loan repayment process very simple. Canadians just need to do what they’d do anyway and as long as tax rates are sufficient, loans will be repaid.

When a developing country takes out a loan denominated in foreign currency, they need some way to turn domestic production into that foreign currency in order to make repayments. This is only possible insofar as their economy produces something that people using the loan currency (often USD) want. Notably, this could be very different than what the people in the country want.

For example, the people of a country could want to grow staple crops, like cassava or maize. Unfortunately, they won’t really be able to sell these staples for USD; there isn’t much market for either in the US. There very well could be room for the country to export bananas to the US, but this means that some of their farmland must be diverted away from growing staples for domestic consumption and towards growing cash crops for foreign consumption. The government will have an incentive to push people towards this type of agriculture, because they need commodities that can be sold for USD in order to make their loan payments [3].

As long as the need for foreign currency persists, countries can be locked into resource extraction and left unable to progress towards a more mature manufacturing- or knowledge-based economies.

This is bad enough, but there’s often greater economic damage when a country defaults on its foreign loans – and default many developing countries will, because they take on debt in a highly procyclical way [4].

A variable, indicator, or quantity is said to be procyclical if it is correlated with the overall health of an economy. We say that developing nation debt is procyclical because it tends to expand while economies are undergoing expansion. Specifically, new developing country debts seem to be correlated with many commodity prices. When commodity prices are high, it’s easier for developing countries that export them to take on debt.

It’s easy to see why this might be the case. Increasing commodity prices make the economies of developing countries look better. Exporting commodities can bring in a lot of money, which can have spillover effects that help the broader economy. As long as taxation isn’t too much a mess, export revenues make government revenues higher. All of this makes a country look like a safer bet, which makes credit cheaper, which makes a country more likely to take it on.

Unfortunately (for resource dependent countries; fortunately for consumes), most commodity price increases do not last forever. It is important to remember that prices are a signal – and that high prices are a giant flag that says “here be money”. Persistently high prices lead to increased production, which can eventually lead to a glut and falling prices. This most recently and spectacularly happened in 2014-2015, as American and Canadian unconventional oil and gas extraction led to a crash in the global price of oil [5].

When commodity prices crash, indebted, export-dependent countries are in big trouble. They are saddled with debt that is doubly difficult to pay back. First, their primary source of foreign cash for paying off their debts is gone with the crash in commodity prices (this will look like their currency plummeting in value). Second, their domestic tax base is much lower, starving them of revenue.

Even if a country wants to keep paying its debts, a commodity crash can leave them with no choice but a default. A dismal exchange rate and minuscule government revenues mean that the money to pay back dollar denominated debts just doesn’t exist.

Oddly enough, defaulting can offer some relief from problems; it often comes bundled with a restructuring, which results in lower debt payments. Unfortunately, this relief tends to be temporary. Unless it’s coupled with strict austerity, it tends to lead into another problem: devastating inflation.

Countries that end up defaulting on external debt are generally not living within their long-term means. Often, they’re providing a level of public services that are unsustainable without foreign borrowing, or they’re seeing so much government money diverted by corrupt officials that foreign debt is the only way to keep the lights on. One inevitable effect of a default is losing access to credit markets. Even when a restructuring can stem the short-term bleeding, there is often a budget hole left behind when the foreign cash dries up [6]. Inflation occurs because many governments with weak institutions fill this budgetary void with the printing press.

There is nothing inherently wrong with printing money, just like there’s nothing inherently wrong with having a shot of whiskey. A shot of whiskey can give you the courage to ask out the cute person at the bar; it can get you nerved up to sing in front of your friends. Or it can lead to ten more shots and a crushing hangover. Printing money is like taking shots. In some circumstances, it can really improve your life, it’s fine in moderation, but if you overdue it you’re in for a bad time.

When developing countries turn to the printing press, they often do it like a sailor turning to whiskey after six weeks of enforced sobriety.

Teachers need to be paid? Print some money. Social assistance? Print more money. Roads need to be maintained? Print even more money.

The money supply should normally expand only slightly more quickly than economic growth [7]. When it expands more quickly, prices begin to increase in lockstep. People are still paid, but the money is worth less. Savings disappear. Velocity (the speed with which money travels through the economy) increases as people try and spend money as quickly as possible, driving prices ever higher.

As the currency becomes less and less valuable, it becomes harder and harder to pay for imports. We’ve already talked about how you can only buy external goods in your own currency to the extent that people outside your country have a use for your currency. No one has a use for a rapidly inflating currency. This is why Venezuela is facing shortages of food and medicine – commodities it formerly imported but now cannot afford.

The terminal state of inflation is hyperinflation, where people need to put their currency in wheelbarrows to do anything with it. Anyone who has read about Germany in the 1930s knows that hyperinflation opens the door to demagogues and coups – to anything or anyone who can convince the people that the suffering can be stopped.

Taking into account all of this – the inflation, the banana plantations, the boom and bust cycles – it seems clear that it might be better if developing countries took on less debt. Why don’t they?

One possible explanation is the IMF (International Monetary Fund). The IMF often acts as a lender of last resort, giving countries bridging loans and negotiating new repayment terms when the prospect of default is raised. The measures that the IMF takes to help countries repay their debts have earned it many critics who rightly note that there can be a human cost to the budget cuts the IMF demands as a condition for aid [8]. Unfortunately, this is not the only way the IMF might make sovereign defaults worse. It also seems likely that the IMF represents a significant moral hazard, one that encourages risky lending to countries that cannot sustain debt loads long-term [9].

A moral hazard is any situation in which someone takes risks knowing that they won’t have to pay the penalty if their bet goes sour. Within the context of international debt and the IMF, a moral hazard arises when lenders know that they will be able to count on an IMF bailout to help them recover their principle in the event of a default.

In a world without the IMF, it is very possible that borrowing costs would be higher for developing countries, which could serve as a deterrent to taking on debt.

(It’s also possible that countries with weak institutions and bad governance will always take on unsustainable levels of debt, absent some external force stopping them. It’s for this reason that I’d prefer some sort of qualified ban on loaning to developing countries that have debt above some small fraction of their GDP over any plan that relies on abolishing the IMF in the hopes of solving all problems related to developing country debt.)

Paired with a qualified ban on new debt [10], I think there are two good arguments for forgiving much of the debt currently held by many developing countries.

First and simplest are the humanitarian reasons. Freed of debt burdens, developing countries might be able to provide more services for their citizens, or invest in infrastructure so that they could grow more quickly. Debt forgiveness would have to be paired with institutional reform and increased transparency, so that newfound surpluses aren’t diverted into the pockets of kleptocrats, which means any forgiveness policy could have the added benefit of acting as a big stick to force much needed governance changes.

Second is the doctrine of odious debts. An odious debt is any debt incurred by a despotic leader for the purpose of enriching themself or their cronies, or repressing their citizens. Under the legal doctrine of odious debts, these debts should be treated as the personal debt of the despot and wiped out whenever there is a change in regime. The logic behind this doctrine is simple: by loaning to a despot and enabling their repression, the creditors committed a violent act against the people of the country. Those people should have no obligation (legal or moral) to pay back their aggressors.

The doctrine of odious debts wouldn’t apply to every indebted developing country, but serious arguments can be made that several countries (such as Venezuela) should expect at least some reduction in their debts should the local regime change and international legal scholars (and courts) recognize the odious debt principle.

Until international progress is made on a clear list of conditions under which countries cannot take on new debt and a comprehensive program of debt forgiveness, we’re going to see the same cycle repeat over and over again. Countries will take on debt when their commodities are expensive, locking them into an economy dependent on resource extraction. Then prices will fall, default will loom, and the IMF will protect investors. Countries are left gutted, lenders are left rich, taxpayers the world over hold the bag, and poverty and misery continue – until the cycle starts over once again.

A global economy without this cycle of boom, bust, and poverty might be one of our best chances of providing stable, sustainable growth to everyone in the world. I hope one day we get to see it.

Footnotes

[1] I so wanted to get through this post without any footnotes, but here we are.

There’s one other reason why e.g. Canada is a lower risk for devaluation than e.g. Venezuela: central bank independence. The Bank of Canada is staffed by expert economists and somewhat isolated from political interference. It is unclear just how much it would be willing to devalue the currency, even if that was the desire of the Government of Canada.

Monetary policy is one lever of power that almost no developed country is willing to trust directly to politicians, a safeguard that doesn’t exist in all developing countries. Without it, devaluation and inflation risk are much higher. ^

[2] Secondarily it’s used to speculatively bet on the health of the resource extraction portion of the global economy, but that’s not like, too major of a thing. ^

[3] It’s not that the government is directly selling the bananas for USD. It’s that the government collects taxes in the local currency and the local currency cannot be converted to USD unless the country has something that USD holders want. Exchange rates are determined based on how much people want to hold one currency vs. another. A decrease in the value of products produced by a country relative to other parts of the global economy means that people will be less interested in holding that country’s currency and its value will fall. This is what happened in 2015 to the Canadian dollar; oil prices fell (while other commodity prices held steady) and the value of the dollar dropped.

Countries that are heavily dependent on the export of only one or two commodities can see wild swings in their currencies as those underlying commodities change in value. The Russian ruble, for example, is very tightly linked to the price of oil; it lost half its value between 2014 and 2016, during the oil price slump. This is a much larger depreciation than the Canadian dollar (which also suffered, but was buoyed up by Canada’s greater economic diversity). ^

[4] This section is drawn from the research of Dr. Karmen Reinhart and Dr. Kenneth Rogoff, as reported in This Time Is Different, Chapter 5: Cycles of Default on External Debt. ^

[5] This is why peak oil theories ultimately fell apart. Proponents didn’t realize that consistently high oil prices would lead to the exploitation of unconventional hydrocarbons. The initial research and development of these new sources made sense only because of the sky-high oil prices of the day. In an efficient market, profits will always eventually return to 0. We don’t have a perfectly efficient market, but it’s efficient enough that commodity prices rarely stay too high for too long. ^

[6] Access to foreign cash is gone because no one lends money to countries that just defaulted on their debts. Access to external credit does often come back the next time there’s a commodity bubble, but that could be a decade in the future. ^

[7] In some downturns, a bit of extra inflation can help lower sticky wages in real terms and return a country to full employment. My reading suggests that commodity crashes are not one of those cases. ^

[8] I’m cynical enough to believe that there is enough graft in most of these cases that human costs could be largely averted, if only the leaders of the country were forced to see their graft dry up. I’m also pragmatic enough to believe that this will rarely happen. I do believe that one positive impact of the IMF getting involved is that its status as an international institution gives it more power with which to force transparency upon debtor nations and attempt to stop diversion of public money to well-connected insiders. ^

[9] A quick search found two papers that claimed there was a moral hazard associated with the IMF and one article hosted by the IMF (and as far as I can tell, later at least somewhat repudiated by the author in the book cited in [4]) that claims there is no moral hazard. Draw what conclusions from this you will. ^

[10] I’m not entirely sure what such a ban would look like, but I’m thinking some hard cap on amount loaned based on percent of GDP, with the percent able to rise in response to reforms that boost transparency, cut corruption, and establish modern safeguards on the central bank. ^

Model, Philosophy

Against Novelty Culture

So, there’s this thing that happens in certain intellectual communities, like (to give a totally random example) social psychology. This thing is that novel takes are rewarded. New insights are rewarded. Figuring out things that no one has before is rewarded. The high-status people in such a community are the ones who come up with and disseminate many new insights.

On the face of it, this is good! New insights are how we get penicillin and flight and Pad Thai burritos. But there’s one itty bitty little problem with building a culture around it.

Good (and correct!) new ideas are a finite resource.

This isn’t news. Back in 2005, John Ioannidis laid out the case for “most published research findings” being false. It turns out that when you have a small chance of coming up with a correct idea even using statistical tests for to find false positives can break down.

A quick example. There are approximately 25,000 genes in the human genome. Imagine you are searching for genes that increase the risk of schizophrenia (chosen for this example because it is a complex condition believed to be linked to many genes). If there are 100 genes involved in schizophrenia, the odds of any given gene chosen at random being involved are 1 in 250. You, the investigating scientist, decide that you want about an 80% chance of finding some genes that are linked (this is called study power and 80% is a common value) You run a bunch of tests, analyze a bunch of DNA, and think you have a candidate. This gene has been “proven” to be associated with schizophrenia at a p=0.05 confidence level.

(A p-value is the possibility of observing an event at least as extreme as the observed one, if the null hypothesis is true. This means that if the gene isn’t associated with schizophrenia, there is only a 1 in 20 chance – 5% – we’d see a result as extreme or more extreme than the one we observed.)

At the start, we had a 1 in 250 chance of finding a gene. Now that we have a gene, we think there’s a 19 in 20 chance that it’s actually partially responsible for schizophrenia (technically, if we looked at multiple candidates, we should do something slightly different here, but many scientists still don’t, making this still a valid example). Which probability to we trust?

There’s actually an equation to figure it out. It’s called Bayes Rule and statisticians and scientists use it to update probabilities in response to new information. It goes like this:

(You can sing this to the tune of Hallelujah; take P of A when given B / times P of A a priori / divide the whole thing by B’s expectation / new evidence you may soon find / but you will not be in a bind / for you can add it to your calculation.)

In plain language, it means that probability of something being true after an observation (P(A|B)) is equal to the probability of it being true absent any observations (P(A), 1 in 250 here), times the probability of the observation happening if it is true (P(B|A), 0.8 here), divided by the baseline probability of the observation (P(B), 1 in 20 here).

With these numbers from our example, we can see that the probability of a gene actually being associated with schizophrenia when it has a confidence level of 0.05 is… 6.4%.

I took this long detour to illustrate a very important point: one of the strongest determinants of how likely something is to actually be true is the base chance it has of being true. If we expected 1000 genes to be associated with schizophrenia, then the base chance would be 1 in 25, and the probability our gene actually plays a role would jump up to 64%.

To have ten times the chance of getting a study right, you can be 10 times more selective (which probably requires much more than ten times the effort)… or you can investigate something ten times as likely to actually occur. Base rates can be more powerful than statistics, more powerful than arguments, and more powerful than common sense.

This suggests that any community that bases status around producing novel insights will mostly become a community based around producing novel-seeming (but false!) insights once it exhausts all of the available true (and easily attainable) insights it could discover. There isn’t a harsh dividing line, just a gradual trend towards plausible nonsense as the underlying vein of truth is mined out, but the studies and blog posts continue.

Except the reality is probably even worse, because any competition for status in such a community (tenure, page views) will become an iterative process that rewards those best able to come up with plausible sounding wrappers on unfortunately false information.

When this happens, we have people publishing studies with terrible analyses but highly sharable titles (anyone remember the himmicanes paper?), with the people at the top calling anyone who questions their shoddy research “methodological terrorists“.

I know I have at least one friend who is rolling their eyes right now, because I always make fun of the reproducibility crisis in psychology.

But I’m just using that because it’s a convenient example. What I’m really worried about is the Effective Altruism community.

(Effective Altruism is a movement that attempts to maximize the good that charitable donations can do by encouraging donation to the charities that have the highest positive impact per dollar spent. One list of highly effective charities can be found on GiveWell; Givewell has demonstrated a noted trend away from novelty such that I believe this post does not apply to them.)

We are a group of people with countless forums and blogs, as well as several organizations devoted to analyzing the evidence around charity effectiveness. We have conventional organizations, like GiveWell, coexisting with less conventional alternatives, like Wild-Animal Suffering Research.

All of these organizations need to justify their existence somehow. All of these blogs need to get shares and upvotes from someone.

If you believe (like I do) that the number of good charity recommendations might be quite small, then it follows that a large intellectual ecosystem will quickly exhaust these possibilities and begin finding plausible sounding alternatives.

I find it hard to believe that this isn’t already happening. We have people claiming that giving your friends cash or buying pizza for community events is the most effective charity. We have discussions of whether there is suffering in the fundamental particles of physics.

Effective Altruism is as much a philosophy movement as an empirical one. It isn’t always the case that we’ll be using P-values and statistics in our assessment. Sometimes, arguments are purely moral (like arguments about how much weight we should give to insect suffering). But both types of arguments can eventually drift into plausible sounding nonsense if we exhaust all of the real content.

There is no reason to expect that we should be able to tell when this happens. Certainly, experimental psychology wasn’t able to until several years after much-hyped studies more-or-less stopped replicating, despite a population that many people would have previously described as full of serious-minded empiricists. Many psychology researchers still won’t admit that much of the past work needs to be revisited and potentially binned.

This is a problem of incentives, but I don’t know how to make the incentives any better. As a blogger (albeit one who largely summarizes and connects ideas first broached by others), I can tell you that many of the people who blog do it because they can’t not write. There’s always going to be people competing to get their ideas heard and the people who most consistently provide satisfying insights will most often end up with more views.

Therefore, I suggest caution. We do not know how many true insights we should expect, so we cannot tell how likely to be true anything that feels insightful actually is. Against this, the best defense is highly developed scepticism. Always remember to ask for implications of new insights and to determine what information would falsify them. Always assume new insights have a low chance of being true. Notice when there seems to be a pressure to produce novel insights long after the low hanging fruit is gone and be wary of anyone in tat ecosystem.

We might not be able to change novelty culture, but we can do our best to guard against it.

[Special thanks to Cody Wild for coming up with most of the lyrics to Bayesian Hallelujah.]

Model

Hidden Disparate Impact

It is against commonly held intuitions that a group can be both over-represented in a profession, school, or program, and discriminated against. The simplest way to test for discrimination is to look at the general population, find the percent that a group represents, then expect them to represent exactly that percentage in any endeavour, absent discrimination.

Harvard, for example, is 17.1% Asian-American (foreign students are broken out separately in the statistics I found, so we’re only talking about American citizens or permanent residents in this post). America as a whole is 4.8% Asian-American. Therefore, many people will conclude that there is no discrimination happening against Asian-Americans at Harvard.

This is what would happen under many disparate impact analyses of discrimination, where the first step to showing discrimination is showing one group being accepted (for housing, employment, education, etc.) at a lower rate than another.

I think this naïve view is deeply flawed. First, we have clear evidence that Harvard is discriminating against Asian-Americans. When Harvard assigned personality scores to applicants, Asian-Americans were given the lowest scores of any ethnic group. When actual people met with Asian-American applicants, their personality scores were the same as everyone else’s; Harvard had assigned many of the low ratings without ever meeting the students, in what many suspect is an attempt to keep Asian-Americans below 20% of the student body.

Personality ratings in college admissions have a long and ugly history. They were invented to enforce quotas on Jews in the 1920s. These discriminatory quotas had a chilling effect on Jewish students; Dr. Jonas Salk, the inventor of the polio vaccine, chose the schools he attended primarily because they were among the few which didn’t discriminate against Jews. Imagine how prevalent and all-encompassing the quotas had to be for him to be affected.

If these discriminatory personality scores were dropped (or Harvard stopped fabricating bad results for Asian-Americans), Asian-American admissions at Harvard would rise.

This is because the proper measure of how many Asian-Americans should get into Harvard has little to do with their percentage of the population. It has to do with how many would meet Harvard’s formal admission criteria. Since Asian-Americans have much higher test scores than any other demographic group in America, it only stands to reason that we should expect to see Asian-Americans over-represented among any segment of the population that is selected at least in part by their test scores.

Put simply, Asian-American test scores are so good (on average) that we should expect to see proportionately more Asian-Americans than any other group get into Harvard.

This is the comparison we should be making when looking for discrimination in Harvard’s admissions. We know their criteria and we know roughly what the applicants look like. Given this, what percentage of applicants should get in if the criteria were applied fairly? The answer turns out to be about four times as many Asian-Americans as are currently getting in.

Hence, discrimination.

Unfortunately, this only picks up one type of discrimination – the discrimination that occurs when stated standards are being applied in an unequal manner. There’s another type of discrimination that can occur when standards aren’t picked fairly at all; their purpose is to act as a barrier, not assess suitability. This does come up in formal disparate impact analyses – you have to prove that any standards that lead to disparate impact are necessary – but we’ve already seen how you can avoid triggering those if you pick your standard carefully and your goal isn’t to lock a group out entirely, but instead to reduce their numbers.

Analyzing the necessity of standards that may have disparate impact can be hard and lead to disagreement.

For example, we know that Harvard’s selection criteria must be discriminate, which is to say it must differentiate. We want elite institutions to have selection criteria that differentiate between applicants! There is a general agreement, for example, that someone who fails all of their senior year courses won’t get into Harvard and someone who aces them might.

If we didn’t have a slew of records from Harvard backing up the assertion that personality criteria were rigged to keep out Asian-Americans (like they once kept out Jews), evaluating whether discrimination was going on at Harvard would be harder. There’s no prima facie reason to consider personality scores (had they been adopted for a more neutral purpose and applied fairly) to be a bad selector.

It’s a bit old fashioned, but there’s nothing inherently wrong with claiming that you also want to select for moral character and leadership when choosing your student body. The case for this is perhaps clearer at Harvard, which views itself as a training ground for future leaders. Therefore, personality scores aren’t clearly useless criteria and we have to apply judgement when evaluating whether it’s reasonable for Harvard to select its students using them.

Historically, racism has used seemingly valid criteria to cloak itself in a veneer of acceptability. Redlining, the process by which African-Americans were denied mortgage financing hid its discriminatory impact with clinical language about underwriting risk. In reality, redlining was not based on actual actuarial risk in a neighbourhood (poor whites were given loans, while middle-class African-Americans were denied them), but by the racial composition of the neighbourhood.

Like in the Harvard case, it was only the discovery of redlined maps that made it clear what was going on; the criterion was seemingly borderline enough that absent evidence, there was debate as to whether it existed for reasonable purpose or not.

(One thing that helped trigger further investigation was the realization that well-off members of the African-American community weren’t getting loans that a neutral underwriter might expect them to qualify for; their income and credit was good enough that we would have expected them to receive loans.)

It is also interesting to note that both of these cases hid behind racial stereotypes. Redlining was defended because of “decay” in urban neighbourhoods (a decay that was in many cases caused by redlining), while Harvard’s admissions relied upon negative stereotypes of Asian-Americans. Many were dismissed with the label “Standard Strong”, implying that they were part of a faceless collective, all of whom had similarly impeccable grades and similarly excellent extracurricular, but no interesting distinguishing features of their own.

Realizing how hard it is to tell apart valid criteria from discriminatory ones has made me much more sympathetic to points raised by technocrat-skeptics like Dr. Cathy O’Neil, who I have previously been harsh on. When bad actors are hiding the proof of their discrimination, it is genuinely difficult to separate real insurance underwriting (which needs to happen for anyone to get a mortgage) from discriminatory practices, just like it can be genuinely hard to separate legitimate college application processes from discriminatory ones.

While numerical measures, like test scores, have their own problems, they do provide some measure of impartiality. Interested observers can compare metrics to outcomes and notice when they’re off. Beyond redlining and college admissions, I wonder what other instances of potential discrimination a few civic minded statisticians might be able to unearth.

Link Post

Link Post – November 2018

When a poet writes about his experience of becoming a lawyer after his release from jail, you know it’s going to be a punch in the gut. One thing I noticed: he would have had a much easier time reintegrating to society, finding a job, etc. had he been tried as a juvenile, rather than an adult. Has there been any meaningful study on recidivism rates between these two groups? You could compare 17 year olds and 18 year olds charged with the same crime and look at outcomes fifteen years down the road.

Segway’s patents are now at the core of the new crop of ride-sharing scooters, which may finally bring about the original promise of the Segway. Perhaps one element of Segway’s downfall (beyond how uncool they were) is how proper they were about everything. They worked hard to get laws passed that made it legal to ride Segways on the sidewalk, rather than “innovating on the regulatory side” (read: ignoring the law) like the scooter companies do.

The winner of the 2018 Boston Marathon is a delightfully dedicated oddball.

Housing can’t be both affordable and a good investment. Currently, “good investment” seems to be beating affordable in many cities and its residents’ groups that ostensibly support affordable housing that are fighting to keep it that way with restrictive zoning.

Does Canada even exist? Or is it a made up place Americans use as the homeland when travelling? I must admit, I’ve been convinced almost to the point of Canadagnosticism.

What would happen if you laid out all the contradictory information about rapid transit in Karachi in one place? “Something a bit post-modern and a bit absurd” seems to be the answer.

Dying scientist launches a desperate attempt to prove that his herpes vaccine works. In the movies, he’d be ultimately vindicated. In real life, several people are left with lingering side effects and all of the data he collected is tainted by poor methodology.

The whole “rich kids of Instagram” thing is full of pyramid schemes that advertise risky financial products to impoverished teens.

Political theorist Hannah Arendt once claimed that you must never say “who am I to judge”. A therapist sees dramatic improvements by teaching their clients to be more judgemental, seems to agree.

Whenever I read about bullshit jobs, I feel like economic competition needs to be turned up to 11 so that companies have no slack with which to hire people to do pointless tasks. One thing that progressives might not appreciate: the investor class probably hates bullshit jobs even more than they do; from the perspective of a stockholder, a bullshit job is management stealing their money so that the managers can get off on feeling powerful.