When a measure becomes a target

5 results back to index

Calling Bullshit: The Art of Scepticism in a Data-Driven World by Jevin D. West, Carl T. Bergstrom

airport security, algorithmic bias, AlphaGo, Amazon Mechanical Turk, Andrew Wiles, Anthropocene, autism spectrum disorder, bitcoin, Charles Babbage, cloud computing, computer vision, content marketing, correlation coefficient, correlation does not imply causation, crowdsourcing, cryptocurrency, data science, deep learning, deepfake, delayed gratification, disinformation, Dmitri Mendeleev, Donald Trump, Elon Musk, epigenetics, Estimating the Reproducibility of Psychological Science, experimental economics, fake news, Ford Model T, Goodhart's law, Helicobacter pylori, Higgs boson, invention of the printing press, John Markoff, Large Hadron Collider, longitudinal study, Lyft, machine translation, meta-analysis, new economy, nowcasting, opioid epidemic / opioid crisis, p-value, Pluto: dwarf planet, publication bias, RAND corporation, randomized controlled trial, replication crisis, ride hailing / ride sharing, Ronald Reagan, selection bias, self-driving car, Silicon Valley, Silicon Valley startup, social graph, Socratic dialogue, Stanford marshmallow experiment, statistical model, stem cell, superintelligent machines, systematic bias, tech bro, TED Talk, the long tail, the scientific method, theory of mind, Tim Cook: Apple, twin studies, Uber and Lyft, Uber for X, uber lyft, When a measure becomes a target

The rankings ended up being influenced as much by admissions departments’ willingness to chase metrics as they did by the quality of schools’ applicants. This problem is canonized in a principle known as Goodhart’s law. While Goodhart’s original formulation is a bit opaque,*8 anthropologist Marilyn Strathern rephrased it clearly and concisely: When a measure becomes a target, it ceases to be a good measure. In other words, if sufficient rewards are attached to some measure, people will find ways to increase their scores one way or another, and in doing so will undercut the value of the measure for assessing what it was originally designed to assess.

…

So if you sample instructors at random, you are likely to observe a large class or a small class in proportion to the frequency of such classes on campus. In our example above, there are more teachers teaching small classes. But large classes have many students and small classes have few, so if you sample students at random, students are more likely to be in large classes.*5 Recall from chapter 5 Goodhart’s law: “When a measure becomes a target, it ceases to be a good measure.” Class sizes provide an example. Every autumn, college and university administrators wait anxiously to learn their position in the U.S. News & World Report university rankings. A higher ranking improves the reputation of a school, which in turn draws applications from top students, increases alumni donations, and ultimately boosts revenue and reputation alike.

…

Significant results are strongly overrepresented in the literature, and nonsignificant results are underrepresented. The data from experiments that generated nonsignificant results end up in scientists’ file cabinets (or file systems, these days). This is what is sometimes called the file drawer effect. Remember Goodhart’s law? “When a measure becomes a target, it ceases to be a good measure.” In a sense this is what has happened with p-values. Because a p-value lower than 0.05 has become essential for publication, p-values no longer serve as a good measure of statistical support. If scientific papers were published irrespective of p-values, these values would remain useful measures of the degree of statistical support for rejecting a null hypothesis.

Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones by James Clear

Atul Gawande, Cal Newport, Checklist Manifesto, choice architecture, clean water, cognitive dissonance, cognitive load, delayed gratification, deliberate practice, en.wikipedia.org, financial independence, Goodhart's law, invisible hand, Lao Tzu, late fees, meta-analysis, microaggression, Paul Graham, randomized controlled trial, ride hailing / ride sharing, Sam Altman, Saturday Night Live, side hustle, survivorship bias, Walter Mischel, When a measure becomes a target

We teach for standardized tests instead of emphasizing learning, curiosity, and critical thinking. In short, we optimize for what we measure. When we choose the wrong measurement, we get the wrong behavior. This is sometimes referred to as Goodhart’s Law. Named after the economist Charles Goodhart, the principle states, “When a measure becomes a target, it ceases to be a good measure.” Measurement is only useful when it guides you and adds context to a larger picture, not when it consumes you. Each number is simply one piece of feedback in the overall system. In our data-driven world, we tend to overvalue numbers and undervalue anything ephemeral, soft, and difficult to quantify.

…

Missing twice is the start of a new habit.” I swear I read this line somewhere or perhaps paraphrased it from something similar, but despite my best efforts all of my searches for a source are coming up empty. Maybe I came up with it, but my best guess is it belongs to an unidentified genius instead. “When a measure becomes a target”: This definition of Goodhart’s Law was actually formulated by the British anthropologist Marilyn Strathern. “‘Improving Ratings’: Audit in the British University System,” European Review 5 (1997): 305–321, https://www.cambridge.org/core/journals/european-review/article/improving-ratings-audit-in-the-british-university-system/FC2EE640C0C44E3DB87C29FB666E9AAB.

The Skeptical Economist: Revealing the Ethics Inside Economics by Jonathan Aldred

airport security, behavioural economics, Berlin Wall, carbon credits, carbon footprint, citizen journalism, clean water, cognitive dissonance, congestion charging, correlation does not imply causation, Diane Coyle, endogenous growth, experimental subject, Fall of the Berlin Wall, first-past-the-post, framing effect, Goodhart's law, GPS: selective availability, greed is good, happiness index / gross national happiness, hedonic treadmill, Intergovernmental Panel on Climate Change (IPCC), invisible hand, job satisfaction, John Maynard Keynes: Economic Possibilities for our Grandchildren, labour market flexibility, laissez-faire capitalism, libertarian paternalism, longitudinal study, new economy, Paradox of Choice, Pareto efficiency, pension reform, positional goods, precautionary principle, price elasticity of demand, Ralph Waldo Emerson, RAND corporation, risk tolerance, school choice, social discount rate, spectrum auction, Thomas Bayes, trade liberalization, ultimatum game, When a measure becomes a target

Any government adopting an explicit, overarching policy of maximizing perceived happiness must confront its relationship with democratic politics. As I have argued, the Greatest Happiness principle cannot stand above politics. Another problem is what economists call Goodhart’s Law.9 A succinct definition is: ‘when a measure becomes a target, it ceases to be a good measure’. So once governments target aggregate measures of self-reported happiness, these measures cease to track ‘true’ happiness. Goodhart’s Law can be thought of as the application to human society of Heisenberg’s Uncertainty Principle in quantum physics. Put simply, measuring a system generally disturbs it.60 In human society, an important reason is that people manipulate data once it matters to them.

…

There is an optimistic view that these kinds of problems can be avoided by carefully chosen targets and incentive structures, but this view is not supported by most independent reviews of the audit culture.23 On the contrary, Goodhart’s Law (introduced in Chapter 5) is frequently mentioned: when a measure becomes a target, it ceases to be a good measure. Goodhart’s Law suggests that distortions and unintended consequences are an unavoidable part of any target regime. Once people or their activities are being targeted, their behaviour inevitably changes, either unintentionally or because they actively seek to manipulate the measurements.

The Choice Factory: 25 Behavioural Biases That Influence What We Buy by Richard Shotton

active measures, behavioural economics, call centre, cashless society, cognitive dissonance, Daniel Kahneman / Amos Tversky, data science, David Brooks, Estimating the Reproducibility of Psychological Science, Firefox, framing effect, fundamental attribution error, Goodhart's law, Google Chrome, Kickstarter, loss aversion, nudge unit, Ocado, placebo effect, price anchoring, principal–agent problem, Ralph Waldo Emerson, replication crisis, Richard Feynman, Richard Thaler, Robert Shiller, Rory Sutherland, TED Talk, Veblen good, When a measure becomes a target, World Values Survey

From your perspective this was a rational decision, but it’s counter to your employer’s intention. They created the bonus system to boost income, but in this case it has reduced it. This poorly set target, which led to unintended consequences, is an example of Goodhart’s Law. This states: When a measure becomes a target, it ceases to be a good measure. One infamous example of unintended consequences is from Hanoi, Vietnam, during the spring of 1902. When faced with an outbreak of bubonic plague, the French colonialists offered a small fee for every rat’s tail handed in. The tactic seemed successful at first – tails began to pour in.

The Behavioral Investor by Daniel Crosby

affirmative action, Asian financial crisis, asset allocation, availability heuristic, backtesting, bank run, behavioural economics, Black Monday: stock market crash in 1987, Black Swan, book value, buy and hold, cognitive dissonance, colonial rule, compound rate of return, correlation coefficient, correlation does not imply causation, Daniel Kahneman / Amos Tversky, disinformation, diversification, diversified portfolio, Donald Trump, Dunning–Kruger effect, endowment effect, equity risk premium, fake news, feminist movement, Flash crash, haute cuisine, hedonic treadmill, housing crisis, IKEA effect, impact investing, impulse control, index fund, Isaac Newton, Japanese asset price bubble, job automation, longitudinal study, loss aversion, market bubble, market fundamentalism, mental accounting, meta-analysis, Milgram experiment, moral panic, Murray Gell-Mann, Nate Silver, neurotypical, Nick Bostrom, passive investing, pattern recognition, Pepsi Challenge, Ponzi scheme, prediction markets, random walk, Reminiscences of a Stock Operator, Richard Feynman, Richard Thaler, risk tolerance, Robert Shiller, science of happiness, Shai Danziger, short selling, South Sea Bubble, Stanford prison experiment, Stephen Hawking, Steve Jobs, stocks for the long run, sunk-cost fallacy, systems thinking, TED Talk, Thales of Miletus, The Signal and the Noise by Nate Silver, Tragedy of the Commons, trolley problem, tulip mania, Vanguard fund, When a measure becomes a target

A similar incident was observed in India during the time of British colonial rule. A reward was set for every dead cobra and so enterprising Indians began to – you guessed it – raise cobras on snake farms. The Cobra Effect is now shorthand for what is officially referred to as Campbell’s’ Law, which states, “when a measure becomes a target, it ceases to be a good measure.” Campbell says of the tendency for measurement to corrupt efficacy, “The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor.”

Transport for Humans: Are We Nearly There Yet? by Pete Dyson, Rory Sutherland

Abraham Maslow, Alan Greenspan, autonomous vehicles, barriers to entry, behavioural economics, bitcoin, Black Swan, Boeing 747, BRICs, butterfly effect, car-free, carbon footprint, Charles Babbage, choice architecture, cognitive bias, cognitive load, coronavirus, COVID-19, Crossrail, Daniel Kahneman / Amos Tversky, decarbonisation, demand response, Diane Coyle, digital map, driverless car, Dunning–Kruger effect, Elon Musk, fake news, functional fixedness, gender pay gap, George Akerlof, gig economy, global supply chain, Goodhart's law, Greta Thunberg, Gödel, Escher, Bach, high-speed rail, hive mind, Hyperloop, Induced demand, informal economy, Isaac Newton, Jane Jacobs, lockdown, longitudinal study, loss aversion, low cost airline, Lyft, megaproject, meta-analysis, Network effects, nudge unit, Ocado, overview effect, Paul Samuelson, performance metric, pneumatic tube, RAND corporation, randomized controlled trial, remote working, ride hailing / ride sharing, risk tolerance, Rory Sutherland, Sapir-Whorf hypothesis, selection bias, Skype, smart transportation, social distancing, South Sea Bubble, systems thinking, TED Talk, the map is not the territory, The Market for Lemons, the scientific method, The Wisdom of Crowds, Thomas Malthus, Uber and Lyft, uber lyft, urban planning, Veblen good, When a measure becomes a target, yield management, zero-sum game

I really beat myself up for being too silent in the first few years that I was there, and I said to myself, ‘This agency isn’t as smart as it thinks it is.’ 8 In the decades that followed, O’Connor rebalanced the agency away from blind spots and narrow criteria and towards a more positive culture of humility, open-mindedness and consideration of uncertainty. What we do measure ‘When a measure becomes a target, it ceases to be a good measure’ describes how well-intentioned metrics and targets change behaviour in perverse ways, because we try to satisfy the metric rather than improve the service it measures.9 See, for example, teachers ‘teaching to the test’ in the field of education. This effect has a profound influence on transport operations.

A Hacker's Mind: How the Powerful Bend Society's Rules, and How to Bend Them Back by Bruce Schneier

4chan, Airbnb, airport security, algorithmic trading, Alignment Problem, AlphaGo, Automated Insights, banking crisis, Big Tech, bitcoin, blockchain, Boeing 737 MAX, Brian Krebs, Capital in the Twenty-First Century by Thomas Piketty, cloud computing, computerized trading, coronavirus, corporate personhood, COVID-19, cryptocurrency, dark pattern, deepfake, defense in depth, disinformation, Donald Trump, Double Irish / Dutch Sandwich, driverless car, Edward Thorp, Elon Musk, fake news, financial innovation, Financial Instability Hypothesis, first-past-the-post, Flash crash, full employment, gig economy, global pandemic, Goodhart's law, GPT-3, Greensill Capital, high net worth, Hyman Minsky, income inequality, independent contractor, index fund, information security, intangible asset, Internet of things, Isaac Newton, Jeff Bezos, job automation, late capitalism, lockdown, Lyft, Mark Zuckerberg, money market fund, moral hazard, move fast and break things, Nate Silver, offshore financial centre, OpenAI, payday loans, Peter Thiel, precautionary principle, Ralph Nader, recommendation engine, ride hailing / ride sharing, self-driving car, sentiment analysis, Skype, smart cities, SoftBank, supply chain finance, supply-chain attack, surveillance capitalism, systems thinking, TaskRabbit, technological determinism, TED Talk, The Wealth of Nations by Adam Smith, theory of mind, TikTok, too big to fail, Turing test, Uber and Lyft, uber lyft, ubercab, UNCLOS, union organizing, web application, WeWork, When a measure becomes a target, WikiLeaks, zero day

Although the 2013 Violence Against Women Act partially closed this vulnerability, a 2019 reauthorization was derailed by the gun lobby for reasons having nothing to do with this particular provision. 28 Hacking Bureaucracy When you design a set of rules, it’s common for those who must comply with them to optimize their actions to fit within the rules—even if what they end up doing goes against the expressly stated goal of those rules. Examples include an exterminator who releases an insect swarm to drum up business or a teacher who teaches strictly to the test to increase student test scores. Economists refer to this as Goodhart’s law: when a measure becomes a target, it stops being a good measure. In this manner, bureaucratic rules are hacked all the time by people who don’t want to abide by them. Bureaucracies are hacked from below, by those who are constrained by them, in order to get things done in spite of them. In the 1980s, Administrator Daniel Goldin hacked the normally moribund NASA bureaucracy and found loopholes in the regulations that applied to NASA in order to launch more, and cheaper, space probes like the Mars Pathfinder mission.

The Data Detective: Ten Easy Rules to Make Sense of Statistics by Tim Harford

Abraham Wald, access to a mobile phone, Ada Lovelace, affirmative action, algorithmic bias, Automated Insights, banking crisis, basic income, behavioural economics, Black Lives Matter, Black Swan, Bretton Woods, British Empire, business cycle, Cambridge Analytica, Capital in the Twenty-First Century by Thomas Piketty, Cass Sunstein, Charles Babbage, clean water, collapse of Lehman Brothers, contact tracing, coronavirus, correlation does not imply causation, COVID-19, cuban missile crisis, Daniel Kahneman / Amos Tversky, data science, David Attenborough, Diane Coyle, disinformation, Donald Trump, Estimating the Reproducibility of Psychological Science, experimental subject, fake news, financial innovation, Florence Nightingale: pie chart, Gini coefficient, Great Leap Forward, Hans Rosling, high-speed rail, income inequality, Isaac Newton, Jeremy Corbyn, job automation, Kickstarter, life extension, meta-analysis, microcredit, Milgram experiment, moral panic, Netflix Prize, Northpointe / Correctional Offender Management Profiling for Alternative Sanctions, opioid epidemic / opioid crisis, Paul Samuelson, Phillips curve, publication bias, publish or perish, random walk, randomized controlled trial, recommendation engine, replication crisis, Richard Feynman, Richard Thaler, rolodex, Ronald Reagan, selection bias, sentiment analysis, Silicon Valley, sorting algorithm, sparse data, statistical model, stem cell, Stephen Hawking, Steve Bannon, Steven Pinker, survivorship bias, systematic bias, TED Talk, universal basic income, W. E. B. Du Bois, When a measure becomes a target

Social scientists have long understood that statistical metrics are at their most pernicious when they are being used to control the world, rather than try to understand it. Economists tend to cite their colleague Charles Goodhart, who wrote in 1975: “Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes.”12 (Or, more pithily: “When a measure becomes a target, it ceases to be a good measure.”) Psychologists turn to Donald T. Campbell, who around the same time explained: “The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor.”13 Goodhart and Campbell were onto the same basic problem: a statistical metric may be a pretty decent proxy for something that really matters, but it is almost always a proxy rather than the real thing.

Super Thinking: The Big Book of Mental Models by Gabriel Weinberg, Lauren McCann

Abraham Maslow, Abraham Wald, affirmative action, Affordable Care Act / Obamacare, Airbnb, Albert Einstein, anti-pattern, Anton Chekhov, Apollo 13, Apple Newton, autonomous vehicles, bank run, barriers to entry, Bayesian statistics, Bernie Madoff, Bernie Sanders, Black Swan, Broken windows theory, business process, butterfly effect, Cal Newport, Clayton Christensen, cognitive dissonance, commoditize, correlation does not imply causation, crowdsourcing, Daniel Kahneman / Amos Tversky, dark pattern, David Attenborough, delayed gratification, deliberate practice, discounted cash flows, disruptive innovation, Donald Trump, Douglas Hofstadter, Dunning–Kruger effect, Edward Lorenz: Chaos theory, Edward Snowden, effective altruism, Elon Musk, en.wikipedia.org, experimental subject, fake news, fear of failure, feminist movement, Filter Bubble, framing effect, friendly fire, fundamental attribution error, Goodhart's law, Gödel, Escher, Bach, heat death of the universe, hindsight bias, housing crisis, if you see hoof prints, think horses—not zebras, Ignaz Semmelweis: hand washing, illegal immigration, imposter syndrome, incognito mode, income inequality, information asymmetry, Isaac Newton, Jeff Bezos, John Nash: game theory, karōshi / gwarosa / guolaosi, lateral thinking, loss aversion, Louis Pasteur, LuLaRoe, Lyft, mail merge, Mark Zuckerberg, meta-analysis, Metcalfe’s law, Milgram experiment, minimum viable product, moral hazard, mutually assured destruction, Nash equilibrium, Network effects, nocebo, nuclear winter, offshore financial centre, p-value, Paradox of Choice, Parkinson's law, Paul Graham, peak oil, Peter Thiel, phenotype, Pierre-Simon Laplace, placebo effect, Potemkin village, power law, precautionary principle, prediction markets, premature optimization, price anchoring, principal–agent problem, publication bias, recommendation engine, remote working, replication crisis, Richard Feynman, Richard Feynman: Challenger O-ring, Richard Thaler, ride hailing / ride sharing, Robert Metcalfe, Ronald Coase, Ronald Reagan, Salesforce, school choice, Schrödinger's Cat, selection bias, Shai Danziger, side project, Silicon Valley, Silicon Valley startup, speech recognition, statistical model, Steve Jobs, Steve Wozniak, Steven Pinker, Streisand effect, sunk-cost fallacy, survivorship bias, systems thinking, The future is already here, The last Blockbuster video rental store is in Bend, Oregon, The Present Situation in Quantum Mechanics, the scientific method, The Wisdom of Crowds, Thomas Kuhn: the structure of scientific revolutions, Tragedy of the Commons, transaction costs, uber lyft, ultimatum game, uranium enrichment, urban planning, vertical integration, Vilfredo Pareto, warehouse robotics, WarGames: Global Thermonuclear War, When a measure becomes a target, wikimedia commons

If the output of nails was determined by their number, factories produced huge numbers of pinlike nails; if by weight, smaller numbers of very heavy nails. The satiric magazine Krokodil once ran a cartoon of a factory manager proudly displaying his record output, a single gigantic nail suspended from a crane. Goodhart’s law summarizes the issue: When a measure becomes a target, it ceases to be a good measure. This more common phrasing is from Cambridge anthropologist Marilyn Strathern in her 1997 paper “‘Improving Ratings’: Audit in the British University System.” However, the “law” is named after English economist Charles Goodhart, whose original formulation in a conference paper presented at the Reserve Bank of Australia in 1975 stated: “Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes.”

Human Frontiers: The Future of Big Ideas in an Age of Small Thinking by Michael Bhaskar

"Margaret Hamilton" Apollo, 3D printing, additive manufacturing, AI winter, Albert Einstein, algorithmic trading, AlphaGo, Anthropocene, artificial general intelligence, augmented reality, autonomous vehicles, backpropagation, barriers to entry, basic income, behavioural economics, Benoit Mandelbrot, Berlin Wall, Big bang: deregulation of the City of London, Big Tech, Bletchley Park, blockchain, Boeing 747, brain emulation, Brexit referendum, call centre, carbon tax, charter city, citizen journalism, Claude Shannon: information theory, Clayton Christensen, clean tech, clean water, cognitive load, Columbian Exchange, coronavirus, cosmic microwave background, COVID-19, creative destruction, CRISPR, crony capitalism, cyber-physical system, dark matter, David Graeber, deep learning, DeepMind, deindustrialization, dematerialisation, Demis Hassabis, demographic dividend, Deng Xiaoping, deplatforming, discovery of penicillin, disruptive innovation, Donald Trump, double entry bookkeeping, Easter island, Edward Jenner, Edward Lorenz: Chaos theory, Elon Musk, en.wikipedia.org, endogenous growth, energy security, energy transition, epigenetics, Eratosthenes, Ernest Rutherford, Eroom's law, fail fast, false flag, Fellow of the Royal Society, flying shuttle, Ford Model T, Francis Fukuyama: the end of history, general purpose technology, germ theory of disease, glass ceiling, global pandemic, Goodhart's law, Google Glasses, Google X / Alphabet X, GPT-3, Haber-Bosch Process, hedonic treadmill, Herman Kahn, Higgs boson, hive mind, hype cycle, Hyperloop, Ignaz Semmelweis: hand washing, Innovator's Dilemma, intangible asset, interchangeable parts, Internet of things, invention of agriculture, invention of the printing press, invention of the steam engine, invention of the telegraph, invisible hand, Isaac Newton, ITER tokamak, James Watt: steam engine, James Webb Space Telescope, Jeff Bezos, jimmy wales, job automation, Johannes Kepler, John von Neumann, Joseph Schumpeter, Kenneth Arrow, Kevin Kelly, Kickstarter, knowledge economy, knowledge worker, Large Hadron Collider, liberation theology, lockdown, lone genius, loss aversion, Louis Pasteur, Mark Zuckerberg, Martin Wolf, megacity, megastructure, Menlo Park, Minecraft, minimum viable product, mittelstand, Modern Monetary Theory, Mont Pelerin Society, Murray Gell-Mann, Mustafa Suleyman, natural language processing, Neal Stephenson, nuclear winter, nudge unit, oil shale / tar sands, open economy, OpenAI, opioid epidemic / opioid crisis, PageRank, patent troll, Peter Thiel, plutocrats, post scarcity, post-truth, precautionary principle, public intellectual, publish or perish, purchasing power parity, quantum entanglement, Ray Kurzweil, remote working, rent-seeking, Republic of Letters, Richard Feynman, Robert Gordon, Robert Solow, secular stagnation, shareholder value, Silicon Valley, Silicon Valley ideology, Simon Kuznets, skunkworks, Slavoj Žižek, sovereign wealth fund, spinning jenny, statistical model, stem cell, Steve Jobs, Stuart Kauffman, synthetic biology, techlash, TED Talk, The Rise and Fall of American Growth, the scientific method, The Wealth of Nations by Adam Smith, Thomas Bayes, Thomas Kuhn: the structure of scientific revolutions, Thomas Malthus, TikTok, total factor productivity, transcontinental railway, Two Sigma, Tyler Cowen, Tyler Cowen: Great Stagnation, universal basic income, uranium enrichment, We wanted flying cars, instead we got 140 characters, When a measure becomes a target, X Prize, Y Combinator

In practice, every elite university spends enormous energy securing a good place in the global rankings. In the UK every university and academic must justify their existence with extensive exercises that grade every layer of research and teaching. Universities have thus become classic victims of Goodhart's Law: that when a measure becomes a target, it ceases to be a good measure. This doesn't stop them adding more such statistical measures all the time, and nor does evidence that an over-reliance on them dampens creativity.50 And so the corporate world's audit culture has ballooned into the dominant fact of life for universities, where researchers spend a vanishing portion of their time on their basic job: instead they write proposals for grant money, assess those proposals, sit on committees, write reports, fill in forms.

System Error by Rob Reich

"Friedman doctrine" OR "shareholder theory", "World Economic Forum" Davos, 2021 United States Capitol attack, A Declaration of the Independence of Cyberspace, Aaron Swartz, AI winter, Airbnb, airport security, Alan Greenspan, Albert Einstein, algorithmic bias, AlphaGo, AltaVista, artificial general intelligence, Automated Insights, autonomous vehicles, basic income, Ben Horowitz, Berlin Wall, Bernie Madoff, Big Tech, bitcoin, Blitzscaling, Cambridge Analytica, Cass Sunstein, clean water, cloud computing, computer vision, contact tracing, contact tracing app, coronavirus, corporate governance, COVID-19, creative destruction, CRISPR, crowdsourcing, data is the new oil, data science, decentralized internet, deep learning, deepfake, DeepMind, deplatforming, digital rights, disinformation, disruptive innovation, Donald Knuth, Donald Trump, driverless car, dual-use technology, Edward Snowden, Elon Musk, en.wikipedia.org, end-to-end encryption, Fairchild Semiconductor, fake news, Fall of the Berlin Wall, Filter Bubble, financial engineering, financial innovation, fulfillment center, future of work, gentrification, Geoffrey Hinton, George Floyd, gig economy, Goodhart's law, GPT-3, Hacker News, hockey-stick growth, income inequality, independent contractor, informal economy, information security, Jaron Lanier, Jeff Bezos, Jim Simons, jimmy wales, job automation, John Maynard Keynes: Economic Possibilities for our Grandchildren, John Maynard Keynes: technological unemployment, John Perry Barlow, Lean Startup, linear programming, Lyft, Marc Andreessen, Mark Zuckerberg, meta-analysis, minimum wage unemployment, Monkeys Reject Unequal Pay, move fast and break things, Myron Scholes, Network effects, Nick Bostrom, Northpointe / Correctional Offender Management Profiling for Alternative Sanctions, NP-complete, Oculus Rift, OpenAI, Panopticon Jeremy Bentham, Parler "social media", pattern recognition, personalized medicine, Peter Thiel, Philippa Foot, premature optimization, profit motive, quantitative hedge fund, race to the bottom, randomized controlled trial, recommendation engine, Renaissance Technologies, Richard Thaler, ride hailing / ride sharing, Ronald Reagan, Sam Altman, Sand Hill Road, scientific management, self-driving car, shareholder value, Sheryl Sandberg, Shoshana Zuboff, side project, Silicon Valley, Snapchat, social distancing, Social Responsibility of Business Is to Increase Its Profits, software is eating the world, spectrum auction, speech recognition, stem cell, Steve Jobs, Steven Levy, strong AI, superintelligent machines, surveillance capitalism, Susan Wojcicki, tech billionaire, tech worker, techlash, technoutopianism, Telecommunications Act of 1996, telemarketer, The Future of Employment, TikTok, Tim Cook: Apple, traveling salesman, Triangle Shirtwaist Factory, trolley problem, Turing test, two-sided market, Uber and Lyft, uber lyft, ultimatum game, union organizing, universal basic income, washing machines reduced drudgery, Watson beat the top human players on Jeopardy!, When a measure becomes a target, winner-take-all economy, Y Combinator, you are the product

Economists have long worried about the problem of proxies, especially in situations where employees receive incentives for meeting their targets. In such situations, employees will quickly orient themselves not toward the worthy end but toward the proxy. The metric becomes the goal, and the means justify the end. This is called Goodhart’s Law, which states that when a measure becomes a target, it ceases to be a good measure. A common sequence would look like this: The boss says we must make progress toward a large and difficult-to-measure goal. The leaders of the company choose some proxies that seem to have a plausible connection to the goal. Employees are tasked with making progress on these proxies.

Radical Technologies: The Design of Everyday Life by Adam Greenfield

3D printing, Airbnb, algorithmic bias, algorithmic management, AlphaGo, augmented reality, autonomous vehicles, bank run, barriers to entry, basic income, bitcoin, Black Lives Matter, blockchain, Boston Dynamics, business intelligence, business process, Californian Ideology, call centre, cellular automata, centralized clearinghouse, centre right, Chuck Templeton: OpenTable:, circular economy, cloud computing, Cody Wilson, collective bargaining, combinatorial explosion, Computer Numeric Control, computer vision, Conway's Game of Life, CRISPR, cryptocurrency, David Graeber, deep learning, DeepMind, dematerialisation, digital map, disruptive innovation, distributed ledger, driverless car, drone strike, Elon Musk, Ethereum, ethereum blockchain, facts on the ground, fiat currency, fulfillment center, gentrification, global supply chain, global village, Goodhart's law, Google Glasses, Herman Kahn, Ian Bogost, IBM and the Holocaust, industrial robot, informal economy, information retrieval, Internet of things, Jacob Silverman, James Watt: steam engine, Jane Jacobs, Jeff Bezos, Jeff Hawkins, job automation, jobs below the API, John Conway, John Markoff, John Maynard Keynes: Economic Possibilities for our Grandchildren, John Maynard Keynes: technological unemployment, John Perry Barlow, John von Neumann, joint-stock company, Kevin Kelly, Kickstarter, Kiva Systems, late capitalism, Leo Hollis, license plate recognition, lifelogging, M-Pesa, Mark Zuckerberg, means of production, megacity, megastructure, minimum viable product, money: store of value / unit of account / medium of exchange, natural language processing, Network effects, New Urbanism, Nick Bostrom, Occupy movement, Oculus Rift, off-the-grid, PalmPilot, Pareto efficiency, pattern recognition, Pearl River Delta, performance metric, Peter Eisenman, Peter Thiel, planetary scale, Ponzi scheme, post scarcity, post-work, printed gun, proprietary trading, RAND corporation, recommendation engine, RFID, rolodex, Rutger Bregman, Satoshi Nakamoto, self-driving car, sentiment analysis, shareholder value, sharing economy, Shenzhen special economic zone , Sidewalk Labs, Silicon Valley, smart cities, smart contracts, social intelligence, sorting algorithm, special economic zone, speech recognition, stakhanovite, statistical model, stem cell, technoutopianism, Tesla Model S, the built environment, The Death and Life of Great American Cities, The Future of Employment, Tony Fadell, transaction costs, Uber for X, undersea cable, universal basic income, urban planning, urban sprawl, vertical integration, Vitalik Buterin, warehouse robotics, When a measure becomes a target, Whole Earth Review, WikiLeaks, women in the workforce

They think that it gives them a competitive advantage, and they don’t want rivals nullifying that advantage by copying it. That part is straightforward enough. But the second reason is that, like all such metrics, these stats can be juked: Branch’s algorithm is subject to Goodhart’s Law, the principle that “when a measure becomes a target, it ceases to be useful as a measure.”66 In other words, they believe that if it became more widely known just how their algorithm arrived at its determinations, it would be easier for unreliable people to act in ways that would fool it into classifying them as trustworthy. On the surface, then, this is the same reason that Google holds the precise composition of its search algorithm closely: to prevent it from being gamed by interested parties.

The Price of Time: The Real Story of Interest by Edward Chancellor

"World Economic Forum" Davos, 3D printing, activist fund / activist shareholder / activist investor, Airbnb, Alan Greenspan, asset allocation, asset-backed security, assortative mating, autonomous vehicles, balance sheet recession, bank run, banking crisis, barriers to entry, Basel III, Bear Stearns, Ben Bernanke: helicopter money, Bernie Sanders, Big Tech, bitcoin, blockchain, bond market vigilante , bonus culture, book value, Bretton Woods, BRICs, business cycle, capital controls, Capital in the Twenty-First Century by Thomas Piketty, Carmen Reinhart, carried interest, cashless society, cloud computing, cognitive dissonance, collapse of Lehman Brothers, collateralized debt obligation, commodity super cycle, computer age, coronavirus, corporate governance, COVID-19, creative destruction, credit crunch, Credit Default Swap, credit default swaps / collateralized debt obligations, crony capitalism, cryptocurrency, currency peg, currency risk, David Graeber, debt deflation, deglobalization, delayed gratification, Deng Xiaoping, Detroit bankruptcy, distributed ledger, diversified portfolio, Dogecoin, Donald Trump, double entry bookkeeping, Elon Musk, equity risk premium, Ethereum, ethereum blockchain, eurozone crisis, everywhere but in the productivity statistics, Extinction Rebellion, fiat currency, financial engineering, financial innovation, financial intermediation, financial repression, fixed income, Flash crash, forward guidance, full employment, gig economy, Gini coefficient, Glass-Steagall Act, global reserve currency, global supply chain, Goodhart's law, Great Leap Forward, green new deal, Greenspan put, high net worth, high-speed rail, housing crisis, Hyman Minsky, implied volatility, income inequality, income per capita, inflation targeting, initial coin offering, intangible asset, Internet of things, inventory management, invisible hand, Japanese asset price bubble, Jean Tirole, Jeff Bezos, joint-stock company, Joseph Schumpeter, junk bonds, Kenneth Rogoff, land bank, large denomination, Les Trente Glorieuses, liquidity trap, lockdown, Long Term Capital Management, low interest rates, Lyft, manufacturing employment, margin call, Mark Spitznagel, market bubble, market clearing, market fundamentalism, Martin Wolf, mega-rich, megaproject, meme stock, Michael Milken, Minsky moment, Modern Monetary Theory, Mohammed Bouazizi, Money creation, money market fund, moral hazard, mortgage debt, negative equity, new economy, Northern Rock, offshore financial centre, operational security, Panopticon Jeremy Bentham, Paul Samuelson, payday loans, peer-to-peer lending, pensions crisis, Peter Thiel, Philip Mirowski, plutocrats, Ponzi scheme, price mechanism, price stability, quantitative easing, railway mania, reality distortion field, regulatory arbitrage, rent-seeking, reserve currency, ride hailing / ride sharing, risk free rate, risk tolerance, risk/return, road to serfdom, Robert Gordon, Robinhood: mobile stock trading app, Satoshi Nakamoto, Satyajit Das, Savings and loan crisis, savings glut, Second Machine Age, secular stagnation, self-driving car, shareholder value, Silicon Valley, Silicon Valley startup, South Sea Bubble, Stanford marshmallow experiment, Steve Jobs, stock buybacks, subprime mortgage crisis, Suez canal 1869, tech billionaire, The Great Moderation, The Rise and Fall of American Growth, The Wealth of Nations by Adam Smith, Thorstein Veblen, Tim Haywood, time value of money, too big to fail, total factor productivity, trickle-down economics, tulip mania, Tyler Cowen, Uber and Lyft, Uber for X, uber lyft, Walter Mischel, WeWork, When a measure becomes a target, yield curve

Yet only six years later the United States was facing the most severe financial crisis in decades. As the newly installed Chairman of the Federal Reserve, Bernanke found himself in the position to make good on this promise. He wasn’t going to make the same mistakes again. Part Two * * * HOW LOW RATES BEGOT LOWER RATES 7 Goodhart’s Law When a measure becomes a target, it ceases to be a good measure. Goodhart’s Law We have not targeted those things which we ought to have targeted, and we have targeted those things which we ought not to have targeted, and there is no health in the economy. Former Bank of England Governor Mervyn King, 2016 MONETARY STABILITY IN JAPAN IN THE 1980s The failure of Hayek’s interpretation of the 1920s’ boom and the aftermath to gain widespread acceptance explains why later generations of economists and policymakers returned so enthusiastically to the pursuit of price stability.