Monday, October 5, 2015

China’s Nightmarish Citizen Scores Are a Warning For Americans and Taiwanese

China’s Nightmarish Citizen Scores Are a Warning For Americans and Taiwan


By Jay Stanley, Senior Policy Analyst, ACLU Speech, Privacy & Technology Project


China is launching a comprehensive “credit score” system, and the more I learn about it, the more nightmarish it seems. China appears to be leveraging all the tools of the information age—electronic purchasing data, social networks, algorithmic sorting—to construct the ultimate tool of social control. It is, as one commentator put it, “authoritarianism, gamified.” Read this piece for the full flavor—it will make your head spin. If that and the little other reporting I’ve seen is accurate, the basics are this:

  • Everybody is measured by a score between 350 and 950, which is linked to their national identity card. While currently supposedly voluntary, the government has announced that it will be mandatory by 2020.
  • The system is run by two companies, Alibaba and Tencent, which run all the social networks in China and therefore have access to a vast amount of data about people’s social ties and activities and what they say.
  • In addition to measuring your ability to pay, as in the United States, the scores serve as a measure of political compliance. Among the things that will hurt a citizen’s score are posting political opinions without prior permission, or posting information that the regime does not like, such as about the Tienanmen Square massacre that the government carried out to hold on to power, or the Shanghai stock market collapse.
  • It will hurt your score not only if you do these things, but if any ofyour friends do them. Imagine the social pressure against disobedience or dissent that this will create.
  • Anybody can check anyone else’s score online. Among other things, this lets people find out which of their friends may be hurting their scores.
  • Also used to calculate scores is information about hobbies, lifestyle, and shopping. Buying certain goods will improve your score, while others (such as video games) will lower it.
  • Those with higher scores are rewarded with concrete benefits. Those who reach 700, for example, get easy access to a Singapore travel permit, while those who hit 750 get an even more valued visa.
  • Sadly, many Chinese appear to be embracing the score as a measure of social worth, with almost 100,000 people bragging about their scores on the Chinese equivalent of Twitter.
A few years ago I wrote a piece about how the fall of the Soviet Union, for all its benefits, has made it harder to defend privacy in the United States. During the Cold War, I argued, we defined ourselves in opposition to an enemy that exemplified and embodied in very real form the nightmarish potential of widespread surveillance and control. This made it easy to point to surveillance and shout, “un-American!”
We have thankfully seen the end of the old totalitarian regimes, but often they have been replaced by authoritarian regimes, which operate with free markets and greater personal freedom, but continue to apply just enough power to stave off threats to their rule. Arrests, beatings, imprisonment, and shootings are such crude tools for the silencing of political opposition and dissent—so much subtler and more effective topressure people, to turn the exercise of power from a hammer, striking the body politic from without, into a drug, which permeates social life from within and shapes it in the desired directions. In today’s world, all the tools are in place to allow a government to do just that in stunningly subtle yet powerful ways, and the Chinese government appears to be wasting no time in exploiting that potential to the fullest.
The United States is a much different place than China, and the chances that our government will explicitly launch this kind of a program any time in the near future is nil, but there are consistent gravitational pulls toward this kind of behavior on the part of many public and private U.S.bureaucracies, and a very real danger that many of the dynamics we see in the Chinese system will emerge here over time. On the government side, for example I have written about how the TSA’s airline passenger “white list” system could evolve in this direction. In the private sector, Frank Pasquale notes that elements of its judgment-and-reward system already exist in the U.S. private-sector credit scoring infrastructure.
I hope this new Chinese system becomes household knowledge in the United States, and can provide the kind of widely recognized paradigm for what to avoid and how not to be that the old totalitarian regimes used to give us. At the ACLU we are constantly warning of the dangers of abuses of power, and often the dangers we cite, while well-founded, consist of potential futures, leading critics to say we’re being “merely theoretical.” With this Chinese system, a whole range of things we’ve warned about are no longer theoretical.

In China, Your Credit Score Is Now Affected By Your Political Opinions – And Your Friends’ Political Opinions

China just introduced a universal credit score, where everybody is measured as a number between 350 and 950. But this credit score isn’t just affected by how well you manage credit – it also reflects how well your political opinions are in line with Chinese official opinions, and whether your friends’ are, too.
In the West, the surveillance agencies have been trying to stay as low-key as possible, while listening to everything and anything. China has taken a different approach. Not only is the surveillance very overt, you are also constantly nudged to fall in line.
This Chinese credit score, which seemed innocent at first, was introduced this summer. More precisely, it was introduced by Alibaba and Tencent, China’s IT giants who run the Chinese equivalents of all social networks, and who therefore have any and all data about you. People can download an app named “Sesame Credit” from the Alibaba network, and the score has become something of a bragging contest, being interpreted as a kind of “citizen status” – and not entirely falsely so. Almost 100,000 people have posted their “status” online on Weibo, the Chinese equivalent of Twitter.
A screenshot from the Sesame Credit app, showing score 698 on a scale from 350 to 950.In the West, our credit score is simple. It’s our ability to pay. It’s measured from our assets, our income, and if we have bought on credit in the past and managed it well. That’s it. In China, the situation is… morenuanced. It’s not just that you have bought things, it’s also what you buy that contribute to your credit score, in either direction. If you’re buying things that the regime appreciates, like dishwashers and baby supplies, your credit score increases. If you’re buying videogames, your score takes a negative hit.
Anybody can check anybody’s credit score using the site Credit China, which again helps people disconnect from people who significantly draw down your own credit score: they’re listed as such. All 869,582 of them.
In theory, Sesame Credit (and its benefits) is optional. So far. For the time being. But China has already announced that it, or something very like it, will become mandatory from 2020. It has also announced that while there are benefits today for obedient people, it intends to add various sanctions for people who don’t behave, like limited Internet connectivity. Such people will also be barred from serving in certain high-status and influential positions, like government official, reporter, CEO, statistician, and similar.
Things that will make your score deteriorate include posting political opinions without prior permission, talking about or describing a different history than the official one, or even publishing accurate up-to-date news from the Shanghai stock market collapse (which was and is embarrassing to the Chinese regime).
But the kicker is that if any of your friends do this — publish opinions without prior permission, or report accurate but embarrassing news — your score will also deteriorate. And this will have a direct impact on your quality of life.
“Sesame Credit, however, also uses other data to calculate the scores, such as a person’s hobbies, interaction with friends, shopping habits and lifestyle.” — Quote from China Daily Asia
The KGB and the Stasi’s method of preventing dissent from taking hold was to plant so-called agents provocateurs in the general population, people who tried to make people agree with dissent, but who actually were after arresting them as soon as they agreed with such dissent. As a result, nobody would dare agree that the government did anything bad, and this was very effective in preventing any large-scale resistance from taking hold. The Chinese way here is much more subtle, but probably more effective still.
This scheme is far more sinister than it seems at first, as you’re also getting assorted immediate privileges based on this credit score:
If your credit score reaches 600, you have the privilege of an instant loan of about $800 without collateral when shopping online.
At a score of 650, you may rent a car without leaving a deposit.
At 700, you get access to a bureaucratic fast track to a Singapore travel permit.
And at 750, you get a similar fast track to a coveted Schengen visa.
There are many more examples – these are just to illustrate.
Do you see what’s happening here? This means that people need to choose between that coveted European vacation and keeping in touch with their old friends who are disagreeing with the regime’s opinions openly. This means that staying in touch with dissidents will cause you and your family to lose out on social benefits. As a result, this will very effectively isolate and neuter anybody who posts unofficial political opinions or unofficial history facts. They’ll effectively be sent into social exile, based on everything they do, write, think, and discuss online.
What China is doing here is selectively breeding its population to select against the trait of critical, independent thinking. This may not be the purpose, indeed I doubt it’s the primary purpose, but it’s nevertheless the effect of giving only obedient people the social ability to have children, not to mention successful children.
People sometimes mock the notion that we’re not at a 1984 level yet. I wonder what it’ll really take to make such people realize that the 1984 point of surveillance has long come and gone.
Privacy remains your own responsibility.
H/t Kit (in Swedish).
UPDATE: Here’s a link to the official directive (in English) to construct this Chinese “social credit score” by 2020. As commented on Hacker News, this Sesame Credit appears to be a trial for the official requirement. Link added inline to text above as well.

No comments:

Post a Comment