RDR seeks feedback on standards for algorithms and machine learning, adding new companies

Ryzhi/Shutterstock.com

Ranking Digital Rights (RDR) seeks input on our work to expand the RDR Corporate Accountability Index to address human rights harms from companies’ use of algorithms, machine learning, and automated decision-making. We also seek feedback on our work to incorporate services offered by Amazon and Alibaba into the RDR Index ranking. 

In February 2019, we announced plans to develop the RDR Index methodology to address the evolving, increasingly complex human rights threats that internet users face. We also opened public consultations soliciting feedback for our ongoing work to develop new indicators that set accountability and transparency standards for company policies and practices related to targeted advertising. 

This week, we are releasing a set of consultation documents (see below) summarizing RDR’s work aimed at encouraging corporate accountability and transparency regarding the use of algorithms, machine learning, and automated decision-making. We are also releasing consultation documents (see below) summarizing our work to include Amazon and Alibabaand specifically, e-commerce platforms and digital personal assistantsin the RDR Index.

Stakeholder feedback: We welcome feedback on these documents by September 13, 2019. Feedback from a wide range of experts and stakeholders is essential to developing a methodology that is credible, rigorous, and effective. It will also help to inform further research as well as in-person stakeholder and expert consultations, which in turn will inform the drafting of pilot indicators that will be published and pilot-tested later in 2019. Please send comments and input to: methodology@rankingdigitalrights.org

Algorithms, machine learning, and automated decision-making

The use of automationfor both content curation and data processingposes a range of human rights risks to internet users, particularly to the right to freedom of expression and information and to the right to privacy. The failure by companies to respect these fundamental human rights also causes or contributes to violations of other human rights, such as the right to non-discrimination. The following materials outline our rationale and approach for developing new indicators addressing these issues:

  1. Rationale: for why and how RDR plans to expand the RDR Index methodology to address algorithms, machine learning, and automated decision-making.
  2. Human rights risk scenarios: a list of “risk scenarios,” each describing human rights harms directly or indirectly related to privacy and expression that can result from companies’ use of algorithms, machine learning, and automated decision-making.
  3. Best Practices: a number of best practices for company disclosure and policy that could help prevent or mitigate these risks.

Our goal in developing new indicators that address human rights harms posed by the use of algorithms, machine learning, and automated decision-making is to help set global accountability and transparency standards for how major, publicly traded internet, mobile, and telecommunications companies can demonstrate respect for human rights online as they develop and deploy these new technologies. 

New companies: Amazon and Alibaba

As two of the world’s largest digital platforms, Amazon and Alibaba’s absence from the RDR Index represents a key gap in our current ranking. There have been growing concerns about both companies’ privacy practices and respect for human rights in generalparticularly in relation to e-commerce platforms and personal digital assistants (PDAs), which collect enormous amounts of information about users. The following consultation materials summarize our rationale and approach for integrating these companies and services into the RDR Index. 

  1. Rationale: for why we are expanding the RDR Index to include Amazon and Alibaba.
  2. Human rights risk scenarios: a list of “risk scenarios” describing privacy and freedom of expression-related risks associated with e-commerce platforms and personal digital assistants.
  3. Best practices: a number of best practices for company disclosure and policy that could help prevent or mitigate these risks.

Our goal in expanding the RDR Index to include Amazon and Alibaba is to apply RDR’s global accountability and transparency standards to two companies that have enormous influence over the rights of people around the world who use their products and services. RDR’s work in this area can inform the work of other stakeholders, including investors conducting due diligence on portfolio risk, policymakers seeking to establish regulatory frameworks to protect the rights of internet users, and advocates looking to encourage these companies to adopt policies and practices to mitigate the human rights harms associated with their services.

Please send feedback to methodology@rankingdigitalrights.org. We look forward to hearing from you. 

To stay informed about our progress and plans, please subscribe to our newsletter here.

The 2019 Ranking Digital Rights Corporate Accountability Index is now online!


Microsoft has unseated Google at the top of the 2019 RDR Corporate Accountability Index. Telefónica outpaced Vodafone among telecommunications companies. Yet despite progress, most companies still leave users in the dark about key policies and practices affecting privacy and freedom of expression, according to the 2019 Ranking Digital Rights Corporate Accountability Index, released today.

The 2019 RDR Index evaluated 24 of the world’s most powerful internet, mobile ecosystem, and telecommunications companies on their disclosed commitments, policies, and practices affecting users’ freedom of expression and privacy, including governance and oversight mechanisms. Research showed that in the past year a majority of companies improved and clarified policies affecting users’ privacya trend that appears to be driven by new data protection regulations in the EU and elsewhere. But even the leading companies fell short in key areas. Few scored higher than 50 percent, failing to even meet basic transparency standards, leaving users across the globe in the dark about how their personal information is collected and protected—and even profited from.

Companies evaluated by the 2019 RDR Index collectively provide products and services used by more than half of the world’s 4.3 billion internet users, thus providing a snapshot of the extent to which users’ rights are protected and respected across the globe. The RDR Index methodology sets minimum standards for what companies should disclose about their rules and processes for enforcing them, data privacy and security policies and practices, and how they handle government demands to remove or block content, to shut down internet services, or to access user information and communications.

Company highlights

  • Microsoft ranked first, due to strong governance and consistent application of its policies across all services. It unseated Google, which had held a decreasing lead since the first RDR Index in 2015.

  • Telefónica shot ahead of all other telecommunications companies. Vodafone, which led in 2018, earned second place, ahead of AT&T, which dropped to third.

  • Facebook maintained fourth place among internet and mobile ecosystem companies, but received a score of just 57% and lagged behind RDR Index leaders in key areas. It showed no evidence of risk assessments on its use of AI or terms of service enforcement, and despite some improvements still disclosed less than a number of its peers about many aspects of how it handles user information.

Click here to view report cards for all 24 companies evaluated by the 2019 RDR Index. An in-depth report analyzing the 2019 RDR Index results across companies and issue areas elaborates on how the world’s most powerful tech companies have a long way to go before the internet supports and sustains human rights for everyone.

“People have a right to know, and companies have a responsibility to show,” said Ranking Digital Rights Director Rebecca MacKinnon. “When companies fail to meet RDR’s standards for disclosure of commitments, policies, and practices, users are exposed to undisclosed risks affecting their freedom of expression and privacy.”

For the full interactive data and analysis, report cards for all 24 companies, methodology, raw data, and other resources for download, please visit: rankingdigitalrights.org/index2019. Follow the conversation on Twitter using the hashtag #rankingrights.

Follow our 2019 RDR Index launch events online and in person:

RDR launches 2019 Corporate Accountability Index research cycle

Image by VLADGRIN on Shutterstock

Research for the 2019 Ranking Digital Rights Corporate Accountability Index began this week, with more than 30 researchers from around the world contributing to the 2019 evaluation. The Index ranks the world’s most powerful internet, mobile, and telecommunications companies on their disclosed policies affecting freedom of expression and privacy.

The 2019 Index will evaluate 24 companies, which includes all of the 22 companies previously ranked plus two new telecommunications companies (Deutsche Telekom and Telenor). We also are expanding our evaluation of cloud services for five internet companies.  

The 2019 Index methodology includes limited revisions to two indicators (G4, G6) in order to preserve year-on-year comparability. In July 2018, we initiated a period of public consultation to solicit feedback from stakeholders about these proposed revisions. Final changes to the methodology are a result of that feedback and internal research conducted by the Ranking Digital Rights (RDR) team.

  • The 2019 Index methodology with detailed research guidance and glossary can be viewed and downloaded here.
  • An online version of the 2019 Index methodology can be accessed here.

Findings of the 2019 Index will be released in May 2019. Company scores and accompanying analysis will be generated through a rigorous process of cross checking, peer review, company feedback, and quality control.

Stay tuned for more updates from the RDR team!

 

2017 Corporate Accountability Index Launch Event: Can the internet sustain human rights?

People around the world increasingly rely on the internet and digitally networked devices in all aspects of their lives. But do we have a global information ecosystem in which future generations’ rights can be respected?

Unfortunately, the answer is “no,” according to our research. Ranking Digital Rights (RDR) on March 23 launched its 2017 Corporate Accountability Index which ranks 22 of the world’s most powerful telecommunications, internet and mobile companies disclosed commitments and policies affecting user’s freedom of expression and privacy. Findings showed that companies did not disclose enough information about policies affecting users’ rightsand as a result most of the world’s internet users lack the information they need to make informed choices.  

Click image to watch video of the full event. (Photo by Niels ten Oever)

“There is tremendous room for improvement by all companies,” said project director Rebecca MacKinnon, despite positive steps by some companies since organization released its inaugural Index in 2015. Only two companiesGoogle and Microsoftscored more than 60 percent on this year’s Index, with the remaining 20 companies evaluated receiving failing grades.

This year’s Index included an evaluation of the “mobile ecosystems” controlled by Apple, Google and Samsung. Findings showed that Apple’s iOS, Google’s Android, and Samsung’s implementation of Android all offered poor disclosure of policies affecting users’ freedom of expression and privacy. This is a particular concern given that most of the world’s new internet users are coming online with smartphones.  

MacKinnon also highlighted that companies overall struggled to disclose policies affecting users’ freedom of expression. For example, all telecommunications companies evaluated had insufficient disclosure on their policies for responding to requests for network shutdowns. Telefónica and Vodafone tied for the highest score on this indicator, but these companies still fell short. None of the telecommunications companies evaluated provided any information on the number of network shutdown requests with which they complied.

Companies that disclosed data breach-related policies.

While companies tend to focus more on privacy and security than freedom of expression, there are nonetheless serious gaps. On the indicator measuring company disclosure of their policies for responding to data breaches, only three out of all 22 companies evaluated, disclosed any information. This is troubling given recent news of various high-profile data breaches, and this issue is of particular concern for users and investors alike.

MacKinnon was joined for a panel discussion by Melissa Brown, Partner at Daobridge Capital and Arvind Ganesan, Director of Business and Human Rights at Human Rights Watch. Moderating the discussion was Niels ten Oever, Head of Digital at Article 19, and Open Technology Institute Director Kevin Bankston.

Panelists discussed whether rankings like the Index can motivate companies to change their policies make policy change. Does highlighting differences in company performance promote competition and a “race to the top”? Do companies that perform better do so because of their business models, because they have been exposed to public scrutiny for longer, or because of other factors?

As speakers noted, there have already been some improvements since the first Index in 2015. Bankston pointed out that in the 2015 report, not a single company received any credit for disclosure of data about content takedowns due to the company’s terms of service enforcement. In the 2017 Index, three companies received some credit on this indicator, and just this week Twitter released its latest transparency report, for the first time including some data on terms of service takedowns.

“With that domino falling, if the trend goes the way it usually does, this is going to become a common practice in the next five or ten years, and that will be due in no small part to the work of Ranking Digital Rights,” said Bankston.

Many people in the audience were concerned about poor company disclosure of the user information they collect, share, and retain. “If someone built a profile on me based on my use of Google, Facebook, AT&T, and my iPhone ecosystem, what kind of profile could be built about me? I need to have enough information that I have some sense of that so that I can then make informed choices. And right now, people are much too far in the dark on that.” One person asked whether it is harder to get companies to change when opacity about the handling of user information is connected to companies’ business model. Another audience member who works for  a company not covered by the Index responded: “If you don’t have people trusting you, you don’t have a business.”

The impetus for change can come not only from civil society activists and policymakers but also from investors. As Daobridge’s Capital’s Melissa Brown pointed out, investors are not monolithic:  some focus on human rights issues in general but few truly understand digital rights issues. However, Brown believes that the Index shows the extent to which “companies are outsourcing privacy and security risks to users,” without giving users enough information to understand or protect themselves against the risks. Over the long run, privacy and security will become “increasingly material” to investors, Brown said.

Fortunately, the Index provides a roadmap for companies to improve. Of course, the 2017 Index is just the beginning of the conversation. We look forward to continuing this dialogue, starting with RightsCon in Brussels next week!

A webcast of the event is available here.

RDR launches 2017 Corporate Accountability Index research cycle

Ranking Digital Rights (RDR) is pleased to announce that research has begun for the 2017 Corporate Accountability Index, which ranks the world’s largest ICT companies’ public commitments to users’ freedom of expression and privacy rights.

A team of 28 researchers based around the world are contributing to this year’s research. The 2017 Index research cycle is an exciting new year for the RDR, as we have expanded our ranking to include new companies, products and services. The 2017 Index will evaluate 22 companies, which includes all companies previously ranked in 2015 as well as six new companies. The 2017 Index ranking also includes makers of mobile devices and software products that create what we call “mobile ecosystems.”

Click here to view or download the full 2017 Index methodology, research guidance, and definitions glossary that our researchers are now using to evaluate companies.

We anticipate launching our findings in March 2017. Companies’ scores and accompanying analysis will be generated through a rigorous process including peer review, company feedback, and quality control.

We encourage stakeholders to review the following documents for details on the changes we made to the 2017 Index methodology, which the RDR team finalized this month after concluding a process of public consultation.

  • The 2017 Index methodology, research guidance, and definitions glossary
  • The “Summary of revisions” document that outlines key changes introduced to the 2017 Index methodology
  • A table comparing the 2015 indicators to the 2017 indicators

Stay tuned for more updates from the RDR team.