Apple’s plans to scan users’ devices raises Big Tech trust issues
There are ways for Big Tech to earn our trust
What is trust?
Trust is “the willingness of a party to bevulnerable to the actions of another party,” according to social scientists. People base the decision to trust on experience, signs and signals. But past behavior, promises, the way someone acts, evidence and even contracts only give you data points. They cannot guarantee future action.
Therefore, trust is a matter of probabilities. You are, in a sense, rolling the dice whenever you trust someone or an organization.
Trustworthiness is a hidden property. People collect information about someone’s likely future behavior, but cannot know for sure whether the person has the ability to stick to their word, is truly benevolent and has the integrity – principles, processes and consistency – to maintain their behavior over time, under pressure or when the unexpected occurs.
Trust in Apple and Big Tech
Apple has stated that their scanning system willonly ever be used for detecting child sexual abuse materialand has multiple strong privacy protections. Thetechnical details of the systemindicate that Apple has taken steps to protect user privacy unless the targeted material is detected by the system. For example, humans will review someone’s suspect material only when the number of times the system detects the targeted material reaches a certain threshold. However, Apple has given little proof regarding how this system will work in practice.
After analyzing the “NeuralHash” algorithmthat Apple is basing its scanning system on, security researchers and civil rights organizations warn that the system is likelyvulnerableto hackers, in contrast toApple’s claims.
Critics also fear that the system will beused to scan for other material, such as indications of political dissent. Apple, along with other Big Tech players, has caved to the demands of authoritarian regimes, notably China, to allow government surveillance of technology users. In practice, the Chinese government hasaccess to all user data. What will be different this time?
It should also be noted that Apple is not operating this system on its own. In the U.S., Apple plans to use data from, and report suspect material to, the nonprofitNational Center for Missing and Exploited Children. Thus, trusting Apple is not enough. Users must also trust the company’s partners to act benevolently and with integrity.
Big Tech’s less-than-encouraging track record
This case exists within a context ofregular Big Tech privacy invasionsand moves tofurther curtail consumer freedoms and control. The companies have positioned themselves as responsible parties, but many privacy experts say there is too little transparency and scant technical or historical evidence for these claims.
Another concern is unintended consequences. Apple might really want to protect children and protect users’ privacy at the same time. Nevertheless, the company has now announced – and staked its trustworthiness to – a technology that is well-suited to spying on large numbers of people. Governments might pass laws to extend scanning to other material deemed illegal.
Would Apple, and potentially other tech firms, choose to not follow these laws and potentially pull out of these markets,or would they comply with potentially draconian local laws? There’s no telling about the future, but Apple and other tech firms have chosen to acquiesce to oppressive regimes before. Tech companies that choose to operate in China areforced to submit to censorship, for example.
Weighing whether to trust Apple or other tech companies
There’s no single answer to the question of whether Apple, Google or their competitors can be trusted. Risks are different depending on who you are and where you are in the world. An activist in India faces different threats and risks than an Italian defense lawyer. Trust is a matter of probabilities, and risks are not only probabilistic but also situational.
It’s a matter of what probability of failure or deception you can live with, what the relevant threats and risks are, and what protections or mitigations exist.Your government’s position, the existence of strong local privacy laws, the strength of rule of law and your own technical ability are relevant factors. Yet, there is one thing you can count on: Tech firms typically have extensive control over your devices and data.
Like all large organizations, tech firms are complex: Employees and management come and go, and regulations, policies and power dynamics change.
A company might be trustworthy today but not tomorrow.
Big Tech has shown behaviors in the past that should make users question their trustworthiness, in particular when it comes to privacy violations. But they have also defended user privacy in other cases, for example in theSan Bernadino mass shooting case and subsequent debates about encryption.
Last but not least, Big Tech does not exist in a vacuum and is not all-powerful. Apple, Google, Microsoft, Amazon, Facebook and others have to respond to various external pressures and powers. Perhaps, considering these circumstances, greater transparency, more independent audits by journalists and trusted people in civil society, more user control, more open-source code and genuine discourse with customers might be a good start to balance different objectives.
While only a first step, consumers would at least be able to make more informed choices about what products to use or buy.
Article byLaurin Weissinger, Lecturer in Cybersecurity,Tufts University
This article is republished fromThe Conversationunder a Creative Commons license. Read theoriginal article.
Story byThe Conversation
An independent news and commentary website produced by academics and journalists.An independent news and commentary website produced by academics and journalists.
Get the TNW newsletter
Get the most important tech news in your inbox each week.
