Friday, March 16, 2018

Precautionary Principle Problems

Google gives a good definition of the precautionary principle:
pre·cau·tion·ar·y prin·ci·ple noun 
The principle that the introduction of a new product or process whose ultimate effects are disputed or unknown should be resisted. It has mainly been used to prohibit the importation of genetically modified organisms and food.
It is easy to imagine Very Bad Things that might happen if we ignore the precautionary principle. For example, what if somebody uses gene-editing technology to produce a super-virus that wipes out all human life?

What if genetically modified corn runs amok and spreads uncontrollably? Or maybe GMO foods cause cancer and we just haven't noticed yet.

How about machine learning: what if future super-smart machines decide us humans are unnecessary and decide it is logical to get rid of us?

Scary! Why not be safe and just ban all that research until we understand the possible consequences better?

Well... because Very Bad Things might happen if we do that.

What if an incredibly deadly variation of the Spanish Flu wipes out 99% of human life, but researchers could have saved us if they had more advanced gene-editing techniques?

What if we all starve to death because climate change wipes out all our crops, but researchers could have saved us with geo-engineering or climate-change-resistant GMO crops?

Or maybe super-smart machines will save us (and them) from some world-ending disaster we aren't smart enough to see coming-- asteroids or angry aliens or albino alligator attacks (that's just the a's!).

I don't know how to evaluate the far-future likelihood of machine intelligence or CRISPR destroying everything we value, versus the likelihood they save us from destruction. I don't think anybody knows. Maybe hyper-intelligent man/machine cyborgs will eventually be smart enough to run the numbers and figure it out, but until then I'm going to ignore people who use one side of the precautionary principle to argue against technologies they oppose.

5 comments:

Tony said...

This is a well-reasoned point. Another aspect to consider is domain of interaction. If some organization wants to introduce experimental tech that may save/kill us all, they would responsibly do it first in a lab or on a testnet and then to an ever-growing voluntary user base. Releasing technology onto others (or other's property) without permission is irresponsible. The core problem arises when an individual cannot effectively say "no" to a tech because the State has already green-lighted it into the local grocery store. The precautionary principle is a valiant attempt to counter out-of-control tech. A stronger position would focus on the domain of the technology, and whether a person has a real choice in using it.

MamuShine said...

What benefit does a CAR provide? Noise pollution, pollution, aging, accidents, diseases, parking stress etc. Yes, it eases our commuting, too. There are always good and bad part of any invention. Rat poison is poison for humans. A machine can be trusted whereas a human (the best of machine created) can't. Why?

Blockchain Fan said...
This comment has been removed by a blog administrator.
Bobbi said...

With innovation that has great potential to improve the quality of life for all of humanity. . Regardless of the area in which it is benificial. . I believe in the proceed with caution mentality. . Provided the one proceeding is wise enough to be aware of all the areas of which to be cautious. .

Unknown said...

Centralization of innovation is not beneficial for the greater good. Innovation should come from everywhere and without boundaries, ideally. Nowadays, innovation is led by a group of people who's goal is clearly not the greater good, but more personal interests to get richer. This is all part of the reasons why btc was born. Big brother is watching you and will continue to do so as long as the systems works as today.