0213 - Crowd control - 2021.11.01 |
||
Comment: I am somewhat annoyed when sci-fi depicts AI "advancing beyond its programming" or "becoming more than just a machine". It's a lot like when a human develops psychic powers because they "unlock the unused portions of their brain", or when they're exposed to "unknown radiation" and it makes them super-strong. It relies on some numinous, supernatural thing that exists beyond what we understand and can therefore be whatever magic the writer likes. Like a lot of Christian kids of my era, I was deeply impressed by C.S. Lewis, and didn't second-guess his brilliance until later in my life. One of the things he said was that morality must, necessarily, be something above instinct and thought, because it directs you to indulge one instinct and suppress another - something that tells you to press one piano key and not another cannot be, itself, a piano key. It must be the soul, you see, that guides us to good behaviour, and, thereby, towards a loving and ethical God. This, of course, works perfectly well until a) you see a nonhuman animal engaging in rudimentary moral-like behaviour, or b) you hook up a human to an EEG and watch parts of their brain light up as they make moral decisions, or c) you alter a human via hormones or brain surgery, and watch their morality shift accordingly. I also feel that the "supernatural" either follows a set of rules or it does not. If it does, it is simply another branch of physics that we haven't fully analyzed yet, no less pre-determined than gravity and pressure. If it does not, it is essentially random and may as well be a set of blind coin flips. Caleb may not be expressing it overtly, but I think they do have a mental picture of ethics and morality as being something that is somehow untainted by their synapses or their circuits, and is therefore unimpeachable, undoubtable, and unexaminable. No doubt, this is why they need Mezzer Twofeather's class. |
||
Transcript: --------------------------------------------------------------- |
||