Joseph Weizenbaum > Quotes

“The computer programmer is a creator of universes for which he alone is the lawgiver. No playwright, no stage director, no emperor, however powerful, has ever exercised such absolute authority to arrange a stage or field of battle and to command such unswervingly dutiful actors or troops.”
― Joseph Weizenbaum

“The salvation of the world depends only on the individual whose world it is. At least, every individual must act as if the whole future of the world, of humanity itself, depends on him. Anything less is a shirking of responsibility and is itself a dehumanizing force, for anything less encourages the individual to look upon himself as a mere actor in a drama written by anonymous agents, as less than a whole person, and that is the beginning of passivity and aimlessness.”
― Joseph Weizenbaum

“What I had not realized is that extremely short exposures to a relatively simple computer program could induce powerful delusional thinking in quite normal people.”
― Joseph Weizenbaum

“Our time prides itself on having finally achieved the freedom from censorship for which libertarians in all ages have struggled...The credit for these great achievements is claimed by the new spirit of rationalism, a rationalism that, it is argued, has finally been able to tear from man's eyes the shrouds imposed by mystical thought, religion, and such powerful illusions as freedom and dignity. Science has given us this great victory over ignorance. But, on closer examination, this victory too can be seen as an Orwellian triumph of an even higher ignorance: what we have gained is a new conformism, which permits us to say anything that can be said in the functional languages of instrumental reason, but forbids us to allude to...the living truth...so we may discuss the very manufacture of life and its 'objective' manipulations, but we may not mention God, grace, or morality.”
― Joseph Weizenbaum, Computer Power and Human Reason: From Judgment to Calculation

“The arrival of the Computer Revolution and the founding of the Computer Age has been announced many times. But if the triumph of a revolution is to be measured in terms of the profundity of the social revisions it entrained, then there has been no computer revolution. And however the present age is to be characterized, the computer is not eponymic of it.”
― Joseph Weizenbaum, Computer Power and Human Reason: From Judgment to Calculation

“If the teacher, if anyone, is to be an example of a whole person to others, he must first strive to be a whole person. Without the courage to confront one's inner as well as one's outer worlds, such wholeness is impossible to achieve. Instrumental reason alone cannot lead to it. And there precisely is a crucial difference between man and machine: Man, in order to become whole, must be forever an explorer of both his inner and his outer realities. His life is full of risks, but risks he has the courage to accept, because, like the explorer, he learns to trust his own capacities to endure, to overcome. What could it mean to speak of risk, courage, trust, endurance, and overcoming when one speaks of machines.”
― Joseph Weizenbaum

“... bright young men of disheveled appearance, often with
sunken glowing eyes, can be seen sitting at computer consoles,
their arms tensed and waiting to fire their fingers, already poised
to strike, at the buttons and keys on which their attention seems
to be riveted as a gambler’s on the rolling dice. When not so
transfixed, they often sit at tables strewn with computer printouts
over which they pore like possessed students of a cabbalistic
text. They work until they nearly drop, twenty, thirty hours
at a time. Their food, if they arrange it, is brought to them:
coffee, Cokes, sandwiches. If possible, they sleep on cots near
the printouts. Their rumpled clothes, their unwashed and
unshaven faces, and their uncombed hair all testify that they are
oblivious to their bodies and to the world in which they move.
These are computer bums, compulsive programmers ...”
― Joseph Weizenbaum

“Jeder ist immer erreichbar. Die ganze Welt beschleunigt sich, alles ist dringend, und wo alles dringend ist, ist nichts mehr dringend, und damit schlittern wir in eine Bedeutungslosigkeit hinein.”
― Joseph Weizenbaum

“To understand something sufficiently well to be able to program it for a computer does not mean to understand it to its ultimate depth. There can be no such ultimate understanding in practical affairs. Programming is rather a test of understanding. In this respect it is like writing; often when we think we understand something and attempt to write about it, our very act of composition reveals our lack of understanding even to ourselves. Our pen writes the word 'because' and suddenly stops. We thought we understood the 'why' of something, but discover that we don't. We begin a sentence with 'obviously,' and then see that what we meant to write is not obvious at all. Sometimes we connect two clauses with the word 'therefore,' only to then see that our chain of reasoning is defective. Programming is like that. It is, after all, writing, too. But in ordinary writing we sometimes obscure our lack of understanding, our failures in logic, by unwittingly appealing to the immense flexibility of a natural language and to its inherent ambiguity... An interpreter of of programming-language-texts, a computer, is immune to the seductive influence of mere eloquence... A computer is a merciless critic.”
― Joseph Weizenbaum, Computer Power and Human Reason: From Judgment to Calculation

“We have a problem and a a problem demands a solution. Problem and solution—these two terms are inseparably connected to each other. It means if a person has a problem there is a certain method—it could be mathematical, algebra—that you can apply to this problem. What you get out of that is the solution. With that the problem is over.

But it is not like that in human life. It is not like that with—now I am going to use the word myself—problems. Human problems, social problems, societal problems will never be solved... It is an illusion that some kind of problem will be solved.”
― Joseph Weizenbaum, Islands in the Cyberstream: Seeking Havens of Reason in a Programmed Society

“I cannot tell why the spokesmen I have cited want the developments I forecast to become true. Some of them have told me that they work on them for the morally bankrupt reason that "If we don't do it, someone else will." They fear that evil people will develop superintelligent machines and use them to oppress mankind, and that the only defense against these enemy machines will be superintelligent machines controlled by us, that is, by well-intentioned people. Others reveal that they have abdicated their autonomy by appealing to the "principle" of technological inevitability. But, finally, all I can say with assurance is that these people are not stupid. All the rest is mystery.”
― Joseph Weizenbaum

“Das Ganze ist ein riesiger Misthaufen, der Perlen enthält. Aber um Perlen zu finden, muss man die richtigen Fragen stellen. Gerade das können die meisten Menschen nicht.”
― Joseph Weizenbaum

“To understand something sufficiently well to be able to program it for a computer does not mean to understand it to its ultimate depth. There can be no such ultimate understanding in practical affairs. Programming is rather a test of understanding. In this respect it is like writing; often when we think we understand something and attempt to write about it, our very act of composition reveals our lack of understanding even to ourselves. Our pen writes the word 'because' and suddenly stops. We thought we understood the 'why' of something, but discover that we don't. We begin a sentence with 'obviously,' and then see that what we meant to write is not obvious at all. Sometimes we connect two clauses with the word 'therefore,' only to then see that our chain of reasoning is defective. Programming is like that. It is, after all, writing, too. But in ordinary writing we sometimes obscure our lack of understanding, our failures in logic, by unwittingly appealing to the immense flexibility of a natural language and to its inherent ambiguity... An interpreter of programming-language-texts, a computer, is immune to the seductive influence of mere eloquence... A computer is a merciless critic.”
― Joseph Weizenbaum, Computer Power and Human Reason: From Judgment to Calculation

“We have a problem and a problem demands a solution. Problem and solution—these two terms are inseparably connected to each other. It means if a person has a problem there is a certain method—it could be mathematical, algebra—that you can apply to this problem. What you get out of that is the solution. With that the problem is over.

But it is not like that in human life. It is not like that with—now I am going to use the word myself—problems. Human problems, social problems, societal problems will never be solved... It is an illusion that some kind of problem will be solved.”
― Joseph Weizenbaum, Islands in the Cyberstream: Seeking Havens of Reason in a Programmed Society

“Die Ohnmacht des Einzelnen ist vielleicht die gefährlichste Illusion, die ein Mensch haben kann.”
― Joseph Weizenbaum

“It is a widely held but a grievously mistaken belief that civil courage finds exercise only in the context of world-shaking events. To the contrary, its most arduous exercise is often in those small contexts in which the challenge is to overcome the fears induced by petty concerns over career, over our relationships to those who appear to have power over us, over whatever may disturb the tranquillity of our mundane existence.”
― Joseph Weizenbaum

“Then, too, I am constantly confronted by students, some of whom have already rejected all ways but the scientific to come to know the world, and who seek only a deeper, more dogmatic indoctrination in that faith (although the world is no longer in their vocabulary). Other students suspect that not even the entire collection of machines and instruments at MIT can significantly give meaning to their lives. They sense the presence of a dilemma in an education polarized around science and technology, an education that implicitly claims to open a privileges access-path to fact, but that cannot tell them how to decide what to count as fact. Even while they recognize the genuine importance of learning their craft, they rebel at working on projects that appear to address themselves neither to answering interesting questions of fact nor to solving problems in theory.”
― Joseph Weizenbaum, Computer Power and Human Reason: From Judgment to Calculation

“I have spoken here of what ought and ought not to be done, of what is morally repugnant, and of what is dangerous. I am, of course, aware of the fact that these judgements of mine have themselves no moral force except on myself. Nor, as I have already said, do I have any intention of telling other people what tasks they should and should not undertake. I urge them only to consider the consequences of what they do do. And here I mean not only, not even primarily, the direct consequences of their actions on the world about them. I mean rather the consequences on themselves, as they construct their rationalizations, as they repress the truths that urge them to different courses , and as they chip away at their own autonomy. That so many people ask what they must do is a sign that the order of being and doing has become inverted. Those who know who and what they are do not need to ask what they should do. And those who must ask will not be able to stop asking until they begin to look inside themselves. It it is everyone's task to show by example what questions one can ask of oneself, and to show that one can live with the few answers there are.”
― Joseph Weizenbaum, Computer Power and Human Reason: From Judgment to Calculation