---
title: "Meaning & Key Takeaway of: In highly automated systems, the operator…"
description: "\"“In highly automated systems, the operator is often at the mercy of the system design and operational procedures.”\" — Nancy G. Leveson"
image: "https://sms4smile.com/quotes/i/eea/nancy-g-leveson-31324_compassion_in-highly-automated-systems-the-operator_1144959.jpg"
---

#  In highly automated systems, the operator is often at the…

![“In highly automated systems, the operator is often at the mercy of the system design and operational procedures.” quote by Nancy G. Leveson](https://sms4smile.com/quotes/i/eea/nancy-g-leveson-31324_compassion_in-highly-automated-systems-the-operator_1144959.jpg)   [Download](https://sms4smile.com/quotes/i/eea/nancy-g-leveson-31324_compassion_in-highly-automated-systems-the-operator_1144959.jpg) [Open image](https://sms4smile.com/quotes/i/eea/nancy-g-leveson-31324_compassion_in-highly-automated-systems-the-operator_1144959.jpg)

> ““In highly automated systems, the operator is often at the mercy of the system design and operational procedures.””

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

## About This Quote

This interpretation was drafted with AI assistance. It is one reading of the quote, not the author's own explanation.

Operators become dependent on system design, limiting control and increasing risk.

**In simple terms:** Systems can trap operators.

Key Takeaway

Design for human control.

Themes

automation human factors risk

Mood

analytical concerned

Type

technical educational

When to use this quote

- industrial control
- aviation
- medical devices
- software development

Key Concepts

human‑machine interaction system design

Questions to Reflect On

- How can design empower operators?
- What safeguards reduce dependency?

A Different Perspective

Complex systems may still fail despite safeguards.

★ ★ ★ ★ ★   No ratings yet

[Compassion](https://sms4smile.com/quotes/about/compassion/)

## Related quotes

> [As a programmer, it is your job to put yourself out of business. What you do today can be automated tomorrow.](https://sms4smile.com/quotes/douglas-mcilroy/as-a-programmer-it-is-your-job-to-put-yourself-out-of-business-what/)

[Douglas McIlroy](https://sms4smile.com/quotes/author/douglas-mcilroy/)

> [When I first met Jeff Bezos back in the late 90s, the only automated thing in his office was a rotating fan, gently blowing…](https://sms4smile.com/quotes/marc-randolph/when-i-first-met-jeff-bezos-back-in-the-late-90s-the-only-automated/)

[Marc Randolph](https://sms4smile.com/quotes/author/marc-randolph/)

> [The cars themselves are getting smarter and will be increasingly able to assist drivers - to the point where the cars will be completely…](https://sms4smile.com/quotes/robert-james-thomson/the-cars-themselves-are-getting-smarter-and-will-be-increasingly-able/)

[Robert James Thomson](https://sms4smile.com/quotes/author/robert-james-thomson/)

> [For example, the vast majority of security break-ins occur as a result of problems with known fixes. With an automated system, you can keep…](https://sms4smile.com/quotes/ben-horowitz/for-example-the-vast-majority-of-security-break-ins-occur-as-a-result/)

[Ben Horowitz](https://sms4smile.com/quotes/author/ben-horowitz/)

> [“Paradox of Automation: the more efficient the Automated system, the more crucial the contribution of the human operators of that system.”](https://sms4smile.com/quotes/josh-kaufman/paradox-of-automation-the-more-efficient-the-automated-system-the/)

[Josh Kaufman](https://sms4smile.com/quotes/author/josh-kaufman/)

> [“The second point is that the lives we lead are much more automated than we imagine—or like to concede—and that this is not always…](https://sms4smile.com/quotes/david-disalvo/the-second-point-is-that-the-lives-we-lead-are-much-more-automated/)

[David DiSalvo](https://sms4smile.com/quotes/author/david-disalvo/)

> [“To have humans executing tests that should be automated is a waste of human potential.”](https://sms4smile.com/quotes/gene-kim/to-have-humans-executing-tests-that-should-be-automated-is-a-waste-of/)

[Gene Kim](https://sms4smile.com/quotes/author/gene-kim/)

> [“we just don't have the time to go chasing after bugs that the automated tests could have found for us. We have to spend…](https://sms4smile.com/quotes/andrew-hunt/we-just-don-t-have-the-time-to-go-chasing-after-bugs-that-the/)

[Andrew Hunt](https://sms4smile.com/quotes/author/andrew-hunt/)

> [“The more automated our experience becomes, the less involved we are in the art of living.”](https://sms4smile.com/quotes/michael-l-brown/the-more-automated-our-experience-becomes-the-less-involved-we-are-in/)

[Michael L. Brown](https://sms4smile.com/quotes/author/michael-l-brown/)

> [The chief product of an automated society is a widespread and deepening sense of boredom.](https://sms4smile.com/quotes/c-northcote-parkinson/the-chief-product-of-an-automated-society-is-a-widespread-and/)

[C. Northcote Parkinson](https://sms4smile.com/quotes/author/c-northcote-parkinson/)

> [“Never automate something that can be eliminated, and never delegate something that can be automated or streamlined. Otherwise, you waste someone else's time instead…](https://sms4smile.com/quotes/timothy-ferriss/never-automate-something-that-can-be-eliminated-and-never-delegate/)

[Timothy Ferriss](https://sms4smile.com/quotes/author/timothy-ferriss/)

> [So you will see us continue to advance the state of the art or take information that we have in our response data bases…](https://sms4smile.com/quotes/john-w-thompson/so-you-will-see-us-continue-to-advance-the-state-of-the-art-or-take/)

[John W. Thompson](https://sms4smile.com/quotes/author/john-w-thompson/)

> [“This includes the creation of automated build, integration, and test processes so that we can immediately detect when a change has been introduced that…](https://sms4smile.com/quotes/gene-kim/this-includes-the-creation-of-automated-build-integration-and-test/)

[Gene Kim](https://sms4smile.com/quotes/author/gene-kim/)

> [In the increasingly mechanized, automated, cybernated environment of the modern world a cold, bodiless world of wheels, smooth plastic surfaces, tubes, pushbuttons, transistors, computers,…](https://sms4smile.com/quotes/eldridge-cleaver/in-the-increasingly-mechanized-automated-cybernated-environment-of/)

[Eldridge Cleaver](https://sms4smile.com/quotes/author/eldridge-cleaver/)

> [A lot of jobs today are being automated; what happens when you extend that concept to very important areas of society like law enforcement?…](https://sms4smile.com/quotes/jose-padilha/a-lot-of-jobs-today-are-being-automated-what-happens-when-you-extend/)

[Jose Padilha](https://sms4smile.com/quotes/author/jose-padilha/)

## More by Nancy G. Leveson

> [“Insisting that operators always follow procedures does not guarantee safety although it does usually guarantee that there is someone to blame-either for following the…](https://sms4smile.com/quotes/nancy-g-leveson/insisting-that-operators-always-follow-procedures-does-not-guarantee/)

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

> [“It seems to be common, judging from the number of incidents and accidents that have resulted, for software designers to forget that the world…](https://sms4smile.com/quotes/nancy-g-leveson/it-seems-to-be-common-judging-from-the-number-of-incidents-and/)

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

> [“Large-scale engineered systems are more than just a collection of technological artifacts: They are a reflection of the structure, management, procedures, and culture of…](https://sms4smile.com/quotes/nancy-g-leveson/large-scale-engineered-systems-are-more-than-just-a-collection-of/)

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

> [“Safety is a system property, not a component property, and must be controlled at the system level, not the component level.”](https://sms4smile.com/quotes/nancy-g-leveson/safety-is-a-system-property-not-a-component-property-and-must-be/)

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

> [“The goal then is to understand why people did not or could not act differently. People acted the way they did for very good…](https://sms4smile.com/quotes/nancy-g-leveson/the-goal-then-is-to-understand-why-people-did-not-or-could-not-act/)

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

> [“The most common accident causality models assume that accidents are caused by component failure and that making system components highly reliable or planning for…](https://sms4smile.com/quotes/nancy-g-leveson/the-most-common-accident-causality-models-assume-that-accidents-are/)

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

> [“A basic principle of system theory is that no control system will perform better than its measuring channel.”](https://sms4smile.com/quotes/nancy-g-leveson/a-basic-principle-of-system-theory-is-that-no-control-system-will/)

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

> [“Safety starts with management leadership and commitment. Without these, the efforts of others in the organization are almost doomed to failure. Leadership creates culture,…](https://sms4smile.com/quotes/nancy-g-leveson/safety-starts-with-management-leadership-and-commitment-without-these/)

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

> [“Human error is not random. It results from basic human mental abilities and physical skills combined with the features of the tools being used,…](https://sms4smile.com/quotes/nancy-g-leveson/human-error-is-not-random-it-results-from-basic-human-mental/)

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

> [“Hindsight bias and focusing only on the operator's role in accidents prevents us from fully learning from accidents and making significant progress in improving…](https://sms4smile.com/quotes/nancy-g-leveson/hindsight-bias-and-focusing-only-on-the-operator-s-role-in-accidents/)

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

> [“When operators receive input about the state of the system being controlled, they will first try to fit that information into their current mental…](https://sms4smile.com/quotes/nancy-g-leveson/when-operators-receive-input-about-the-state-of-the-system-being/)

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

> [“Virtually all systems contain humans, but engineers are often not taught much about human factors and draw convenient boundaries around the technical components, focusing…](https://sms4smile.com/quotes/nancy-g-leveson/virtually-all-systems-contain-humans-but-engineers-are-often-not/)

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

> [“viewing accidents as chains of events and conditions may limit understanding and learning from the loss and omit causal factors that cannot be included…](https://sms4smile.com/quotes/nancy-g-leveson/viewing-accidents-as-chains-of-events-and-conditions-may-limit/)

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

> [“Making all the components highly reliable will not necessarily make the system safe.”](https://sms4smile.com/quotes/nancy-g-leveson/making-all-the-components-highly-reliable-will-not-necessarily-make/)

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

> [“identifying only operator error or sabotage as the root cause of the accident ignores most of the opportunities for the prevention of similar accidents…](https://sms4smile.com/quotes/nancy-g-leveson/identifying-only-operator-error-or-sabotage-as-the-root-cause-of-the/)

[Nancy G. Leveson](https://sms4smile.com/quotes/author/nancy-g-leveson/)

[Explore all 16 Nancy G. Leveson quotes ](https://sms4smile.com/quotes/author/nancy-g-leveson/)

## More Compassion quotes

> [Half the misery of human life might be extinguished if men would alleviate the general curse they lie under by mutual offices of compassion,…](https://sms4smile.com/quotes/joseph-addison/half-the-misery-of-human-life-might-be-extinguished-if-men-would/)

[Joseph Addison](https://sms4smile.com/quotes/author/joseph-addison/)

> [“I fight with love and kindness as my weapons and compassion as my defense.”](https://sms4smile.com/quotes/debasish-mridha/i-fight-with-love-and-kindness-as-my-weapons-and-compassion-as-my/)

[Debasish Mridha](https://sms4smile.com/quotes/author/debasish-mridha/)

> [I really enjoy making people laugh; I've discovered that's a great technique. That's as powerful as stirring their sorrow, stirring their compassion, because that…](https://sms4smile.com/quotes/max-lucado/i-really-enjoy-making-people-laugh-i-ve-discovered-that-s-a-great/)

[Max Lucado](https://sms4smile.com/quotes/author/max-lucado/)

> [“If you refuse to use physical force, then you will be at the mercy of your oppressor!”](https://sms4smile.com/quotes/segun-magbagbeola/if-you-refuse-to-use-physical-force-then-you-will-be-at-the-mercy-of/)

Segun Magbagbeola

> [For some reason, we are truly convinced that if we criticize ourselves, the criticism will lead to change. If we are harsh, we believe…](https://sms4smile.com/quotes/geneen-roth/for-some-reason-we-are-truly-convinced-that-if-we-criticize-ourselves/)

[Geneen Roth](https://sms4smile.com/quotes/author/geneen-roth/)

> [I could not have slept tonight if I had left that helpless little creature to perish on the ground.](https://sms4smile.com/quotes/abraham-lincoln/i-could-not-have-slept-tonight-if-i-had-left-that-helpless-little/)

[Abraham Lincoln](https://sms4smile.com/quotes/author/abraham-lincoln/)

> [We are puzzled and bewildered whenever we see suffering in this world because we have become accustomed to the mercy and the long-suffering of…](https://sms4smile.com/quotes/r-c-sproul/we-are-puzzled-and-bewildered-whenever-we-see-suffering-in-this-world/)

[R. C. Sproul](https://sms4smile.com/quotes/author/r-c-sproul/)

> [“Helpers in every corner, helpers in every hood. That's how we'll make the move, to reform from rude.”](https://sms4smile.com/quotes/abhijit-naskar/helpers-in-every-corner-helpers-in-every-hood-that-s-how-we-ll-make/)

[Abhijit Naskar](https://sms4smile.com/quotes/author/abhijit-naskar/)

> [There are a number of qualities which are important for mental peace, but from the little experience I have, I believe that one of…](https://sms4smile.com/quotes/dalai-lama/there-are-a-number-of-qualities-which-are-important-for-mental-peace/)

[Dalai Lama](https://sms4smile.com/quotes/author/dalai-lama/)

> [May the gods have mercy on whoever pisses them off, because Zarek and Jericho will have none for them. (Madoc) You’d better be glad…](https://sms4smile.com/quotes/sherrilyn-kenyon/may-the-gods-have-mercy-on-whoever-pisses-them-off-because-zarek-and/)

[Sherrilyn Kenyon](https://sms4smile.com/quotes/author/sherrilyn-kenyon/)

> [When you need empathy, you cannot give empathy.](https://sms4smile.com/quotes/marshall-b-rosenberg/when-you-need-empathy-you-cannot-give-empathy/)

[Marshall B. Rosenberg](https://sms4smile.com/quotes/author/marshall-b-rosenberg/)

> [But victimhood was seductive, a release from responsibility and caring. Fear would be transmuted into weary resignation; failure would no longer generate guilt but,…](https://sms4smile.com/quotes/dean-koontz/but-victimhood-was-seductive-a-release-from-responsibility-and-caring/)

[Dean Koontz](https://sms4smile.com/quotes/author/dean-koontz/)

> [“No one has any right to tell you that the way you perceive yourself is wrong. Because by doing so, they also discourage the…](https://sms4smile.com/quotes/kamand-kojouri/no-one-has-any-right-to-tell-you-that-the-way-you-perceive-yourself/)

[Kamand Kojouri](https://sms4smile.com/quotes/author/kamand-kojouri/)

> [“la ilaha ilallah muhammadun rasulullah, alaihi salatullah wa alihi wal ahibba "shine your mercy like the sun, and be gracious as the earth let…](https://sms4smile.com/quotes/talib-al-habib/la-ilaha-ilallah-muhammadun-rasulullah-alaihi-salatullah-wa-alihi-wal/)

Talib al Habib

> [The love for all living creatures is the most noble attribute of man.](https://sms4smile.com/quotes/charles-darwin/the-love-for-all-living-creatures-is-the-most-noble-attribute-of-man/)

[Charles Darwin](https://sms4smile.com/quotes/author/charles-darwin/)

[Browse all 9,892 Compassion quotes ](https://sms4smile.com/quotes/about/compassion/)

```json
{
    "@context": "https://schema.org",
    "@graph": [
        {
            "@type": "Quotation",
            "text": "“In highly automated systems, the operator is often at the mercy of the system design and operational procedures.”",
            "creator": {
                "@type": "Person",
                "name": "Nancy G. Leveson"
            },
            "isPartOf": {
                "@id": "https://sms4smile.com/quotes/#website"
            },
            "url": "https://sms4smile.com/quotes/nancy-g-leveson/in-highly-automated-systems-the-operator-is-often-at-the-mercy-of-the/",
            "about": {
                "@type": "Thing",
                "name": "Compassion"
            },
            "@id": "https://sms4smile.com/quotes/nancy-g-leveson/in-highly-automated-systems-the-operator-is-often-at-the-mercy-of-the/#quotation",
            "image": {
                "@type": "ImageObject",
                "@id": "https://sms4smile.com/quotes/i/eea/nancy-g-leveson-31324_compassion_in-highly-automated-systems-the-operator_1144959.jpg",
                "contentUrl": "https://sms4smile.com/quotes/i/eea/nancy-g-leveson-31324_compassion_in-highly-automated-systems-the-operator_1144959.jpg",
                "url": "https://sms4smile.com/quotes/i/eea/nancy-g-leveson-31324_compassion_in-highly-automated-systems-the-operator_1144959.jpg",
                "width": 1080,
                "height": 1080,
                "caption": "“In highly automated systems, the operator is often at the mercy of the system design and operational…” — Nancy G. Leveson",
                "creditText": "SMS4Smile Quotes",
                "creator": {
                    "@id": "https://sms4smile.com/quotes/#organization"
                }
            }
        },
        {
            "@type": "BreadcrumbList",
            "itemListElement": [
                {
                    "@type": "ListItem",
                    "position": 1,
                    "name": "Home",
                    "item": "https://sms4smile.com/"
                },
                {
                    "@type": "ListItem",
                    "position": 2,
                    "name": "Quotes",
                    "item": "https://sms4smile.com/quotes/"
                },
                {
                    "@type": "ListItem",
                    "position": 3,
                    "name": "Nancy G. Leveson",
                    "item": "https://sms4smile.com/quotes/author/nancy-g-leveson/"
                },
                {
                    "@type": "ListItem",
                    "position": 4,
                    "name": "“In highly automated systems, the operator...",
                    "item": "https://sms4smile.com/quotes/nancy-g-leveson/in-highly-automated-systems-the-operator-is-often-at-the-mercy-of-the/"
                }
            ],
            "@id": "https://sms4smile.com/quotes/nancy-g-leveson/in-highly-automated-systems-the-operator-is-often-at-the-mercy-of-the/#breadcrumb"
        },
        {
            "@type": "WebSite",
            "@id": "https://sms4smile.com/quotes/#website",
            "name": "SMS4Smile Quotes",
            "url": "https://sms4smile.com/quotes/",
            "publisher": {
                "@id": "https://sms4smile.com/quotes/#organization"
            }
        },
        {
            "@type": "Organization",
            "@id": "https://sms4smile.com/quotes/#organization",
            "name": "SMS4Smile Quotes",
            "url": "https://sms4smile.com/quotes/",
            "logo": {
                "@type": "ImageObject",
                "url": "https://sms4smile.com/quotes/wp-content/themes/sq/assets/icons/icon-512.png",
                "width": 512,
                "height": 512
            }
        }
    ]
}
```
