Agent Architecture

The internal computational organisation of an agent — deliberative (BDI), reactive (subsumption), layered, or hybrid — along with the control loop and data pipelines that realise it.

In this vault

Architectural lineage

graph TD
  MC["McCarthy (1979)<br/>Ascribing Mental Qualities to Machines"] --> IS["Dennett<br/>Intentional Stance<br/>True Believers"]
  HEW["Hewitt (1973)<br/>Universal Modular Actor Formalism"] --> ACTOR[Actor Model]
  ACTOR --> CONC[Concurrent agents]
  BRAT["Bratman (1987)<br/>Intention Plans Practical Reason"] --> BDI[[BDI]]
  RG["Rao & Georgeff<br/>BDI Logic"] --> BDI
  MIN["Minsky<br/>Society of Mind"] --> SOC[Societies of sub-agents]
  BRO["Brooks (1991)<br/>Intelligence Without Representation"] --> SUB[Subsumption]
  SUB --> REACT[Reactive / behaviour-based]
  IS --> SHO["Shoham (1993)<br/>AGENT-0 · Agent-Oriented Programming"]
  BDI --> SHO
  SHO --> AA((Agent Architecture))
  REACT --> AA
  SOC --> AA
  CONC --> AA
  AA --> HYB[Hybrid / layered]

Papers: A Universal Modular Actor Formalism for Artificial Intelligence · Ascribing Mental Qualities to Machines · Intelligence Without Representation · The Society of Mind · True Believers - The Intentional Strategy and Why It Works · AGENT-0

Backlinks

concept-map line 144
The Extended Mind line 32
Intelligence Without Representation line 31
The BOID Architecture line 28
On Agent-Based Software Engineering line 32

Linked Pages

AGENT-0

The first agent-oriented programming language, introduced by Yoav Shoham, in which agents are defined by a formal mental state (beliefs, capabilities, commitments) and interact via speech-act-typed primitives (INFORM, REQUEST, UNREQUEST). AGENT-0 concretises agent-oriented programming as a specialisation of object-oriented programming where module state is a mental state and messages are speech acts constrained by honesty/consistency rules.

In this vault

True Believers - The Intentional Strategy and Why It Works

True Believers: The Intentional Strategy and Why It Works

Reference: Dennett, D. C. (1981). In A. F. Heath (Ed.), Scientific Explanations, Oxford University Press. Reprinted in The Intentional Stance (1987, MIT Press, ch. 2) and in Mind Design II (1997). Source file: dennett_true_believers.pdf. URL

Summary

Dennett’s canonical defence of the intentional stance: a predictive strategy in which one treats a system as a rational agent with beliefs and desires, works out what a rational agent so situated ought to do, and predicts it will do that. The stance is contrasted with the physical stance (predict from physical laws and microstructure) and the design stance (predict from presumed function). Belief is a perfectly objective phenomenon, but one discernible only from the point of view of an adopter of this strategy; a system is a true believer just in case its behaviour is reliably predictable by intentional ascription.

Dennett argues this vindicates a “mild realism” (or “interpretationism”) about belief against both hard-core realism (beliefs as sentence-like tokens in the head) and eliminativism. The remarkable empirical fact is that the intentional strategy works — on people, animals, chess programs, even thermostats (in a degenerate way) — because evolution and engineering produce systems whose behaviour tracks their interests given accurate beliefs. This pattern of success is what there is to being a believer; no further fact about inner sentential structure is required. The paper grounds the philosophical licence to ascribe mental states to artificial agents and thus underwrites the mentalistic vocabulary of agent theory.

Key Ideas

Three stances: physical, design, intentional.
Intentional strategy: assume rationality, compute ought-to-do, predict.
True believer = system reliably predicted by the intentional strategy.
Belief is objective but stance-relative (mild realism / interpretationism).
Natural selection explains why the strategy works on organisms.
Thermostats as degenerate (but continuous) intentional systems.
Licence for mentalistic ascription to artificial agents.

Connections

Conceptual Contribution

Claim: Beliefs and desires are objective but stance-relative — a system genuinely has them just in case adopting the intentional strategy (assume rationality with appropriate beliefs/desires and predict accordingly) reliably predicts its behaviour.
Mechanism: Dennett distinguishes physical, design, and intentional stances; defines the intentional strategy operationally (attribute beliefs the system ought to have given its perceptual and epistemic history, attribute desires it ought to have given its biological/functional role, predict the rational action); argues success of the strategy on people, animals, and artefacts is an empirical fact explained by evolutionary/design pressures, and that this success is all there is to being a believer — no further requirement of language-of-thought tokens.
Concepts introduced/used: Intentional Stance, True Believer, Mild Realism, Design Stance, Physical Stance, Rationality Assumption
Stance: philosophical theory
Relates to: Justifies the ascription of BDI mental states to artificial systems in Modeling Rational Agents within a BDI-Architecture, Intelligent Agents Theory and Practice and Agent-Oriented Programming; cohabits with Two Faces of Intention as a pillar of agent-theoretic philosophy; foreshadows functional-role arguments in Society of Mind.

Tags

The Society of Mind

Reference: Marvin Minsky (1986). Simon & Schuster (Touchstone). ISBN 0-671-65713-5. Source file: minsky-society-of-mind.pdf. URL

Summary

Minsky’s landmark synthesis: mind is built from many small agents each of which by itself can only do very simple things, yet collectively — through the right kinds of organisation — give rise to intelligence. Thirty short chapters (each a few pages of essays numbered by subsection) develop a cognitive architecture in which no single agent is conscious, no single agent thinks, and no single agent understands — understanding is always a property of a society of agents working together.

The book ranges across agent theory (agents and agencies, hierarchies and heterarchies), memory (K-lines as activatable sets of agents that were co-active when something was learned), introspection (B-brains watching A-brains watching the world), language (polynemes, isonomes, micronemes, pronomes as classes of inter-agent signals), frames (trans-frames for actions, scripts for scenes), reasoning (chains, uniframes, negation), emotion and development (attachment learning, Papert’s principle), individuality (no unified self — an illusion produced by conflicting agencies), and consciousness (a coarse-grained access to the immediately prior mental state). Across all of it the architectural thesis is the same: agencies, not agents, do the work; and the agencies are themselves agencies all the way down.

As a cognitive-architecture proposal the book is a precise anti-unitarian manifesto — against the idea that there is a single central “thinker”, a single logical reasoner, or a single goal-pursuing executive. It is also the philosophical wellspring of modern multi-agent AI: Shoham’s Agent-Oriented Programming, Wooldridge & Jennings’ agent theory, the BDI tradition, and today’s LLM Agents frameworks (MetaGPT, CAMEL, AutoGen, AGENTS) all descend from — and often explicitly cite — this picture.

Key Ideas

Agents and agencies: the mind is a society; each agent is a specialist that knows little on its own; intelligence is organisational
Parts and wholes: a mind has no single “centre”; every whole is made of parts that are themselves wholes of smaller parts
Hierarchies and heterarchies: not pure trees — agencies form overlapping networks with mutual reciprocity
K-lines: Minsky’s theory of memory — a memory is a K-line that, when activated, re-arouses the set of agents whose joint activity earlier constituted the experience
B-brains and levels of introspection: a brain that watches another brain (and so on); the basis of self-knowledge, but also of systematic error
Frames and trans-frames: structured templates for objects and actions; trans-frames carry the origin/trajectory/destination pattern that underwrites verbs and planning
Polynemes / isonomes / micronemes / pronomes: categories of inter-agent signals — the ‘language’ in which agencies speak to each other
Papert’s Principle: genuine mental growth depends less on acquiring new skills than on acquiring better managerial agents that coordinate old ones
Uniframes and the Exception Principle: concepts are unified by exceptions-as-features, not by defining necessary-and-sufficient conditions
The self as society: personal identity is the persistent organisation of one’s agencies, not a unitary soul or homunculus
No sharp line between reasoning and perception: they are the same agency-activation process with different inputs

Connections

Ascribing Mental Qualities to Machines — McCarthy’s companion stance on design-stance mentalism
Intelligent Agents Theory and Practice — Wooldridge & Jennings’ weak/strong agency taxonomy
Agent-Oriented Programming — Shoham’s first-class “agent” abstraction descends from Minsky’s
Multi-Agent Systems
Multiagent Systems Sycara
BDI
Mental State
The Knowledge Level — Newell’s complementary stratification
Computational Boundary of a Self — Levin’s scale-free generalisation of the individual-as-society idea
Theory of Self-Reproducing Automata — the complication-threshold thesis is a direct ancestor
Self-Adaptive Systems
Agents Framework - Zhou et al
MetaGPT Meta Programming for Multi-Agent Collaboration
CAMEL Communicative Agents for Mind Exploration of LLM Society
AutoGen - Multi-Agent Conversation Framework
Multi-Agent Collaboration in AI - Wasif Tunkel
The Rise and Potential of LLM-Based Agents
Why Do Multi-Agent LLM Systems Fail
Language Games for Autonomous Robots
Myconet Fungi Inspired Superpeer Overlay
Ethical Governor
Metacognitive Loop
Ensuring Trustworthy and Ethical Behaviour in Intelligent Logical Agents
Subsumption Architecture
Semantic Information Processing
Common Sense Reasoning

Conceptual Contribution

Claim: Minds — human or artificial — are built from many simple specialist agents whose organised interactions produce intelligence. There is no single locus of thought, understanding, or selfhood; all mental phenomena are agency-level properties that dissolve if you look for them at the single-agent level.
Mechanism: Thirty small chapters each arguing from introspective examples, developmental psychology, and computational thought-experiments to commit to a specific architectural hypothesis — K-lines for memory, trans-frames for action, pronomes/polynemes for inter-agent signalling, B-brains for introspection, Papert’s principle for growth, the exception principle for concepts. No single chapter is decisive; the book’s force is cumulative.
Concepts introduced/used: Society of Mind, Agents (Minsky), Agencies, K-Lines, Trans-Frames, Pronomes, Polynemes, Isonomes, Micronemes, B-brains, Papert’s Principle, Uniframes, Difference-Engines, Frames (AI), Exception Principle, Investment Principle, Society-of-More
Stance: foundational / essay
Relates to: Minsky’s book is the direct ancestor of the Multi-Agent Systems paradigm. Agent-Oriented Programming, Intelligent Agents Theory and Practice, Multiagent Systems Sycara all inherit the agent-as-specialist framing. The modern LLM-agent revival (MetaGPT Meta Programming for Multi-Agent Collaboration, CAMEL Communicative Agents for Mind Exploration of LLM Society — note the name! — AutoGen - Multi-Agent Conversation Framework, The Rise and Potential of LLM-Based Agents) explicitly returns to the Society-of-Mind idiom: competence emerges from societies of small specialists talking to each other, not from a single monolithic model. B-brains prefigure the runtime self-oversight loop of Ensuring Trustworthy and Ethical Behaviour in Intelligent Logical Agents and the Metacognitive Loop / Ethical Governor. The anti-unitarian account of the self sits beside Computational Boundary of a Self (Levin) and the scale-free-cognition programme. Read alongside The Knowledge Level: Newell describes what such a system means at the agent level; Minsky gives a candidate how.

Intelligence Without Representation

Reference

Brooks, Rodney A. (1991). “Intelligence without representation.” Artificial Intelligence 47: 139–159. (Received September 1987.)
PDF: people.csail.mit.edu/brooks/papers/representation.pdf
Local: brooks1991_representation.pdf

Summary

Brooks challenges the dominant symbol-manipulation paradigm of classical AI, arguing that “representation is the wrong unit of abstraction in building the bulkiest parts of intelligent systems.” Drawing on an evolutionary argument — 3.5 billion years were spent evolving sensorimotor and survival competence, and only a few thousand years on “expert” symbolic knowledge — he claims the hard part of intelligence is mobility, vision, and acting in dynamic environments, not the formal problem-solving that dominated early AI. The “blocks-world” style of AI succeeds only because researchers have already factored out perception and motor action, relegating them to input/output black boxes.

In place of centralized symbolic architectures, Brooks proposes building autonomous mobile robots he calls “Creatures,” decomposed by activity rather than by function. Each activity-producing layer connects sensing to action directly and runs in parallel; higher layers are incrementally added on top of lower, already-working layers without a central symbolic world model. This is the subsumption architecture. The slogan is “the world is its own best model”: rather than maintaining an internal representation the robot re-perceives what it needs.

The paper’s philosophical payload is a rejection of the sense–model–plan–act pipeline and of the assumption that intelligence can be decomposed into modules trading symbolic messages. Brooks argues this methodological commitment — that perception delivers a human-style Merkwelt that central reasoning can operate on — is a form of self-deception, since each species and each robot inhabits its own Merkwelt. Intelligence is to be built bottom-up, situated and embodied, tested continuously against the real world.

Key Ideas

Situatedness and embodiment as design primitives: Creatures must cope with a dynamic environment and have some purpose in being.
Decomposition by activity, not function: layers of task-achieving behavior (avoid, wander, explore) replace perception → modeling → planning → action pipelines.
Subsumption architecture: higher competence layers inhibit/subsume lower ones while lower continue running.
No central representation: “the world is its own best model”; no shared symbolic world model between layers.
Evolutionary time argument: sensorimotor intelligence is the hard, ancient core; symbolic expertise is a thin late veneer.
Critique of abstraction: abstracting away perception and action is how AI self-deceives about having solved problems.
Hypothesis (H): representation is the wrong primitive for building intelligent systems.

Connections

Subsumption Architecture — this paper is the manifesto.
Intelligent Agents Theory and Practice — Wooldridge & Jennings use Brooks as the exemplar of reactive agents, contrasted with deliberative BDI agents.
The Society of Mind — shares the anti-monolithic, many-small-agents intuition, though Minsky retains representations.
Multi-Agent Systems — reactive/behavior-based approaches feed directly into swarm and MAS work.
Actor Model — independent parallel activity producers without a central controller.
A Universal Modular Actor Formalism for Artificial Intelligence — kindred rejection of centralized control.
Agent Architecture — subsumption is a canonical architecture contrasted with BDI, layered, hybrid.
Contrast with Knowledge Representation, Ontologies, Advice Taker — papers that double down on representation.

Conceptual Contribution

Ascribing Mental Qualities to Machines

Reference: John McCarthy (1979). Stanford CS Department; reprinted in Formalizing Common Sense: Papers by John McCarthy (V. Lifschitz ed., Ablex, 1990). Source file: mccarthy-ascribing.pdf. URL

Summary

McCarthy argues that ascribing beliefs, desires, intentions, knowledge, and other mental qualities to machines (including simple ones like thermostats) is legitimate when the ascription conveys the same information about the machine that it would about a person, and useful when it helps us predict, repair, or improve the machine’s behaviour. He proposes two new definitional tools — definitions relative to an approximate theory, and second-order structural definitions — so that mental-state vocabulary can be applied to physical systems conservatively rather than by reduction to physics.

This is the philosophical foundation for the entire mentalistic (BDI) tradition in agent research that ACL Rethinking Principles pushes back against. Singh cites McCarthy as the origin of the view that agent communication can be specified by ascribing beliefs and intentions; McCarthy himself is already careful to warn that such ascriptions must be conservative and may be merely convenient shorthand for structural facts.

Key Ideas

Ascribing mental qualities is warranted when it expresses information about the machine concisely — not because the machine “really” has a mind.
Ascription is most useful precisely when the structure of the system is incompletely known; for fully-listed programs one could in principle simulate instead.
Mental qualities should be ascribed separately (belief without desire, desire without consciousness, etc.) rather than bundled into a monolithic concept of mind; different machines warrant different subsets.
Novel definitional tools: (1) definitions relative to an approximate theory — a mental predicate is defined only within a coarser theory that abstracts away from physical detail; (2) second-order structural definitions — mental qualities defined by the existence of certain structural roles in the system.
Epistemological vs metaphysical adequacy of representations: AI needs representations that capture what is knowable about a situation, not just what is ultimately true.
The approach is intended as conservative (liberal in what it admits having some mental qualities, strict in how each is attributed).

Connections

Conceptual Contribution

Claim: It is legitimate and often necessary to ascribe mental qualities (belief, desire, intention, knowledge) to machines, provided the ascription is conservative, quality-by-quality, and grounded either in an approximate theory that abstracts away from physical detail or in a second-order structural definition that names the role the quality plays.
Mechanism: Philosophical / definitional. Distinguishes epistemological from metaphysical adequacy of representations, separates mental qualities rather than bundling them, and introduces approximate-theory and structural-definition techniques for defining predicates like believes(M, P) over machines.
Concepts introduced/used: Intentional Stance, Mentalistic Semantics, Approximate Theory, Structural Definitions, Epistemological Adequacy, Common Sense Reasoning
Stance: foundational / philosophical
Relates to: Source of the mental-ascription tradition that Intention Is Choice with Commitment formalises and that Semantics and Conversations for an ACL applies to KQML. ACL Rethinking Principles argues this tradition overreaches when used as a compliance criterion for ACLs; McCarthy’s own hedges about conservativism actually support that pushback.

Tags

A Universal Modular Actor Formalism for Artificial Intelligence

Reference

Hewitt, C., Bishop, P., & Steiger, R. (1973). “A Universal Modular Actor Formalism for Artificial Intelligence.” Proceedings of the 3rd International Joint Conference on Artificial Intelligence (IJCAI), 235-245. URL

Summary

Hewitt, Bishop, and Steiger introduce the Actor — a universal computational primitive that unifies data, procedure, and process under a single kind of object. An actor is an active agent with behavior defined entirely by the messages it sends and receives. All computational structures — numbers, functions, semaphores, cells, queues, interpreters — are modeled uniformly as actors that respond to messages. Control flow and data flow are inseparable; sending a message replaces goto, call-return, interrupt, and semaphore operations with a single mechanism.

The paper grew out of the PLANNER project and explicit dissatisfaction with the von Neumann / stored-program paradigm dominant in AI languages. In place of “program counter + global memory + interrupts,” the actor model offers local state per actor, inherent concurrency via simultaneous message sends, and a coherent account of parallelism that scales from fine-grained numeric computation to large, autonomous agents. The authors emphasize intentions as first-class properties — an actor’s intention is the contract it guarantees to satisfy for its senders, supporting a form of declarative meta-evaluation and debugging.

Hewitt’s framework anticipated and influenced a long arc of subsequent work: Smalltalk’s message-passing object model, Agha’s formalization of actor semantics, Erlang/OTP’s supervised processes and let-it-crash philosophy, the Akka framework, CSP (Hoare) which formalized a closely related but channel-centric style, and contemporary actor-based agentic systems. The paper’s insistence that “creation, control, and communication” are one mechanism remains the defining alternative to shared-memory concurrency.

Key Ideas

Actor = message-receiving agent: a single primitive subsumes data, procedures, processes.
Message passing only: no shared memory, no goto, no interrupt, no semaphore.
Inseparability of control and data: computation is intrinsic — “ask not what you can do to an object; ask what the actor will do for you.”
Inherent concurrency: every message send is potentially parallel.
Intentions / contracts: each actor publishes obligations; meta-evaluators check that behavior satisfies intentions.
Modularity via encapsulation: actors expose only message interfaces; internal state is private.
Universality: the formalism expresses every computational construct needed for AI programming without primitive aggregates.
Hierarchies of scheduling, intention, monitoring, binding, resource management: supervisory structures emerge naturally.

Connections

Actor Model
Programming Erlang Second Edition — the most successful large-scale realization.
Let It Crash
Supervision Tree
A Language-Based Approach To Prevent DDoS
The Society of Mind — Minsky’s agent-of-agents shares the intuition.
Communicating Sequential Processes — Hoare’s contemporary rival formulation.
Hoare Logic

Conceptual Contribution

Agent-Oriented Programming

Reference: Shoham, Y. (1993). Artificial Intelligence 60, Elsevier. Source file: shoam-aop.pdf. URL

Summary

Shoham introduces Agent-Oriented Programming (AOP) as a specialization of object-oriented programming in which the state of each module — now called an agent — is a mental state composed of beliefs, capabilities, decisions/choices, commitments, and obligations. Interpretation of these components is formally grounded in an extension of standard epistemic logics that adds temporality, obligation, decision, and capability operators.

Agents communicate via speech-act-inspired primitives (inform, request, offer, promise, decline, etc.), constrained by rules such as honesty and consistency. The paper defines a class of agent interpreters and presents AGENT-0, a concrete implemented language whose semantics is tied to the mental-state logic. Shoham also discusses “agentification” — converting arbitrary devices into AOP-programmable agents — and situates AOP against BDI architectures, speech act theory, and McCarthy’s Elephant2000.

Key Ideas

AOP as OOP specialization with mental-state components.
Agents constrained by honesty/consistency on communicative acts.
Speech-act-typed primitives as message types.
AGENT-0 language and interpreter.
“Agentification” of arbitrary devices.

Connections

Conceptual Contribution

Claim: Programming can be fruitfully specialised to an “agent” paradigm in which module state is a formally specified mental state and inter-module communication is a speech act constrained by rational/ethical rules.
Mechanism: Shoham extends standard modal-epistemic logic with temporal, obligation, decision and capability operators, defines the mental-state components of an agent (belief, capability, commitment, choice, obligation), then specifies a generic agent interpreter cycle (update mental state, execute commitments, handle incoming messages) and instantiates it in AGENT-0, whose programs are condition-action rules over mental state and whose messages are typed INFORM/REQUEST/UNREQUEST primitives.
Concepts introduced/used: Agent-Oriented Programming, Mental State, Commitment, AGENT-0, Speech Act Theory, Agentification, BDI, Honesty Constraint
Stance: foundational
Relates to: Establishes the mentalistic ACL stance later criticised by Agent Communication Languages - Rethinking the Principles and surveyed by Intelligent Agents Theory and Practice; AGENT-0’s speech-act primitives anticipate KQML as an Agent Communication Language and FIPA-ACL; the mental-state architecture is reused in An Interaction-oriented Agent Framework for Open Environments.

Tags

Intelligent Agents Theory and Practice

Intelligent Agents: Theory and Practice

Reference: Wooldridge, M., Jennings, N. R. (1995). Knowledge Engineering Review. Source file: woodridge_intelligent_agents.pdf. URL

Summary

A foundational survey that organizes the agent-based computing field into three tightly coupled concerns: agent theories (formal specifications of what an agent is, often via intentional notions such as belief, desire, intention, obligation), agent architectures (software/hardware designs satisfying those specifications, e.g., BDI, subsumption, layered), and agent languages (programming languages whose primitives embody the theorists’ concepts).

Wooldridge and Jennings distinguish a weak notion of agency (autonomy, social ability, reactivity, pro-activeness) from a stronger AI-centric notion involving mentalistic attributes (knowledge, belief, intention) and sometimes emotion or mobility. They review representational and reasoning formalisms (modal logics for knowledge and belief, intention logics), critique their computational tractability, and survey implementations (AGENT-0, PLACA, Concurrent METATEM). The paper sets the vocabulary used by much subsequent MAS research.

Key Ideas

Three-way division: theory, architecture, language.
Weak vs. strong notion of agency.
Intentional stance justifies mentalistic ascription (Dennett/McCarthy).
BDI and related mental-state architectures.
Survey of 1990s agent languages and applications.

Connections

Conceptual Contribution

Claim: The emerging field of agent-based computing should be structured around the interlocking triad of agent theories, architectures and languages, and tensions between weak (behavioural) and strong (mentalistic) notions of agency should be kept explicit rather than elided.
Mechanism: Wooldridge and Jennings synthesise early 1990s work by (i) defining weak agency (autonomy, social ability, reactivity, pro-activeness) and strong agency (adds belief, desire, intention, emotion, mobility); (ii) surveying modal-logic theories of knowledge/belief/intention and the intentional stance as justification; (iii) cataloguing BDI, subsumption and layered architectures; and (iv) reviewing implemented languages (AGENT-0, PLACA, Concurrent METATEM) and representative applications. Computational tractability of the richer logics is flagged as a central open problem.
Concepts introduced/used: Weak Agency, Strong Agency, Intentional Stance, BDI, Subsumption Architecture, Layered Architecture, Concurrent METATEM, PLACA, Agent Theory-Architecture-Language Triad
Stance: survey
Relates to: Canonises the vocabulary used by Agent-Oriented Programming, Agent Communication Languages - Rethinking the Principles and Trends in Agent Communication Language; its tractability critique anticipates the social-semantic move in An Interaction-oriented Agent Framework for Open Environments.

Tags

The BOID Architecture

The BOID Architecture: Conflicts Between Beliefs, Obligations, Intentions and Desires

Reference: Broersen, Dastani, Hulstijn, Huang, van der Torre (2001). Proceedings of the Fifth International Conference on Autonomous Agents (AGENTS’01), Montreal. Source file: broersen_01_boid.pdf. URL

Summary

This paper introduces the BOID architecture, a deontic extension of the classic BDI (Belief-Desire-Intention) agent model that adds Obligations as a first-class motivational attitude alongside Beliefs, Desires, and Intentions. The authors argue that autonomous agents must reason not only about what they believe, want, and plan, but also about the norms and social commitments that constrain them, and that modeling obligations explicitly lets the architecture handle conflicts between self-interested goals and externally imposed duties.

The central contribution is a classification of conflict types between the four components (e.g., BO, BD, BI, OD, OI, DI, and triple/quadruple conflicts such as BOD and BOID) and a corresponding taxonomy of agent types determined by orderings over which component overrules which. Six “realistic” orderings yield named agent types: realistic, simple-minded/stable (BIDO, BIOD), selfish (BDIO, BDOI), social (BOID, BOID), and open-minded. Conflicts are resolved by feedback loops in the control cycle that iteratively apply rules from each component, producing one or multiple extensions in the sense of Reiter’s default logic. An additional planning component selects actions from intentions.

Key Ideas

Deontic extension of BDI: Obligations become a fourth motivational attitude.
Four components as input/output black boxes producing sets of formulas (extensions).
Taxonomy of conflicts: binary (BO, BD, BI, OD, OI, DI), triple (BOD, BOI, BDI, OID), quadruple (BOID).
Agent types as orderings over components: realistic, simple-minded, selfish, social, open-minded.
Conflict resolution via feedback-loop control architecture (extensions constructed before selection).
Connection to Reiter’s default logic and Thomason’s BDP logic.
Single-extension vs multiple-extension BOID; planning component selects one final extension.

Connections

Conceptual Contribution

Claim: Autonomous agents require obligations as a first-class motivational attitude alongside BDI, and an agent’s character can be formally identified with the priority ordering used to resolve conflicts between beliefs, obligations, intentions, and desires.
Mechanism: Four component black boxes (B, O, I, D) produce extensions over a propositional language; an ordering function rho on rules determines which components override others; a feedback-loop control cycle iteratively applies applicable rules; a planning component selects a single extension. The 24 possible orderings collapse to six realistic agent types.
Concepts introduced/used: BDI, Deontic Logic, Default Logic, Agent Types, Norms and Obligations, Agent Architecture, Multi-Agent Systems
Stance: formal
Relates to: Extends the BDI foundations referenced throughout the vault (Agent-Oriented Programming, BDI) with normative reasoning relevant to Agent Communication And Institutional Reality; provides a conflict-resolution substrate that agent communication languages (FIPA-ACL, KQML) implicitly assume when performatives carry commissive or directive force.