Preview EdX Origo Instance
Origo
User Transactions
Access Right

Permission granted to an individual to a resource.

Evaluation Problems
Accountable

The obligation to justify and report results of systems such that harms can be mitigated.

Data Model
Action

A method or function that can be invoked on an entity which mutates its state.

Component
Actor

Autonomous entities capable of interacting with the environment by receiving inputs, producing outputs, and performing operations; have some degree of control over their internal state which enables them to perform their operations autonomously; defined by the operations it performs.

Component
Agent

Interactive and autonomous like actors, but also has the ability to adapt and change rules in order to perform its operations.

Data Model
Attribute

A property of an entity in the data model, singled out as relevant to its definition; a field in a schema; also known as a parameter depending on the context.

Evaluation Problems
Auditable

The ability for external stakeholders to assess the operations and quality standards of a system.

Component
Blackbox Model

A type of agent; machine learning model that is flexible and unstructured.

Data
Cadence

The frequency at which that data is processed. In Origo, four types:

  • Batch: Transactions are processed after a set amount of time with minimal human interaction. The length of time between batches should be appropriate to the use case and type of data being handled. There is a spectrum of updates between batch and streaming data, but batch usually implies that there is not seemingly continuous processing.
  • Streaming: Transactions are processed continually, allowing a real-time understanding of events occurring. Makes the most sense for use cases where moment-to-moment context matters to the experience.
  • Backfill: Historical information is processed to account for a new field.
  • Adhoc: Transactions are processed on an as-needed basis.
Relationship
Cardinality

A counting of how many things can relate to something else.

Relationship
Child of

An object that is nested within another object that inherits its properties.

Scope
Conceptual Data Model

Highest level of abstraction for a data model that captures business requirements and scopes projects.

Evaluation Problems
Consensual

When permission is requested and given.

Component
Constraint

A decision of resignation within an action space, either implicitly or explicitly.

Scope
Content Model

A collection of related content types, or groups of information, found within an ICT, that is consumed by the end user.

Evaluation Problems
Contestable

An end user is able to interpret the results or have the results explained to them such that they can catch and resolve any errors.

User Transactions
Create

One of the four basic functions of persistent storage; the addition of a new entry.

Data
Data

A lack of uniformity that makes a difference that can be perceived, measured, captured, and produced via an interaction; a precondition for experience.

Data Model
Data Dictionary

A catalog of the fields in one or more schemas within a database system allowing an end user to navigate the database.

Data Model
Data Model

An abstraction of a domain, for purpose of translation into an ICT system, and thereby a set of distilled data structures representing real-world entities.

Scope
Data Model

An abstraction of a domain, for purpose of translation into an ICT system, and thereby a set of distilled data structures representing objects in meatspace. For more details, view Model.

Data
Data Type

An attribute of data that tells the compiler how it is to be used. Included in Origo are:

  • Categorical
  • Integer
  • Float
  • Date-Time
  • ID
  • String
User Transactions
Delete

One of the four basic functions of persistent storage; the deletion, deactivation, or removal of existing entries.

Object Design
Deontic Premise

The "ought-to-be" statement involved in developing a solution to a wicked problem which is not based on scientific expertise but the moral and ethical attitude of the interventionist. Cannot be reconstructed by looking at the outcome of a solution as it is filigreed into the solution based on the underlying the judgment of the designer.

That there is one or more deontic premises for every solution for a wicked problem highlights the importance of involving multiple stakeholders in a transparent planning process.

User Transactions
Diff

A comparison of the differences between two files.

Scope
Domain Model

A formal representation of an area of knowledge, influence, or activity; consists of real-world entities that eventually needs to be translated into software.

Object Design
Edge Case
Data Model
Entity

A data schema or structure that corresponds to an object in meatspace.

Organizational Problems
Ethics Bluewashing

A form of misinformation achieved by spending a fraction of the resources that would be needed to tackle the ethical problems meant to be addressed.

Organizational Problems
Ethics Dumping

The export of unethical research practices to countries where there are weaker legal and ethical frameworks and enforcing mechanisms.

Organizational Problems
Ethics Lobbying

Private actors attempting to self-regulate by lobbying against the introduction of legal norms and/or the weakening of enforcement such that compliance is limited.

Organizational Problems
Ethics Shirking

The malpractice of doing increasingly less ethical work in a given context the lower the return of such ethical work in that context is perceived to be.

Organizational Problems
Ethics Shopping

The malpractice of choosing, adapting, or revising ethical principles, guidelines, codes, frameworks, or other standards from a variety of available offers, in order to retrofit some pre-existing behaviors and justify them a posteriori instead of benchmarking against public, ethical standards.

User Transactions
Event

An action handled by the ICT.

Evaluation Problems
Explainable

A system that explains to a human the reasons behind a result. The human understands the system through its results; the human may not be able to interpret the inner workings of a model directly.

Ontology Problems
Faulty Assumption

Vague beliefs without specific proof; can very be problematic when building product, especially if it is around a requirement.

Data Model
Field

An attribute of an object described in a schema. A set of field composes a record for an instance of an entity.

System
Heterogenous Organization

A population of actors, agents, and individuals that share resources to coordinate their activities effectively in order to achieve common goals.

Data Problems
Historical Bias

Bias that exist in the dataset due unequal representation historically. This bias then perpetuate existing systemic problems into the future when used in a machine learning model.

System
Hybrid Procedures

Inconsistency in function that limits adoption by reducing the coherence of the operations performed by different actors, agents, and individuals within an organization.

Ontology Problems
Impedence Mismatch

When conceptual or technical challenges arise due to a poorly designed data model, pointing to how research into and translation of domain objects into the user interface was not well considered. May require costly refactoring.

Data Problems
Incomplete Data

Gaps in data collection which may not be effectively communicated to the data handler or unaccounted for in the processing, leading to biased results.

Data Problems
Incorrect Data

Inaccuracies in the data which may be due to the lack of technical rigor in the method in which it was collected.

Component
Individual

Traditional entities that perform operations in an organization; autonomous, adaptive, interactive, and possess semanticisation capacity.

Object Design
Individuality

Something that makes an object discrete from the metaphysical flux around it, that gives it a coherent unity, a figure separated from ground.

System
Information & Communication Technology (ICT)

A system that stores, retrieves, manipulates, transmits, and receives information (data) electronically, across networks, software, and hardware technologies.

Relationship
Inheritance

A mechanism upon which objects or classes are based upon another object or class, retaining similar implementation or properties.

Task
Input

Information needed to accomplish a step in a task. May not always be in digital form as data, but the process of digitization usually refers to taking these inputs which may be found in different forms and creating a streamlined process where they can be digitized and moved through the system as discrete blendable data elements in the data model.

Ontology Problems
Inscription Error

"... a tendency for an observer, first, to write or project or impose or inscribe a set of ontological assumptions onto a computational system (onto the system itself, onto the task domain, onto the relation between the two, and so forth), and then, second, to read those assumptions or their consequences back off the system, as if that constituted an independent empirical discovery or theoretical result."

Data Model
Instance

An example of an object.

Evaluation Problems
Interpretable

The system is capable of being understood by humans. This is easier when the number of inputs is low.

Object Design
Judgment

Deliberate thought grounded in ethical commitment and responsible action that is appropriate to the situation in which it is deployed; human intelligence. [1]

Rittel claims that there are four kinds of judgments:

  1. Off-Hand / Intuitive Judgment: Offhand and based on intuition. The terminal of all partial and deliberated judgments.
  2. Systematic / Deliberated Judgment: Substitutes for intuitive judgments because you don't trust them or have to explain them to someone else (objectification).
  3. Overall Judgment: The final decision integrating all the independent pros and cons of a given solution.
  4. Partial Judgment: A single judgment for a single criteria. Can be broken down from overall judgments into a tree-like structure. [2]
Ontology Problems
Knowledge Transfer

Sharing knowledge to solve problems; can be between industries, disciplines, generations, teams, etc. If knowledge is not transferred, it runs the risk of being lost or not meeting its full potential due to being trapped in a silo.

Scope
Level of Abstraction

The same model of information and processes at a certain level of detail.

User Transactions
Log

A record of an event that has taken pace within an ICT.

Scope
Logical Data Model

Detailed level of conceptual data model that contains all attributes and relationships needed for solution to problem.

Relationship
Many to Many

A relationship where several instances of an object relates to several instances of another object.

Data Model
Metadata

Basic information about data to help users understand how to work with it; fields in a schema.

Object Design
Middle Distance

A place between the general and particular; a space of computation.

"...an intermediate realm between a proximal though ultimately ineffable connection, reminiscent of the familiar bumping and shoving of the world, and a more remote disconnection, a form of unabridgeable separation that lies at the root of abstraction and of the partial (and painful) subject-object divide."

Ontology Problems
Missing Context

A lack of situational information that may create faulty assumptions.

Data Model
Object

This word can get overloaded, but for the purposes of this glossary, it is a thing of interest out in meatspace that is distinct, unique, and self-contained. Through data modeling, these objects are translated into entities. See Object for more.

Scope
Object Model

A collection of concepts embedded in a program that interfaces with a service or system.

Object Design
Objectification

The process of making one's judgment about what should be done explicit and communicating it to others so that there is a successful exchange of information about the foundations of the judgment, allowing it to be collectively discussed, reasoned, and/or argued over.

Whilst agreement may not be an outcome of objectification, the likelihood of one can be improved through collective learning. In the process of objectification, one also comes to a greater understanding of which questions are worthwhile to pursue, which have the greatest weight, and where there may be disagreements needing further testing and analysis.

Not to be confused with the process of making something objective, that is making a procedure that can be replicated by someone other than the creator. In contrast, objectification seeks to expose the judgment of the creator.

Relationship
One to Many

A relationship where an instance of an object relates to many instances of another object.

Relationship
One to One

A relationship where an instance of an object relates to only one instance of another object.

Object Design
Ontology
Relationship
Optional

A relationship that sometimes exists, but not always.

Data
Origin

The location from which data arrives as input. In Origo, this is classified as:

  • User-Defined: data is generated from user input on the interface; for example, typing their name.
  • Transactional: data is generated from computational processes; for example, clicking a button.
  • Backend: data arrives from the data warehouse; for example, metadata.
Data Problems
Outdated Data

Data is not being updated at a cadence that is sensible for the use case.

Task
Output

Information produced as a result of a step.

Data
Ownership

The owner of the data, where to own means to collect. If a change needs to be made, understanding who owns the data allows for understanding the scope of changes that can or cannot be made. Origo shows three types:

  • First Party: Data owned and directly collected by the company
  • Second Party: Data collected by another company that is directly shared out of mutual benefits
  • Third Party: Data collect by another company and bought in order to enrich the first party dataset; for example, weather data.
Relationship
Parent of

The object that contains another object that passes on its properties.

Object Design
Particular

The specific, located, and singular; the form the particular takes depends on the perspective.

Data
Personally Identifiable Information

Information that can be directly linked to an individual's identity.

Scope
Physical Data Model

Implementation level of logical data model taking into account technical optimizations and constraints around data processing in the physical world within physical media.

Data Problems
Poorly Selected Data

Careless selection of data inputs for an algorithmic decision that may lead to biased results. Data might be missing in a way that disadvantages certain groups, or is structured at the wrong level of granularity.

Data
Quasi-Identifier

Information that can be linked to other information to potentially reveal an individual's identity.

Evaluation Principles
Rationality

To try and anticipate the consequences of contemplated actions; thinking before acting.

Rittel lays out the following paradoxes of rationality:

  1. The tracing of consequences can go back infinitely. One always has to start a step earlier.
  2. Once the tracing of consequences has started, there is no reason to stop.
  3. The further back the consequences are traced, the more one is overburdened. Tracing consequences does not lead to better decisions in the present.
  4. If you were to really build a model of all the consequences, you would have to model a model of the consequences. The model needs to contain itself, which is impossible.

These paradoxes move design away from a linear model of problem definition and problem solving (first generation system analysis) and positions it closer to experimental problem finding where solving the problem is the same as understanding it (second generation system analysis). That is, the solution space and the problem space are considered as one (wicked problem).

See wicked problem.

User Transactions
Read

One of the four basic functions of persistent storage; the reading, reviewing, searching, or viewing of existing entries.

Object Design
Reckoning

The powerful calculative rationality that display as intelligence possessed by machines; colloquially known as artificial intelligence.

Data Model
Record

Several fields in a row representing an instance of an entity for an object in meatspace.

Relationship
Recursive

A relationship that connects the object to itself.

Data Model
Relationship

A connection between two entities. For more details, see Relationship.

User Transactions
Resource

An asset within an ICT.

Task
Result

The last step in a task. Necessary to identify first as part of bounding a task analysis. Can be identified by talking through the motivation of a task.

Component
Rule-Based Bot

A type of actor; business process logic that is rigid and configured in detail.

User Transactions
Run

The execution of a resource configured to be activated by an actor, agent, and/or individual.

Evaluation Problems
Safe

To be free from harm or danger. Many questions of ethics are framed in terms of utilitarian trade-offs between risks and benefits, which is why safety is the primary protective criteria for disciplines with more mature ethical protocols.

Data Model
Schema

The structure and design of a database. In a relational database, this is a set of tables and fields. The overall set of schemas driving an application composes the data model. Details in definition may vary slightly depending on database tooling (Oracle vs. Postgres, etc.)

Data Problems
Selection Bias

The set of data inputs into a model is not representative of all stakeholder concerns resulting in biased outputs.

Object Design
Semantic Elaboration

The process of semanticising information which may or may not be ethically neutral depending on information was collected, correlated, or interpreted.

Object Design
Semantic Information

Meaningful, veridical, comprehensible, accessible, and useful data that can be used for epistemic purposes and connected with a process of decision-making.

Object Design
Semanticisation

The operations performed by an agent to transform raw data into semantic information that is meaningful and truthful

Data Model
State

A property of an entity generated through computational processing that describes how it has moved through the system; may or may not be able to be changed by a user. Success and error states are the minimum states generated through any process.

Task
Step

The basic unit of a task describing a change from the previous step. Step may be user or system generated.

Object Design
Stopping Rule

Criteria which indicate when a solution has been found; does not exist in wicked problems where work only ends with lack of time, money, and/or patience.

System
Symmetry of Ignorance

Exists amongst stakeholders for a wicked problem given their local frame of the problem. Each stakeholder can only be an expert in guiding the process of handling the wicked problem because of their limited view; they cannot be subject matter experts of the problem itself.

Task
Task

A set of steps with a clear goal. Serves as a backbone to developing attributes, states, relationships, and other metadata that may be necessary to include in the schema for an entity.

System
The Menlo Report

A report summarizing a set of basic principles to guide the identification and resolution of ethical problems arising in research or involving ICT.

Evaluation Principles
Transparent

The degree of completeness to which users may access information, intentions, or behaviors, intentionally revealed through a process of disclosure, for use in decision-making; an enabling or impairing factor to doing ethics.

Data Model
Data Model

An abstraction of a domain, for purpose of translation into an ICT system, and thereby a set of distilled data structures representing real-world entities.

Kent, William, and Steve Hoberman. Data and Reality: A Timeless Perspective on Perceiving and Managing Information in Our Imprecise World. Westfield, NJ: Technics Publications, 2012.
Data Model
Schema

The structure and design of a database. In a relational database, this is a set of tables and fields. The overall set of schemas driving an application composes the data model. Details in definition may vary slightly depending on database tooling (Oracle vs. Postgres, etc.)

Data Model
Object

This word can get overloaded, but for the purposes of this glossary, it is a thing of interest out in meatspace that is distinct, unique, and self-contained. Through data modeling, these objects are translated into entities. See Object for more.

Atherton, Mike, and Carrie Hane. Designing Connected Content: Plan and Model Digital Products for Today and Tomorrow. San Francisco, CA: New Riders, 2018.
Data Model
Data Dictionary

A catalog of the fields in one or more schemas within a database system allowing an end user to navigate the database.

Data Model
Entity

A data schema or structure that corresponds to an object in meatspace.

Atherton, Mike, and Carrie Hane. Designing Connected Content: Plan and Model Digital Products for Today and Tomorrow. San Francisco, CA: New Riders, 2018.
Data Model
Instance

An example of an object.

Atherton, Mike, and Carrie Hane. Designing Connected Content: Plan and Model Digital Products for Today and Tomorrow. San Francisco, CA: New Riders, 2018.
Data Model
Record

Several fields in a row representing an instance of an entity for an object in meatspace.

Data Model
Field

An attribute of an object described in a schema. A set of field composes a record for an instance of an entity.

Data Model
Attribute

A property of an entity in the data model, singled out as relevant to its definition; a field in a schema; also known as a parameter depending on the context.

Atherton, Mike, and Carrie Hane. Designing Connected Content: Plan and Model Digital Products for Today and Tomorrow. San Franscisco, CA: New Riders, 2018.
Data Model
Metadata

Basic information about data to help users understand how to work with it; fields in a schema.

Data Model
State

A property of an entity generated through computational processing that describes how it has moved through the system; may or may not be able to be changed by a user. Success and error states are the minimum states generated through any process.

Data Model
Action

A method or function that can be invoked on an entity which mutates its state.

Data Model
Relationship

A connection between two entities. For more details, see Relationship.

Atherton, Mike, and Carrie Hane. Designing Connected Content: Plan and Model Digital Products for Today and Tomorrow. San Francisco, CA: New Riders, 2018.
Task
Task

A set of steps with a clear goal. Serves as a backbone to developing attributes, states, relationships, and other metadata that may be necessary to include in the schema for an entity.

Task
Step

The basic unit of a task describing a change from the previous step. Step may be user or system generated.

Task
Trigger

The first step of a task. Can be identified by talking through the motivation of a task. Necessary to identify upfront when doing a task analysis.

Task
Result

The last step in a task. Necessary to identify first as part of bounding a task analysis. Can be identified by talking through the motivation of a task.

Task
Input

Information needed to accomplish a step in a task. May not always be in digital form as data, but the process of digitization usually refers to taking these inputs which may be found in different forms and creating a streamlined process where they can be digitized and moved through the system as discrete blendable data elements in the data model.

Task
Output

Information produced as a result of a step.

Data
Data

A lack of uniformity that makes a difference that can be perceived, measured, captured, and produced via an interaction; a precondition for experience.

Turilli, Matteo, and Luciano Floridi. "The Ethics of Information Transparency." Ethics and Information Technology 11, no. 2 (2009): 105-12. doi:10.1007/s10676-009-9187-9.
Data
Data Type

An attribute of data that tells the compiler how it is to be used. Included in Origo are:

  • Categorical
  • Integer
  • Float
  • Date-Time
  • ID
  • String
Data
Cadence

The frequency at which that data is processed. In Origo, four types:

  • Batch: Transactions are processed after a set amount of time with minimal human interaction. The length of time between batches should be appropriate to the use case and type of data being handled. There is a spectrum of updates between batch and streaming data, but batch usually implies that there is not seemingly continuous processing.
  • Streaming: Transactions are processed continually, allowing a real-time understanding of events occurring. Makes the most sense for use cases where moment-to-moment context matters to the experience.
  • Backfill: Historical information is processed to account for a new field.
  • Adhoc: Transactions are processed on an as-needed basis.
Data
Origin

The location from which data arrives as input. In Origo, this is classified as:

  • User-Defined: data is generated from user input on the interface; for example, typing their name.
  • Transactional: data is generated from computational processes; for example, clicking a button.
  • Backend: data arrives from the data warehouse; for example, metadata.
Data
Ownership

The owner of the data, where to own means to collect. If a change needs to be made, understanding who owns the data allows for understanding the scope of changes that can or cannot be made. Origo shows three types:

  • First Party: Data owned and directly collected by the company
  • Second Party: Data collected by another company that is directly shared out of mutual benefits
  • Third Party: Data collect by another company and bought in order to enrich the first party dataset; for example, weather data.
Data
Personally Identifiable Information

Information that can be directly linked to an individual's identity.

Data
Quasi-Identifier

Information that can be linked to other information to potentially reveal an individual's identity.

Relationship
Inheritance

A mechanism upon which objects or classes are based upon another object or class, retaining similar implementation or properties.

Relationship
Child of

An object that is nested within another object that inherits its properties.

Relationship
Parent of

The object that contains another object that passes on its properties.

Relationship
Cardinality

A counting of how many things can relate to something else.

Atherton, Mike, and Carrie Hane. Designing Connected Content: Plan and Model Digital Products for Today and Tomorrow. San Franscisco, CA: New Riders, 2018.
Relationship
One to One

A relationship where an instance of an object relates to only one instance of another object.

Kent, William, and Steve Hoberman. Data and Reality: A Timeless Perspective on Perceiving and Managing Information in Our Imprecise World. Westfield, NJ: Technics Publications, 2012.
Relationship
One to Many

A relationship where an instance of an object relates to many instances of another object.

Kent, William, and Steve Hoberman. Data and Reality: A Timeless Perspective on Perceiving and Managing Information in Our Imprecise World. Westfield, NJ: Technics Publications, 2012.
Relationship
Many to Many

A relationship where several instances of an object relates to several instances of another object.

Kent, William, and Steve Hoberman. Data and Reality: A Timeless Perspective on Perceiving and Managing Information in Our Imprecise World. Westfield, NJ: Technics Publications, 2012.
Relationship
Recursive

A relationship that connects the object to itself.

Relationship
Optional

A relationship that sometimes exists, but not always.

Object Design
Objectification

The process of making one's judgment about what should be done explicit and communicating it to others so that there is a successful exchange of information about the foundations of the judgment, allowing it to be collectively discussed, reasoned, and/or argued over.

Whilst agreement may not be an outcome of objectification, the likelihood of one can be improved through collective learning. In the process of objectification, one also comes to a greater understanding of which questions are worthwhile to pursue, which have the greatest weight, and where there may be disagreements needing further testing and analysis.

Not to be confused with the process of making something objective, that is making a procedure that can be replicated by someone other than the creator. In contrast, objectification seeks to expose the judgment of the creator.

Horst Rittel. "On the Planning Crisis: System Analysis of the 'First and Second Generation.'" Bedriftsøkonomen, no. 8 (1972): 390-96.
Object Design
Deontic Premise

The "ought-to-be" statement involved in developing a solution to a wicked problem which is not based on scientific expertise but the moral and ethical attitude of the interventionist. Cannot be reconstructed by looking at the outcome of a solution as it is filigreed into the solution based on the underlying the judgment of the designer.

That there is one or more deontic premises for every solution for a wicked problem highlights the importance of involving multiple stakeholders in a transparent planning process.

Horst Rittel. "On the Planning Crisis: System Analysis of the 'First and Second Generation.'" Bedriftsøkonomen, no. 8 (1972): 390-96.
System
Symmetry of Ignorance

Exists amongst stakeholders for a wicked problem given their local frame of the problem. Each stakeholder can only be an expert in guiding the process of handling the wicked problem because of their limited view; they cannot be subject matter experts of the problem itself.

Horst Rittel. "On the Planning Crisis: System Analysis of the 'First and Second Generation.'" Bedriftsøkonomen, no. 8 (1972): 390-96.
Component
Constraint

A decision of resignation within an action space, either implicitly or explicitly.

Horst Rittel. "On the Planning Crisis: System Analysis of the 'First and Second Generation.'" Bedriftsøkonomen, no. 8 (1972): 390-96.
Object Design
Individuality

Something that makes an object discrete from the metaphysical flux around it, that gives it a coherent unity, a figure separated from ground.

Smith, Brian Cantwell. On the Origin of Objects. Cambridge: The MIT Press, 1998.
Scope
Data Model

An abstraction of a domain, for purpose of translation into an ICT system, and thereby a set of distilled data structures representing objects in meatspace. For more details, view Model.

Kent, William, and Steve Hoberman. Data and Reality: A Timeless Perspective on Perceiving and Managing Information in Our Imprecise World. Westfield, NJ: Technics Publications, 2012.
User Transactions
Log

A record of an event that has taken pace within an ICT.

"The Log: What Every Software Engineer Should Know about Real-time Data's Unifying Abstraction." LinkedIn Engineering. Accessed March 06, 2021. https://engineering.linkedin.com/distributed-systems/log-what-every-software-engineer-should-know-about-real-time-datas-unifying.
User Transactions
Event

An action handled by the ICT.

User Transactions
Diff

A comparison of the differences between two files.

User Transactions
Version Control

Systems responsible for managing changes to ICT.

User Transactions
Run

The execution of a resource configured to be activated by an actor, agent, and/or individual.

User Transactions
Update

One of the four basic functions of persistent storage; the update or editing of existing entries.

User Transactions
Delete

One of the four basic functions of persistent storage; the deletion, deactivation, or removal of existing entries.

User Transactions
Read

One of the four basic functions of persistent storage; the reading, reviewing, searching, or viewing of existing entries.

User Transactions
Create

One of the four basic functions of persistent storage; the addition of a new entry.

User Transactions
Access Right

Permission granted to an individual to a resource.

User Transactions
Resource

An asset within an ICT.

System
Hybrid Procedures

Inconsistency in function that limits adoption by reducing the coherence of the operations performed by different actors, agents, and individuals within an organization.

Turilli, Matteo. "Ethical Protocols Design." Machine Ethics: 375-97. doi:10.1017/cbo9780511978036.026.
System
Heterogenous Organization

A population of actors, agents, and individuals that share resources to coordinate their activities effectively in order to achieve common goals.

Turilli, Matteo. "Ethical Protocols Design." Machine Ethics: 375-97. doi:10.1017/cbo9780511978036.026.
System
The Menlo Report

A report summarizing a set of basic principles to guide the identification and resolution of ethical problems arising in research or involving ICT.

Kenneally, Erin and David Dittrich. "The Menlo Report: Ethical Principles Guiding Information and Communication Technology Research." Tech. Report. U.S. Department of Homeland Security, Aug 2012. https://www.dhs.gov/sites/default/files/publications/CSD-MenloPrinciplesCORE-20120803_1.pdf
System
Information & Communication Technology (ICT)

A system that stores, retrieves, manipulates, transmits, and receives information (data) electronically, across networks, software, and hardware technologies.

Kenneally, Erin and David Dittrich. "The Menlo Report: Ethical Principles Guiding Information and Communication Technology Research." Tech. Report. U.S. Department of Homeland Security, Aug 2012. https://www.dhs.gov/sites/default/files/publications/CSD-MenloPrinciplesCORE-20120803_1.pdf
Object Design
Semantic Elaboration

The process of semanticising information which may or may not be ethically neutral depending on information was collected, correlated, or interpreted.

Turilli, Matteo, and Luciano Floridi. "The Ethics of Information Transparency." Ethics and Information Technology 11, no. 2 (2009): 105-12. doi:10.1007/s10676-009-9187-9.
Object Design
Semanticisation

The operations performed by an agent to transform raw data into semantic information that is meaningful and truthful

Turilli, Matteo, and Luciano Floridi. "The Ethics of Information Transparency." Ethics and Information Technology 11, no. 2 (2009): 105-12. doi:10.1007/s10676-009-9187-9.
Object Design
Semantic Information

Meaningful, veridical, comprehensible, accessible, and useful data that can be used for epistemic purposes and connected with a process of decision-making.

Turilli, Matteo, and Luciano Floridi. "The Ethics of Information Transparency." Ethics and Information Technology 11, no. 2 (2009): 105-12. doi:10.1007/s10676-009-9187-9.
Object Design
Middle Distance

A place between the general and particular; a space of computation.

"...an intermediate realm between a proximal though ultimately ineffable connection, reminiscent of the familiar bumping and shoving of the world, and a more remote disconnection, a form of unabridgeable separation that lies at the root of abstraction and of the partial (and painful) subject-object divide."

Smith, Brian Cantwell. On the Origin of Objects. Cambridge: The MIT Press, 1998.
Object Design
Particular

The specific, located, and singular; the form the particular takes depends on the perspective.

Smith, Brian Cantwell. On the Origin of Objects. Cambridge: The MIT Press, 1998.
Object Design
Reckoning

The powerful calculative rationality that display as intelligence possessed by machines; colloquially known as artificial intelligence.

Brian Cantwell Smith. The Promise of Artificial Intelligence: Reckoning and Judgment. The MIT Press. 2019.
Object Design
Judgment

Deliberate thought grounded in ethical commitment and responsible action that is appropriate to the situation in which it is deployed; human intelligence. [1]

Rittel claims that there are four kinds of judgments:

  1. Off-Hand / Intuitive Judgment: Offhand and based on intuition. The terminal of all partial and deliberated judgments.
  2. Systematic / Deliberated Judgment: Substitutes for intuitive judgments because you don't trust them or have to explain them to someone else (objectification).
  3. Overall Judgment: The final decision integrating all the independent pros and cons of a given solution.
  4. Partial Judgment: A single judgment for a single criteria. Can be broken down from overall judgments into a tree-like structure. [2]
[1] Brian Cantwell Smith. The Promise of Artificial Intelligence: Reckoning and Judgment. The MIT Press. 2019. [2] Horst Rittel. "On the Planning Crisis: System Analysis of the 'First and Second Generation.'" Bedriftsøkonomen, no. 8 (1972): 390-96.
Object Design
Stopping Rule

Criteria which indicate when a solution has been found; does not exist in wicked problems where work only ends with lack of time, money, and/or patience.

Horst W. J. Rittel, and Melvin M. Webber. "Dilemmas in a General Theory of Planning." Policy Sciences 4, no. 2 (1973): 155-69. Accessed May 18, 2021. http://www.jstor.org/stable/4531523.
Object Design
Wicked Problem

A different class of problems from those handled by engineering and/or science; societal problems which are ill-defined and which require a political position in order to resolve as no solution can actually exist. Each problem is unique, and each solution is a one-shot operation. Wicked problems cannot be simulated in a lab.

"The process of formulating a problem and of conceiving a solution are identical, since every specification of the problem is a specification of the direction in which a treatment is considered... one cannot understand the problem without knowing its context; one cannot meaningfully search for information without the orientation of a solution concept; one cannot first understand then solve." [1]

"A problem can be stated as a discrepancy, as something as it is compared with something as it ought to be... you look for reasons for the existence of this discrepancy, the cause and the explanation. And the trouble is that in wicked problems there are many explanations for the same discrepancy and there is no test for which of these explanations is the best one." [2]

Origo treats ethics as a wicked problem where the only way to move towards good is by improving the time to understanding the underlying design problem, which is, under this framework, the same as improving the chances of creating a more ethical design solution.

[1] Horst W. J. Rittel, and Melvin M. Webber. "Dilemmas in a General Theory of Planning." Policy Sciences 4, no. 2 (1973): 155-69. [2] Horst Rittel. "On the Planning Crisis: System Analysis of the 'First and Second Generation.'" Bedriftsøkonomen, no. 8 (1972): 390-96.
Scope
Physical Data Model

Implementation level of logical data model taking into account technical optimizations and constraints around data processing in the physical world within physical media.

Kent, William, and Steve Hoberman. Data and Reality: A Timeless Perspective on Perceiving and Managing Information in Our Imprecise World. Westfield, NJ: Technics Publications, 2012.
Scope
Logical Data Model

Detailed level of conceptual data model that contains all attributes and relationships needed for solution to problem.

Kent, William, and Steve Hoberman. Data and Reality: A Timeless Perspective on Perceiving and Managing Information in Our Imprecise World. Westfield, NJ: Technics Publications, 2012.
Scope
Conceptual Data Model

Highest level of abstraction for a data model that captures business requirements and scopes projects.

Kent, William, and Steve Hoberman. Data and Reality: A Timeless Perspective on Perceiving and Managing Information in Our Imprecise World. Westfield, NJ: Technics Publications, 2012.
Scope
Domain Model

A formal representation of an area of knowledge, influence, or activity; consists of real-world entities that eventually needs to be translated into software.

Atherton, Mike, and Carrie Hane. Designing Connected Content: Plan and Model Digital Products for Today and Tomorrow. San Franscisco, CA: New Riders, 2018.
Scope
Object Model

A collection of concepts embedded in a program that interfaces with a service or system.

Scope
Content Model

A collection of related content types, or groups of information, found within an ICT, that is consumed by the end user.

Atherton, Mike, and Carrie Hane. Designing Connected Content: Plan and Model Digital Products for Today and Tomorrow. San Franscisco, CA: New Riders, 2018.
Component
Agent

Interactive and autonomous like actors, but also has the ability to adapt and change rules in order to perform its operations.

Turilli, Matteo. "Ethical Protocols Design." Machine Ethics: 375-97. doi:10.1017/cbo9780511978036.026.
Component
Individual

Traditional entities that perform operations in an organization; autonomous, adaptive, interactive, and possess semanticisation capacity.

Turilli, Matteo. "Ethical Protocols Design." Machine Ethics: 375-97. doi:10.1017/cbo9780511978036.026.
Component
Actor

Autonomous entities capable of interacting with the environment by receiving inputs, producing outputs, and performing operations; have some degree of control over their internal state which enables them to perform their operations autonomously; defined by the operations it performs.

Turilli, Matteo. "Ethical Protocols Design." Machine Ethics: 375-97. doi:10.1017/cbo9780511978036.026.
Scope
Level of Abstraction

The same model of information and processes at a certain level of detail.

Component
Blackbox Model

A type of agent; machine learning model that is flexible and unstructured.

Component
Rule-Based Bot

A type of actor; business process logic that is rigid and configured in detail.

System
Information & Communication Technology (ICT)

A system that stores, retrieves, manipulates, transmits, and receives information (data) electronically, across networks, software, and hardware technologies.

Kenneally, Erin and David Dittrich. "The Menlo Report: Ethical Principles Guiding Information and Communication Technology Research." Tech. Report. U.S. Department of Homeland Security, Aug 2012. https://www.dhs.gov/sites/default/files/publications/CSD-MenloPrinciplesCORE-20120803_1.pdf
System
The Menlo Report

A report summarizing a set of basic principles to guide the identification and resolution of ethical problems arising in research or involving ICT.

Kenneally, Erin and David Dittrich. "The Menlo Report: Ethical Principles Guiding Information and Communication Technology Research." Tech. Report. U.S. Department of Homeland Security, Aug 2012. https://www.dhs.gov/sites/default/files/publications/CSD-MenloPrinciplesCORE-20120803_1.pdf
System
Heterogenous Organization

A population of actors, agents, and individuals that share resources to coordinate their activities effectively in order to achieve common goals.

Turilli, Matteo. "Ethical Protocols Design." Machine Ethics: 375-97. doi:10.1017/cbo9780511978036.026.
System
Hybrid Procedures

Inconsistency in function that limits adoption by reducing the coherence of the operations performed by different actors, agents, and individuals within an organization.

Turilli, Matteo. "Ethical Protocols Design." Machine Ethics: 375-97. doi:10.1017/cbo9780511978036.026.
System
Symmetry of Ignorance

Exists amongst stakeholders for a wicked problem given their local frame of the problem. Each stakeholder can only be an expert in guiding the process of handling the wicked problem because of their limited view; they cannot be subject matter experts of the problem itself.

Horst Rittel. "On the Planning Crisis: System Analysis of the 'First and Second Generation.'" Bedriftsøkonomen, no. 8 (1972): 390-96.
Component
Actor

Autonomous entities capable of interacting with the environment by receiving inputs, producing outputs, and performing operations; have some degree of control over their internal state which enables them to perform their operations autonomously; defined by the operations it performs.

Turilli, Matteo. "Ethical Protocols Design." Machine Ethics: 375-97. doi:10.1017/cbo9780511978036.026.
Component
Individual

Traditional entities that perform operations in an organization; autonomous, adaptive, interactive, and possess semanticisation capacity.

Turilli, Matteo. "Ethical Protocols Design." Machine Ethics: 375-97. doi:10.1017/cbo9780511978036.026.
Component
Agent

Interactive and autonomous like actors, but also has the ability to adapt and change rules in order to perform its operations.

Turilli, Matteo. "Ethical Protocols Design." Machine Ethics: 375-97. doi:10.1017/cbo9780511978036.026.
Component
Rule-Based Bot

A type of actor; business process logic that is rigid and configured in detail.

Component
Blackbox Model

A type of agent; machine learning model that is flexible and unstructured.

Component
Constraint

A decision of resignation within an action space, either implicitly or explicitly.

Horst Rittel. "On the Planning Crisis: System Analysis of the 'First and Second Generation.'" Bedriftsøkonomen, no. 8 (1972): 390-96.
Scope
Domain Model

A formal representation of an area of knowledge, influence, or activity; consists of real-world entities that eventually needs to be translated into software.

Atherton, Mike, and Carrie Hane. Designing Connected Content: Plan and Model Digital Products for Today and Tomorrow. San Franscisco, CA: New Riders, 2018.
Scope
Level of Abstraction

The same model of information and processes at a certain level of detail.

Scope
Data Model

An abstraction of a domain, for purpose of translation into an ICT system, and thereby a set of distilled data structures representing objects in meatspace. For more details, view Model.

Kent, William, and Steve Hoberman. Data and Reality: A Timeless Perspective on Perceiving and Managing Information in Our Imprecise World. Westfield, NJ: Technics Publications, 2012.
Scope
Content Model

A collection of related content types, or groups of information, found within an ICT, that is consumed by the end user.

Atherton, Mike, and Carrie Hane. Designing Connected Content: Plan and Model Digital Products for Today and Tomorrow. San Franscisco, CA: New Riders, 2018.
Scope
Object Model

A collection of concepts embedded in a program that interfaces with a service or system.

Scope
Conceptual Data Model

Highest level of abstraction for a data model that captures business requirements and scopes projects.

Kent, William, and Steve Hoberman. Data and Reality: A Timeless Perspective on Perceiving and Managing Information in Our Imprecise World. Westfield, NJ: Technics Publications, 2012.
Scope
Logical Data Model

Detailed level of conceptual data model that contains all attributes and relationships needed for solution to problem.

Kent, William, and Steve Hoberman. Data and Reality: A Timeless Perspective on Perceiving and Managing Information in Our Imprecise World. Westfield, NJ: Technics Publications, 2012.
Scope
Physical Data Model

Implementation level of logical data model taking into account technical optimizations and constraints around data processing in the physical world within physical media.

Kent, William, and Steve Hoberman. Data and Reality: A Timeless Perspective on Perceiving and Managing Information in Our Imprecise World. Westfield, NJ: Technics Publications, 2012.
Object Design
Wicked Problem

A different class of problems from those handled by engineering and/or science; societal problems which are ill-defined and which require a political position in order to resolve as no solution can actually exist. Each problem is unique, and each solution is a one-shot operation. Wicked problems cannot be simulated in a lab.

"The process of formulating a problem and of conceiving a solution are identical, since every specification of the problem is a specification of the direction in which a treatment is considered... one cannot understand the problem without knowing its context; one cannot meaningfully search for information without the orientation of a solution concept; one cannot first understand then solve." [1]

"A problem can be stated as a discrepancy, as something as it is compared with something as it ought to be... you look for reasons for the existence of this discrepancy, the cause and the explanation. And the trouble is that in wicked problems there are many explanations for the same discrepancy and there is no test for which of these explanations is the best one." [2]

Origo treats ethics as a wicked problem where the only way to move towards good is by improving the time to understanding the underlying design problem, which is, under this framework, the same as improving the chances of creating a more ethical design solution.

[1] Horst W. J. Rittel, and Melvin M. Webber. "Dilemmas in a General Theory of Planning." Policy Sciences 4, no. 2 (1973): 155-69. [2] Horst Rittel. "On the Planning Crisis: System Analysis of the 'First and Second Generation.'" Bedriftsøkonomen, no. 8 (1972): 390-96.
Object Design
Semantic Information

Meaningful, veridical, comprehensible, accessible, and useful data that can be used for epistemic purposes and connected with a process of decision-making.

Turilli, Matteo, and Luciano Floridi. "The Ethics of Information Transparency." Ethics and Information Technology 11, no. 2 (2009): 105-12. doi:10.1007/s10676-009-9187-9.
Object Design
Semanticisation

The operations performed by an agent to transform raw data into semantic information that is meaningful and truthful

Turilli, Matteo, and Luciano Floridi. "The Ethics of Information Transparency." Ethics and Information Technology 11, no. 2 (2009): 105-12. doi:10.1007/s10676-009-9187-9.
Object Design
Semantic Elaboration

The process of semanticising information which may or may not be ethically neutral depending on information was collected, correlated, or interpreted.

Turilli, Matteo, and Luciano Floridi. "The Ethics of Information Transparency." Ethics and Information Technology 11, no. 2 (2009): 105-12. doi:10.1007/s10676-009-9187-9.
Object Design
Middle Distance

A place between the general and particular; a space of computation.

"...an intermediate realm between a proximal though ultimately ineffable connection, reminiscent of the familiar bumping and shoving of the world, and a more remote disconnection, a form of unabridgeable separation that lies at the root of abstraction and of the partial (and painful) subject-object divide."

Smith, Brian Cantwell. On the Origin of Objects. Cambridge: The MIT Press, 1998.
Object Design
Particular

The specific, located, and singular; the form the particular takes depends on the perspective.

Smith, Brian Cantwell. On the Origin of Objects. Cambridge: The MIT Press, 1998.
Object Design
Individuality

Something that makes an object discrete from the metaphysical flux around it, that gives it a coherent unity, a figure separated from ground.

Smith, Brian Cantwell. On the Origin of Objects. Cambridge: The MIT Press, 1998.
Object Design
Judgment

Deliberate thought grounded in ethical commitment and responsible action that is appropriate to the situation in which it is deployed; human intelligence. [1]

Rittel claims that there are four kinds of judgments:

  1. Off-Hand / Intuitive Judgment: Offhand and based on intuition. The terminal of all partial and deliberated judgments.
  2. Systematic / Deliberated Judgment: Substitutes for intuitive judgments because you don't trust them or have to explain them to someone else (objectification).
  3. Overall Judgment: The final decision integrating all the independent pros and cons of a given solution.
  4. Partial Judgment: A single judgment for a single criteria. Can be broken down from overall judgments into a tree-like structure. [2]
[1] Brian Cantwell Smith. The Promise of Artificial Intelligence: Reckoning and Judgment. The MIT Press. 2019. [2] Horst Rittel. "On the Planning Crisis: System Analysis of the 'First and Second Generation.'" Bedriftsøkonomen, no. 8 (1972): 390-96.
Object Design
Reckoning

The powerful calculative rationality that display as intelligence possessed by machines; colloquially known as artificial intelligence.

Brian Cantwell Smith. The Promise of Artificial Intelligence: Reckoning and Judgment. The MIT Press. 2019.
Object Design
Deontic Premise

The "ought-to-be" statement involved in developing a solution to a wicked problem which is not based on scientific expertise but the moral and ethical attitude of the interventionist. Cannot be reconstructed by looking at the outcome of a solution as it is filigreed into the solution based on the underlying the judgment of the designer.

That there is one or more deontic premises for every solution for a wicked problem highlights the importance of involving multiple stakeholders in a transparent planning process.

Horst Rittel. "On the Planning Crisis: System Analysis of the 'First and Second Generation.'" Bedriftsøkonomen, no. 8 (1972): 390-96.
Object Design
Objectification

The process of making one's judgment about what should be done explicit and communicating it to others so that there is a successful exchange of information about the foundations of the judgment, allowing it to be collectively discussed, reasoned, and/or argued over.

Whilst agreement may not be an outcome of objectification, the likelihood of one can be improved through collective learning. In the process of objectification, one also comes to a greater understanding of which questions are worthwhile to pursue, which have the greatest weight, and where there may be disagreements needing further testing and analysis.

Not to be confused with the process of making something objective, that is making a procedure that can be replicated by someone other than the creator. In contrast, objectification seeks to expose the judgment of the creator.

Horst Rittel. "On the Planning Crisis: System Analysis of the 'First and Second Generation.'" Bedriftsøkonomen, no. 8 (1972): 390-96.
Object Design
Stopping Rule

Criteria which indicate when a solution has been found; does not exist in wicked problems where work only ends with lack of time, money, and/or patience.

Horst W. J. Rittel, and Melvin M. Webber. "Dilemmas in a General Theory of Planning." Policy Sciences 4, no. 2 (1973): 155-69. Accessed May 18, 2021. http://www.jstor.org/stable/4531523.
Evaluation Principles
Rationality

To try and anticipate the consequences of contemplated actions; thinking before acting.

Rittel lays out the following paradoxes of rationality:

  1. The tracing of consequences can go back infinitely. One always has to start a step earlier.
  2. Once the tracing of consequences has started, there is no reason to stop.
  3. The further back the consequences are traced, the more one is overburdened. Tracing consequences does not lead to better decisions in the present.
  4. If you were to really build a model of all the consequences, you would have to model a model of the consequences. The model needs to contain itself, which is impossible.

These paradoxes move design away from a linear model of problem definition and problem solving (first generation system analysis) and positions it closer to experimental problem finding where solving the problem is the same as understanding it (second generation system analysis). That is, the solution space and the problem space are considered as one (wicked problem).

See wicked problem.

Ontology Problems
Missing Context

A lack of situational information that may create faulty assumptions.

Ontology Problems
Faulty Assumption

Vague beliefs without specific proof; can very be problematic when building product, especially if it is around a requirement.

Ontology Problems
Inscription Error

"... a tendency for an observer, first, to write or project or impose or inscribe a set of ontological assumptions onto a computational system (onto the system itself, onto the task domain, onto the relation between the two, and so forth), and then, second, to read those assumptions or their consequences back off the system, as if that constituted an independent empirical discovery or theoretical result."

Ontology Problems
Impedence Mismatch

When conceptual or technical challenges arise due to a poorly designed data model, pointing to how research into and translation of domain objects into the user interface was not well considered. May require costly refactoring.

Ontology Problems
Knowledge Transfer

Sharing knowledge to solve problems; can be between industries, disciplines, generations, teams, etc. If knowledge is not transferred, it runs the risk of being lost or not meeting its full potential due to being trapped in a silo.

Evaluation Problems
Consensual

When permission is requested and given.

Evaluation Problems
Contestable

An end user is able to interpret the results or have the results explained to them such that they can catch and resolve any errors.

Evaluation Problems
Welfare

The health, happiness, and well-being of a group that should be protected.

Evaluation Problems
Safe

To be free from harm or danger. Many questions of ethics are framed in terms of utilitarian trade-offs between risks and benefits, which is why safety is the primary protective criteria for disciplines with more mature ethical protocols.

Evaluation Problems
Accountable

The obligation to justify and report results of systems such that harms can be mitigated.

Evaluation Problems
Auditable

The ability for external stakeholders to assess the operations and quality standards of a system.

Evaluation Problems
Interpretable

The system is capable of being understood by humans. This is easier when the number of inputs is low.

Evaluation Problems
Explainable

A system that explains to a human the reasons behind a result. The human understands the system through its results; the human may not be able to interpret the inner workings of a model directly.

Evaluation Principles
Transparent

The degree of completeness to which users may access information, intentions, or behaviors, intentionally revealed through a process of disclosure, for use in decision-making; an enabling or impairing factor to doing ethics.

Organizational Problems
Ethics Shirking

The malpractice of doing increasingly less ethical work in a given context the lower the return of such ethical work in that context is perceived to be.

Organizational Problems
Ethics Dumping

The export of unethical research practices to countries where there are weaker legal and ethical frameworks and enforcing mechanisms.

Organizational Problems
Ethics Lobbying

Private actors attempting to self-regulate by lobbying against the introduction of legal norms and/or the weakening of enforcement such that compliance is limited.

Organizational Problems
Ethics Bluewashing

A form of misinformation achieved by spending a fraction of the resources that would be needed to tackle the ethical problems meant to be addressed.

Organizational Problems
Ethics Shopping

The malpractice of choosing, adapting, or revising ethical principles, guidelines, codes, frameworks, or other standards from a variety of available offers, in order to retrofit some pre-existing behaviors and justify them a posteriori instead of benchmarking against public, ethical standards.

Data Problems
Outdated Data

Data is not being updated at a cadence that is sensible for the use case.

Data Problems
Poorly Selected Data

Careless selection of data inputs for an algorithmic decision that may lead to biased results. Data might be missing in a way that disadvantages certain groups, or is structured at the wrong level of granularity.

Data Problems
Historical Bias

Bias that exist in the dataset due unequal representation historically. This bias then perpetuate existing systemic problems into the future when used in a machine learning model.

Data Problems
Selection Bias

The set of data inputs into a model is not representative of all stakeholder concerns resulting in biased outputs.

Data Problems
Incomplete Data

Gaps in data collection which may not be effectively communicated to the data handler or unaccounted for in the processing, leading to biased results.

Data Problems
Incorrect Data

Inaccuracies in the data which may be due to the lack of technical rigor in the method in which it was collected.

Data Problems
Incorrect Data

Inaccuracies in the data which may be due to the lack of technical rigor in the method in which it was collected.

Executive Office of the President. Big Data: A Report on Algorithmic Systems, Opportunity, and Civil Rights. 2014.
Data Problems
Incomplete Data

Gaps in data collection which may not be effectively communicated to the data handler or unaccounted for in the processing, leading to biased results.

Executive Office of the President. Big Data: A Report on Algorithmic Systems, Opportunity, and Civil Rights. 2014.
Data Problems
Selection Bias

The set of data inputs into a model is not representative of all stakeholder concerns resulting in biased outputs.

Executive Office of the President. Big Data: A Report on Algorithmic Systems, Opportunity, and Civil Rights. 2014.
Data Problems
Historical Bias

Bias that exist in the dataset due unequal representation historically. This bias then perpetuate existing systemic problems into the future when used in a machine learning model.

Executive Office of the President. Big Data: A Report on Algorithmic Systems, Opportunity, and Civil Rights. 2014.
Data Problems
Poorly Selected Data

Careless selection of data inputs for an algorithmic decision that may lead to biased results. Data might be missing in a way that disadvantages certain groups, or is structured at the wrong level of granularity.

Executive Office of the President. Big Data: A Report on Algorithmic Systems, Opportunity, and Civil Rights. 2014.
Data Problems
Outdated Data

Data is not being updated at a cadence that is sensible for the use case.

Executive Office of the President. Big Data: A Report on Algorithmic Systems, Opportunity, and Civil Rights. 2014.
Ontology Problems
Knowledge Transfer

Sharing knowledge to solve problems; can be between industries, disciplines, generations, teams, etc. If knowledge is not transferred, it runs the risk of being lost or not meeting its full potential due to being trapped in a silo.

Ontology Problems
Impedence Mismatch

When conceptual or technical challenges arise due to a poorly designed data model, pointing to how research into and translation of domain objects into the user interface was not well considered. May require costly refactoring.

Ontology Problems
Inscription Error

"... a tendency for an observer, first, to write or project or impose or inscribe a set of ontological assumptions onto a computational system (onto the system itself, onto the task domain, onto the relation between the two, and so forth), and then, second, to read those assumptions or their consequences back off the system, as if that constituted an independent empirical discovery or theoretical result."

Smith, Brian Cantwell. On the Origin of Objects. Cambridge: The MIT Press, 1998.
Ontology Problems
Faulty Assumption

Vague beliefs without specific proof; can very be problematic when building product, especially if it is around a requirement.

Ontology Problems
Missing Context

A lack of situational information that may create faulty assumptions.

Organizational Problems
Ethics Shopping

The malpractice of choosing, adapting, or revising ethical principles, guidelines, codes, frameworks, or other standards from a variety of available offers, in order to retrofit some pre-existing behaviors and justify them a posteriori instead of benchmarking against public, ethical standards.

Floridi, Luciano. "Translating Principles into Practices of Digital Ethics: Five Risks of Being Unethical." Philosophy & Technology 32, no. 2 (2019): 185-93. doi:10.1007/s13347-019-00354-x.
Organizational Problems
Ethics Bluewashing

A form of misinformation achieved by spending a fraction of the resources that would be needed to tackle the ethical problems meant to be addressed.

Floridi, Luciano. "Translating Principles into Practices of Digital Ethics: Five Risks of Being Unethical." Philosophy & Technology 32, no. 2 (2019): 185-93. doi:10.1007/s13347-019-00354-x.
Organizational Problems
Ethics Lobbying

Private actors attempting to self-regulate by lobbying against the introduction of legal norms and/or the weakening of enforcement such that compliance is limited.

Floridi, Luciano. "Translating Principles into Practices of Digital Ethics: Five Risks of Being Unethical." Philosophy & Technology 32, no. 2 (2019): 185-93. doi:10.1007/s13347-019-00354-x.
Organizational Problems
Ethics Dumping

The export of unethical research practices to countries where there are weaker legal and ethical frameworks and enforcing mechanisms.

Floridi, Luciano. "Translating Principles into Practices of Digital Ethics: Five Risks of Being Unethical." Philosophy & Technology 32, no. 2 (2019): 185-93. doi:10.1007/s13347-019-00354-x.
Organizational Problems
Ethics Shirking

The malpractice of doing increasingly less ethical work in a given context the lower the return of such ethical work in that context is perceived to be.

Floridi, Luciano. "Translating Principles into Practices of Digital Ethics: Five Risks of Being Unethical." Philosophy & Technology 32, no. 2 (2019): 185-93. doi:10.1007/s13347-019-00354-x.
Evaluation Principles
Rationality

To try and anticipate the consequences of contemplated actions; thinking before acting.

Rittel lays out the following paradoxes of rationality:

  1. The tracing of consequences can go back infinitely. One always has to start a step earlier.
  2. Once the tracing of consequences has started, there is no reason to stop.
  3. The further back the consequences are traced, the more one is overburdened. Tracing consequences does not lead to better decisions in the present.
  4. If you were to really build a model of all the consequences, you would have to model a model of the consequences. The model needs to contain itself, which is impossible.

These paradoxes move design away from a linear model of problem definition and problem solving (first generation system analysis) and positions it closer to experimental problem finding where solving the problem is the same as understanding it (second generation system analysis). That is, the solution space and the problem space are considered as one (wicked problem).

See wicked problem.

Rittel Horst. "On the Planning Crisis: System Analysis of the 'First and Second Generations.'" Bedriftsøkonomen, 8, 390-96. 1972.
Evaluation Principles
Transparent

The degree of completeness to which users may access information, intentions, or behaviors, intentionally revealed through a process of disclosure, for use in decision-making; an enabling or impairing factor to doing ethics.

Turilli, Matteo, and Luciano Floridi. "The Ethics of Information Transparency." Ethics and Information Technology 11, no. 2 (2009): 105-12. doi:10.1007/s10676-009-9187-9.
Evaluation Problems
Explainable

A system that explains to a human the reasons behind a result. The human understands the system through its results; the human may not be able to interpret the inner workings of a model directly.

Evaluation Problems
Interpretable

The system is capable of being understood by humans. This is easier when the number of inputs is low.

Evaluation Problems
Auditable

The ability for external stakeholders to assess the operations and quality standards of a system.

Evaluation Problems
Accountable

The obligation to justify and report results of systems such that harms can be mitigated.

Evaluation Problems
Safe

To be free from harm or danger. Many questions of ethics are framed in terms of utilitarian trade-offs between risks and benefits, which is why safety is the primary protective criteria for disciplines with more mature ethical protocols.

Evaluation Problems
Welfare

The health, happiness, and well-being of a group that should be protected.

Evaluation Problems
Contestable

An end user is able to interpret the results or have the results explained to them such that they can catch and resolve any errors.

Evaluation Problems
Consensual

When permission is requested and given.

© Elisa Ngan 2024