đ§ Maybe What's Missing When You "Can't Decide" Is Just One of Five Elements
Decision Making / Data Science / AI / Statistics
â The Decision Map as a Scaffold for Thinking â
Introduction
You try to decide something, and you go round in circles.
âWhat should I have for lunch today?â âWhich method should I use for this research?â âHow should I delegate this to AI?â
The scale is completely different each time, yet the texture of the struggle feels similar. All sorts of information is floating around in your head, but the final call wonât come. Maybe thereâs a single reason common to all of these states.
This blog post is about a tool for making that âcommon reasonâ visible â a way of thinking called the decision map. Itâs a concept put forward by Professor Toshiyasu Matsushima of Waseda University, in the context of organizing data science as âa discipline dealing with the clear, rational process of making decisions from data,â and itâs laid out systematically in his papers and book series.
It got long, so I split it into four parts.
- Part 1: What is a decision map? â The five elements
- Part 2: Statistics and optimization can both be written as decision maps
- Part 3: There is no decision-making without subjectivity â what does a scientific attitude mean?
- Part 4: The skill you need in the AI era â standing on the side that designs the five elements
Read them in order, or just read whichever part interests you.
Part 1: What Is a Decision Map? â The Five Elements
Most of âstruggling to decideâ is just one of the five elements not yet put into words
A decision map is the idea of treating every decision as a âmapâ (function) that takes an input and picks one item out of an output set.
That map is described using the following five elements.
| Element | Content | Form of the question |
|---|---|---|
| Goal | What you want to achieve | For what purpose? |
| Setting | The premised situation, assumptions, constraints | What kind of world are we talking about? |
| Evaluation Criteria | The standard for judging whether an output is good or bad | What counts as a good result? |
| Input | The information/facts used as material for the judgment | What are you going on? |
| Output Set | The candidate actions/results that count as options | What set are you choosing from? |
If even one of the five elements is missing, the decision canât be completed. Put the other way around: when you feel you âcanât decide,â itâs usually because one of the five elements hasnât been put into words yet.
Example: deciding what to have for lunch
| Element | Content |
|---|---|
| Goal | Donât let my afternoon work performance drop |
| Setting | A weekday, near the office, 12:00â13:00, „3,000 in my wallet |
| Evaluation Criteria | Wonât make me sleepy Ă tasty Ă can finish eating within 30 minutes |
| Input | List of nearby restaurants, how I feel today, what I ate yesterday |
| Output Set | {udon, a set meal, a salad bowl, a convenience-store sandwich, skip lunch} |
Even a trivial choice has all five elements once you write it out.
And you notice that the usual cause of âhesitatingâ is that the weighting of the evaluation criteria hasnât been fixed. When âwonât make me sleepyâ and âtastyâ collide, you canât decide because you havenât fixed which one takes priority. This isnât a problem with the goal or a lack of input â itâs an evaluation-criteria problem.
Write it out, and you see what the struggle really is.
Career worries have the same structure
| Element | Content |
|---|---|
| Goal | Be in a job I can be proud of five years from now |
| Setting | Third-year university student, science major, intermediate English |
| Evaluation Criteria | Growth opportunity Ă salary Ă freedom to choose where to live |
| Input | Internship experience, self-analysis, company information, seniorsâ stories |
| Output Set | {graduate school, a job at a large company, a startup, studying abroad, starting a business} |
Career worries are, more often than not, a problem where the goal itself hasnât been fixed. Even the mismatch over whether to prioritize âgrowth opportunityâ or âsalaryâ as an evaluation criterion is rooted in the goal layer.
Do you want to âgrow,â or do you want âstabilityâ? If this is wavering, the evaluation criteria will waver forever, and no answer will come no matter how long you stare at the options.
Once you write the five elements out on a single page, you can see which element you usually havenât put into words. That is the real reason your decision-making has stalled.
Thatâs Part 1. Next comes the reach of this way of seeing things.
Part 2: Statistics and Optimization Can Both Be Written as Decision Maps
What looks like âa methodâ is, in fact, always a decision map
This is where the decision map really shows its worth.
In fact, what get called âmethodsâ â regression analysis, optimization, machine learning â can all be described as decision maps. This is the starting point of Professor Matsushimaâs paper, and itâs the core of a viewpoint that captures data science in a unified way.
Example: multiple regression analysis
Given you want to predict a target variable from explanatory variables , you seek a linear function . Written in five elements:
| Element | Content |
|---|---|
| Goal | Estimate a model expressing the relationship between the explanatory and target variables |
| Setting | Follows a linear regression model / iid / errors are homoscedastic and normally distributed |
| Evaluation Criteria | Maximize likelihood (equivalently, minimize squared error) |
| Input | Training data |
| Output Set | The parameter â i.e., the set of all lines |
Whatâs beautiful here is the coupling between the setting and the evaluation criteria. Because the setting fixed âerrors are homoscedastic and normally distributed,â maximizing likelihood turns out equivalent to minimizing squared error. Change the setting to a Laplace distribution, and under the same likelihood maximization you get minimization of absolute error instead.
The five elements arenât independent. Theyâre coupled to one another. Good design sense comes down to whether you can stay aware of that coupling.
Ridge regression, Lasso, AIC â all written in the same framework
In Professor Matsushimaâs paper, ridge regression, Lasso, AIC, variable-selection problems, and even variational Bayes methods are all organized uniformly as pairs of a decision map and an evaluation function. You come to see things not as âmemorize a pile of methodsâ but as âwhat family of methods appears as you vary the evaluation function or the setting of the same map.â
In the book series Introduction to Data Science, this same view lays out descriptive statistics, inferential statistics, and Bayesian statistics â fields that take different stances â side by side, in the common language of the decision map.
Even âthe same mapâ changes meaning when the goal above it differs
This is especially interesting.
Professor Matsushima points out that the very same decision map and evaluation function for multiple regression admits two different stances.
- Stance 1: I want to describe the data I obtained well (the descriptive-statistics stance)
- Stance 2: I want to know about the population/probability distribution behind the data (the mathematical-statistics stance)
Written as an equation, the two look identical, yet the higher-level goal â what youâre deciding for â is different. Under Stance 2, the output isnât just a coefficient; itâs interpreted as an estimator of a population parameter.
In other words, a decision map has a hierarchy above it. Above the âgoalâ there is a âhigher-level goal,â and above the evaluation criteria there is the question of grounds: âwhy is this the right evaluation?â
Hierarchical structure â fractal nature
A decision map is nested (fractal).
Top level: Want the company to survive 10 years from now
â toward that
Strategy: Want to strengthen the engineering organization
â toward that
Tactics: Want to hire 3 senior engineers this term
â toward that
Implementation: Should we hire Person A?
Each layer is its own decision map with its own five elements. The lower layerâs âgoalâ is nothing more than âone item in the output setâ from the upper layerâs point of view.
If you agonize only over the implementation and lose sight of the top level, your judgment wobbles. If you only talk about the top level and never decide on the implementation, you canât move forward. Without being aware of which layer youâre currently deciding in, the conversation wonât line up.
And, âhow to design the five elementsâ is itself, once again, a decision map (a meta-decision). If you feel you âcanât quite decide,â the better move isnât to add more options one layer down â itâs to doubt the map one layer up: âis the evaluation criterion even right to begin with?â
Thatâs Part 2. A mountain of methods, and the common language of the decision map changes the whole view.
Next is the topic of subjectivity and objectivity. This is probably where the decision map does its best work.
Part 3: There Is No Decision-Making Without Subjectivity â What Does a Scientific Attitude Mean?
âWe decided objectivelyâ is, in almost every case, not a lie but imprecise
This might be the decision mapâs most practical contribution.
Professor Matsushimaâs paper makes an extremely important point about the limits of data science. To summarize:
The mathematical description of the decision map and the evaluation function is clear and rational, but the higher-level notions â âwhy this goal,â âwhy is this the right evaluation,â âwhat assumptions are we allowed to makeâ â must be decided from outside the system of data science. They depend on the intent of the deciding party and on domain expertise in the field concerned.
This isnât a criticism that âdata science is vague.â Itâs a statement of the precondition for using data science correctly.
Where in the five elements is subjective, and where is objective
Color-coding the five elements of the decision map by subjective/objective gives you this:
| Element | Nature |
|---|---|
| Goal | A value judgment someone made â subjective |
| Setting | The choice of which assumptions to adopt â subjective |
| Evaluation Criteria | The choice of which axis to measure on â subjective |
| Input | The data/facts themselves â objective |
| Output Set | The choice of what to include as candidates â subjective |
Data and facts bear directly on only the âinputâ â the other four elements are, fundamentally, designed by human subjectivity.
The phrase âwe decided based on the dataâ is, in almost every case, not a lie, but itâs imprecise. In reality, youâre just processing data inside a frame that was assembled subjectively.
Example: what gets called âdata-driven hiringâ
| Element | Content | Subjective / Objective |
|---|---|---|
| Goal | Strengthen the engineering organization | Subjective |
| Setting | Full-time employment, fully remote OK | Subjective |
| Evaluation Criteria | Coding test score Ă interview evaluation | Subjective |
| Input | Candidatesâ test results, work history | Data |
| Computation | Rank by weighted average of scores | Objective |
| Output Set | {pass, fail} | Subjective |
Only 2 of these 6 items are based on data. All the rest is a frame someone designed subjectively.
What a scientific decision is â not eliminating subjectivity, but making the boundary explicit
This is the core point.
Not eliminating subjectivity, but making explicit the boundary between the subjective and the objective â that is the scientific attitude toward decision-making.
Once you write out the five elements:
- You can see where the subjective parts are (goal, setting, evaluation criteria, output set)
- You can see where the objective parts are (input data, the computation process)
- You can own the subjective parts as âthis is my judgmentâ
- You can present the objective parts as âthis part is verifiableâ
Someone who insists âwe decided objectivelyâ is far less trustworthy than someone who separates things out and says âup to here is subjective, from here on is data.â Whether you run things aware of this or unaware of it makes a completely different difference to the quality of your judgments and to how improvable they are.
The decision map is a device that stops âdata-drivenâ from being used as a decorative phrase, and forces you to ask again how much of it is really being driven [by data].
Thatâs Part 3. The last part is about the AI era.
Part 4: The Skill You Need in the AI Era â Standing on the Side That Designs the Five Elements
AI can only handle the âcontentsâ of a decision
If youâve read this far, you may already see this conclusion coming.
AI (machine learning, LLMs, optimization solvers) can, in essence, only do the following:
Given the âgoal, setting, evaluation criteria, output setâ among the five elements, take an input and choose an output.
In other words, AI cannot design the five elements. Delegating a decision to AI is equivalent to handing it the five elements.
This is a logical consequence of the decision map. No matter how smart AI gets, designing âthis is what the goal should beâ or âthis is the evaluation criterionâ ultimately stays on the human side. The responsibility for designing that cannot, in principle, be dumped onto AI.
The gap between people who can hand over the five elements and people who canât
| People who can structure it | People who canât | |
|---|---|---|
| Instructing AI | Can hand over the goal, evaluation criteria, and constraints explicitly | Hands things over vaguely as âmake it niceâ |
| Evaluating output | Can judge whether the output is valid against the evaluation criteria | Settles for âseems roughly goodâ |
| Identifying failure | Can isolate which element was designed wrong | Ends at âAI is badâ |
| Improvement | Can determine which part of the map to fix | Rewrites the prompt at random |
| Locus of responsibility | Can put into words where the subjective, human-responsible part is | Blames AI, or shoulders all the responsibility |
This isnât the surface-level skill of âwriting a good prompt.â Itâs the ability to treat decision-making itself as a structure.
One more step â designing AI agents
Everything so far is about the stage where a human calls on AI for individual decisions.
One step further, in the AI agent â a system that autonomously breaks down tasks, calls tools, and chooses and executes actions â the structure of the five elements gets lifted up one level.
The agent assembles the five elements of each individual task itself, given a goal. But what makes the agent possible in the first place is the âfive elements of the agent,â designed by a human.
| Agent element | What the human designs |
|---|---|
| Goal | The goal given to the agent (reward function / instructions) |
| Setting | Operating environment, available tools, action constraints, safety guardrails |
| Evaluation Criteria | Success conditions, cost function, the threshold at which a human intervenes |
| Input | Observable state, context provided, referenceable data sources |
| Output Set | The space of actions available (API calls, generation, halting, etc.) |
Agent development has entered a stage where itâs not âhanding an individual decision over to AI,â but âdesigning the deciding subject itself.â
The work left for humans is clear.
- Designing the agentâs five elements (especially the goal, the evaluation criteria, and action constraints)
- Structurally monitoring whether the individual-task five elements the agent assembles are running out of control
- When the agent fails, isolating which element, at which layer of the five elements, went wrong
Someone who holds a decision map can, in the agent era, stand on the side that designs the agent. Someone who doesnât just ends up watching the agentâs output. This gap is about to become decisively large.
Conclusion â Replacing âStrugglingâ with âDesigningâ
This got long. Let me compress the key points onto one page at the end.
- Every decision can be written using the five elements: goal, setting, evaluation criteria, input, output set
- Data science, statistics, optimization, and machine learning are all just special cases of this
- The five elements are hierarchically nested (fractal)
- There is always a meta-decision that determines the five elements themselves
- Data and facts bear directly on only the âinput.â The other four elements are human subjectivity
- A scientific decision is not the elimination of subjectivity, but making the boundary between subjective and objective explicit
- In the AI era, the people who create value are those who can hand the five elements over to AI â and further, those who can stand on the side that designs the five elements of the AI agent itself
If youâre going to try just one thing starting tomorrow, try this:
Pick one decision in front of you, and write the five elements out on a single page.
If thereâs an element thatâs hard to write, thatâs the part you usually avoid putting into words. That element is the real reason your decision-making has stalled.
Having a decision map means you can replace âstrugglingâ with âdesigning.â That alone raises both the speed and the quality of your decisions.
References
-
Toshiyasu Matsushima, âHow Should We Grasp and Teach Data Science? â Drawing on Waseda Universityâs Efforts,â Operations Research, Vol. 65, No. 10, 2020, pp. 544â550. https://orsj.org/wp-content/corsj/or65-10/or65_10_544.pdf ăâ The paper that clearly situates the concept of the decision map within the system of data science. The core source cited in this article.
-
Waseda University Data Science Education Team (author), supervised by Toshiyasu Matsushima, Introduction to Data Science I â Foundations of Data-Based Decision Making (Data Science Library 1), Science-sha, 2022. ISBN: 978-4-7819-1540-1. ăâ A textbook that systematically explains descriptive statistics, inferential statistics, and Bayesian statistics within the unified framework of the decision map. Recommended if you want to properly study the decision map â itâs systematic. The series currently runs to Volume IV.
