Literature Map: The Genealogy of Social Design Evaluation — 14 Years of English-Language Scholarship and the Gap in Japanese

This note belongs to the literature map series of the Social Vision Design Lab (ISVD-LAB-003). It organizes the English-language research genealogy of evaluating and critiquing design in the social sphere through seven sources, and contrasts it with the state of reception in Japanese. The boundary with design research in general is drawn in a separate note. Every source in this map has been verified one by one against bibliographic databases and publisher pages.

"What did that design change in society?" Research that tackles this question head-on has accumulated in the English-speaking world since 2012.

The starting point was the Social Impact Design Summit held in February 2012 at the Rockefeller Foundation offices in New York. Convened by the Cooper-Hewitt, National Design Museum, the NEA (National Endowment for the Arts), and The Lemelson Foundation, the summit's white paper (Lasky, 2013) put "Build a Culture of Evaluation" among its five proposals. The problem it named: the field lacks tools to demonstrate the long-term social impact of design projects.

In the fourteen years since, two strands have grown in this field: framework-building for evaluation, and critical theory. By 2026, The Design Journal published a framework paper for bringing social impact assessment into design practice (Menichinelli, Bianchini & Maffei, 2026).

The situation in Japanese is the opposite. There is infrastructure on the program-evaluation side, and there are awards on the expression side. But a sustained discourse connecting the two, asking whether design decisions connected to social outcomes, could not be confirmed at the time of writing this map.

The Starting Point: Build a Culture of Evaluation (2012-2013)

The white paper "Design and Social Impact" was written by Julie Lasky (the credit reads "Text by Julie Lasky"). As a record of discussions among practitioners, educators, and funders of social impact design, it compiled the issues spanning education, research, and practice into five proposals, the third of which is "Build a Culture of Evaluation." The absence of a shared way to demonstrate outcomes is what blocks the field from proving its value. That awareness was shared from the very beginning.

The Critical Strand (2014-2023)

Before evaluation frameworks matured, critical research came first, probing what today's social design overlooks.

Janzer & Weinstein (2014), in Design and Culture, examined the methodology of social design itself. They pointed out that human-centered design, by focusing on individual users, overlooks social and cultural structures, and called for a shift to situation-centered design and for developing a shared framework for understanding, executing, and evaluating initiatives. By tying the absence of a shared evaluation framework to the risk of design neocolonialism, this is the direct predecessor of this map's theme.

Julier & Kimbell (2019), in Design Issues, delivered a more fundamental critique. The reproduction of inequalities is a necessary product of neoliberal economic systems, and social design's attempts to ameliorate this actually perpetuate the situation. It is an institutional critique: design's precarious professional norms mitigate against long-term consolidation. Anyone designing evaluation cannot ignore this. The paper names the danger that evaluation mechanisms themselves end up on the side of "keeping the system going."

Arboleda (2022), in "Sustainability and Privilege," drew on fieldwork in Africa and Latin America to argue that social design invoking sustainability has treated vulnerable populations as test subjects and marginalized them through green gentrification (environmental improvements raising land values and displacing existing residents) and economic burdens. As an alternative, he proposes ethnoarchitecture, a stakeholder-driven design process that puts people's voices and experience first.

von Busch & Palmås (2023), in "The Corruption of Co-Design," take aim at the idealism of participatory design. Designers overestimate the place of ideals and are ill-equipped for a social reality of power-wielding and zero-sum games. Co-design processes are rife with betrayals and corruption, and what is needed is a realism that learns from Machiavelli (Realdesign).

The Framework-Building Strand (2016-2026)

In parallel with critique, attempts to implement evaluation advanced.

In architecture, The Plan Journal maintains "Design for Social Impact" as a standing theme, inviting contributions on how design for social impact is being envisioned, developed, realized, experienced, and evaluated around the world. Its editorial policy of treating the cycle from conception to evaluation as one sequence is worth referencing as a vessel for case studies.

In product and service design, Menichinelli, Bianchini & Maffei (2026) presented in The Design Journal the foundations for bringing impact assessment, especially its social dimension, into design practice. This paper by a Politecnico di Milano group organizes the connections between existing evaluation approaches and design and discusses implications for practitioners and researchers. It is the current culmination of this strand.

The Situation in Japan

On the program-evaluation side, SIMI (Social Impact Management Initiative) has built the infrastructure. Its Guideline Ver.2 (2021) defines social impact management as a systematic activity that aims to improve social impact by continuously using information about the changes and value produced by a program or initiative in decision-making and improvement, and it presents a template of practice that builds program strategy using tools such as the logic model. But the object of evaluation is the program; a framework for decomposing how design decisions contributed to outcomes is out of scope.

On the expression side stands the Good Design Award. Its philosophy states that it evaluates not mere beauty of things but what enriches people, society, and the future; social value is clearly within its field of view. But an award, as a format, celebrates what is selected. Structural analysis of why something worked or failed, above all putting failure into words, is out of scope.

And a body of work that systematically introduces the English-language sources above into Japanese could not be confirmed at the time of writing. Not an absence of theory, but an absence of translation and connection. That is the true nature of the gap in Japanese.

The Tension Between the Two Strands

Fourteen years of accumulation can be organized into two strands. The framework-building strand (the Cooper Hewitt summit → The Plan Journal → Menichinelli et al.) asks how to measure. The critical strand (Janzer & Weinstein → Julier & Kimbell → Arboleda → von Busch & Palmås) asks about the power relations underlying the act of measuring.

These two should be read not as opposition but as tension. What the critical strand made clear is that the very act of building an evaluation mechanism carries politics: whose words define outcomes, and what does not get counted as an outcome. In terms of epistemic injustice, the design of evaluation criteria can either give or take away the words in which people speak their own experience. Only by internalizing critical theory does an evaluation framework escape becoming a tool for what Julier & Kimbell call keeping the system going.

The Gap in Japanese Has Three Layers

1. The absence of a medium. The discussions above are scattered across peer-reviewed journals and monographs; within this map's survey scope, no established venue for sustained review that practitioners (municipal officials, NPOs, corporate social responsibility staff) can read and use was found even in English
2. The absence of translation and introduction. This discussion has barely reached the Japanese language
3. The absence of connection to institutions. The structures of municipal budgets, assemblies, and procurement; the social welfare corporation system; the reporting formats of grant programs. Evaluation criteria that assume these conditions governing Japanese practice will not come from direct import of overseas theory

This Lab's Position

Facing this gap, there is no need to claim a world first, nor should one. Fourteen years of citable prior research is, rather, a favorable condition: it secures scholarly legitimacy and connection routes. The work to be done is translation and application, connecting the overseas theoretical accumulation to Japan's institutional reality, while building the critical strand's warnings into the design of evaluation criteria.

This coincides exactly with the intersection of the three practices by which this lab defines social vision design: structural social analysis (what is blocking outcomes), epistemological critique (in whose words is that evaluation spoken), and design practice (turning insight into intervention). Evaluation research is this lab's applied output, and a field test of the six-field synthesis.

• This map is limited to English-language sources. Primary literature on policy design evaluation in German, French, and Nordic languages remains unexamined. The French-speaking practice around La 27e Région, covered in the international comparison map, is the next candidate
• The center of gravity is architecture and space (The Plan Journal, Arboleda) and product and service design (Menichinelli et al.). Evaluation research in graphic and communication design appears thinner still, but a systematic confirmation of that thinness has not been done
• The framework by Menichinelli et al. was published in 2026 and has no accumulated cases of applied validation yet
• "No systematic introduction exists in Japanese" means absence within this lab's survey scope, not an exhaustive census. If counterevidence, a prior domestic introduction, is found, this map will be revised

→ Related: Social Vision Design Lab: Hypothesis Overview | Literature Map: Design Research Comparison | Literature Map: Comparison of Similar Labs Abroad