A good deal of my policy analytical work has been informed by semiotics and narratology, or at least the following traces. Someone interested in wicked policy problems (hint-hint: they are said to have no beginning or end) is understandably attracted to small-m metanarratives already in the public’s sociolect that can–no guarantees!–recast these problems into more tractable problems without reducing their complexity. Here the search is for what Riffaterre called the intertext(s), which can account for contradictions without dismissing the complexities of the competing stories.
For example, rising sea levels are frequently credited with increased salinization of the coasts. But that narrative has to be pushed much further to be relevant for global climate change. For another story out there today, the GCC modelers’ story, is that rising sea levels also cause increased storm surges and inland flooding (from the increased inland rainfall). When pushed further, the policy implications change (i.e., seawalls to stop coastal salinization and erosion can only be part of the response, as what is to happen to storm surges and inland flooding in those coastal areas now targeted beyond the ends of the seawall?)
So the policy analyst asks, like Lenin, What is to be done? What are the intertext(s) that could account for the modelers’ story and all the other stories, for good or bad, about global climate change? Riffaterre’s intertext is much like the way Greimas’s node of “both a and not-a hold at the same time” has been formulated for his semiotic square. To my mind, we are also searching for any policy relevant metanarratives around the “neither a nor not-a” node. That is, are there other language games already out there which would describe what is going on without reducing the complexity of all this, but which really isn’t about “global climate change” as currently described and problematized?
That is why, by way of answer, I remain interested in novels. Even the doomer-lit remains a fraction of what is being written about in novels: namely, the messy ways we live. (Russ Ackoff, the organization theorist, argued: Predicting the future is the mess we are in today.) Novels aren’t policy relevant because they offer or prefigure blueprints for the future; they are policy relevant precisely because of the priority they give to the “neither-nor” node of semantic reality.
A good deal of my policy analytical work has been informed by semiotics and narratology, or at least the following traces. Someone interested in wicked policy problems (hint-hint: they are said to have no beginning or end) is understandably attracted to small-m metanarratives already in the public’s sociolect that can–no guarantees!–recast these problems into more tractable problems without reducing their complexity. Here the search is for what Riffaterre called the intertext(s), which can account for contradictions without dismissing the complexities of the competing stories.
For example, rising sea levels are frequently credited with increased salinization of the coasts. But that narrative has to be pushed much further to be relevant for global climate change. For another story out there today, the GCC modelers’ story, is that rising sea levels also cause increased storm surges and inland flooding (from the increased inland rainfall). When pushed further, the policy implications change (i.e., seawalls to stop coastal salinization and erosion can only be part of the response, as what is to happen to storm surges and inland flooding in those coastal areas now targeted beyond the ends of the seawall?)
So the policy analyst asks, like Lenin, What is to be done? What are the intertext(s) that could account for the modelers’ story and all the other stories, for good or bad, about global climate change? Riffaterre’s intertext is much like the way Greimas’s node of “both a and not-a hold at the same time” has been formulated for his semiotic square. To my mind, we are also searching for any policy relevant metanarratives around the “neither a nor not-a” node. That is, are there other language games already out there which would describe what is going on without reducing the complexity of all this, but which really isn’t about “global climate change” as currently described and problematized?
That is why, by way of answer, I remain interested in novels. Even the doomer-lit remains a fraction of what is being written about in novels: namely, the messy ways we live. (Russ Ackoff, the organization theorist, argued: Predicting the future is the mess we are in today.) Novels aren’t policy relevant because they offer or prefigure blueprints for the future; they are policy relevant precisely because of the priority they give to the “neither-nor” node of semantic reality.
In my profession, policy analysis and public management, theory and method aren’t separate when it comes to actual, really-existing practices. Theory and method are unavoidably fused for practitioners with whom I’ve worked.
This would be a banal observation if it weren’t for the fact that many practices mean many methods-cum-theories, and the virtue of the many is having more means to reframe, redescribe, recalibrate, revise, readjust, repurpose, rescript, recalibrate, reorient–in a word, recast–difficult policy and management issues. No guarantees, but you get the point: A little theory, as it has been said, can go a long way in practice, and the many methodological considerations across them can take you even further.
Below are fifteen different examples of what this means by way of practice:
1. Key method questions in complex policy and management
2. Methodological implications of using triangulation in complex policy and management.
3. Methodologically, analogies without counter-cases are empty signifiers
4. Peer review: another area where error avoidance is the method for reliability management
5. Not all the “can’s, might’s, may’s, or could’s” add up to one single “must” in policy analysis
6. But in policy advocacy, conditions of “could and might” do lead to proposals that “require and would”
7. To paraphrase Wittgenstein, an infinite regress explains nothing
8. The Achilles heel of conventional risk management is the counterfactual
9. What “calling for increased granularity” means
10. The methodological relevance of like-to-like comparisons for policy and management
11. The methodological importance of “and-yet” counternarratives
12.The cross-cutting methodological fault-line in Infrastructure Studies, and why it matters
13. Seven differences in method that matter for reliable policy and management
14. As the dimensions of a two-by-two typology are meant to be independent, what then to make of this figure?
15. Why the difference matters between ultimate and proximate causes: an example
1. Key method questions in complex policy and management
I
A young researcher had just written up a case study of traditional irrigation in one of the districts that fell under the Government of Kenya’s Arid and Semi-Arid Lands (ASAL) Programme. (We’re in the early 1980s.) I remember reading the report and getting excited. Here was detailed information about really-existing irrigation practices and constraints sufficient to pinpoint opportunities for improvement there.
That was, until I turned the page to the conclusions: What was really needed, the author stated, was a country-wide land reform.
Huh? Where did that come from? Not from the details and findings in the report!
This was my introduction to “solutions” in search of problems they should “solve.” Only later did I realize I should have asked him, “What kind of land reform for whom and under what conditions at your research site?”
II
Someone asserts that this policy or approach holds broadly, and that triggers you asking:
Under what conditions?
With respect to what?
As opposed to what?
What is this a case of?
What are you–and we–missing?
Under what conditions does what you’re saying actually hold? Risk or uncertainty with respect to what failure scenario? Settler colonialism as opposed to what? Just what is this you are talking about a case of? What are you and I missing that’s right in front us?
2. Methodological implications of using triangulation in complex policy and management
I
Triangulation is the use of multiple methods, databases, theories, disciplines and/or analysts to converge on what to do about the complex issue. The goal is for analysts to increase their confidence–and that of their policy audiences–that no matter what position they take, they are led to the same problem definition, alternative, recommendation, or other desideratum. Familiar examples are the importance in the development literature of women and of the middle classes.
In triangulating, the analyst accommodates unexpected changes in positions later on. If your analysis leads you to the same conclusion regardless of initial positions that are already orthogonal, then the fact you must adjust that position later on matters less because you have sought to take into account utterly different views from the get-go.
Everyone triangulates, ranging from cross-checking of sources to formal use of varied methods, strategies and theories for convergence on a shared point of departure or conclusion. Triangulation is thought to be especially helpful in identifying and compensating for biases and limitations of any single approach. Obtaining a second (and third. . .) opinion or soliciting the input of divergent stakeholders or ensuring you interview key informants with divergent backgrounds are common examples.
Detecting bias is fundamental, because reducing, or correcting and adjusting for bias is one thing analysts can actually do. To the extent that bias remains an open question for the case at hand, it must not be assumed that increasing one’s confidence automatically or always increases certainty, reduces complexity, and/or gets one closer to the truth of the matter.
II
Return now to our starting point: The approaches in triangulation are chosen because they are, in a formal sense, orthogonal. This has another methodological implication: The aim is not to select the “best” from each approach and then combine these elements into a composite that you think better fits or explains the case at hand.
Why? Because the arguments, policies and narratives for complex policy and management already come to us as composites. Current issue understandings have been overwritten, obscured, effaced and reassembled over time by myriad interventions. To my mind, a great virtue of triangulation is to make their “composite/palimpsest” nature clearer from the outset.
To triangulate asks what, if anything, has persisted or survived in the multiple interpretations and reinterpretations that the issue has undergone over time up to the point of analysis. Indeed, failure to triangulate can provide very useful information. When findings do not converge across multiple and widely diverse metrics or measures (populations, landscapes, times and scales…), the search by the analysts becomes one of identifying specific, localized or idiographic factors at work. What you are studying may be non-generalizable–that is, it may be a case in its own right–and failing to triangulate is one way to help confirm that.
3. Methodologically, analogies without counter-cases are empty signifiers
The relentless rise of modern inequality is widely appreciated to have taken on crisis dimensions, and in moments of crisis, the public, politicians and academics alike look to historical analogies for guidance.
I bolded the preceding because its insight is major: The search for analogies from the past for the present is especially acute in turbulent times.
The methodological problem–which is also a matter of historical record–is any misleading analogy. Jackson, by way of illustrating this point, provides ample evidence to question the commonplace that the US is presently in “the Second (New) Gilded Age,” with rising inequality, populism and corruption last seen in the final quarter of our 19th century.
II
But we are still stuck with the fallacy of composition. Not all of the country was going through the Gilded Age, even when underway. And doubtless parts of the country are now going through a Second Gilded Age, even if not nationally.
The upshot is that we must press the advocates of this or that analogy to go further. The burden of proof is on the advocates to demonstrate their generalizations hold regardless of the more granular exceptions, including those reframed by other analogies.
Why would they concede exceptions? Because we, their interlocutors, know empirically that micro and macro can be loosely-coupled, and most certainly not as tightly coupled as theory and ideology often have it. Broad analogies that do not admit granular counter-cases float unhelpfully above policy and management.
A fairly uncontroversial upshot, I should have thought, but let’s make the matter harder for us.
III
The same day I read Jackson’s article, I came across the following analogy for current events. Asked if there were any parallels to the Roman Empire, Edward Luttwak, a scholar on international, military and grand strategy, offered this:
Well, here is one parallel: after 378 years of success, Rome, which was surrounded by barbarians, slowly started admitting them until it completely changed society and the whole thing collapsed. I am sure you know that the so-called barbarian invasions were, in fact, illegal migrations. These barbarians were pressing against the border. They wanted to come into the Empire because the Romans had facilities like roads and waterworks. They knew that life in the Roman Empire was great. Some of these barbarians were “asylum seekers,” like the Goths who crossed the Danube while fleeing the Huns.
Of course, some read this as inflammatory and go no further. Others, of course, dismiss this outright as racist, adding the ad hominem “Just look at who is writing and publishes this stuff!”
But the method to adopt would be to press Luttwak for definitions and, most importantly, counter-examples.
4. Peer review: another area where error avoidance is the method for reliability management
Below is part of an interchange in the Comments section of a recent Financial Times article on scientific fraud:
Comment: I am a scientist. I spend all my time trying not to be wrong in print. Even then, occasionally I am. It is the same for all of us. Furthermore, some scientists are very poor at dealing with statistics and are thus wrong more than others. Our common incompetence is different from actual fraud. The proportion of frauds has probably held steady since the time science became a profession and has grown as the number of scientists has grown. I find it unlikely that the proportion of scientists with this character flaw has increased recently. Possibly much more common than fraud is ripping off your collaborators, or stealing ideas during reviews of manuscripts and grant applications. That is quite hard to prove and so it seems to be popular among certain character types but again, there is no reason to think their proportion has increased.
Reply: It actually doesn’t matter if the proportion is remaining steady – even though it almost certainly is growing, with so much more financial, career and political pressure on academics these days, and a for-profit publishing system that reduces public oversight and is massively biased towards positive outcomes.
The goal should remain zero.
It’s unacceptable for scientists to publish errors due to being ‘poor at statistics’. Huge amounts of money is being wasted, lives are being lost – the least people can do is get training, or work with someone else who IS good at them.
Upshot: If peer review isn’t solely about error avoidance, how can it aspire to be reliable?
5. Not all the “can’s, might’s, may’s, or could’s” add up to one single “must” in policy analysis
Consider the following example (my bolding):
Our expert-interview exercise with leading thinkers on the topic revealed how climate technologies canpotentially propagate very different types of conflict at different scales and among diverse political actors. Conflict and war couldbe pursued intentionally (direct targeted deployment, especially weather-modification efforts targeting key resources such as fishing, agriculture, or forests) or result accidently (unintended collateral damage during existing conflicts or even owing to miscalculation). Conflict couldbe over material resources (mines or technology supply chains) or even immaterial resources (patents, software, control systems prone to hacking). The protagonists of conflict couldbe unilateral (a state, a populist leader, a billionaire) or multi- lateral in nature (via cartels and clubs, a new “Green OPEC”). Research and deployment could exacerbate ongoing instability and conflict, or cause and contribute to entirely new conflicts. Militarization couldbe over perceptions of unauthorized or destabilizing deployment (India worrying that China has utilized it to affect the monsoon cycle), or to enforce deployment or deter noncompliance (militaries sent in to protect carbon reservoirs or large-scale afforestation or ecosystem projects). Conflict potentialcould involve a catastrophic, one-off event such as a great power war or nuclear war, or instead a more chronic and recurring series of events, such as heightening tensions in the global political system to the point of miscalculation, counter-geoengineering, permissive tolerance and brinksmanship. . . .
States and actors will need to proceed even more cautiously in the future if they are to avoid making these predictions into reality, and more effective governance architectures may be warranted to constrain rather than enable deployment, particularly in cases that might lead to spiralling, retaliatory developments toward greater conflict. After all, to address the wicked problem of climate change while creating more pernicious political problems that damage our collective security is a future we must avoid.
Let’s be clear: All such “could’s-as-possibilities” do not add up to one single “must-as-necessity.”
The only way in this particular passage that “could” and “can” link to “must” would mean that the article–and like ones–began with “We must avoid this or that” and then proceeded to demonstrate how to undertake really-existing error avoidance with respect to those could-events and might-be’s.
6. But in policy advocacy, conditions of “could and might” do lead to proposals that “require and would”
I just read an article [1] that demonstrated how the climate and capitalism crises need to be analyzed together in order to better address how emotions such as anxiety and burnout with respect to each crisis are highly interconnected.
I agree. But I worry how readers might conflate advocacy and analysis.
I agree with the author that so much could help improve the situation: “these insights could be deepened by placing them in the context of the care crisis of neoliberal capitalism”; “such reforms could help create the preconditions for deeper post-capitalist transformation”; and “a ‘polycrisis’ lens might usefully decenter the climate crisis while informing a broader analytic framework and political program”.
But then the author asserts that “this must be a form of polycrisis analysis deeply influenced by Feminist and ecological Marxism”. Also, some could-reforms “must prioritize public transit over private cars, circular economies, and extended producer responsibility to reduce extraction as far as possible”. Indeed and also specifically [my bolding below]:
To a large extent this requires the decommodification of care, involving ‘universal guarantees in place that all people will be entitled to care,’ along with expanding publicly funded childcare, physical and mental healthcare, elderly care, and care for those with disabilities (ibid: 195–196). It also requires revitalizing community infrastructures – like libraries, community centers, parks, and public spaces – that have decayed under decades of neoliberal privatization and austerity (particularly in poor communities) (Rose 2020). More broadly, ending the care crisis requires social programs that dramatically reduce (if not eliminate) the emotionally distressing dynamics of debt and unemployment by improving economic security for all.
I have no problem with these requirements! My problem is with the paradox: Conditions are sufficiently uncertain that we cannot say the proposed reforms would actually work, but we are certain enough to say that these proposed reforms entail must-requirements of varying degrees of specificity.
Now there is nothing “illogical” about taking that latter position. It’s what we expect from policy advocacy. This is what policy advocates do; theirs is not to analyze the uncertainties and certainties case-by-case; that’s my job as a practicing policy analyst. Policy analysts of course make recommendations and that is an advocacy of sorts. But they do so in the face of that case-specific determination of what is “sufficiently certain” and “certain enough.” For advocates, the determination is a settled method over the range of cases.
7. To paraphrase Wittgenstein, methodologically an infinite regress explains nothing
Why? Because there is no closure rule. Stop fossil fuels; stop cutting down trees; stop using plastics; stop this defense spending; stop being imperialist; stop techno-solutionism; be small-d democratic and small-p participatory; dismantle capitalism, racism and the rest; transform cities; save biodiversity; never forget class, gender, race, inequality, religions, bad faith, identity. . .and. . .and. . .
8. The Achilles heel of conventional risk management methods is the counterfactual
I
For me, the crux of counterfactual history is a present always not one way only. You want a counterfactual, but for which current interpretation or set of historical interpretations?
What’s at work are the two blades of a scissors. One devotes time and attention to “what is happening,” a state of affairs that can be interpreted in multiple different ways. The other devotes time and attention to “what has happened,” a state of affairs that could have turned out differently and so too the allied interpretations.
Where the blades slice, they open up not only the contingent nature of events past and present, but also the recasting of what is and has been.
II
For example, consider a city’s building code. Viewed one way, it is sequential interconnectivity (do this-now followed by do-that-then). But if cities also view their building codes as the means to bring structures up to or better than current seismic standards, then the code becomes a focal mechanism for pooled interconnectivity among these developers and builders.
That neither is guaranteed should be obvious. That you in no way need recourse to the language of conventional risk management to conclude so should also be obvious.
9. What “calling for increased actionable granularity” means
I
When I say concepts like regulation, inequality, and poverty are too abstract, I am not criticizing abstraction. I am saying (1) that these concepts are not differentiated enough for an actionable policy or management and (2) that this actionable granularity requires a particular kind of abstraction from the get-go.
What then does “actionable granularity” mean?
II
I have in mind the range of policy analysis and management that exists between, on the one side, the adaptation of policy and management designs and principles to local circumstances and, on the other side, the recognition that systemwide patterns emerging across a diverse set of existing cases inevitably contrast with official and context-specific policy and management designs.
Think here of adapting your systemwide definition of poverty to local contingencies and having to accommodate the fact that patterns that emerge across how really-existing people identify poverty differ from not only system definitions but also from localized poverty scenarios based in these definitions.
III
One implication is that cases that are not framed by emerging patterns and, on the other side, by localized design scenarios are rightfully called “unique.” Unique cases of poverty cannot be abstracted, just as some concepts of poverty are, in my view, too abstract. Unique cases stand outside the actionable granularity of interest here for policy and management.
Where so, there is the methodological problem of cases that are assumed to be unique or stand-alone, when in fact no prior effort has been made to ascertain (1) systemwide patterns and local contingency scenarios in which the case might be embedded along with (2) the practices, if any, of adaptation and modification that emerge as a result.
From a policy and management perspective, such cases have been prematurely rendered unique: They have been, if you will, over-complexified so as to permit no abstraction. Unique cases are not themselves something we can even abstract as sui generis or “‘a case’ in its own right.”
I stress this point if only because of the exceptionalism deferred to “wicked policy problems”. Where the methodological problem of premature complexification isn’t addressed beforehand, then by definition the so-called wicked policy problem is prematurely “wickedly unique.” Or, more ironically, uniquely wicked problems are abstracted insufficiently for the purposes of systemwide pattern recognition and design scenario modification.
10. The methodological relevance of like-to-like comparisons for policy and management
Assume the following typology, a 2 X 2 table identifying four types of confidence you have over empirical findings for policy analysis and policymaking:
Even with all that detail, it’s fairly easy to critique the above. Do we really believe that well-established evidence and high certainty are as tightly coupled and correlated? In fact, each dimension can be problematized in ways relevant to policy analysis and policymaking.
But the methodological issue at stake here is to compare like to like.
That is, interrogate the cells of the above typology using the cells of another typology whose overlapping dimensions also problematize those of the above. Consider, for example, the Thompson-Tuden typology, where the key decisionmaking process is a function of agreement (or lack thereof) over policy-relevant means and ends:
This latter typology has a few surprises for the former one. Contrary to the notion that inconclusive evidence is “solved” by more and better evidence, the persistence of “inconclusive” (because, say, of increasing urgency and interruptions) implies eventually lapsing, it is hypothesized, into decisionmaking-by-inspiration. So too the persistence of “unresolved” or “established but incomplete” shuttles, again and again, between decisionmaking by majority-rule and by compromises. More, what is tightly coupled in the latter isn’t “evidence and certainty” as in the former, but rather the beliefs over evidence with respect to causation and the preferences for agreed-upon ends and goals.
In case it needs saying, methodological like-to-like comparisons of typologies need not stop at a comparison of two only. Social and organizational complexity means the more typologies the better by way of finding something more tractable to policy or management.
11. The methodological importance of “and-yet” counternarratives
The paragraph I’ve just read before typing this is bookended by two quotes:
Just before: “Therefore, rather than being schools of democracy, ACs [associative councils] may be spaces where associative and political elites interact and, therefore, just reproduce existing political inequities (Navarro, 2000). Furthermore, these institutions may have limited impact in growing and diversifying the body of citizens making contributions to public debate (Fraser, 1990).”
Just after: “The professionalised model results from a complex combination of inequalities in associationism and a specific type of participation labour. Analysing the qualitative interviews, regulations and documents was fundamental to understanding the underlying logic of selecting professionals as the main components.”
Now try to guess the gist of the paragraph in between. More of the same? Well, no. Six paragraphs from the article’s end emerges an “and-yet” that had been there from the beginning of the article:
Nevertheless, an alternative interpretation of professionalisation should be considered. The fact that ACs perform so poorly in inclusiveness does not mean that they are not valuable for other purposes, such as voicing a plurality of interests in policymaking (Cohen, 2009). In this respect, participants can act as representatives of associations that, in many cases, promote the needs of oppressed and exploited groups (De Graaf et al., 2015; Wampler, 2007). Suffice it to say, for example, that labour unions or migrants’ associations frequently send lawyers or social workers to ACs to defend their needs and positions. Problems with inclusion should not take away from other purposes, that is, struggles to introduce critical issues and redistribution demands to the state agenda. Other studies have already shown that groups make strategic decisions to achieve better negotiation outcomes in the context of technical debates (Grillos, 2022). Thus, the choice of selecting professionals can be a strategy to improve the capacity of pressure in institutional spaces dominated by experts. (my bold; accessed online at https://journals.sagepub.com/doi/10.1177/00323217251319065)
Methodological upshot: What the counterfactual is to economic analysis, the and-yet counternarratives are to policy analysis.
12. The cross-cutting methodological fault-line in Infrastructure Studies, and why it matters
The large-scale infrastructure is never safe from the disciplinary and interdisciplinary assaults of economists, civil engineers, ecologists, risk managers, political scientists, anthropologists and so many more, each claiming a special purchase that demands our attention. A less banal observation is the cross-cutting methodological default line once each discipline poses its “big picture”: Some ratchet up further analysis to the global, while others dig down into the granular. We’re told that further analysis necessarily entails resorting to understanding the wider contexts (political, social, cultural. . .) or the more fine-grained practices, processes and interactions.
For example, we’re told that the study of digital archives is first and foremost “deeply rooted in the history of infrastructure policy”. But you have a choice in describing that “policy:” ratcheting up or digging down. So often today the road taken is the former:
In our attempt to understand contemporary archival politics, it would seem much more beneficial to pay attention to the concrete political issues in which community digital archives are involved, such as, for example, armed conflict and civil unrest (e.g. The Mosireen Collective 2024; Syrian Archive 2024; Ukraine War Archive 2024), gender queerness (e.g. Australian Queer Archives 2024; Digitial Transgender Archive 2024; Queer Digital History Project 2024), forced migration (e.g. The Amplification Project 2024; Archivio Memorie Migranti 2024; Living Refugee Archive 2024), post-colonialism (e.g. Talking Objects Lab 2024), rights of Indigenous peoples (e.g. Archivo Digital Indigena 2024; Digital Sami Archives 2024; Mukurtu 2024), racial discrimination (e.g. The Black Archives 2024; Black Digital Archiving 2024), or feminism (e.g. Féminicides (2024); Feminist Archive North 2024, Rise Up 2024).
You may wonder at the methodological finesse taking place in this passage, namely: equating the concrete with the abstract. This transmutation is made easier because it is not really-existing archival practices that the author describes, but rather “the politics of digital archival practice.” Rather than being case-specific, these politics face outward and upward. They’re “political agendas,” not micro-practices. Such is why the author can write he is “attending to the politics of digital archives at the level of concrete archival practices,” while in no way differentiating concrete practices, processes and interactions of each of the bolded categories and how they work themselves out relationally, case by case and over time.
Lesson? Just say you’re talking about politics and you’re taken to be more practical than practical?
I however come from a profession, policy analysis, whose propensity is to dig down rather than to ratchet up analysis, especially when it comes Infrastructure Studies. The “big picture” each discipline gives us is too important in terms of policy relevance for them alone to determine how to move the analysis forward. To equate policy with politics is to miss practices, processes and interactions that matter.
In the infrastructure case of digital archives, I suspend judgment over the author’s conclusion precisely because no concrete practices of digital archiving are detailed over a range of different cases. Please note: He may well have them at hand and to be clear, I am happy to search out practices that float something in and through passages such as:
Similarly, the temporality of community-based digital archival enterprises seems neither ephemeral nor unfathomable. Rather, it plays a crucial role in rearticulating the historical subjectivities of various Queer, Indigenous, post-colonial, and other marginalized communities. And indeed, such enterprises and the rise of participatory and collaborative archiving can surely also be seen as examples of ‘collectivization’ and ‘socialization’ or even of ‘the dialectics between the individual and the society’–the very conditions of politics and historicity that Étienne Balibar (2024) sees ‘the digital’ as precluding.
13. Seven differences in method that matter for reliable policy and management
When I and others call for better recognition and accommodation of complexity, we mean the complex as well as the uncertain, unfinished and conflicted must be particularized and contextualized so that we can analyze and manage, if only case-by-granular case.
When I and others say we need more findings that can be replicated across a range of cases, we are calling for identifying not only emerging better practices across cases, but also greater equifinality: finding multiple but different pathways to achieve similar objectives, given case diversity.
What I and others mean by calling for greater collaboration is not just more teamwork or working with more and different stakeholders, but that team members and stakeholders “bring the system into the room” for the purposes of making the services in question reliable and safe.
When I and others call for more system integration, we mean the need to recouple the decoupled activities in ways that better mimic but can never fully reproduce the coupled nature of the wider system environment.
When I and others call for more flexibility, we mean the need for greater maneuverability across different performance modes in the face of changing system volatility and options to respond to those changes. (“Only the middle road does not lead to Rome,” said composer Arnold Schoenberg.)
Where we need more experimentation, we do not mean more trial-and-error learning, when the systemwide error ends up being the last systemwide trial by destroying the limits of survival.
While others talk about risks in a system’s hazardous components, we point to different systemwide reliability standards and then, to the different risks and uncertainties that follow from different standards.
14. As the dimensions of a two-by-two typology are meant to be independent, what then to make of this figure?
In the above figure, the cost of a disturbance and the cost of its response mirror the typology’s vertical and horizontal dimensions. As the disturbance severity grows larger, for example, so too is its parallel cost shown to increase.
Yet methodologically those main dimensions of the degree of response change and the severity of disturbance are to be independent of each other. Consequently, as the two costs are manifestly correlated and interdependent, the immediate implication is that the two dimensions are not in fact independent.
So what? Well, one thing this means is that the cost ranking from low to high of cope, adapt and transform resilience strategies is not presumptively as shown. That is, you can imagine (if not identify) cases where incremental adapting was less costly than indefinite coping or where transformation was not radically (more) costly.
Source
Roig Boixeda, P., E. Corbera, and J. Loos (2025). “Navigating a global crisis: impacts, responses, resilience, and the missed opportunity of African protected areas during the COVID-19 pandemic.” Ecology and Society 30(4):28. https://doi.org/10.5751/ES-16352-30042
15. Why the difference matters between ultimate and proximate causes: an example
The [anti-baboon poisoning] campaign’s collateral damage is clearest in the compensation record. In March 1953, for example, two Fulani herders received £50 after losing eighteen cattle and six sheep that drank from a poisoned water hole. Officials marked contaminated sites and instructed Native Authorities to notify village heads and Fulani chiefs, but these precautions were unevenly effective, especially given pastoral mobility and the uneven circulation of information. When doubts arose about whether herders had been adequately warned, token compensation was sometimes paid in the interest of preserving local relations, revealing both the administrative limits and political sensitivities of the campaign.
Of course, colonialism caused this wrongful campaign. But it is also true that the campaign was first proven wrong by the Fulani, and importantly so among others. Actionable granularity for really-existing practices is better found in proximate causes.
When Complex is as Simple as it Gets: Guide for recasting policy and management in the Anthropocene, along with a useful schematic, can now be found at
Discrepantly, def. “. . .in a discordant or inconsistent manner” The OED also records the word’s first use in English to be from a 1601 translation of Montaigne’s Essays
I
Between you and me, my guilty pleasure is reading histories of ideas. When I read about the evolution of concepts like virtue, liberty, autonomy, the Enlightenment(s), equality, capitalism, the nation-state (or histories of that hyphen), I feel I’m learning something important. At these times, it matters to me that Isaiah Berlin and Jonathan Israel, both historians of ideas, have very different understandings of “the Enlightenment” that matter to them.
But I’m a practicing policy analyst and should know better than to expect anything to be resolved at that level of abstraction. If I’m learning anything, it is learning discrepantly. It’s the discrepancies–and their many varieties–that become unavoidably visible via the comparison and contrast of concepts across a given time and over time.
“All men are created equal,” but its writer still had slaves. “Man is born free; and everywhere he is in chains,” and its author was free enough to consign his five children to an orphanage. Your culture’s version of the concepts differ from ours as if both sets were something like settled knowledge; but something new always turns up for (re)interpretation–and importantly so both of us are repeatedly told. And then, in case it needs repeating, no major plan–including those for liberty, individual autonomy, Enlightenment, equality and the rest–survives contact with really existing events, situations and contexts.
Some respond to the discrepancies as if they don’t or shouldn’t matter. So what if Jefferson and Rousseau were shits in some roles? So what if our idealized ethics turn situational in practice? Don’t we already have more than enough proof that ideas have independently affected human history?
II
The problem I have with that last question is I’m being asked once again to go off running to levels of abstraction in which I love to thrash about but find still insufficient even when not misleading. Why? Because there is always a knowledge-into-action gap between macro-principle guiding policy and management and micro-operations in implementing or executing policy and management on the ground. Macro-principles do not on their own determine every micro-operation on their own. It takes really-existing practices and skill–particularly those of recognizing system patterns and formulating localized scenarios–to maneuver through the intervening contingencies and conjunctures so as to connect the two poles. And even then there are no guarantees.
That focus on really-existing practices and skill in managing to realize missions and objectives is extremely important. Philosophers like Gilbert Ryle and Michael Oakeshott stressed the importance of thinking adverbially. It’s not democracy as a set of macro-principles we are talking about but what it means to act and behave democratically (and not just individually at the micro-level). Do those practices include voting, free speech, assembly or not? If so, how? If not, what practices are denominated when saying people “behave democratically”?
Which leads to my main point: Learning discrepantly is a set of practices as well.
It’s not about talking away or otherwise avoiding inconsistencies and discordance between human values and human behavior. I don’t think of the aforementioned discrepancies as stumbling blocks but as affordances. Learning discrepantly is identifying, managing and improvising practices for decisionmaking because of, not in spite of, the messy middle. It’s another way to take seriously complexity in action. (And this is why there’s also some kind of justice in the first use of “discrepantly” in translating Michel Montaigne’s Essays, a book all about persisting in the face of human complexities, contradictions and limits).
III
So what?
What’s the purchase in recognizing that irreducible discrepancies populate policymaking and public management and that ground the complex, conflicted, uncertain and unfinished there? An example illustrates how this plays out in one very topical case today.
IV
I’m hardly the first to have been struck by an analytic tip evolving in my profession, policy analysis: What used to be analyzed primarily at the local, regional and national levels, at least when I started out in the early 1970s, must now be addressed, first and foremost, globally. For example, the historically noted but isolated urban heat island effect has now become part and parcel of global warming discourse. What I was unprepared for was (1) how “the local” has been consigned to analytic oblivion as the analytic tip proceeded and 2) the increasing pressures to “re-localize” (recast) issues at a level of greater granularity where policy and management more tractability can be achieved.
Start with society’s critical infrastructures considered to be both cause of and solution to an important piece of the climate change challenge:
Infrastructures should be understood as plural, active, and dynamic, producing a range of impacts, both planned and unplanned, on the places and societies they traverse and inhabit. These insights reinforce the characterization of infrastructures as socio-technical networks, while their multiple and often ambiguous effects partially challenge the intentionality presumed in [Michael Mann’s 1984] conceptualization of infrastructural power. For example, recent scholarship highlights the unanticipated costs or forms of violence that infrastructures can impose on disenfranchised communities and regions.
The socio-technical nature of infrastructures is clearly reflected in their politicization and contestation, which reveal competing social interests across multiple scales. Commonly regarded as background systems, infrastructures rarely occupy public attention until they fail to meet expectations, whether through malfunction, inadequate supply, or clashes with users’ interests and needs. Increasing attention has also been paid to infrastructures’ negative externalities, or “public bads,” including ecological, social, and psychological harms, revealing both conflicting local perspectives and broader changes in societal priorities and beliefs, as well as new forms of collective identity and agency, manifested in labor strikes, acts of sabotage, or protests. (https://journals.sagepub.com/doi/10.1177/1368431026145776; internal citations deleted)
To me, these passages represent hard-won insights over years of research: the units and levels of analysis are socio-technical, networks, across scales, contingent on context, and often with unanticipated and unintended impacts.
But then comes the sweeping updraft of global analytic tip in the article’s next sentence:
These dynamics are not confined to the local scale: transnational infrastructures are increasingly implicated in broader geoeconomic contexts, as exemplified by the Houthi attacks on the Red Sea shipping lanes, the shutdown of major Chinese ports under Beijing’s zero-COVID policy, and the disputes surrounding the Nord Stream 2 gas pipeline.
Well, yes, that’s true, but still: Just what is happening at the lower scales of analysis and action? Actually, how do really-existing operations of critical infrastructures unfold at the local and regional levels? What, in turn, does climate change look like at these more granular levels of infrastructure operations said to be important for causing and guiding climate change?
Instead, the article, like so many others, is off and running to the international, global and planetary levels–understandably so, since that’s the practice of analytic tip–but: Even if what the article continues to say is just as true as the above quotes, that truth needs to be pushed further. Why? Because variation in inter-infrastructural connectivities at the local and regional levels matterso often and so directlyfor policy and management, not least of which at the level of systemwide critical infrastructures.
To insist or otherwise assume that global interdependencies trump or obviate the need to work with the realities of local and regional variation in the ecological and environmental impacts of inter-infrastructural sequential, mediated and pooled interconnectivities runs deeply counter to effective policy analysis and public management. That local and regional accomplishments do not add up to a comprehensive, interdependent global climate change regime is an unavoidable discrepancy that comes, part and parcel, with the practicing global analytic tip. The response is not (to try) to explain away or otherwise avoid the discrepancy but rather to see what it newly affords by way of recognition, namely: What is positively accomplished locally and regionally necessarily takes more policy-analytic importance in a world repeatedly demonstrated to be messily interconnected.
V
I was first introduced to the policy-narrative importance of discrepancy through the work of French literary theorist, Michael (Michel) Riffaterre, majorly his Fictional Truth (John Hopkins University Press). Applying his idea here, one way to account for something anomalous or contradictory–a discrepancy–in a complex policy issue is to look for other narratives whose reading explains or resolves that inconsistency.
One group of experts insists that instituting carbon taxes still remains the best single option for addressing climate change. Another group insists geoengineering solutions are now the only real alternative left. A metanarrative (intertext) that can explain how both discrepant positions hold at the same time is: The planet must rely on techno-managerial elites, even if they disagree, to come up with climate change solutions that the unwashed billions cannot come up with on their own.
This blog asks you to think of “learning discrepantly” as a planet-wide metanarrative to be applied instead.
I’ve suggested elsewhere that human agency–this collective and individual capacity to determine and make meaning from events, situations, and contexts through purposive analysis, reflection, and improvisation–represents the only real global counternarrative to hegemonic policies, strategies, and processes that have, if you will, degranularised human agency in their dominant narratives and scenarios. Without belaboring the point, degranularization is what our techno-managerial elites are doing when recommending the primary focus on taxing carbon production and consumption or on geoengineering solutions because humans leave Earth no other choice. The human agency discussed here, in contrast, is grounded in the fact that aforementioned discrepancies and like abound everywhere and across scales. Indeed, they are first ontological (think initially of “cognitive biases”) and then over-time political, and it’s only when they are political that they can be recast or treated–regranularized–as actionable affordances.
Human agency wouldn’t be a global counternarrative if we didn’t learn discrepantly.
NB. For more on human agency and power, see my When Complex is as Simple as it Gets: Guide for recasting policy and management in the Anthropocene (Institute of Development Studies, University of Sussex, 2023) https://opendocs.ids.ac.uk/opendocs/handle/20.500.12413/18008
The [anti-baboon poisoning] campaign’s collateral damage is clearest in the compensation record. In March 1953, for example, two Fulani herders received £50 after losing eighteen cattle and six sheep that drank from a poisoned water hole. Officials marked contaminated sites and instructed Native Authorities to notify village heads and Fulani chiefs, but these precautions were unevenly effective, especially given pastoral mobility and the uneven circulation of information. When doubts arose about whether herders had been adequately warned, token compensation was sometimes paid in the interest of preserving local relations, revealing both the administrative limits and political sensitivities of the campaign.
Of course, colonialism caused this wrongful campaign. But it is also true that the campaign was first proven wrong by the Fulani, and importantly so among others.
–What would pastoralist policy look like if gleaned solely from statements in leaked government documents and NGO emails?
–When young herders wait around before, during and after herding, are they functioning like gig workers?
–Water, as they say, is life, and the “r” in “water” is for its reliability. Do people understand then that this means adopting, repurposing and inventing water infrastructures as daily lives necessarily change, and not just for pastoralists?
–If we do not routinely ask pastoralists about their voting behavior, what does that imply about our notions of their citizenship?
–As more than half of the world’s population is now urban, should one of the first tasks of pastoralist research be to differentiate the urban populations in terms of being pro-pastoralist, anti-pastoralist, or otherwise (think of the Gen-Z protesters in Kenya)?
I’m hardly the first to have been struck by the analytic tip in my profession, policy analysis: What used to be dealt with at the local, regional and even national levels, at least when I started out in the early 1970s, must now be addressed first and foremost globally (think “global warming”). What I was unprepared for was how “the local” has been consigned to analytic oblivion as the tip proceeded.
Let me give an example from the field of Infrastructure Studies. To be clear, I agree with every word in the following:
Infrastructures should be understood as plural, active, and dynamic, producing a range of impacts, both planned and unplanned, on the places and societies they traverse and inhabit. These insights reinforce the characterization of infrastructures as socio-technical networks, while their multiple and often ambiguous effects partially challenge the intentionality presumed in [Michael Mann’s 1984] conceptualization of infrastructural power. For example, recent scholarship highlights the unanticipated costs or forms of violence that infrastructures can impose on disenfranchised communities and regions.
The socio-technical nature of infrastructures is clearly reflected in their politicization and contestation, which reveal competing social interests across multiple scales. Commonly regarded as background systems, infrastructures rarely occupy public attention until they fail to meet expectations, whether through malfunction, inadequate supply, or clashes with users’ interests and needs. Increasing attention has also been paid to infrastructures’ negative externalities, or “public bads,” including ecological, social, and psychological harms, revealing both conflicting local perspectives and broader changes in societal priorities and beliefs, as well as new forms of collective identity and agency, manifested in labor strikes, acts of sabotage, or protests. (https://journals.sagepub.com/doi/10.1177/1368431026145776; internal citations deleted)
To me, this passage represents hard-won insights over years of research, namely: the units and levels of analysis are socio-technical, networks, across scales, contingent on context, and often with unanticipated and unintended impacts.
But then comes the irresistible updraft in the article’s next sentence:
These dynamics are not confined to the local scale: transnational infrastructures are increasingly implicated in broader geoeconomic contexts, as exemplified by the Houthi attacks on the Red Sea shipping lanes, the shutdown of major Chinese ports under Beijing’s zero-COVID policy, and the disputes surrounding the Nord Stream 2 gas pipeline.
Well, yes, that’s true of course, but still: Just what is happening at the lower scales of analysis? Indeed, how do actual operations of critical infrastructures unfold at the local and regional levels?
The article, like so many others, is off and runningto the international, global and now planetary levels–understandably so, since that’s analytic tip after all–but: Even if what the article continues to say is just as true as the above quotes, that truth needs to be pushed further, especially as variation in inter-infrastructural connectivities at the local and regional levels matter so often and so directly for policy and management.
NB. For more on this analytic tip, see my 1994 Narrative Policy Analysis.
GMMTV, the producer of Thai BLs, may yet screw this series up, but something very very special has been building over the first three episodes: finding love in spite of dark times.
As now. When we are told that everything–repeat, everything–is political, even something as political as “God’s sons” can transcend itself when the script, music, cinematography, acting and chemistry of the two male leads excel like this. The culmination in the last scene of episode 3 has a life of its own.
WHEN COMPLEX IS AS SIMPLE AS IT GETS 