Double Materiality Assessment Methodology: How to Score Impacts and Risks

The biggest stumbling block for companies executing a Double Materiality Assessment (DMA) isn't understanding the concept—it is executing the methodology.

When a third-party assurance provider reviews your sustainability report, they do not just look at your final list of material topics. They examine the exact mathematical and qualitative logic you used to compile that list. If your scoring methodology is undocumented, biased, or inconsistent, your entire report is at risk of being rejected.

In this deep dive, we break down the scoring criteria mandated by EFRAG, explain the mathematics behind ExecutESG’s AHP Pairwise Comparison engine, and show how to set defensible thresholds.

1. Scoring Impact Materiality (Inside-Out)

Impact materiality evaluates how your company affects people and the environment. Under the European Sustainability Reporting Standards (ESRS 1, Chapter 3), negative impacts must be scored across three primary dimensions: Scale, Scope, and Irremediability.

To create a robust methodology, companies use a 1-to-5 scale for each dimension.

                         IMPACT MATERIALITY SCORING
┌────────────────────────────────────────────────────────────────────────┐
│                                                                        │
│   [ SCALE ] (1-5 Severity)      ──►  How grave is the impact?          │
│   [ SCOPE ] (1-5 Spread)        ──►  How widespread is it?             │
│   [ IRREMEDIABILITY ] (1-5)     ──►  Can the damage be undone?         │
│                                                                        │
│   Formula for Actual Impacts:   (Scale + Scope + Irremediability) / 3  │
│   Formula for Potential:        Impact Score × Likelihood              │
└────────────────────────────────────────────────────────────────────────┘

Scale: How Severe is the Impact?

1 (Minimal): Negligible impact on the environment or local communities.
3 (Moderate): Noticeable impact that is localized and manageable.
5 (Severe): Grave, life-altering, or ecosystem-degrading impact.

Scope: How Widespread is the Impact?

1 (Isolated): Affects a small, confined area or a tiny group of people.
3 (Regional): Affects an entire facility, local municipality, or regional ecosystem.
5 (Systemic): Global consequences (e.g., global greenhouse gas emissions or systemic supply chain human rights issues).

Irremediability: Can the Damage Be Undone?

1 (Easily Reversible): Ecosystem or community can recover quickly at negligible cost.
3 (Difficult to Reverse): Recovery is possible but requires years and significant capital investment.
5 (Irreversible): Permanent damage that cannot be undone (e.g., loss of life, extinction of a species).

The Impact Formula

For actual impacts (events already occurring), the final Impact Score is the average: $$\text{Impact Score} = \frac{\text{Scale} + \text{Scope} + \text{Irremediability}}{3}$$

For potential impacts (future risks), you must multiply the average impact score by its Likelihood (scored 1 to 5): $$\text{Final Potential Impact Score} = \text{Impact Score} \times \text{Likelihood}$$

2. Scoring Financial Materiality (Outside-In)

Financial materiality evaluates how external sustainability matters could affect your company's financial position, cash flows, and cost of capital. The scoring relies on two dimensions: Magnitude and Likelihood.

                        FINANCIAL MATERIALITY SCORING
┌────────────────────────────────────────────────────────────────────────┐
│                                                                        │
│   [ MAGNITUDE ] (1-5 Effect)    ──►  Financial cost or opportunity.    │
│   [ LIKELIHOOD ] (1-5 Prob)     ──►  Probability of occurrence.        │
│                                                                        │
│   Formula:                      Magnitude × Likelihood                 │
└────────────────────────────────────────────────────────────────────────┘

Financial Magnitude: How Big is the Hit or Gain?

1 (Low): Minor operational cost fluctuations; easily absorbed.
3 (Medium): Noticeable impact on quarterly earnings requiring strategic adjustments.
5 (High): Threatens the solvency of the business; sudden loss of major revenue streams or inability to access capital.

Likelihood: What Are the Chances?

1 (Rare): Highly unlikely to occur within the next ten years.
3 (Possible): Moderate chance of occurring in the medium term.
5 (Certain): Already occurring or guaranteed to happen in the short term.

The Financial Formula

The risk score is calculated as: $$\text{Financial Score} = \text{Magnitude} \times \text{Likelihood}$$

3. The Analytical Problem: Why Traditional Scoring Fails

Traditional stakeholder engagement relies on sending surveys asking participants to rate a long-list of 50 topics from 1 to 5. While simple to set up, this methodology suffers from severe statistical limitations:

Low Scoring Variance: Stakeholders care about ESG issues, so they score almost everything as a 4 or 5. If "Climate Change," "Water Use," and "Worker Health" all score a 4.8, leadership has no data to guide strategic resource allocation.
Subjective Bias: A score of "4" on Scale means different things to a compliance manager, an investor, and an environmental scientist.
Survey Fatigue: Stakeholders get overwhelmed by dozens of technical questions and complete the forms arbitrarily.

4. The ExecutESG Solution: AHP Pairwise Consensus Math

To resolve these variance and bias issues, ExecutESG uses an Automated Pairwise Consensus Mechanism based on Thomas Saaty’s Analytic Hierarchy Process (AHP).

Instead of rating topics in isolation, stakeholders are presented with a series of forced-choice comparisons: "Which topic represents a more significant impact for our company: Topic A or Topic B?"

The AHP Matrix Algebra

When a stakeholder completes these comparisons, the system builds a reciprocal pairwise comparison matrix $A$:

$$A = \begin{pmatrix} 1 & w_1/w_2 & \dots & w_1/w_n \ w_2/w_1 & 1 & \dots & w_2/w_n \ \vdots & \vdots & \ddots & \vdots \ w_n/w_1 & w_n/w_2 & \dots & 1 \end{pmatrix}$$

Using matrix algebra, we compute the principal eigenvector of $A$, which yields the normalized priority weight (Win Rate) for each topic. These weights sum to 1.0 (or 100%), providing a mathematically clear ranking with high variance.

The Inconsistency Index

A major advantage of AHP is its ability to measure decision coherence. The system calculates the Inconsistency Index (II) using the formula: $$\text{II} = \frac{\lambda_{\max} - n}{n - 1}$$ Where $\lambda_{\max}$ is the principal eigenvalue and $n$ is the number of compared topics. If a stakeholder’s choices are illogical (e.g., A > B, B > C, but C > A), the index rises. If it exceeds $0.10$, the platform flags the survey for review.

Group Aggregation

To consolidate inputs from different stakeholder groups (e.g., combining employee views with investor views), the platform uses the Weighted Geometric Mean of the individual matrices: $$a_{ij}^{\text{group}} = \prod_{k=1}^{m} (a_{ij}^{(k)})^{w_k}$$ Where $w_k$ is the weight assigned to stakeholder group $k$. This prevents any single group from dominating the final consensus.

For validation of this methodology, see our Hanken School of Economics Case Study on AI-Driven Double Materiality.

5. Setting Thresholds and Matrix Generation

Once every topic is scored, the platform plots them on the Double Materiality Matrix:

Y-Axis: Impact Materiality (Inside-Out win-rates normalized to a 1-5 scale).
X-Axis: Financial Materiality (Outside-In risk scores normalized to a 1-5 scale).

                      DOUBLE MATERIALITY MATRIX
         ▲
         │ [Material: Impact]         │ [Material: Dual]
       5 ├────────────────────────────┼────────────────────────────
         │                            │  * Climate Change (E1)
         │                            │  * Own Workforce (S1)
  IMPACT │                            │
  (Y)  3 ├ - - - - - - - - - - - - - -┼ - - - - - - - - - - - - - - [THRESHOLD]
         │                            │
         │ [Immaterial]               │ [Material: Financial]
         │                            │  * Resource Use (E5)
         └────────────────────────────┴────────────────────────────
         0                            3                            5
                                FINANCIAL (X)  ►

The Threshold Rules

The leadership team establishes the threshold lines (typically at $3.0$ on both axes).

If a topic scores $\ge 3.0$ on the Y-Axis, it is material.
If a topic scores $\ge 3.0$ on the X-Axis, it is material.
If a topic scores $\ge 3.0$ on both, it is highly material.

This "OR" logic is essential: a topic does not need to threaten financial returns to be disclosed; if it has a severe environmental impact (such as biodiversity damage outlined in the Nature Footprint and Handprint Guide), it crosses the threshold and must be reported.

6. Audit Trails & Documenting Decisions

The final step in a compliant DMA is generating the audit trail. When external auditors review your report, they require traceability for every score.

ExecutESG's platform automatically packages:

Stakeholder Logs: Anonymized records of all stakeholder votes, win-rates, and inconsistency indexes.
Consensus Maps: Visual representations of agreement and disagreement points.
Methodology Declarations: A document detailing the formulas and threshold settings used.

By digitizing this workflow, ExecutESG transforms double materiality from a subjective guessing game into an audit-proof, scientifically defensible strategy.

Products

Full Service

LEARN

PROVE