Somewhere in every entrepreneur support organization’s annual report sits a ratio: every dollar invested generated four, seven, eleven dollars of social value. The genre is Social Return on Investment, and its arithmetic is seductive because it converts the unquantifiable, confidence built, households stabilized, dignity restored, into a single investable number. The trouble is that the number is an assumption sandwich: which outcomes count, what proxy prices them, how much would have happened anyway, how many years benefits persist, and every layer is chosen by the party being evaluated. The opposite temptation is harder-nosed and equally distorting: measure only venture revenue and jobs, the industry’s audit-grade metrics, and formation value, the founder who learned honest bookkeeping, the cohort that became a covenant community, the failure that taught, reads as zero. Between a ratio that can say anything and a ledger that misses the point sits the honest question this essay works: what should an ESO measure, publish, and be judged by, especially one claiming a triple bottom line?
Key Takeaways
- SROI’s ratio compresses defensible measurement and indefensible assumptions into one number; its sensitivity to proxy prices, attribution, and drop-off choices makes it gameable by construction.
- Revenue-and-jobs-only measurement is honest about less: it resists gaming but excludes formation, network, and household outcomes that are the point of much support work.
- The deadweight problem is the field’s hardest: without counterfactual discipline, near-miss tracking, baselines, both SROI and revenue metrics attribute selection to treatment.
- The Honest Scorecard framework publishes four lines: verified venture outcomes, formation evidence, attribution basis, and cost per outcome, with assumptions on the table.
- Funders shape the lying: reporting demands that reward big ratios buy big ratios; demands that reward published assumptions and counterfactuals buy learning.
What is actually wrong with SROI?
Not the ambition, the degrees of freedom. The method’s steps are individually reasonable: map outcomes with stakeholders, price them with financial proxies, subtract deadweight (what would have happened anyway), attribution (others’ contributions), and drop-off (decay over years), then divide by cost. But each step hands the evaluated party a dial. Choose generous proxies, a year of improved confidence priced at a counseling course’s cost, minimize deadweight by assumption, extend benefit periods, and the ratio inflates arbitrarily; the literature’s own reviews find SROI ratios for similar programs ranging across an order of magnitude, driven by analyst choices rather than program differences. The ratio then does its rhetorical work, ceremony reported as results, precisely because audiences read it as accounting when it is advocacy. None of this makes social outcomes unreal; it makes single-number compression the wrong container. The information SROI destroys, which outcomes, priced how, attributed why, is exactly the information an honest funder needs, and the fix is not better ratios but published disaggregation.
Is revenue-only measurement the honest alternative?
It is the auditable floor, not the honest whole. Venture survival, revenue growth, jobs, and financing, the GALI-standard battery, have the virtue of verifiability: bank statements and payrolls resist wishful pricing, and programs measured on them cannot hide behind proxies. But the floor misses three real value classes. Formation: the founder who exits with clean books, a practiced operating cadence, and rehearsed integrity is carrying capability into a lifetime of ventures, invisible in this venture’s twelve-month revenue. Network: the alumni body’s transaction density, demonstrably valuable, unpriced by venture metrics. And distribution: whose incomes moved, a program lifting subsistence households can lose a revenue comparison to one polishing urban elites while doing more of what its funders exist for. Measured honestly, these are trackable observables, routines retained at follow-up, transactions brokered, income segments served, without a single invented price. The dishonesty was never in measuring soft outcomes. It was in pricing them into a ratio instead of publishing them as evidence.
What is the Honest Scorecard?
The named framework of this essay: four published lines that together resist both the ratio’s inflation and the ledger’s blindness.
- Verified venture outcomes. Survival, revenue, jobs, financing at one and three years, collected on the industry standard, stated with response rates. The audit-grade floor, non-negotiable.
- Formation evidence. The program’s claimed capabilities, verified as behaviors: routines alive at six months, records quality, cadence kept, plus network transactions, asks honored, deals brokered. Observables, not priced proxies.
- Attribution basis. What the outcomes are compared against: near-miss cohorts, baselines, or honestly, nothing yet. One line that converts every other number from claim to evidence, and the line whose absence identifies marketing.
- Cost per outcome. Program cost divided by the floor outcomes, jobs, surviving ventures, published without embarrassment, because funders allocating scarce ecosystem money deserve the division and programs confident in their model survive it.
A program publishing all four can still tell its stories, and should; the scorecard is what makes the stories credible. For faith-based programs the stakes are doubled: a tradition whose scriptures demand honest weights and measures has no license for assumption-stuffed ratios, and its distinctive claims, character formed, community covenanted, deserve the dignity of real evidence rather than the embarrassment of priced testimonies.
What should funders change?
The demand function, because reporting supply follows it. Funders who ask for a social return ratio will receive one, inflated to the market-clearing level of the grant round; funders who ask for the scorecard’s four lines, and explicitly reward published assumptions, response rates, and null findings, buy the learning the sector claims to want. Three specific practices: require near-miss or baseline tracking in every award, the counterfactual priced into the budget rather than demanded for free; accept formation and network evidence as observables without forcing monetization, ending the proxy-pricing arms race; and publish portfolio-level cost-per-outcome across grantees, letting the comparison discipline the field the way receipts discipline programs. The sector’s measurement dishonesty is a negotiated equilibrium, and funders hold the pen. Honest weights and measures, Proverbs’ delight, are available at the cost of asking for them, and the programs doing real work, formation and revenue both, have the most to gain when the ratios stop shouting over the evidence.
FAQ
What makes SROI ratios unreliable?
Analyst-chosen proxies, deadweight, attribution, and drop-off assumptions stack multiplicatively; similar programs produce ratios varying by an order of magnitude, so the number reflects choices more than performance.
Should programs measure only revenue and jobs then?
As the verified floor, yes, but alone it misses formation, network, and distributional value. The fix is publishing those as observable evidence, not pricing them into a ratio.
What is the Honest Scorecard?
Four published lines: verified venture outcomes with response rates, formation and network observables, the attribution basis, and cost per outcome. Together they resist inflation and blindness.
What is the deadweight problem?
Without counterfactuals, programs attribute to treatment what selection produced. Near-miss tracking and baselines are the affordable disciplines that separate the two.
How can funders get honest reporting?
Demand the scorecard, budget the counterfactual, accept unmonetized observables, and publish cost-per-outcome comparisons. Reporting quality follows what grants reward.
Related Reading
- Selection vs Treatment: What Accelerators Actually Add
- Triple Bottom Line Without Three Sets of Books
- What the Learning Science Says Founders Retain
- What Makes a Faith-Based Accelerator Different in Practice
Sources and Evidence
- Social Value International: the SROI methodology and its assumption structure.
- GALI: the verified venture-outcome standard for entrepreneur support.
- Academic reviews of SROI reliability: findings on ratio sensitivity to analyst choices.
- 60 Decibels: lean, comparable outcome measurement as an alternative reporting practice.