← Reports for counselPrint / save as PDF
Sample. The opposing report, data and results are invented and describe no real matter or expert. This sample is written from the defense side to show that the analysis is the same whichever side retains it.

Rebuttal Analytics Memorandum

Review of the plaintiffs' statistical report on promotion rates — what survives and what does not

To[Defense counsel], [Firm]
FromKarim Souidi, M.Sc. (Econometrics), NorthLaw.ai
Matter[Plaintiffs] v. [Employer] — sample file NL-2026-0002 (Title VII, promotion; putative class)
Date25 September 2026
PurposeConsulting review of the report of [Opposing Expert] dated [date]. Privileged; prepared at the request of counsel. Not prepared for filing.

1. Bottom line

The opposing report concludes that women were promoted at a rate 2.9 standard deviations below expectation company-wide and that this disparity is "highly statistically significant". Three of the report's choices drive that result, and each is contestable: it counts every employee as eligible for promotion rather than those who applied or met the posted criteria; it pools four job families with different promotion ladders into one test; and it does not adjust for the fact that the promotion decisions were made in 27 separate departments.

When eligibility is defined by the employer's own posted criteria and the analysis respects department structure, the company-wide disparity falls to 1.4 standard deviations (adjusted odds ratio 1.6, 95% CI 0.9 – 2.7), which is not statistically significant by the standard the report itself invokes. One job family, Field Operations, retains a significant disparity on its own (2.4 SD); the other three do not. Counsel should expect the plaintiffs to narrow their theory to that family, and the exposure discussion should start there.

2. Question presented

Whether the opposing report's statistical conclusions are supported by its data and methods; which findings survive correction of identifiable errors; and what the corrected analysis implies for class-wide and job-family-specific claims.

3. What the opposing report did

Using the employer's HRIS extract (4,860 employees, 2021 – 2024), the report compared the share of promotions received by women (31.2%) with women's share of headcount (38.9%), computed a standard-deviation statistic on that comparison, and supplemented it with a logistic regression of promotion on gender with tenure and rating as controls. It reports 2.9 SD and an odds ratio of 0.66 (p = 0.003).

4. Findings

IssueWhat the report didWhy it mattersEffect on SD
1. Eligibility poolTreats all employees as eligible for promotion each yearThe employer's postings require a minimum tenure and rating; 41% of headcount is ineligible in a given year, and ineligibility differs by gender (more recent female hires)2.9 → 2.1
2. AggregationPools four job families into one company-wide testPromotion rates and gender mix differ sharply by family; pooling creates a Simpson's-paradox pattern (Appendix A2)2.1 → 1.7
3. Decision unitStandard errors assume independent individual decisionsDecisions were made within 27 departments; clustering standard errors by department widens the interval1.7 → 1.4
4. Double countingLateral transfers with a title change coded as promotions112 transfers (63% male) counted as promotions; removing them slightly increases the disparity1.4 → 1.5
5. Selective reportingReports the one subgroup (Field Operations) with a significant result, not the three withoutNot an error in itself, but the report's text implies the finding is company-wide—

Effects are cumulative in the order shown; the sequence matters little (Appendix A3).

5. What survives

6. Limits of this review

Karim SouidiM.Sc. Econometrics · DASCA Senior Data Scientist · NorthLaw.ai · karim@northlaw.ai

Appendix A — Technical results

A1. Replication. The opposing report's headline figures were reproduced exactly from the produced extract (2.9 SD; OR 0.66, p = 0.003), confirming that the differences below arise from method, not data.

Table A2. Promotion rates by job family, eligible employees only, 2021 – 2024.

Job familyEligible (F / M)Promoted (F / M)Rate FRate MSD (clustered)OR (95% CI)
Field Operations168 / 61219 / 12111.3%19.8%2.40.52 (0.31 – 0.87)
Corporate402 / 38871 / 6617.7%17.0%0.31.05 (0.72 – 1.53)
Sales221 / 34740 / 6818.1%19.6%0.40.91 (0.58 – 1.41)
Technical184 / 54533 / 10417.9%19.1%0.30.93 (0.60 – 1.44)
All families, pooled (opposing method)1,890 / 2,970———2.90.66 (0.50 – 0.87)
All families, eligible, stratified, clustered975 / 1,892163 / 35916.7%19.0%1.40.84 (0.66 – 1.08)

A3. Order of corrections. Applying the three corrections in all six possible orders yields final values between 1.3 and 1.5 SD; the conclusion does not depend on sequence.

A4. Method. Eligibility defined per posting as ≥ 24 months tenure and rating ≥ 3 in the prior cycle. Stratified (Mantel-Haenszel) comparison across job family × year; logistic regression of promotion on gender with tenure, rating, job family, year and department fixed effects; standard errors clustered by department (27 clusters; wild-cluster bootstrap gives equivalent intervals). Transfers identified from the HRIS action code and excluded.

Appendix B — Data

Source: employer HRIS extract as produced to plaintiffs (Bates [range]), identical to that used by the opposing expert. Population: 4,860 employees with at least one active year 2021 – 2024; 2,867 employee-years eligible under posted criteria. Fields: gender, hire date, job family, department, annual rating, action codes (promotion, transfer, separation). No records excluded beyond ineligible employee-years and coded transfers. Data not independently verified.