Skip to content

Commit 70b547b

Browse files
igerberclaude
andcommitted
Document new SyntheticDiDResults validation diagnostics in bundled guides
PR #309 added four validation diagnostics to SyntheticDiDResults: `get_weight_concentration()`, `get_loo_effects_df()`, `in_time_placebo()`, and `sensitivity_to_zeta_omega()`. Because this PR is the first place the guides ship inside the wheel, we want them faithful to main's API at the moment of merge. - `llms-full.txt`: add the four methods to the SyntheticDiDResults Methods line and a short "Validation diagnostics" subsection describing each. - `llms-practitioner.txt`: split the former `SyntheticDiD/TROP` bullet so SyntheticDiD now points at the built-in helpers (with the jackknife caveat for LOO); TROP keeps the generic guidance. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
1 parent 8023b19 commit 70b547b

2 files changed

Lines changed: 8 additions & 1 deletion

File tree

diff_diff/guides/llms-full.txt

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1029,6 +1029,12 @@ Returned by `SyntheticDiD.fit()`.
10291029

10301030
**Methods:** `summary()`, `print_summary()`, `to_dict()`, `to_dataframe()`, `get_unit_weights_df()`, `get_time_weights_df()`
10311031

1032+
**Validation diagnostics** (call after `fit()`):
1033+
- `get_weight_concentration(top_k=5)` - effective N and top-k weight share; flags fragile synthetic controls dominated by a few donor units
1034+
- `get_loo_effects_df()` - leave-one-out influence per treated unit (requires `variance_method="jackknife"` at fit and >=2 treated units with positive effective support)
1035+
- `in_time_placebo()` - re-estimate on shifted fake treatment dates in the pre-period; near-zero placebo ATTs indicate a credible design
1036+
- `sensitivity_to_zeta_omega()` - re-estimate across a grid of unit-weight regularization values; checks ATT robustness to the auto-selected zeta_omega
1037+
10321038
### TripleDifferenceResults
10331039

10341040
Returned by `TripleDifference.fit()`.

diff_diff/guides/llms-practitioner.txt

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -296,7 +296,8 @@ to your estimator's API. Examples:
296296
- **StackedDiD**: vary `clean_control` definition
297297
- **EfficientDiD**: compare `control_group='never_treated'` vs `'last_cohort'`
298298
- **ImputationDiD/TwoStageDiD**: leave-one-cohort-out, cross-estimator comparison
299-
- **SyntheticDiD/TROP**: in-time or in-space placebo (fake treatment date, leave-one-unit-out)
299+
- **SyntheticDiD**: built-in diagnostics on the results object - `results.in_time_placebo()`, `results.get_loo_effects_df()` (requires `variance_method="jackknife"` at fit time), `results.sensitivity_to_zeta_omega()`, and `results.get_weight_concentration()`
300+
- **TROP**: in-time or in-space placebo (fake treatment date, leave-one-unit-out)
300301

301302
```python
302303
from diff_diff import run_all_placebo_tests

0 commit comments

Comments
 (0)