Title: | Distributional Synthetic Controls Estimation |
---|---|
Description: | The method of synthetic controls is a widely-adopted tool for evaluating causal effects of policy changes in settings with observational data. In many settings where it is applicable, researchers want to identify causal effects of policy changes on a treated unit at an aggregate level while having access to data at a finer granularity. This package implements a simple extension of the synthetic controls estimator, developed in Gunsilius (2023) <doi:10.3982/ECTA18260>, that takes advantage of this additional structure and provides nonparametric estimates of the heterogeneity within the aggregate unit. The idea is to replicate the quantile function associated with the treated unit by a weighted average of quantile functions of the control units. The package contains tools for aggregating and plotting the resulting distributional estimates, as well as for carrying out inference on them. |
Authors: | David Van Dijcke [aut, cre] , Florian Gunsilius [aut] , Siyun He [aut] |
Maintainer: | David Van Dijcke <[email protected]> |
License: | MIT + file LICENSE |
Version: | 0.1.1 |
Built: | 2024-11-10 02:59:45 UTC |
Source: | https://github.com/davidvandijcke/discos |
This function implements the distributional synthetic controls (DiSCo) method from Gunsilius (2023). as well as the alternative mixture of distributions approach.
DiSCo( df, id_col.target, t0, M = 1000, G = 1000, num.cores = 1, permutation = FALSE, q_min = 0, q_max = 1, CI = FALSE, boots = 500, replace = TRUE, uniform = FALSE, cl = 0.95, graph = FALSE, qmethod = NULL, qtype = 7, seed = NULL, simplex = FALSE, mixture = FALSE, grid.cat = NULL )
DiSCo( df, id_col.target, t0, M = 1000, G = 1000, num.cores = 1, permutation = FALSE, q_min = 0, q_max = 1, CI = FALSE, boots = 500, replace = TRUE, uniform = FALSE, cl = 0.95, graph = FALSE, qmethod = NULL, qtype = 7, seed = NULL, simplex = FALSE, mixture = FALSE, grid.cat = NULL )
df |
Data frame or data table containing the distributional data for the target and control units. The data table should contain the following columns:
|
id_col.target |
Variable indicating the name of the target unit, as specified in the id_col column of the data table. This variable can be any type, as long as it is the same type as the id_col column of the data table. |
t0 |
Integer indicating period of treatment. |
M |
Integer indicating the number of control quantiles to use in the DiSCo method. Default is 1000. |
G |
Integer indicating the number of grid points for the grid on which the estimated functions are evaluated. Default is 1000. |
num.cores |
Integer, number of cores to use for parallel computation. Default is 1. If the |
permutation |
Logical, indicating whether to use the permutation method for computing the optimal weights. Default is FALSE. |
q_min |
Numeric, minimum quantile to use. Set this together with |
q_max |
Numeric, maximum quantile to use. Set this together with |
CI |
Logical, indicating whether to compute confidence intervals for the counterfactual quantiles. Default is FALSE. The confidence intervals are computed using the bootstrap procedure described in Van Dijcke et al. (2024). |
boots |
Integer, number of bootstrap samples to use for computing confidence intervals. Default is 500. |
replace |
Logical, indicating whether to sample with replacement when computing the bootstrap samples. Default is TRUE. |
uniform |
Logical, indicating whether to construct uniform bootstrap confidence intervals. Default is FALSE If FALSE, the confidence intervals are pointwise. |
cl |
Numeric, confidence level for the (two-sided) confidence intervals. |
graph |
Logical, indicating whether to plot the permutation graph as in Figure 3 of the paper. Default is FALSE. |
qmethod |
Character, indicating the method to use for computing the quantiles of the target distribution. The default is NULL, which uses the |
qtype |
Integer, indicating the type of quantile to compute when using |
seed |
Integer, seed for the random number generator. This needs to be set explicitly in the function call, since it will invoke |
simplex |
Logical, indicating whether to use to constrain the optimal weights to the unit simplex. Default is FALSE, which only constrains the weights to sum up to 1 but allows them to be negative. |
mixture |
Logical, indicating whether to use the mixture of distributions approach instead.
See Section 4.3. in Gunsilius (2023). This approach minimizes the distance between the CDFs
instead of the quantile functions, and is preferred for categorical variables. When working with such variables, one should
also provide a list of support points in the |
grid.cat |
List, containing the discrete support points for a discrete grid to be used with the mixture of distributions approach. This is useful for constructing synthetic distributions for categorical variables. Default is NULL, which uses a continuous grid based on the other parameters. |
This function is called for every time period in the DiSCo function. It implements the DiSCo method for a single time period, as well as the mixture of distributions approach.
The corresponding results for each time period can be accessed in the results.periods
list of the output of the DiSCo function. The DiSCo function returns the average weight for each unit across all periods,
calculated as a uniform mean, as well as the counterfactual target distribution produced as the weighted average of the control distributions for each period, using these averaged weights.
A list containing the following elements:
results.periods
A list containing, for each time period, the elements described in the return argument of DiSCo_iter
, as well as the following additional elements:
DiSco
quantile
The counterfactual quantiles for the target unit.
weights
The optimal weights for the target unit.
cdf
The counterfactual CDF for the target unit.
weights
A numeric vector containing the synthetic control weights for the control units, averaged over time.
When mixture
is TRUE, these are the weights for the mixture of distributions, otherwise they are the weights for the quantile-based approach.
CI
A list containing the confidence intervals for the counterfactual quantiles and CDFs, if CI
is TRUE.
Each element contains two named subelements called upper
, lower
, se
which
are the upper and lower confidence bands and the standard error of the estimate, respectively.
They are G x T matrices where G is the specified number of grid points and T is the number of time periods.
The elements are:
cdf
The bootstrapped CDF
quantile
The bootstrapped quantile
quantile_diff
The bootstrapped quantile difference
cdf_diff
The bootstrapped CDF difference
bootmat
A list containing the raw bootstrapped samples for the counterfactual quantiles and CDFs, if CI
is TRUE.
These are not meant to be accessed directly, but are used by DiSCoTEA
to compute aggregated standard errors. Advanced users
may wish to access these directly for further analysis. The element names should be self-explanatory.
#'
control_ids
A list containing the control unit IDs used for each time period, which can be used to identify the weights
associated with each control as the returned weights have the same order as the control IDs.
perm
A permut
object containing the results of the permutation method, if permutation
is TRUE.
Call summary
on this object to print the overall results of the permutation test.
#'
evgrid
A numeric vector containing the grid points on which the quantiles were evaluated.
params
A list containing the parameters used in the function call.
Gunsilius FF (2023).
“Distributional synthetic controls.”
Econometrica, 91(3), 1105–1117.
Van Dijcke D, Gunsilius F, Wright AL (2024).
“Return to Office and the Tenure Distribution.”
Working Paper 2024-56, University of Chicago, Becker Friedman Institute for Economics.()
This function implements the DiSCo method for a single time period, as well as the mixture of distributions approach. Its return values contain valuable period-specific estimation outputs.
DiSCo_iter( yy, df, evgrid, id_col.target, M, G, T0, qmethod = NULL, qtype = 7, q_min = 0, q_max = 1, simplex = FALSE, controls.id, grid.cat, mixture )
DiSCo_iter( yy, df, evgrid, id_col.target, M, G, T0, qmethod = NULL, qtype = 7, q_min = 0, q_max = 1, simplex = FALSE, controls.id, grid.cat, mixture )
yy |
Integer indicating the current year being processed. |
df |
Data frame or data table containing the distributional data for the target and control units. The data table should contain the following columns:
|
evgrid |
A vector of grid points on which to evaluate the quantile functions. |
id_col.target |
Variable indicating the name of the target unit, as specified in the id_col column of the data table. This variable can be any type, as long as it is the same type as the id_col column of the data table. |
M |
Integer indicating the number of control quantiles to use in the DiSCo method. Default is 1000. |
G |
Integer indicating the number of grid points for the grid on which the estimated functions are evaluated. Default is 1000. |
T0 |
Integer indicating the last pre-treatment period starting from 1. |
qmethod |
Character, indicating the method to use for computing the quantiles of the target distribution. The default is NULL, which uses the |
qtype |
Integer, indicating the type of quantile to compute when using |
q_min |
Numeric, minimum quantile to use. Set this together with |
q_max |
Numeric, maximum quantile to use. Set this together with |
simplex |
Logical, indicating whether to use to constrain the optimal weights to the unit simplex. Default is FALSE, which only constrains the weights to sum up to 1 but allows them to be negative. |
controls.id |
List of strings specifying the column names for the control units' identifiers. |
grid.cat |
List, containing the discrete support points for a discrete grid to be used with the mixture of distributions approach. This is useful for constructing synthetic distributions for categorical variables. Default is NULL, which uses a continuous grid based on the other parameters. |
mixture |
Logical, indicating whether to use the mixture of distributions approach instead.
See Section 4.3. in Gunsilius (2023). This approach minimizes the distance between the CDFs
instead of the quantile functions, and is preferred for categorical variables. When working with such variables, one should
also provide a list of support points in the |
This function is part of the DiSCo method, called for each time period. It calculates the optimal weights for the DiSCo method and the mixture of distributions approach for a single time period. The function processes data f or both the target and control units, computes the quantile functions, and evaluates these on a specified grid. The function is designed to be used within the broader context of the DiSCo function, which aggregates results across multiple time periods.
A list with the following elements:
DiSCo_weights
Weights calculated using the DiSCo method.
mixture
weights
Optimal weights for the mixture approach.
distance
Value of the objective function for the mixture approach.
mean
Weighted mixture of the controls' CDFs.
target
cdf
Empirical CDF of the target. Only computed when mixture=TRUE
.
grid
Grid on which the quantile and CDF functions were evaluated.
data
Original data for the target unit.
quantiles
Quantiles for the target unit, evaluated on the specified grid.
controls
data
Original data for the control units.
cdf
Empirical CDFs of the control units. Only computed when mixture=TRUE
.
quantiles
Quantiles for the control units, evaluated on the specified grid.
.
controls.q
Quantiles for the control units, evaluated on the specified grid.
S3 object holding aggregated treatment effects
DiSCoT( agg, treats, ses, grid, ci_lower, ci_upper, t0, call, cl, N, J, agg_df, perm, plot )
DiSCoT( agg, treats, ses, grid, ci_lower, ci_upper, t0, call, cl, N, J, agg_df, perm, plot )
agg |
aggregation method |
treats |
list of treatment effects |
ses |
list of standard errors |
grid |
grid |
ci_lower |
list of lower confidence intervals |
ci_upper |
list of upper confidence intervals |
t0 |
start time |
call |
call |
cl |
confidence level |
N |
number of observations |
J |
number of treated units |
agg_df |
dataframe of aggregated treatment effects and their confidence intervals |
perm |
list of per mutation results |
plot |
a ggplot object containing the plot for the aggregated treatment effects using the |
S3 object of class DiSCoT
with associated summary
and print
methods
Function to aggregate treatment effects from the output of the DiSCo function, plot the distribution of the aggregation statistic over time, and report summary tables.
DiSCoTEA( disco, agg = "quantileDiff", graph = TRUE, t_plot = NULL, savePlots = FALSE, xlim = NULL, ylim = NULL, samples = c(0.25, 0.5, 0.75) )
DiSCoTEA( disco, agg = "quantileDiff", graph = TRUE, t_plot = NULL, savePlots = FALSE, xlim = NULL, ylim = NULL, samples = c(0.25, 0.5, 0.75) )
disco |
Output of the DiSCo function. |
agg |
String indicating the aggregation statistic to be used. Options include
|
graph |
Boolean indicating whether to plot graphs (default is TRUE). |
t_plot |
Optional vector of time periods ( |
savePlots |
Boolean indicating whether to save the plots to the current working directory (default is FALSE). The plot names will be |
xlim |
Optional vector of length 2 indicating the x-axis limits of the plot. Useful for zooming in on relevant parts of the distribution for fat-tailed distributions. |
ylim |
Optional vector of length 2 indicating the y-axis limits of the plot. |
samples |
Numeric vector indicating the range of quantiles of the aggregation statistic ( |
This function takes in the output of the DiSCo_per function and computes aggregate treatment effect using a user-specified aggregation statistic.
The default is the differences between the counterfactual and the observed quantile functions (quantileDiff
). If graph
is set to TRUE,
the function will plot the distribution of the aggregation statistic over time. The S3 class returned by the function
has a summary
property that will print a selection of aggregated effects (specified by the samples
parameter) for the chosen agg
method, by post-treatment year (see examples below).
This summary
call will only print effects if the agg
parameter requested a distribution difference (quantileDiff
or cdfDiff
). The other aggregations are meant to be inspected visually.
If the permutation
parameter was set to TRUE in the original DiSCo
call, the summary table will include the results of the permutation test.
If the original DiSCo
call was restricted to a range of quantiles smaller than [0,1]
(i.e. q_min
> 0 or q_max
< 1), the samples
parameter is ignored
and only the aggregated differences for the quantile range specified in the original call are returned.
A DiSCoT
object, which is an S3 class that stores a list of treatment effects, their standard errors,
the corresponding confidence intervals (if specified), and a dataframe with treatment effects aggregated
according to the agg
input. The S3 class also has a summary
property that will print a selection of aggregated effects (specified by the samples
parameter)
for the chosen agg
method, by post-treatment year, as well as the permutation test results, if specified.
As used in the empirical application of Gunsilius (2023).
dube
dube
dube
A data frame with 652,870 rows and 3 columns:
State FIPS
Year
adj0contpov
variable in Dube (2019). Captures the distribution of equalized family income from wages and salary, defined as multiples of the federal poverty threshold.
...
Example data for DiSCo
command.
Returns simulated target and control that are mixtures of Gaussian distributions.
ex_gmm(Ts = 2, num.con = 30, numdraws = 1000)
ex_gmm(Ts = 2, num.con = 30, numdraws = 1000)
Ts |
an integer indicating the number of time periods |
num.con |
an integer indicating the number of control units |
numdraws |
an integer indicating the number of draws |
target |
a vector. |
control |
a matrix. |
Object to hold results of permutation test
permut(distp, distt, p_overall, J_1, q_min, q_max, plot)
permut(distp, distt, p_overall, J_1, q_min, q_max, plot)
distp |
List of squared Wasserstein distances between the control units |
distt |
List of squared Wasserstein distances between the target unit and the control units |
p_overall |
Overall p-value |
J_1 |
Number of control units |
q_min |
Minimum quantile |
q_max |
Maximum quantile |
plot |
ggplot object containing plot of squared Wasserstein distances over time for all permutations. |
A list of class permut, with the same elements as the input arguments.
Summary of DiSCoT object
## S3 method for class 'DiSCoT' summary(object, ...)
## S3 method for class 'DiSCoT' summary(object, ...)
object |
DiSCoT object |
... |
Additional arguments |
summary of DiSCoT object
Summarize permutation test results
## S3 method for class 'permut' summary(object, ...)
## S3 method for class 'permut' summary(object, ...)
object |
Object of class permut |
... |
Additional arguments |
Prints permutation test results