I have no legal experience or knowledge. When the laws are changed, how do lawmakers assess their consequences and effects? Are there special teams that are supposed to take data that measures whether or not a certain policy or law is working?
For example, Oregon just decriminalized drugs. How will we know if it is saving the government money, decreasing BIPOC incarceration, and increasing the resources allocated to addiction recovery centers as proposed? How will we know if drug use is increasing or decreasing as a result?
People always talk about holding legislators accountable. How do you actually do this? What is the time frame for measuring the effects of a policy change?
In: Other
So whether or not a policy gets assessed depends on what the laws in the jurisdiction say or, otherwise, the policy stance of the government in question. As a rule of thumb, if it directly involves government spending, it will almost certainly get evaluated in some way or another.
However, the question of how to evaluate a complex policy is more interesting. Fundamentally, it comes down to turning the policy outcome into a series of quantifiable questions such as the ones you laid out:
* Has the policy resulted in decreased BIPOC incarceration
* Has the policy increased resources allocated to recovery centers
* Has the policy saved the government money
* Is drug use increasing or decreasing as a result of the policy
Of these questions, the second is certainly the easiest as it is merely a matter of checking the government’s budget (which is public information) to see if the government followed the new law’s stipulation to direct whatever funding the law dictated to addiction recovery centers.
The remaining, fundamentally, involve attempting to isolate the impact of the policy on the outcomes of interest from other things that might be impacting it. Ultimately, this is an exercise in statistics. One way or another, you must construct a counterfactual (what would drug use, BIPOC incarcerations, and government revenue/spending look like in a parallel universe where the policy was not implemented). Such a counterfactual can, obviously, never be directly observed, so it must be inferred through data.
One popular method for doing this is called the difference in differences approach. Basically, you find a population that is *not* subject to the policy in question, but is otherwise very similar and experiences a similar **trend** in the outcome of interest (e.g. a neighboring, similar state, where government spending on drug enforcement was increasing at the same rate as Oregon’s would be a decent one for the government cost outcome). Then, you can observe whether, after the policy took effect, there was a change in trend over and above any change in trend observed in the comparison state. Provided that the two states are suitably similar in other aspects (you can control for these as well), the differences in how the trends evolved between the two states after the policy took effect can be attributed to the impact of the policy.
Governments tend to hire contractors to do evaluations like this because they are independent and governments often lack the capacity to retain internal evaluation teams. As for when these evaluations occur and their timeframe, it really depends on the policy. Some policies are evaluated for years and years while others are very short lived.
Latest Answers