TY - JOUR T1 - Cautions on using the Before-After-Control-Impact design in environmental effects monitoring programs AU - Smokorowski, K.E. AU - Randall, R.G. Y1 - 2017/01/01 PY - 2017 DA - 2017/01/01 N1 - doi: 10.1139/facets-2016-0058 DO - 10.1139/facets-2016-0058 T2 - FACETS JF - FACETS SP - 212 EP - 232 VL - 2 PB - Canadian Science Publishing N2 - Often the Before-After-Control-Impact (BACI) design is suggested as being a statistically powerful experimental design in environmental impact studies. If the timing and location of the impact are known and adequate pre-data are collected, the BACI design is considered optimal to help isolate the effect of the development from natural variability. This paper presents 9 years of results from a long-term BACI experiment tested using a range of statistical models and post-impact monitoring designs. To explore suboptimal designs that are often utilized in environmental effects monitoring, the same data were also explored assuming either no control system was available (Before-After only), or that no pre-impact data were available (Control-Impact only). The results of the BACI design were robust to the statistical model used, and the BACI design was able to detect effects from the impact that the two suboptimal designs failed to detect. However, the BACI design demonstrated different conclusions depending on the number and configuration of post-impact years included in the analysis. Our results reinforce the idea that caution should be employed when using, or interpreting results from, a BACI design in an environmental impact study, but demonstrate that a well-designed BACI remains one of the best models for environmental effects monitoring programs. AB - Often the Before-After-Control-Impact (BACI) design is suggested as being a statistically powerful experimental design in environmental impact studies. If the timing and location of the impact are known and adequate pre-data are collected, the BACI design is considered optimal to help isolate the effect of the development from natural variability. This paper presents 9 years of results from a long-term BACI experiment tested using a range of statistical models and post-impact monitoring designs. To explore suboptimal designs that are often utilized in environmental effects monitoring, the same data were also explored assuming either no control system was available (Before-After only), or that no pre-impact data were available (Control-Impact only). The results of the BACI design were robust to the statistical model used, and the BACI design was able to detect effects from the impact that the two suboptimal designs failed to detect. However, the BACI design demonstrated different conclusions depending on the number and configuration of post-impact years included in the analysis. Our results reinforce the idea that caution should be employed when using, or interpreting results from, a BACI design in an environmental impact study, but demonstrate that a well-designed BACI remains one of the best models for environmental effects monitoring programs. M3 - doi: 10.1139/facets-2016-0058 UR - https://doi.org/10.1139/facets-2016-0058 Y2 - 2024/04/25 ER - TY - JOUR T1 - Development of an adaptive monitoring framework for long-term programs: an example using indicators of fish health AU - Arciszewski, TJ AU - Munkittrick, KR JO - Integrated Environmental Assessment and Management Y1 - 2015 VL - 11 IS - 4 SP - 701 ER - TY - JOUR T1 - Beyond BACI: optimization of environmental sampling designs through monitoring and simulation AU - Benedetti-Cecchi, L JO - Ecological Applications Y1 - 2001 VL - 11 SP - 783 ER - TY - JOUR T1 - Considerations when using the reference condition approach for bioassessment of freshwater ecosystems AU - Bowman, FB AU - Somers, KM JO - Water Quality Research Journal of Canada Y1 - 2005 VL - 40 SP - 347 ER - TY - JOUR T1 - Importance of long-term monitoring for detecting environmental change: lessons from a lowland river in south east England AU - Burt, TP AU - Howden, NJK AU - Worrall, F AU - Whelan, MJ JO - Biogeosciences Y1 - 2008 VL - 5 SP - 1529 ER - TY - JOUR T1 - Improving sampling designs for measuring restoration in aquatic habitats AU - Chapman, MG JO - Journal of Aquatic Ecosystem Stress and Recovery Y1 - 1998 VL - 6 SP - 235 ER - TY - BOOK AU - Elliott, JM TI - Freshwater Biological Association Scientific Publication No. 25 Y1 - 1977 SP - 159 ED - 2nd edition ER - TY - JOUR T1 - How to cope with negative estimates of components of variance in ecological field studies AU - Fletcher, DJ AU - Underwood, AJ JO - Journal of Experimental Marine Biology and Ecology Y1 - 2002 VL - 273 SP - 89 ER - TY - BOOK AU - Gottelli, NJ AU - Graves, GR TI - Null models in ecology Y1 - 1996 SP - 368 ER - TY - BOOK AU - Green, RH TI - Sampling design and statistical methods for environmental biologist Y1 - 1979 ER - TY - JOUR T1 - A simple sequentially rejective multiple test procedure AU - Holm, S JO - Scandinavian Journal of Statistics Y1 - 1979 VL - 6 IS - 2 SP - 65 ER - TY - JOUR T1 - The nonconcept of species diversity: a critique and alternative parameters AU - Hurlbert, SH JO - Ecology Y1 - 1971 VL - 52 SP - 577 ER - TY - JOUR T1 - Pseudoreplication and the design of ecological field experiments AU - Hurlbert, SH JO - Ecological Monographs Y1 - 1984 VL - 54 SP - 187 ER - TY - JOUR T1 - More sites or more years? Optimal study design for monitoring fish response to watershed restoration AU - Liermann, M AU - Roni, P JO - North American Journal of Fisheries Management Y1 - 2008 VL - 28 IS - 3 SP - 935 ER - TY - JOUR T1 - Adaptive monitoring: a new paradigm for long-term research and monitoring AU - Lindenmayer, DB AU - Likens, GE JO - Trends in Ecology & Evolution Y1 - 2009 VL - 24 IS - 9 SP - 482 ER - TY - JOUR T1 - Long-term datasets in biodiversity research and monitoring: assessing change in ecological communities through time AU - Magurran, AE AU - Baillie, SR AU - Buckland, ST AU - Dick, JMCP AU - Elston, DA AU - Scott, EM JO - Trends in Ecology & Evolution Y1 - 2010 VL - 25 IS - 10 SP - 574 ER - TY - JOUR T1 - Factors affecting the performance of basket and multiplate macroinvertebrate samplers AU - Mason, WT AU - Weber, CI AU - Lewis, PA AU - Julian, EG JO - Freshwater Biology Y1 - 1973 VL - 3 SP - 409 ER - TY - JOUR T1 - Allometry of home range sizes in lake and river fishes AU - Minns, CK JO - Canadian Journal of Fisheries and Aquatic Sciences Y1 - 1995 VL - 52 SP - 1499 ER - TY - JOUR T1 - Overview of freshwater fish studies from the pulp and paper environmental effects monitoring program AU - Munkittrick, KR AU - McGeachy, A AU - McMaster, ME AU - Courtenay, SC JO - Water Quality Research Journal of Canada Y1 - 2002 VL - 37 IS - 1 SP - 49 ER - TY - JOUR T1 - A review of potential methods of determining critical effect size for designing environmental monitoring programs AU - Munkittrick, KR AU - Arens, CJ AU - Lowell, RB AU - Kaminski, GP JO - Environmental Toxicology and Chemistry Y1 - 2009 VL - 28 IS - 7 SP - 1361 ER - TY - JOUR T1 - Ecological responses to altered flow regimes: a literature review to inform the science and management of environmental flows AU - Poff, NL AU - Zimmerman, JKH JO - Freshwater Biology Y1 - 2010 VL - 55 SP - 194 ER - TY - JOUR T1 - Estimation and use of variance components AU - Robinson, DL JO - The Statistician Y1 - 1987 VL - 36 SP - 3 ER - TY - JOUR T1 - Global review of the physical and biological effectiveness of stream habitat rehabilitation techniques AU - Roni, P AU - Hanson, K AU - Beechie, T JO - North American Journal of Fisheries Management Y1 - 2008 VL - 28 SP - 836 ER - TY - JOUR T1 - Colonization of an introduced substrate by stream macroinvertebrates AU - Shaw, DW AU - Minshall, GW JO - Oikos Y1 - 1980 VL - 34 SP - 259 ER - TY - JOUR T1 - ANOVA for unbalanced data: an overview AU - Shaw, RG AU - Mitchell-Olds, T JO - Ecology Y1 - 1993 VL - 74 IS - 6 SP - 1638 ER - TY - JOUR T1 - Impact assessment using the Before-After-Control-Impact (BACI) model: concerns and comments AU - Smith, EP AU - Orvos, BW AU - Cairns, J JO - Canadian Journal of Fisheries and Aquatic Sciences Y1 - 1993 VL - 50 SP - 627 ER - TY - JOUR T1 - Ecosystem level assessment of environmentally-based flow restrictions for maintaining ecosystem integrity: a comparison of a modified peaking versus unaltered river AU - Smokorowski, KE AU - Metcalfe, RA AU - Finucan, SD AU - Jones, N AU - Marty, J AU - Power, null JO - Ecohydrology Y1 - 2011 VL - 4 SP - 791 ER - TY - JOUR T1 - Temporal and spatial variation in environmental impact assessment AU - Stewart-Oaten, A AU - Bence, JR JO - Ecological Monographs Y1 - 2001 VL - 71 SP - 305 ER - TY - JOUR T1 - Assessing effects of unreplicated perturbations: no simple solutions AU - Stewart-Oaten, A AU - Bence, JR AU - Osenberg, CW JO - Ecology Y1 - 1992 VL - 73 IS - 4 SP - 1396 ER - TY - JOUR T1 - Environmental impact assessment: “Pseudoreplication” in time? AU - Stewart-Oaten, A AU - Murdoch, WW AU - Parker, KR JO - Ecology Y1 - 1986 VL - 67 SP - 929 ER - TY - JOUR T1 - Beyond BACI: experimental designs for detecting human environmental impacts on temporal variations in natural populations AU - Underwood, AJ JO - Australian Journal of Marine and Freshwater Research Y1 - 1991 VL - 42 SP - 569 ER - TY - JOUR T1 - Beyond BACI: the detection of environmental impacts on populations in the real, but variable, world AU - Underwood, AJ JO - Journal of Experimental Marine Biology and Ecology Y1 - 1992 VL - 161 SP - 145 ER - TY - JOUR T1 - The mechanics of spatially replicated sampling programmes to detect environmental impacts in a variable world AU - Underwood, AJ JO - Australian Journal of Ecology Y1 - 1993 VL - 18 SP - 99 ER - TY - JOUR T1 - On beyond BACI: sampling designs that might reliably detect environmental disturbances AU - Underwood, AJ JO - Ecological Applications Y1 - 1994 VL - 4 IS - 1 SP - 3 ER -