FY 2003 Mainstem/Systemwide proposal 199602000

Section 1. Administrative

Proposal titleComparative Survival Rate Study (CSS) of Hatchery Pit Tagged Chinook & Comparative Survival Study Oversight Committee
Proposal ID199602000
OrganizationPacific States Marine Fisheries Commission & Columbia Basin Fish & Wildlife Foundation (PSMFC/CBFWF)
Proposal contact person or principal investigator
NameMichele Dehart
Mailing address2501 SW First Ave., Suite 230 Portland, Oregon 97201
Phone / email5032304288 / mdehart@fpc.org
Manager authorizing this projectMichele DeHart, FPC; Pam Kahut, PSMFC
Review cycleMainstem/Systemwide
Province / SubbasinMainstem/Systemwide /
Short descriptionAdult and juvenile PIT tag recovery data are analyzed to compare survival estimates for transported fish of known origin, downriver stocks, wild and hatchery transported fish and fish handled and not handled at dams.
Target speciesChinook & Steelhead
Project location
LatitudeLongitudeDescription
46.510318 -116.371537 Dworshak Hatchery
44.878829 -114.001594 Pasimeroi Hatchery
44.891784 -116.078873 McCall Hatchery
45.422863 -116.316566 Rapid River Hatchery
47.6438 -120.674792 Leavenworth Hatchery
45.749332 -121.835138 Carson Hatchery
48.059147 -119.913322 Wells Hatchery
47.418596 -120.273136 Eastbank
46.42 -117.03 Lewiston Trap
45.66 -116.29 White Bird Trap, on Salmon River
46.06 -116.98 Grande Ronde Fish Trap
46.4245033 -116.917434 Clearwater Trap
Reasonable and Prudent Alternatives (RPAs)

Sponsor-reported:

RPA
9.6.5.3.4 Hatchery Effectiveness Monitor.
9.6.5.3.5
9.6.5.3.5.1 Juvenile Monitoring & Evaluation
9.7.1.1 Analysis of Effects, Juv Salmonid Pssg
9.7.1.2 Analysis of Effects, Adult Salmonid Pssg
10.5.1.1 Evaluate Reach Survivals
10.5.1.2 Monitor Smolt-to-Adult returns
10-5.1.4 Monitoring Juvenile Fish Pssg at Dams

Relevant RPAs based on NMFS/BPA review:

Reviewing agencyAction #BiOp AgencyDescription
NMFS/BPA Action 199 NMFS The Action Agencies shall implement the specific research/monitoring actions outlined in Appendix H.
NMFS Action 185 NMFS The Action Agencies shall continue to fund and expand, as appropriate, fish marking and recapturing programs aimed at defining juvenile migrant survival for both transported and nontransported migrants and adult returns for both groups. These studies shall also compare the SARs of transported and nontransported fish to calculate the differential delayed mortality (D), if any, of transported fish.
NMFS/BPA Action 185 NMFS The Action Agencies shall continue to fund and expand, as appropriate, fish marking and recapturing programs aimed at defining juvenile migrant survival for both transported and nontransported migrants and adult returns for both groups. These studies shall also compare the SARs of transported and nontransported fish to calculate the differential delayed mortality (D), if any, of transported fish.
NMFS Action 47 NMFS During all transport evaluations, the Corps and BPA, in coordination with NMFS through the annual planning process, shall include an evaluation of delayed mortality (D) of transported versus inriver migrating juvenile anadromous salmonids.
NMFS/BPA Action 187 NMFS The Action Agencies and NMFS shall work within the annual planning and congressional appropriation processes to establish and provide the appropriate level of FCRPS funding for studies and analyses to evaluate relationships between ocean entry timing and SARs for transported and downstream migrants.
NMFS Action 46 NMFS The Corps and BPA, in coordination with NMFS through the annual planning process, shall evaluate transport to inriver return ratios for wild SR yearling chinook salmon and steelhead. In addition, the Corps and BPA shall also evaluate the effects of transportation on summer-migrating subyearling SR chinook salmon.
NMFS/BPA Action 189 NMFS The Action Agencies and NMFS shall work within the annual planning and congressional appropriation processes to establish and provide the appropriate level of FCRPS funding for studies to investigate the causes of discrepancies in adult return rates for juvenile salmonids that have different passage histories through the hydrosystem.

Section 2. Past accomplishments

YearAccomplishment
2001 Completed Annual Report and analysis of juvenile and adult tag returns through 1999 and juvenile data through 2000.
2000 Completed annual status report of adult returns through 1998 and juvenile data through 1999.
1999 Application of tags, reporting juvenile survival indices, travel time, design and installation of Rapid River volitional detector, annual report of adult returns and SARs
1998 Application of tag groups, reporting juvenile survival indices, and travel time
1997 Application of tags, reporting of juvenile survival estimates

Section 3. Relationships to other projects

Project IDTitleDescription
198712700 Smolt Monitoring Program-Federal & Non Federal Critical Component
199008000 PITAGIS Critical Component
199403300 Fish Passage Center Critical Component
19960200 Marking Spring Chinook Critical Component
0 NMFS Transportation Study (COE funded) Critical Component

Section 4. Budget for Planning and Design phase

Task-based budget
ObjectiveTaskDuration in FYsEstimated 2003 costSubcontractor
Outyear objectives-based budget
ObjectiveStarting FYEnding FYEstimated cost
Outyear budgets for Planning and Design phase

Section 5. Budget for Construction and Implementation phase

Task-based budget
ObjectiveTaskDuration in FYsEstimated 2003 costSubcontractor
Outyear objectives-based budget
ObjectiveStarting FYEnding FYEstimated cost
Outyear budgets for Construction and Implementation phase

Section 6. Budget for Operations and Maintenance phase

Task-based budget
ObjectiveTaskDuration in FYsEstimated 2003 costSubcontractor
Outyear objectives-based budget
ObjectiveStarting FYEnding FYEstimated cost
Outyear budgets for Operations and Maintenance phase

Section 7. Budget for Monitoring and Evaluation phase

Task-based budget
ObjectiveTaskDuration in FYsEstimated 2003 costSubcontractor
1. PIT tagging at IDFG hatcheries and traps of wild and hatchery yearling chinook and steelhead in the Snake and Columbia River basins for use in the analyses of Program Objectives 1-4 (narrative). a. Rapid River/McCall Hatcheries - chinook $99,000
b. Pahsimeroi Hatchery - steelhead $78,000
c. Snake, Salmon, and Clearwater traps-wild chinook & steelhead $34,000
d. Other tributary traps (tags only) - wild chinook and steelhead $0
e. 202,150 PIT Tags $454,838
2. PIT tagging at ODFW hatcheries and traps of wild and hatchery yearling chinook and steelhead in the Snake and Columbia River basins for use in the analyses of Program Objectives 1-4 (narrative). a. Imnaha/Catherine Creek AP - chinook $67,000
b. Grande Ronde River trap-wild chinook and steelhead. $17,000
c. John Day River trap - wild chinook and steelhead $0
d. 46,350 PIT Tags $104,288
3. PIT tagging at USFWS hatcheries of wild and hatchery yearling chinook and steelhead in the Snake and Columbia River basins for use in the analyses of Program Objectives 1-4 (narrative). a. Dworshak/Carson Hatcheries - chinook $65,000
b. Dworshak Hatchery - steelhead $70,000
c. 149,000 PIT Tags $335,250
4. PIT tagging at WDFW hatcheries and traps of wild and hatchery yearling chinook and steelhead in the Snake and Columbia River basins for use in the analyses of Program Objectives 1-4 (narrative). a. East Bank/Wells Hatcheries - steelhead $125,000 Yes
b. 100,000 PIT Tags $225,000
5. Analyses: The creation of a time series of smolt-to-adult survival rates (objective 4 in the narrative part), comparisons of smolt-to-adult survival rates of in-river migrating smolts and transported smolts (i) from Lower Granite Dam to Lower a. CSS Oversight Committee $60,000
Granite Dam (objective 1 in the narrative) and (ii) from hatchery to hatchery (objective 2 in the narrative), and comparisons with smolts from the Mid-Columbia and lower Columbia River (objective 3 in the narrative). b. PSMFC Administrative Oversight $8,400
Outyear objectives-based budget
ObjectiveStarting FYEnding FYEstimated cost
Outyear budgets for Monitoring and Evaluation phase
FY 2004FY 2005FY 2006FY 2007
$1,812,487$1,884,987$1,979,236$2,078,197

Section 8. Estimated budget summary

Itemized budget
ItemNoteFY 2003 cost
Personnel $232,760
Fringe $58,070
Supplies $48,900
Travel $22,800
Indirect $96,370
PIT tags # of tags: 497,500 $1,119,376
Subcontractor $164,500
$1,742,776
Total estimated budget
Total FY 2003 cost$1,742,776
Amount anticipated from previously committed BPA funds$0
Total FY 2003 budget request$1,742,776
FY 2003 forecast from 2002$927,077
% change from forecast88.0%
Reason for change in estimated budget

The addition of steelhead mark groups requires additional PIT tags.

Reason for change in scope

Management need for steelhead passage and SAR data. This meets the recommendations of the State and Tribal fish managers and is consistant with the Council's ISAB reviews in 1997 and 1998.

Cost sharing
OrganizationItem or service providedAmountCash or in-kind

Reviews and recommendations

This information was not provided on the original proposals, but was generated during the review process.

Recommendation:
Fundable only if response is adequate
Date:
Aug 2, 2002

Comment:

The response must include an outside peer review of the estimation process by a qualified statistician(s) or there must be a programmatic review by the ISRP allowing adequate time for careful evaluation of the estimation process before a positive recommendation for funding can be given. Previous reviews by the ISAB and the ISRP resulted in the conclusion that the overall design of the data collection was adequate to meet the primary objectives of the project, but that the statistical properties of the proposed analysis procedures (mathematical formulas) should be further investigated before conclusions are based on data from this study. The previous ISRP and ISAB reviews did not approve the specific mathematical formulas in the reports issued by this project. Adequate review of the proposed analysis procedures is not feasible in the time allocated for the review of all proposals in the Mainstem and Systemwide Province.

When will the project end? The reason for the project stated on page 2 is to answer," can transportation of fish to below Bonneville Dam compensate for the effect of the hydrosystem on juvenile survival rates of Snake River spring and summer chinook salmon during their downstream migration?" It appears that the direction of the project is changing to the point that the proposal should be considered a new proposal. The project began in 1996 yet the proposal notes a rather tentative goal on page 2, and repeated on page 3, " This study is intended to begin to provide the basis for the Mainstem Monitoring and Evaluation (M&E) Program's analysis of long term alternatives for recovery of depressed listed and unlisted stocks of chinook and steelhead." The response should contain a careful self-review evaluating the advantages and disadvantages of combining this project with the CBFWA proposal #35033 to form a systemwide monitoring and evaluation project.

The proponents should summarize progress toward publication of the results and methods in the peer reviewed literature, if any attempt has been made.

It was mentioned that bootstrapping would be used to obtain confidence intervals on the point estimates and we agree that this may be an appropriate procedure. However, the problem is deeper than estimation of variances. The formulas proposed are ratios of ratios and the magnitude of mathematical bias in the point estimates should also be evaluated. In addition, maximum likelihood estimators and perhaps others should be developed and contrasted to the proposed ad hoc estimators to determine the most accurate and precise estimates possible with the available data.

Why is NMFS not on the interagency Comparative Survival Study (CSS) Oversight Committee? It seems that they are one of the primary users of the results and should be directly involved in oversight of the project.

Action Agency/NMFS RME Group Comments:

HYDRO SUBGROUP -- The proposal identified several Hydro-related RME-RPAs that the research would support 185 ("D"), 187 ("D"), 188 (lower Columbia stocks), and 189 (EM).

The RME Hydro work group recognizes that the proposed research has the potential to provide data and estimates useful in satisfying elements in those RPAs. Hydro-related RME RPAs 185, 187, 188, and 189. The smolt survival estimates have further application in the context of testing compliance with the Hydro performance standards as noted for other proposals in this review. The proposal was thorough in specifying sample sizes comprising key index and treatment groups. However, it would be beneficial if that information was translated into precision estimates. Alternatively power analyses for key hypothesis tests could be presented to demonstrate the estimates will be satisfactory for evaluating key hypotheses remaining in the region. This would also aid in assessing the utility of the information in performance tests that would be performed at the checkins.

ISRP Remarks on RME Group Comments:

In general, the ISRP is in agreement with the comments.


Recommendation:
Core Program
Date:
Oct 24, 2002

Comment:

This project is critical to Hydrosystem Biological Opinion check-in points. It provides data and analyses to evaluate the Biological Opinion at the 2005 and 2008 check-ins. It also provides data on delayed mortality for transport and inriver groups of fish. This project addresses RPAs 46, 47, 185 and 187 of the NMFS 2000 FCRPS BiOp. The budget has been increased to include a steelhead release group and the additional tagging and analysis required.
Recommendation:
Core Program
Date:
Oct 24, 2002

Comment:

The CSS budget is difficult to change significantly without reducing the scope of work and the number of fish that are PIT tagged since the bulk of the budget is the cost of PIT tags (65%) and they are projected to remain at a cost of $2.25 per tag in the foreseeable future. We did, however, lower the program and oversight costs 1% by reducing the cost of living allowances and the inflation factor.
Recommendation:
Fund
Date:
Nov 5, 2002

Comment:

Fundable (Qualified), agree with CBFWA's Core Program ranking, but some reallocation of effort for mathematical and statistical research, as indicated in the following, should be worked out by the Council during the project selection process and implemented by BPA in the contracting process. The response provided adequate details on monitoring activities, and connections with other projects such as 35033. If 35033 is funded then the functional melding of 35033 with the CSS is likely assured.

A subcommittee of the ISRP met with representatives of the Comparative Survival Study (CSS) in Seattle on September 24, 2002. We appreciate the sponsor's willingness to meet and discuss the technical issues of the design and analysis of the study. The long-term solutions to the mathematical and statistical problems in estimation of smolt-to-adult return rates (Bonneville to Bonneville and Bonneville to Low Granite SARs) appear to be: 1) detection of sufficient numbers of PIT tagged juveniles passing Bonneville No. 2 Dam at the planned corner collector, estimates of mortality of fish passing via that route, and/or 2) sufficiently large sample sizes of PIT tagged fish downstream of Bonneville. The ISRP recommends that these sampling efforts for PIT tagged juveniles be given high priority by the Council and the Corps of Engineers. In particular, task 2 of proposal 198331900 from NMFS for development of PIT tag detection in the corner collector at Bonneville No. 2 Dam should be given high priority.

Various scientists in the region, in particular scientists from the CSS project and NMFS, have considered the problems in estimation of the LGD to LGD SARs from currently available data and have apparently arrived at what they consider to be the "best" formulas. Unfortunately, the formulas are complicated, convoluted, and in general, very unsatisfactory from a statistical point of view. There is high probability that the complicated, convoluted methods will continue to spawn arguments and counter arguments over trivial issues that will occupy the resources of the region, because the stakes are high (e.g., high costs of spill, high costs of transportation, unknown long term effects of the non-normative transportation, high costs of augmented flow, etc).

We do not provide unqualified endorsement of the particular estimation formulas that are proposed, and we recommend that continuing statistical methods research be directed at investigating the performance of various proposed estimators and possible alternatives, including but not limited to the proposed methods and planned bootstrapping. Such research on mathematical and statistical methods could be pursued by the sponsors of this project, and by others. As an aid to clarity in comparison among possible alternative analyses, we recommend that the FPC make available a single reference data set which includes all the necessary interpretation of route of passage of PIT tagged fish and culls any suspect or ambiguous data that might be subject to further interpretation. The budget for the recommended mathematical and statistical analyses is relatively minor compared to the total cost of the project so investigation of our unresolved questions about statistical methods should not require substantial reallocation of the budget in this project.


Recommendation:
Date:
Jan 21, 2003

Comment:

Statement of Potential Biological Benefit
Benefits are indirect. This study is intended to provide the basis for Mainstem Monitoring and Evaluation Program's analysis of long term alternatives for the recovery of depressed listed and unlisted stocks of chinook and steelhead.

Comments
This study will provide better insight into management strategies which will aid salmon recovery. A good study which complements NMFS study. NOAA Fisheries agrees with the ISRP and RME group comments that it would be beneficial if that information was translated into precision estimates and that NMFS be part of the Interagency Comparative Oversight Committee.

Already ESA Required?
No

Biop?
Yes


Recommendation:
Fund
Date:
Jun 2, 2003

Comment:

BPA Phase 2
Recommendation:
Fund (Tier 1)
Date:
Jun 11, 2003

Comment:

Category:
1. Council Staff preferred projects that fit province allocation

Comments:
Address ISRP concerns, rework funding for mathematical and statistical models for ISRP review


Recommendation:
Date:
Sep 20, 2003

Comment:


Recommendation:
Fund
Date:
Oct 2, 2003

Comment:

Sustains budget at FY03 level. Other projects also provide estimates of the benefit of transportation, delayed transportation mortality, and effect of multiple bypass. Expansion of project scope would appear to be a legitimate subject for review by the Fish Passage Center Oversight Board's Technical Review Committee.
REVIEW:
NW Power and Conservation Council's FY 2006 Project Funding Review
Funding category:
expense
Date:
May 2005
FY05 NPCC start of year:FY06 NPCC staff preliminary:FY06 NPCC July draft start of year:
$828,535 $828,535 $828,535

Sponsor comments: See comment at Council's website