--- title: Independent Review, Model Validation, and Backtesting for Community Banks description: Independent Review, Model Validation, and Backtesting for Community Banks image: https://blog.plansmith.com/hubfs/IRModelValBacktesting.jpg --- [CALL TOLL-FREE 1-800-323-3281](https://www.plansmith.reachproductions.net/project/call-toll-free-1-800-323-3281/) [![Plansmith](https://blog.plansmith.com/hs-fs/hubfs/Plansmith-Logo.png?width=764&height=135&name=Plansmith-Logo.png "Plansmith")](https://www4.plansmith.com) - Solutions - [Budgeting](https://www4.plansmith.com/budgeting/) - [ALM](https://www4.plansmith.com/alm) - [ALM Advisory Services](https://www4.plansmith.com/alm/advisory-services/) - [CECL](https://www4.plansmith.com/cecl/) - [Strategy](https://www4.plansmith.com/strategy/) - [Market Intelligence](https://www4.plansmith.com/market-intelligence/) - Products - [StrategyGPS](https://www4.plansmith.com/strategygps/) - [Compass](https://www4.plansmith.com/compass/) - [BankersGPS](https://www4.plansmith.com/bankersgps/) - Resources - [Blog](https://blog.plansmith.com/) - [Videos](https://plansmith.wistia.com/projects/7qemazkqii) - [Compass Tutorials](https://info.plansmith.com/compass-tutorials) - [Lunch N’ Learn](https://info.plansmith.com/lunch-n-learns) - [Webinars](https://www4.plansmith.com/webinars/) - [About](https://www4.plansmith.com/about/) - [Schedule A Discovery Call](https://www4.plansmith.com/contact-us/) - [CALL TOLL-FREE 1-800-323-3281](tel:8003233281) # Plansmith Blog # Independent Review, Model Validation, and Backtesting for Community Banks Posted by [Dave Wicklund](https://blog.plansmith.com/author/dave-wicklund) on 3/16/15 2:30 PM - [Tweet](https://twitter.com/share) In our ever increasing efforts to educate and inform, our marketing department here at team Plansmith has been on me to contribute to our Blog. Quite frankly, I’m not really a "blog" guy, but for those of you that know me, I’m not short on opinions either. So, given that I sit here stuck on a plane for a few hours, this seems like a good time to take a shot at it. In my more than 20 years at the FDIC and now three years here at Plansmith, I can’t count the number of times I’ve heard the terms "Independent Review," "Model Validation," and "Backtesting" misused. Many times, they’re even used synonymously, but are they the same? If so, I guess I could end this blog post now and dig out the Skymall Catalog tucked neatly in the seat back pouch in front of me. But, of course, they’re not the same, and so my shopping for self-cleaning litter boxes and speakers that look like garden gnomes will have to wait. First, let’s examine why we even care about this subject in the first place. According to the 1996 Joint Agency Policy Statement on IRR, "Effective control of the interest rate risk management process includes independent review…", and according to the Policy Statement, one of the five areas of the review should be "The validity of the risk measurement calculations" (i.e., model validation), which is "often tested by comparing actual versus forecasted results" (i.e., backtesting). Essentially, Independent Review is an audit function, the scope of which should cover five separate areas (all five areas are detailed in the Policy Statement). One of those five areas is Model Validation, and one method of Model Validation is backtesting (as an aside, the other common method referenced in the policy statement is benchmarking). So, for those of you that like pictures more than words, the simple diagram below illustrates this point. That is, Backtesting is part of Model Validation, and Model Validation is part of Independent Review. Now that we have that straight, you may be asking yourself "what does this all mean to me, and does my compliance program meet the Regulatory standard?" Well, maybe yes; maybe no. What I can tell you is that we rarely see financial institutions get away with just giving examiners a copy of the third-party model validation that we give you for free. That document is only a small part of the "Validation" picture above. It simply affirms that the model’s math, formulas, code, etc. are valid and the model functions properly. It, by no means, is a full Independent Review as required by the Policy Statement. It also does not include the backtesting of your interest rate risk modeling results or assumptions. At a minimum, you must ensure that your interest rate risk management process includes a full scope Independent Review addressing the following five areas as fully detailed in the Policy Statement: 1. Adequacy of the internal control system 2. Appropriateness of risk measurement system 3. Accuracy and completeness of data inputs 4. Reasonableness and validity of scenarios 5. Validation of risk measurement calculations And, don’t forget the Backtesting…or maybe we should forget backtesting for now since that opens a whole other set of questions such as who should do it, how often should it be done, what period should be covered, do you need to backtest model results and assumptions, and why even bother if market rates really aren't changing. Hmmm, all good questions. Looks like I’ll have to write [another blog](https://www1.plansmith.com/blog/post/Backtesting-Necessary-Evil-or-Just-Evil) to follow this one up. But for now…I need to ask the flight attendant for a copy of the Skymall; mine seems to be missing. In the meantime, give me a call or shoot me an email if you’re interested in any of our Advisory Services, including Independent Review for Plansmith and non-Plansmith model users, as well as backtesting.   ![Wicklund Head Shot 1-1](https://blog.plansmith.com/hs-fs/hubfs/Wicklund%20Head%20Shot%201-1.jpg?width=109&height=136&name=Wicklund%20Head%20Shot%201-1.jpg)Dave Wicklund *Director of ALM Advisory Services*     Topics: [interest rate risk](https://blog.plansmith.com/topic/interest-rate-risk), [community bank](https://blog.plansmith.com/topic/community-bank), [community bank strategy](https://blog.plansmith.com/topic/community-bank-strategy), [community bank ALCO](https://blog.plansmith.com/topic/community-bank-alco), [community bank interest rate risk](https://blog.plansmith.com/topic/community-bank-interest-rate-risk), [community bank budget software](https://blog.plansmith.com/topic/community-bank-budget-software), [community bank budgeting](https://blog.plansmith.com/topic/community-bank-budgeting), [ALCO](https://blog.plansmith.com/topic/alco) ### Subscribe Now! ### Posts by Tag - [community bank planning (52)](https://blog.plansmith.com/topic/community-bank-planning) - [community bank strategy (52)](https://blog.plansmith.com/topic/community-bank-strategy) - [community bank (49)](https://blog.plansmith.com/topic/community-bank) - [community bank budget software (45)](https://blog.plansmith.com/topic/community-bank-budget-software) - [credit union planning (44)](https://blog.plansmith.com/topic/credit-union-planning) - [community bank budgeting (42)](https://blog.plansmith.com/topic/community-bank-budgeting) - [budgeting (39)](https://blog.plansmith.com/topic/budgeting) - [interest rate risk (35)](https://blog.plansmith.com/topic/interest-rate-risk) - [community bank interest rate risk (33)](https://blog.plansmith.com/topic/community-bank-interest-rate-risk) - [community bank budget (30)](https://blog.plansmith.com/topic/community-bank-budget) - [strategic planning (28)](https://blog.plansmith.com/topic/strategic-planning) - [asset liability management (27)](https://blog.plansmith.com/topic/asset-liability-management) - [interest rate risk management (27)](https://blog.plansmith.com/topic/interest-rate-risk-management) - [community bank marketing strategy (26)](https://blog.plansmith.com/topic/community-bank-marketing-strategy) - [fintech (26)](https://blog.plansmith.com/topic/fintech) - [community bank ALCO (25)](https://blog.plansmith.com/topic/community-bank-alco) - [social media for community banks (24)](https://blog.plansmith.com/topic/social-media-for-community-banks) - [strategy (24)](https://blog.plansmith.com/topic/strategy) - [IRR (22)](https://blog.plansmith.com/topic/irr) - [bank strategy (21)](https://blog.plansmith.com/topic/bank-strategy) - [social media (20)](https://blog.plansmith.com/topic/social-media) - [strategic thinking (20)](https://blog.plansmith.com/topic/strategic-thinking) - [ALCO (19)](https://blog.plansmith.com/topic/alco) - [community bank forecasting (17)](https://blog.plansmith.com/topic/community-bank-forecasting) - [strategic planning for banks (17)](https://blog.plansmith.com/topic/strategic-planning-for-banks) - [ceo (16)](https://blog.plansmith.com/topic/ceo) - [Strategic Plan (12)](https://blog.plansmith.com/topic/strategic-plan) - [bank strategic planning software (12)](https://blog.plansmith.com/topic/bank-strategic-planning-software) - [community bank planning software (12)](https://blog.plansmith.com/topic/community-bank-planning-software) - [leadership (12)](https://blog.plansmith.com/topic/leadership) - [CECL (11)](https://blog.plansmith.com/topic/cecl) - [Customer Service (9)](https://blog.plansmith.com/topic/customer-service) - [playbook (9)](https://blog.plansmith.com/topic/playbook) - [alm (8)](https://blog.plansmith.com/topic/alm) - [bank budget (8)](https://blog.plansmith.com/topic/bank-budget) - [bank irr reporting (8)](https://blog.plansmith.com/topic/bank-irr-reporting) - [liquidity (8)](https://blog.plansmith.com/topic/liquidity) - [credit union interest rate risk (7)](https://blog.plansmith.com/topic/credit-union-interest-rate-risk) - [crisis planning (7)](https://blog.plansmith.com/topic/crisis-planning) - [forecasting (7)](https://blog.plansmith.com/topic/forecasting) - [budget playbook (6)](https://blog.plansmith.com/topic/budget-playbook) - [compass (6)](https://blog.plansmith.com/topic/compass) - [Outsource IRR (5)](https://blog.plansmith.com/topic/outsource-irr) - [banker education (5)](https://blog.plansmith.com/topic/banker-education) - [surge deposits (5)](https://blog.plansmith.com/topic/surge-deposits) - [bank mission vision core values (4)](https://blog.plansmith.com/topic/bank-mission-vision-core-values) - [continuing education (4)](https://blog.plansmith.com/topic/continuing-education) - [credit union budgeting (4)](https://blog.plansmith.com/topic/credit-union-budgeting) - [millennials (4)](https://blog.plansmith.com/topic/millennials) - [reforecasting (4)](https://blog.plansmith.com/topic/reforecasting) - [IRR Assumptions (3)](https://blog.plansmith.com/topic/irr-assumptions) - [board training (3)](https://blog.plansmith.com/topic/board-training) - [branch budgeting (3)](https://blog.plansmith.com/topic/branch-budgeting) - [decay rate (3)](https://blog.plansmith.com/topic/decay-rate) - [millennial employees in banking (3)](https://blog.plansmith.com/topic/millennial-employees-in-banking) - [rising rates (3)](https://blog.plansmith.com/topic/rising-rates) - [what-ifs (3)](https://blog.plansmith.com/topic/what-ifs) - [AI (2)](https://blog.plansmith.com/topic/ai) - [FDIC (2)](https://blog.plansmith.com/topic/fdic) - [backtesting (2)](https://blog.plansmith.com/topic/backtesting) - [bank brand marketing (2)](https://blog.plansmith.com/topic/bank-brand-marketing) - [board of directors (2)](https://blog.plansmith.com/topic/board-of-directors) - [compliance (2)](https://blog.plansmith.com/topic/compliance) - [cost center budgeting (2)](https://blog.plansmith.com/topic/cost-center-budgeting) - [deposit study (2)](https://blog.plansmith.com/topic/deposit-study) - [deposit trends (2)](https://blog.plansmith.com/topic/deposit-trends) - [funds transfer pricing (2)](https://blog.plansmith.com/topic/funds-transfer-pricing) - [market intelligence (2)](https://blog.plansmith.com/topic/market-intelligence) - [millennials in banking (2)](https://blog.plansmith.com/topic/millennials-in-banking) - [modern human resources strategy for banks (2)](https://blog.plansmith.com/topic/modern-human-resources-strategy-for-banks) - [peer analysis (2)](https://blog.plansmith.com/topic/peer-analysis) - [stress testing (2)](https://blog.plansmith.com/topic/stress-testing) - [Insider (1)](https://blog.plansmith.com/topic/insider) - [asset prepayments (1)](https://blog.plansmith.com/topic/asset-prepayments) - [baby boomers (1)](https://blog.plansmith.com/topic/baby-boomers) - [brand (1)](https://blog.plansmith.com/topic/brand) - [client spotlight (1)](https://blog.plansmith.com/topic/client-spotlight) - [contingency funding plan (1)](https://blog.plansmith.com/topic/contingency-funding-plan) - [credit union strategic planning software (1)](https://blog.plansmith.com/topic/credit-union-strategic-planning-software) - [employee human resources for banks (1)](https://blog.plansmith.com/topic/employee-human-resources-for-banks) - [event (1)](https://blog.plansmith.com/topic/event) - [financial institution succession planning (1)](https://blog.plansmith.com/topic/financial-institution-succession-planning) - [funding (1)](https://blog.plansmith.com/topic/funding) - [loan prepayments (1)](https://blog.plansmith.com/topic/loan-prepayments) - [market analysis (1)](https://blog.plansmith.com/topic/market-analysis) - [negative rates (1)](https://blog.plansmith.com/topic/negative-rates) - [policy (1)](https://blog.plansmith.com/topic/policy) - [ppp loans (1)](https://blog.plansmith.com/topic/ppp-loans) - [profitability (1)](https://blog.plansmith.com/topic/profitability) - [sensitivity testing (1)](https://blog.plansmith.com/topic/sensitivity-testing) - [social video for banks (1)](https://blog.plansmith.com/topic/social-video-for-banks) - [strategic action plan (1)](https://blog.plansmith.com/topic/strategic-action-plan) - [trade show (1)](https://blog.plansmith.com/topic/trade-show) See all ### Recent Posts - Navigate - [Home](https://www4.plansmith.com/) - [Budgeting](https://www4.plansmith.com/budgeting/) - [Asset Liability Management](https://www4.plansmith.com/alm/) - [CECL](https://www4.plansmith.com/cecl/) - [Strategy](https://www4.plansmith.com/strategy/) - [Market Intelligence](https://www4.plansmith.com/market-intelligence/) - [About](https://www4.plansmith.com/about/) - [Contact Us](https://www4.plansmith.com/contact-us/) - Products - [StrategyGPS](https://www4.plansmith.com/strategygps/) - [Compass](https://www4.plansmith.com/compass/) - [BankersGPS](https://www4.plansmith.com/bankersgps/) - Resources - [Blog](https://blog.plansmith.com) - [Videos](https://plansmith.wistia.com/projects/7qemazkqii) - [Compass Tutorials](https://info.plansmith.com/compass-tutorials) - [Lunch n' Learns](https://info.plansmith.com/lunch-n-learns) - [Webinars](https://www4.plansmith.com/webinars/) #### Contact 1827 Walden Office Square, Ste. 350 Schaumburg IL 60173 Toll Free: 1.800.323.3281 Local: 1.847.359.4045 Fax: 1.847.705.8200 info@plansmith.com Copyright 2018 | Plansmith Corporation ```json { "@context" : "https://schema.org", "@type" : "BlogPosting", "author" : { "@type" : "Person", "name" : "Dave Wicklund", "url" : "https://blog.plansmith.com/author/dave-wicklund" }, "dateModified" : "2025-06-30T16:50:59.421Z", "datePublished" : "2015-03-16T19:30:00.000Z", "headline" : "Independent Review, Model Validation, and Backtesting for Community Banks", "image" : [ "https://blog.plansmith.com/hubfs/IRModelValBacktesting.jpg" ], "mainEntityOfPage" : { "@id" : "https://blog.plansmith.com/independent-review-model-validation-and-backtesting-for-community-banks", "@type" : "WebPage" }, "publisher" : { "@type" : "Organization", "logo" : { "@type" : "ImageObject", "url" : "https://blog.plansmith.com/hubfs/Plansmith-Logo-Budgeting-ALM-Outsourcing-01.png" }, "name" : "Plansmith" } } ```