Wednesday, November 18, 2026
Data from SEC filings, checked daily
My DeskFree
Public filings, plainly told
Backtesting and simulation
Summarize with AIChatGPTClaudePerplexityGoogle AIGrokCopilot
CFA® Level II · Portfolio Construction · Lesson 6 of 6

Backtesting and simulation

Testing strategies without fooling yourself.

Written by Sepehr Parsa9 min read

The backtesting process

  1. Strategy design: define the investment hypothesis, universe, factors, rebalancing frequency, weighting and benchmark.
  2. Historical investment simulation: build portfolios at each rebalancing date using only data available then; record returns.
  3. Output analysis: returns, risk (volatility, drawdown, VaR), turnover, factor exposures, performance in sub-periods.

Rolling window: estimate on an in-sample window, test on the next out-of-sample period, roll forward. It mimics real-time investing and reveals instability.

Common problems

  • Survivorship bias: using only companies that still exist inflates returns. Use point-in-time databases including delisted firms.
  • Look-ahead bias: using data not yet available (restated figures, late earnings). Use reporting lags and point-in-time data.
  • Data snooping: testing many variations until something works. Require economic reasoning and stricter significance.
  • Transaction costs and shorting constraints ignored.
  • Regime changes: relationships change across economic or market regimes.
  • Non-normal returns: fat tails and skewness that averages hide.

Spot the bias

Beyond backtesting

Scenario analysis: test the strategy in specific environments (recessions, rate shocks, high volatility) or structural breaks.

Historical simulation: draw past returns randomly (bootstrapping) to create many paths.

Monte Carlo simulation: specify distributions (possibly with fat tails, regime switching, changing correlations) and simulate.

Sensitivity analysis: vary assumptions to test robustness.

Exam focus

Describe the backtesting steps, identify survivorship, look-ahead and data-snooping biases, and compare historical simulation, Monte Carlo and scenario analysis.

Check yourself

Tap an answer. You get the explanation straight away.

  1. A backtest uses fiscal-year earnings in portfolio decisions dated before those earnings were published. This is:

  2. A researcher tests 500 trading rules and reports the one with the best Sharpe ratio. The main risk is:

  3. Compared with historical simulation, Monte Carlo simulation can:

Questions people ask

How do I reduce data snooping?

Base strategies on economic reasoning, limit the number of variations tested, keep a hold-out sample, use cross-validation and require higher t-statistics (for example above 3).

Why include transaction costs in backtests?

High-turnover strategies can look profitable before costs and lose money after. Include commissions, spreads, market impact and borrowing costs for shorts.

What is sensitivity analysis in backtesting?

Changing key assumptions, such as factor definitions, rebalancing frequency or the sample period, to see whether results hold. Robust strategies don't depend on one narrow choice.

Unlimited practiceGenerate more Portfolio Construction questionsFresh questions with worked solutions every time, in the Level II style.
Progress is saved in this browser.
Topic finishedTake the Level II practice examTimed, in the real exam format, with an explanation for every answer.

CFA Institute does not endorse, promote or warrant the accuracy or quality of WallStPal. CFA® and Chartered Financial Analyst® are registered trademarks owned by CFA Institute.

Exam format, timing and topic weights are from CFA Institute's Level I, II and III exam pages, checked November 15, 2026. Check CFA Institute for the year you sit. Lessons and practice questions are WallStPal's own and are not CFA Institute material.

Report an error

Tell us what looks wrong on this page. We check every report against the original filing and fix mistakes on our corrections page.

Share this trade
XTelegram
My Desk · free

Sign in to follow

Follow stocks, members of Congress, famous investors and funds, and see what's new each time you come back.