How to Pick Index Funds

The 5 Criteria That Actually Matter

There are thousands of index funds. Most of them are fine. A handful are exceptional. Here's exactly how to tell the difference.

By Mark T ยท Updated August 29, 2026

Walk into any brokerage today and you'll find thousands of index funds competing for your money. They all claim to be "low cost" and "diversified." How do you actually choose the right one?

The good news: index fund selection is far simpler than picking stocks. You're not trying to predict which companies will outperform. You're just trying to own the market as cheaply and efficiently as possible. Five criteria will eliminate 90% of your options and leave you with a short list of genuinely excellent funds.

Start with the Index, Not the Fund

Before you look at any fund, you need to decide which index you want to track. This is the most consequential decision you'll make - the index defines your exposure, your risk, and your expected return. The fund is just the vehicle.

The major US equity indexes differ dramatically in scope:

  • S&P 500: 500 of the largest US companies by market cap. Covers roughly 80% of total US market capitalization. Apple, Microsoft, Amazon, Nvidia - the biggest names are here.
  • Total US Market (Russell 3000 / CRSP US Total Market): 4,000+ US stocks including small- and mid-cap companies. Broader than the S&P 500, capturing the full spectrum of US public companies.
  • Total World (FTSE Global All Cap / MSCI ACWI IMI): 8,000+ stocks across developed and emerging markets. US companies make up roughly 60%, with the rest spread across Europe, Japan, emerging Asia, and beyond.

Beyond scope, indexes also differ in weighting methodology. Most major indexes are cap-weighted - larger companies get larger allocations. An S&P 500 index fund owns far more Apple than it does a smaller S&P 500 member. Equal-weight indexes give each constituent the same allocation, leading to higher small-cap exposure and more frequent rebalancing (which increases costs and turnover).

Cap-Weighted vs Equal-Weight: In a cap-weighted S&P 500 fund, the top 10 holdings represent roughly 35% of the portfolio. In an equal-weight version (like RSP), each of the 500 stocks gets 0.2%. Equal-weight tends to outperform in small-cap bull markets and underperform in mega-cap rallies.

For most investors, the core choice is between the S&P 500 and the Total US Market. We'll cover that debate in depth below. The key point: pick your index first, then compare the funds that track it.

Criterion 1: Expense Ratio - The Single Most Important Number

The expense ratio is the annual fee the fund charges, expressed as a percentage of your investment. It's deducted automatically from the fund's returns - you never see a bill, but you feel it in every year's performance.

Unlike market returns (which are uncertain), fees are guaranteed. Every basis point you pay in expenses is a permanent, compounding drag on your wealth. Here's the expense ratio landscape for major index funds today:

          <table class="table table-bordered mb-4">
            <thead class="table-light">
              <tr>
                <th>Fund</th>
                <th>Index Tracked</th>
                <th>Expense Ratio</th>
              </tr>
            </thead>
            <tbody>
              <tr>
                <td><strong>VTI</strong> (Vanguard Total Stock Market ETF)</td>
                <td>CRSP US Total Market</td>
                <td><strong>0.03%</strong></td>
              </tr>
              <tr>
                <td><strong>FSKAX</strong> (Fidelity Total Market Index Fund)</td>
                <td>Dow Jones US Total Stock Market</td>
                <td><strong>0.015%</strong></td>
              </tr>
              <tr>
                <td><strong>SPLG</strong> (SPDR Portfolio S&P 500 ETF)</td>
                <td>S&P 500</td>
                <td><strong>0.02%</strong></td>
              </tr>
              <tr>
                <td><strong>IVV</strong> (iShares Core S&P 500 ETF)</td>
                <td>S&P 500</td>
                <td><strong>0.03%</strong></td>
              </tr>
              <tr>
                <td><strong>SPY</strong> (SPDR S&P 500 ETF Trust)</td>
                <td>S&P 500</td>
                <td>0.09%</td>
              </tr>
              <tr>
                <td><strong>QQQ</strong> (Invesco Nasdaq-100 ETF)</td>
                <td>Nasdaq-100</td>
                <td>0.20%</td>
              </tr>
              <tr>
                <td>Average active mutual fund</td>
                <td>Varies</td>
                <td>0.68%</td>
              </tr>
            </tbody>
          </table>

The compounding effect of this difference is staggering. Consider $100,000 invested at 7% nominal return for 30 years:

  • 0.03% ER (VTI): ~$758,000 final balance
  • 0.20% ER (QQQ): ~$718,000 final balance - $40,000 less
  • 0.68% ER (average active): ~$609,000 final balance - $149,000 less
๐Ÿ’ก Tip: For broad US or international market exposure, there's no reason to pay more than 0.05% per year. VTI, VXUS, BND, FSKAX, FZROX, and SWTSX are all exceptional funds at 0.03% or less. If a fund charges more for the same index, walk away.

Criterion 2: Tracking Error - How Well Does It Follow the Index?

A fund's job is to replicate its benchmark index as closely as possible. Tracking difference is the annual return gap between the fund and the index it tracks. Tracking error is the volatility of that gap over time.

Counterintuitively, some funds actually outperform their index (negative tracking difference) thanks to securities lending income - the fund lends its holdings to short sellers and earns fees that partially offset expenses. Well-run large funds from Vanguard, Fidelity, and iShares routinely achieve this.

Tracking Difference vs Tracking Error: Tracking difference is the total annual performance gap (fund return minus index return). Tracking error is the standard deviation of those gaps year to year. A fund can have consistently low tracking difference but high tracking error - meaning it deviates unpredictably, even if it averages out. You want both to be low.

Here's why this matters: a fund with a 0.03% expense ratio but 0.20% tracking difference delivers worse net performance than a fund with a 0.05% expense ratio and 0.01% tracking difference. The stated expense ratio is a floor, not a ceiling.

For the major index funds from Vanguard, iShares, and Schwab, tracking difference is typically near zero or negative. Exotic ETFs from smaller providers - especially in emerging markets or niche sectors - can have significant tracking problems due to illiquid underlying securities, currency hedging costs, and swap structures.

๐Ÿ’ก Tip: ETFdb.com and ETF.com both publish tracking difference data. Before buying any fund, verify it tracks its index faithfully. If the tracking difference exceeds the expense ratio by more than 0.10%, something is wrong.

Criterion 3: Fund Size and Liquidity

Bigger index funds are almost always better. Here's why:

  • Lower bid-ask spreads: High trading volume means market makers compete aggressively, keeping the spread between buy and sell prices tight. For small ETFs, the spread can cost you 0.05-0.30% on every trade - often exceeding the annual expense ratio.
  • Securities lending income: Large funds can lend their holdings to short sellers at better rates, generating revenue that offsets expenses and can produce negative tracking difference.
  • Lower closure risk: Funds with insufficient assets get shut down. When that happens, investors must sell (potentially triggering taxable gains) and reinvest. Funds under $100 million in assets are at real risk of closure, especially if from smaller providers.
  • Index committee leverage: Giant funds have more influence when negotiating index inclusion/exclusion terms with index providers, which can marginally benefit all shareholders.
โš ๏ธ Warning: Funds under $100 million in AUM carry meaningful closure risk, especially niche or thematic ETFs. When a fund closes, you're forced to sell - which can trigger capital gains taxes in a taxable account and disrupt your investment plan. Stick to funds with at least $1 billion in assets for your core holdings.

For context, VTI has over $400 billion in assets. SPY has over $500 billion. IVV is above $400 billion. These funds are not going anywhere. A newer thematic ETF launched in 2021 with $80 million? That's a different story.

Notably, even SPY - despite being older and larger - has a higher expense ratio (0.09%) than IVV (0.03%) or SPLG (0.02%). SPY's fee persists largely because institutional traders use it for short-term hedging and prefer its massive liquidity. Long-term buy-and-hold investors are better served by IVV or SPLG for S&P 500 exposure.

Criterion 4: Tax Efficiency in Taxable Accounts

In tax-advantaged accounts like a 401(k) or IRA, tax efficiency doesn't matter - gains grow sheltered from current taxes. But in a taxable brokerage account, it matters enormously. Our ETF vs mutual fund guide covers the full tax and account-type breakdown.

When a mutual fund sells securities at a gain (to rebalance, meet redemptions, or adjust to index changes), it distributes those capital gains to all shareholders - even if you personally never sold anything. You owe taxes on gains you didn't choose to realize.

The ETF Structure Advantage

ETFs have a powerful tax mechanism called the "in-kind creation/redemption" process. When large investors redeem ETF shares, they receive a basket of stocks rather than cash. The ETF never sells securities to meet redemptions, so it rarely generates taxable capital gain distributions. This is a significant structural advantage over traditional mutual funds.

Vanguard's Unique Patent (Now Expired)

Until 2023, Vanguard held a patent that allowed its mutual funds to share the ETF share class's tax benefits - meaning Vanguard's index mutual funds (like VTSAX) were as tax-efficient as ETFs (like VTI). That patent has expired, and other fund families are beginning to offer similar dual-share-class structures.

Dividend Tax Character

Not all dividends are taxed equally. Qualified dividends (from US stocks held more than 60 days) are taxed at long-term capital gains rates (0-20%). Nonqualified dividends are taxed as ordinary income (up to 37%). For taxable accounts:

  • US stock index funds (VTI, VTSAX) - predominantly qualified dividends
  • REITs, bond funds (BND, VBTLX) - mostly nonqualified, ordinary income rates
  • International equity funds (VXUS) - partially qualified, depending on tax treaty countries
๐Ÿ’ก Tip: In taxable accounts, favor ETFs over mutual funds for broad equity exposure. Hold bond funds and REIT funds in tax-advantaged accounts (IRA, 401k) where their ordinary income distributions don't create annual tax bills. This asset location strategy can save thousands per year in taxes.

Criterion 5: Brokerage Compatibility

The best fund on paper can become impractical if your brokerage charges commissions or imposes restrictions on buying it. Brokerage compatibility affects both your out-of-pocket costs and the friction of automatic investing.

Commission-Free ETF Lists

Most major brokerages (Vanguard, Fidelity, Schwab, TD Ameritrade/Schwab, E*TRADE) now offer commission-free trading on virtually all ETFs. But commission-free doesn't always mean frictionless - some brokerages impose short-term trading fees if you sell within 30 days of purchase.

Proprietary Zero-Fee Funds

Some fund families offer products that are only available (or only fully commission-free) at their own brokerage:

  • Fidelity ZERO funds (FZROX, FZILX): 0% expense ratio - no fees at all. But they're only available at Fidelity and are mutual funds (not ETFs), so they cannot be transferred to another brokerage. If you ever move your account, you'd need to sell and rebuy, potentially triggering taxes.
  • Vanguard ETFs at Vanguard: Historically commission-free only at Vanguard, though most brokerages now trade them for free as well. Vanguard's mutual fund share classes (VTSAX, VTIAX, VBTLX) require a $3,000 minimum and are available anywhere but most easily held at Vanguard.
  • Schwab index funds (SWTSX, SCHB): Exceptionally low expense ratios and most easily used at Schwab.
โš ๏ธ Warning: Fidelity ZERO funds (FZROX, FZILX) are genuinely 0% expense ratio - which sounds perfect. But their mutual fund structure and brokerage lock-in mean you cannot transfer them in-kind if you leave Fidelity. If you're confident you'll stay with Fidelity for decades, they're excellent. Otherwise, VTI at 0.03% provides nearly the same cost with full portability.

Also consider automatic investment capabilities. Mutual funds allow you to invest any dollar amount automatically on a schedule. ETFs require whole-share purchases at most brokerages (though Fidelity, Schwab, and others now support fractional ETF shares). For dollar-cost averaging small amounts, mutual funds can be more convenient.

The Core Three-Fund Portfolio

Once you understand the five criteria, the selection process converges on a remarkably simple portfolio. The three-fund portfolio - developed and popularized by Vanguard founder Jack Bogle and refined by the Bogleheads community - uses just three funds to own the entire investable world:

๐Ÿ’ก Tip: The classic three-fund portfolio uses these funds (ETF / mutual fund equivalents):
  • Total US Market: VTI / VTSAX (0.03%) - owns 4,000+ US stocks
  • Total International: VXUS / VTIAX (0.07%) - owns 8,000+ non-US stocks
  • Total Bond Market: BND / VBTLX (0.03%) - investment-grade US bonds

A common starting allocation for a 30-year-old might be 60% VTI, 30% VXUS, 10% BND. As you age, you shift more into bonds. The rule of thumb (increasingly conservative): your bond percentage equals your age, or your age minus 10 for those with higher risk tolerance.

Bogle's philosophy was that complexity is the enemy of good investing. You don't need sector funds, factor tilts, or 15 different holdings. Three funds with rock-bottom expenses, held forever, will outperform the vast majority of more complex strategies - not because they're clever, but because they're cheap, diversified, and free from behavioral mistakes.

Bogleheads Three-Fund Portfolio: A passive investing strategy using three total-market index funds - US stocks, international stocks, and bonds - to achieve global diversification at minimal cost. Named after the followers of Jack Bogle, Vanguard's founder, who pioneered low-cost index fund investing.

S&P 500 vs Total Market: Which to Choose?

This is the most common debate among index fund investors, and the good news is that it barely matters. Here's the nuanced answer:

The S&P 500 holds the 500 largest US companies, covering ~80% of total US market cap. The Total US Market holds 4,000+ stocks, adding mid-cap and small-cap exposure. Because the S&P 500 companies dominate by weight, the two indexes have historically produced nearly identical returns - correlation above 0.99 over most long periods.

          <table class="table table-bordered mb-4">
            <thead class="table-light">
              <tr>
                <th></th>
                <th>S&P 500 (e.g., VOO, IVV)</th>
                <th>Total US Market (e.g., VTI, FSKAX)</th>
              </tr>
            </thead>
            <tbody>
              <tr>
                <td>Number of holdings</td>
                <td>~500</td>
                <td>~4,000+</td>
              </tr>
              <tr>
                <td>Small-cap exposure</td>
                <td>None</td>
                <td>~10-15%</td>
              </tr>
              <tr>
                <td>Historical returns (similar)</td>
                <td>Similar</td>
                <td>Similar</td>
              </tr>
              <tr>
                <td>Bogle's preference</td>
                <td>Yes (historically)</td>
                <td>Also endorsed</td>
              </tr>
              <tr>
                <td>Buffett's recommendation</td>
                <td>Yes (S&P 500)</td>
                <td> - </td>
              </tr>
            </tbody>
          </table>

The small-cap exposure in Total Market funds is the academic argument for choosing VTI over VOO: small-cap stocks have historically delivered a premium over large-caps (the Fama-French small-cap factor). However, this premium has been inconsistent in recent decades, and the additional holdings add negligible cost.

Jack Bogle personally preferred the S&P 500 for its simplicity and the quality of its constituents. Warren Buffett famously instructed his estate trustee to put 90% in an S&P 500 index fund. On the other hand, most academic passive investing frameworks recommend Total Market for maximum diversification.

๐Ÿ’ก Tip: Can't decide between VOO and VTI? Pick either and stop thinking about it. The performance difference over your investing lifetime will be negligible. The worst outcome would be spending years agonizing over this choice instead of just investing consistently.

Index Funds to Avoid

Not every fund with "index" in the name is a good investment. Several categories carry serious risks that the marketing materials gloss over:

Leveraged ETFs (e.g., TQQQ, UPRO, SSO)

Leveraged ETFs deliver 2x or 3x the daily return of an index. Over any period longer than one day, they suffer from volatility decay (also called beta decay or compounding decay). In choppy or sideways markets, a 2x leveraged fund can lose money even when the underlying index is flat. These are trading instruments, not long-term investments. Long-term holders of TQQQ have sometimes dramatically underperformed despite QQQ's gains.

Inverse ETFs (e.g., SH, PSQ, SQQQ)

Inverse ETFs provide the opposite of their benchmark's daily return. Like leveraged ETFs, they suffer from decay over time. Holding an inverse ETF for months as a "hedge" almost always loses money, even if the market declines moderately.

Single-Sector or Thematic ETFs (Unless Intentional)

Funds like ARKK (innovation), HACK (cybersecurity), or JETS (airlines) track narrow indexes and introduce concentration risk. They're not inherently bad, but they're not diversified index funds - they're sector bets. Be honest about whether you're indexing or speculating.

High-Fee Index Funds in Old 401(k)s

Many employer 401(k) plans offer "index funds" with expense ratios of 0.50-1.00% - dramatically higher than retail options. A fund labeled "Large Cap Index Fund" with a 0.70% expense ratio is significantly worse than VTI at 0.03% despite tracking similar indexes. If your 401(k) has only expensive index options, prioritize contributing for the employer match, then direct additional savings to an IRA where you can access low-cost Vanguard/Fidelity/Schwab funds.

โš ๏ธ Warning: Beware of funds with wide bid-ask spreads - typically niche ETFs with thin trading volumes. When you buy or sell, the spread represents an instant loss. Always check the bid-ask before placing a market order on a small ETF. Use limit orders if the spread exceeds 0.05%.

Putting It All Together: A Simple Decision Framework

Apply the five criteria in this order when selecting index funds:

Following this framework leads most investors to one of three simple portfolios:

๐Ÿ’ก Tip: Three recommended portfolios based on goal and brokerage:
  • Simple US-only (Vanguard/Schwab/Fidelity): 90% VTI + 10% BND. Lowest complexity, very low cost, extremely diversified.
  • Global three-fund (any brokerage): 55% VTI + 35% VXUS + 10% BND. Owns the entire world at 0.04% blended expense ratio. Best long-run diversification.
  • Fidelity zero-cost (Fidelity only): 70% FZROX + 20% FZILX + 10% FXNAX. 0% blended expense ratio. Ideal if you're committed to Fidelity long-term.

None of these portfolios require stock picking, market timing, or economic forecasting. They require only consistent contributions, annual rebalancing, and the patience to ignore short-term noise. That combination - boring, low-cost, global diversification - has outperformed 92% of professional active managers over the past 15 years.

The best time to start was yesterday. The second best time is today. Pick a fund from the list above, open an account, and automate your contributions. The decision about whether to own VTI or VOO matters far less than the decision to start.

Related Articles & Tools

Why Index Funds Win

92% of active managers underperform index funds over 15 years. Here's the math behind why passive beats active.

Read Article
ETF vs Mutual Fund

ETFs and mutual funds can track the same index at the same cost - so why does the structure still matter? We break it down.

Read Article
The True Cost of Investment Fees

A 1% expense ratio sounds small. Over 30 years it costs you $149,000 on a $100,000 investment. See the full impact.

Read Article

Free Tools & Courses

Portfolio vs S&P 500

Backtest any combination of index funds against SPY with real 10-year historical data.

Open Tool โ†’
Investment Fee Analyzer

See exactly how much different expense ratios cost you over 10, 20, and 30 years.

Open Tool โ†’
Index Fund Fundamentals

A complete free course on index fund selection, portfolio construction, and long-term management.

Start Free โ†’