Standards of Greatness
By Craig L. Israelsen
Reprinted from Financial Planning Magazine, July 2004
hat does it take to be a really great actively managed equity fund? By what margin must one beat the competition? Or is simply beating this-or-that benchmark index sufficient to claim superiority?
Pragmatically, performance superiority is both a relative standard and an absolute standard. Greatness is relative in the sense that an actively managed fund must beat its peers (a group of relatively similar actively managed funds) to have a legitimate claim to greatness. Greatness is absolute in the sense that benchmark indexes have essentially been canonized and thus represent an absolute standard against which all other funds are measured.
This article provides some "parameters" for carrying out such relative and absolute comparisons among actively managed U.S. equity mutual funds over the five year period from 1999-2003. The data for this study were gleaned from Morningstar Principia. Index funds were excluded as were redundant portfolios. Thus, the funds being analyzed were distinct (i.e. only one share class included from multiple share class funds) U.S. equity funds which had at least 12 months of performance at the end of each of the five years being analyzed.
Survivor bias and style drift from year to year were eliminated from this data set. This was accomplished by extracting the needed data from each year-end version of Principia for the five year period being studied rather than extracting 5 years worth of data from the 12/31/2003 release of Principia. Five providers of U.S. equity indexes were utilized in this study, namely Barra, Dow Jones, Morningstar, Russell, and Wilshire.
This study utilized two research methodologies worth briefly noting. First, benchmark index returns (used in absolute comparisons) were presented as an average of five indexes, rather than using the return of just one index. There is too much variance among U.S. equity indexes to rely upon one index as being representative of any particular market cap and style sector. It is my opinion that the industry would be well served by averaging the performance of several indexes for purposes of benchmarking, rather than relying upon the performance of a single index.
Secondly, the 75th percentile five year annualized return (as will be seen in Figures 1 and 2) that was calculated from each year's 75th percentile annual return is a novel approach. This five year annualized return (used in relative comparisons) is "theoretical" in the sense that it was not achieved by one fund in particular, but rather is representative of the best results (top quartile) from each year's cap/style-specific funds (regardless of whether or each year's best funds survived the entire five year period). This technique establishes a level of performance that creates a very demanding "relative comparison" standard.
Let's start first with U.S. equity value funds in Figure 1. The performance parameters for a relative comparison are highlighted in blue and include average return in each of the five years, the annual 50th percentile return (or median return), and the annual 75th percentile return. Averaged index returns represent the parameters for an absolute performance comparison and are highlighted in purple.
For example, the 50th percentile return (i.e. median return) in 1999 for large cap value (LV) funds was 6.1%. The median return indicates that half of the 230 funds had a return equal to or higher than 6.1% and half of the funds had a one year return lower than 6.1%. Finally, 25% of the LV funds (or the 75th percentile) had a return equal to or higher than 12.2% during 1999. The same information is provided for midcap value funds and small cap value funds. Figure 2 includes comparable data for growth funds.
The last column in Figures 1 and 2 is the five year annualized return for each array of annual returns and represents a compact comparison figure when conducting relative comparisons among actively managed funds. The choice of which figure to use (average return, median return, or 75th percentile return) is a function of how stringent you want the comparison to be. Generally speaking, average return and median return are fairly similar (with the possible exception of small cap funds). Using the five year annualized 75th percentile return creates a very demanding relative comparison standard. For example, only 18 LV funds had a return in excess of the 5 year annualized 75th percentile return of 6.7%, whereas 118 funds exceeded the raw average return of 2.7%.
In each of the five years, the 75th percentile return for LV funds was higher than the average return of the five indexes. Simply put, using the 75th percentile return as the comparison figure provided a more demanding test than using the average return of the five indexes. In fact, even using the median return for LV funds (2.6%) was more stringent than the five LV index five year average return of 2.2%. Over this particular five year period, relative performance was a stricter judge of greatness among LV funds than was an absolute comparison against the average return of LV indexes.
In the midcap value category, the average return of the five indexes exceeded the 75th percentile return in two years (2000 and 2003) suggesting that absolute comparisons of actively managed MV funds against MV indexes is a reasonable measure of greatness. However, as the five year 75th percentile return of 15.2% exceeded the five year average index return of 10.2% it is clear that a relative comparison using the top quartile of funds is an even stricter standard.
Among small cap value funds, the most demanding comparison is a relative one utilizing the five year 75th percentile return. An absolute comparison against the average return of the five indexes (12.3%) was comparable to a relative comparison using the median (or 50th percentile) five year return of 12.1%.
Among growth funds (large, mid, and small) the most demanding comparison to reveal great funds was, by far, a relative one in which the 75th percentile return was utilized. In fact, a relative comparison using the 50th percentile return was even more stringent than an absolute comparison against the indexes among large cap and small cap growth funds.
This analysis suggests that relative comparisons among actively managed equity funds may be more effective in identifying great funds than absolute comparisons against index benchmarks.
Figure 1. Value Funds
|
Large Cap Value
|
1999
|
2000
|
2001
|
2002
|
2003
|
5 Year
Ave. Annual % Return
|
|
Number of Actively Managed Funds
|
230
|
260
|
263
|
251
|
281
|
|
|
Average Return (%)
|
6.8
|
6.8
|
-4.1
|
-18.7
|
28.6
|
2.7
|
|
50th Percentile Return (median)
|
6.1
|
7.1
|
-4.7
|
-18.2
|
28.1
|
2.6
|
|
75th Percentile Return
|
12.2
|
11.8
|
-0.5
|
-15.5
|
31.2
|
6.7
|
|
Ave. Return of 5 LV Indexes (%)
(Barra LV, Dow Jones LV, Morningstar LV, Russell 1000
Value, Wilshire LV)
|
6.1
|
6.0
|
-7.0
|
-17.4
|
29.1
|
2.2
|
|
MidCap Value
|
1999
|
2000
|
2001
|
2002
|
2003
|
5 Year
Ave. Annual % Return
|
|
Number of Actively Managed Funds
|
107
|
79
|
77
|
63
|
66
|
|
|
Average Return (%)
|
7.9
|
17.1
|
6.4
|
-12.2
|
35.4
|
9.8
|
|
50th Percentile Return (median)
|
7.6
|
15.5
|
6.1
|
-12.6
|
34.0
|
9.1
|
|
75th Percentile Return
|
14.9
|
24.3
|
12.4
|
-8.9
|
38.7
|
15.2
|
|
Ave. Return of 5 MV Indexes (%)
(Barra MV, Dow Jones MV, Morningstar MV, Russell MV,
Wilshire MV)
|
-2.4
|
25.3
|
5.7
|
-9.7
|
39.5
|
10.2
|
|
Small Cap Value
|
1999
|
2000
|
2001
|
2002
|
2003
|
5 Year
Ave. Annual % Return
|
|
Number of Actively Managed Funds
|
115
|
82
|
64
|
57
|
62
|
|
|
Average Return (%)
|
4.3
|
14.1
|
20.9
|
-9.5
|
44.9
|
13.5
|
|
50th Percentile Return (median)
|
1.4
|
15.1
|
18.6
|
-9.6
|
41.7
|
12.1
|
|
75th Percentile Return
|
9.9
|
21.4
|
27.5
|
-4.4
|
49.9
|
19.5
|
|
Ave. Return of 5 SV Indexes (%)
(Barra SV, Dow Jones SV, Morningstar SV, Russell 2000
Value, Wilshire SV)
|
-2.0
|
21.9
|
13.7
|
-10.0
|
45.9
|
12.3
|
Figure 2. Growth Funds
|
Large Cap Growth
|
1999
|
2000
|
2001
|
2002
|
2003
|
5 Year
Ave. Annual % Return
|
|
Number of Actively Managed Funds
|
183
|
267
|
289
|
389
|
410
|
|
|
Average Return (%)
|
47.3
|
-14.1
|
-23.7
|
-28.2
|
28.7
|
-2.3
|
|
50th Percentile Return (median)
|
39.4
|
-15.0
|
-23.0
|
-28.3
|
27.2
|
-3.6
|
|
75th Percentile Return
|
55.5
|
-7.9
|
-16.9
|
-24.4
|
31.7
|
3.5
|
|
Ave. Return of 5 LG Indexes (%)
(Barra LG, Dow Jones LG, Morningstar LG, Russell 1000 Growth,
Wilshire LG)
|
35.0
|
-27.1
|
-21.6
|
-28.2
|
28.2
|
-6.6
|
|
MidCap Growth
|
1999
|
2000
|
2001
|
2002
|
2003
|
5 Year
Ave. Annual % Return
|
|
Number of Actively Managed Funds
|
134
|
165
|
193
|
217
|
238
|
|
|
Average Return (%)
|
63.8
|
-5.8
|
-22.2
|
-27.5
|
36.8
|
3.6
|
|
50th Percentile Return (median)
|
58.1
|
-6.1
|
-22.4
|
-27.7
|
36.5
|
2.6
|
|
75th Percentile Return
|
83.2
|
6.3
|
-12.7
|
-22.1
|
41.7
|
13.4
|
|
Ave. Return of 5 MG Indexes (%)
(Barra MG, Dow Jones MG, Morningstar MG, Russell MG,
Wilshire MG)
|
52.4
|
-9.7
|
-16.0
|
-27.1
|
39.3
|
3.3
|
|
Small Cap Growth
|
1999
|
2000
|
2001
|
2002
|
2003
|
5 Year
Ave. Annual % Return
|
|
Number of Actively Managed Funds
|
143
|
155
|
182
|
225
|
216
|
|
|
Average Return (%)
|
64.6
|
-4.6
|
-8.6
|
-28.8
|
46.6
|
8.4
|
|
50th Percentile Return (median)
|
51.8
|
-7.6
|
-12.2
|
-28.2
|
44.4
|
5.0
|
|
75th Percentile Return
|
84.5
|
6.2
|
0.5
|
-22.7
|
50.8
|
18.1
|
|
Ave. Return of 5 SG Indexes (%)
(Barra SG, Dow Jones SG, Morningstar SG, Russell 2000 Growth,
Wilshire SG)
|
44.7
|
-14.7
|
-9.2
|
-30.1
|
46.2
|
2.7
|
|