This is actually a great compromise solution (and practical). I had the experience of being in a "gifted" class from third grade to sixth grade. It seemed to be a win-win situation where the school (and students) got the benefits of intellectual diversity but allowed kids to learn more at their own pace.