Just because smart people tend to have fewer children (because, for instance, they delay it due to schooling and career demands) doesn't mean genes for intelligence are necessarily being selected against.
There's several reasons why this might not be the case, including that our premise is simple heritability and not genetic determinism, which is a different concept. I get where you're coming from now though.