In Bird Box, why are all people not affected in the same fashion?

Malorie and Olympia are pregnant hence not affected at first.

There are some people driving without blindfolds, looking for children.

What does the plot have to do with children?