I'm well aware of the possibility of epigenetic inheritance, but you seem to have pulled your "one or two points" number out of a hat. This is not what research indicates.

There's a very obvious (to a human geneticist) type of experiment which would separate these things, and it's been done.