The numbers, coupled with the substantially larger economy of the north, do not suggest that this is likely, much less so obvious as to be "point blank period". Though black soldiers were about 10% of the Union army, and their contributions undoubtedly made a big difference (perhaps even bigger than their numbers would suggest), the outcome would ultimately likely have been similar.
We can acknowledge important contributions without pretending they were everything.