It can matter, but I don't think a poor job was done by any builder of these boats.
It's common for a boat design/type to be built by different manufacturers. There are differences when different manufacturers build the same boat design. Further, these boats are largely hand made in thet the glass work is laid by hand. This is different from a mass-produced product like a Bayliner. If Bayliner was sold, and their production facilities were conveyed, it's likely the new owner would make largely the same boat. In I believe all cases, production was moved to a different place each time the CDory line was sold. So there will be differences. They may be small, but there.
There are some specific differences in models of any given year, in terms of their setup that may be preferable to you. Up to you in that regard.
There is a current thread: "Does model year matter" that may get at some of your questions.