Lots of opinions and good advice here. I can only offer my experience, having owned both a C-Dory 22 and a 24' Tomcat.
The 22 Cruiser is a great boat. Light, efficient, and very versatile. The Tomcat, however, (in my opinion) is far more suited for offshore conditions- wind waves, swell, etc.
My crew consists of a 5 and 9 year old, my wife and I. Over the last 5 years we have made over 240 trips to catalina and visited every channel island, including San Nic, as well as the Tanner, Osborne, and 43 banks to fish for Tuna. While we loved our 22, and there is a soft spot in our hearts for our beloved CPelican, many of these voyages would simply not have been possible in that vessel due to weather conditions, fuel range, and the comfort of 4 people (especially two small kids).
Below is a video of the recent 10 day trip that we took to 4 different channel islands off of the southern California coast. Could you do the same trip in a 22' Cruiser? of course. I can say that the weather conditions between Santa Cruz and Santa Rosa were quite nautical (6' wind waves at 8 seconds and 20 knts of wind) )and I would have never made the run in our 22' on the days that we spent out there.
https://youtu.be/3-Kiu9BzfQ4
My advice is- get the best boat you can afford to buy and afford to use... and then use it. Get experience behind the helm in all kinds of conditions, respect the power of the sea, and never be too "macho" to call off a trip if the weather is up or makes a turn for the worse.
-TIm