Do you trust WordPress enough to run an online shop on it ? There are many takers for WooCommerce, is that people being influenced by the WordPress popularity ?
I don't think there is any reason be worried if you are using WordPress and WooCommerce together. It is a very popular combination and is widely used across the world.
The combo is well maintained with timely bug fix and security updates.