splashingpixels.com on "[Plugin: WooCommerce - excelling eCommerce] Woocommerce - Display multiple pages for one category"

HMmm by default it should show if you indeed have products to paginate. Try this and see what you get. Add this in your functions.php of your theme file.

remove_action( 'woocommerce_pagination', 'woocommerce_pagination', 10 );
add_action( 'woocommerce_pagination', 'woocommerce_pagination', 10);

function woocommerce_pagination() {
echo 'this is working';
}