According to the speaker, you don't need a lot of vacation rental properties to be successful. The key to success is finding a hidden gem in the market and learning to optimize the processes within the business. The speaker also mentions that it's important to be an expert on one property.