The speaker emphasizes that investing in properties is different from owning a primary residence, as rentals generate cash flow. He cautions against relying solely on primary residence appreciation for retirement, as historically, home prices only keep up with inflation.