According to the video, spending too much time scrolling on your phone is costing you money. When you scroll on your phone, you are not thinking for yourself and preventing yourself from doing something that could benefit you financially like exploring a business idea.