The speaker acknowledges the difficulty of customer service jobs due to increased customer expectations. He highlights that unpleasant customer experiences impact the employees' families, emphasizing the importance of understanding and gratitude when interacting with service industry staff.