Understanding the fundamental limit of performance optimization

Understanding the difference between doing multiple things at once vs. doing multiple things simultaneously