What is the difference between scaling out and scale sets? How would you decide on either?

"scale out" is a general term that describes a type of capacity expansion concentrating on the addition of new hardware resources instead of increasing the capacity of already available hardware resources.

Azure Scale Set is an Azure feature used to provide autoscaling (or "scaling out") VMs based on a recurring schedule or app performance.