Yep, you’re right on it. The continual outward push while exhaling helps you create a steady and consistent flow of air while singing, which is why we breathe from the diaphragm in the first place.
You can check out more ideas on breathing and singing on this page – Breathing and Singing
Hope that helps!
Ken Taylor