The atoms in the negative side would be more stable with less electrons, the atoms in the positive side would be more stable with more electrons. When these terminals are set up in a way where the electrons can flow between them, the electrons do; this makes the system more stable. Energy is always conserved, so when the electrons flow and the system becomes more stable, energy is released.