Talking during Friday prayer`s sermon is disliked, but there is no harm in offering Istigfar between the two parts of the sermon, and it doesn`t invalidate the prayer as it is actually from Sunnah. And Allah Knows Best.