Is it permissible to swear by (Allah "The Living")?
Yes, it is permissible because "The Living" is one of Allah`s Attributes.
What should a praying person who doubts having offered one, or two prostrations in the third Rakah (unit of prayer) do?
Whoever has doubts about their prayer should consider what is less i.e. the above person should offer another Sajda (prostration) and complete his/her prayer, then offer Sujood As-Sahw (prostration of forgetfulness). And Allah Knows Best.
If the imam does not leave time for reciting Surah Al-Fatihah, is the recitation of Al-Fatihah waived for the follower?
The recitation of Al-Fatihah is not waived for the follower. They should recite it silently, even if it causes a slight delay in following the imam in bowing (Ruku'). And Allah Knows Best.
What is the ruling on staring at the Holy Ka'abah?
All perfecy praise be to Allah, The Lord of The Worlds and may His Peace and Blessings be upon our Prophet Muhammad and upon all of his family and companions.
Staring/looking at the Holy Ka'abah is an act of worship even if this took place while performing a prayer, since Al-Baihaqee stated that the Prophet (PBUH) said: " Staring at the Holy Ka'abah is an act of devotion." [Sho'aab Al-Imaan]. And Allah Knows Best.