"When babies die at a church school, it is time for us to move beyond thoughts and prayers," Senate Chaplain Barry Black said in his opening prayer.