The Ukrainian navy said it sunk the Russian ship Orsk on Thursday morning near the Ukrainian port city of Berdyansk.