Authorities will take tough action against public transport drivers and conductors using narcotics, implementing measures that include the cancellation of route permits and driving licences, Transport, Highways and Urban Development Minister Bimal Ratnayake said yesterday.