Journey towards progress to continue despite impediments by `Dharnas’: PM