So is a lipstick also not allowed during the month of Muharram or Safar?

Regardless of whether it is Muharram and Safar, if the lipstick color is such that it shows one has applied lipstick, it's use is haraam infront of Na Mahram.