I had a similar problem, mine had been fitted with blue tinged lamps, on dark wet winter nights they were awful, I replaced them with Osram lamps with 5500k colour (which I believe is the original colour spec) this solved the problem. Lamps cost around £60 for the pair.
edit: sorry I misunderstood the original question, 🙄
You can buy cleaning kits to remove the yellow from the headlights, I have heard polishing with toothpaste works but never tried either myself.