I can't believe I just spent over half an hour changing my desktop wallpaper...
I had the wallpaper on a USB... It just wouldn't display properly.
Set it to "tiled", works fine.
"Center"... Still good.
The colour borks and it becomes worthless. This is what the wallpaper looks like, for those that are interested.
[NOTE - not the actual one that borked. This one borks