Just letting you know guys that someone helped me on another forum to get the drivers to install. Here's the answer, if it can help others :
DpInst Method
Basically using the DPInst.exe (provided in the Windows Drivers Kit )and DPInst.xml file i was able to call DPInst within the Specialize phase asking it to install all drivers from a specified drivers folder ex. C:\Drivers