Check this thread
The conversation also extended into the NWMax Plus thread. Personally, I haven't compiled models in the past and have never had a problem running the game or my small LAN server. However, going forward (now that I know more about what was causing models NOT to compile correctly) I feel its the best practice to compile models. If a compiled model causes issues then the model should be fixed, not left for the ingame compiler to sort out.