I really cannot understand why you didn't want to use the CRT. What are you using as a memory manager, Windows' HeapAlloc? Also, why would you ever want to replace LoadLibrary? There is absolutely no benefit in doing that for your use case - you're loading kernel32.dll anyway, and as btcc22 mentioned, most system dlls don't physically get loaded into memory just for you (other processes are already using them).

By the way if you don't want to install the redistributable that Kornman linked to, and you're using msvc10+, then you can simply include the dlls along with your code.