Different issues can arise when running DVC on Microsoft Windows, mainly involving system performance. Some, for example, have to do with NTFS file system characteristics and Windows built-in security mechanisms. Below are some workarounds that can help avoid these potential problems:
Did you know that DVC is available for Microsoft Visual Studio Code? More details here!
The regular Command Prompt (
cmd) in Windows will most likely not help you use
DVC effectively, or follow the examples in our docs. Please avoid it. There's no
perfect solution, but here are some ideas:
\line continuation). It has good performance (and can even access GPUs).
Symlinks are one of the possible file link types that DVC can use for
purposes. They're available on Windows, but the Create symbolic links user
privilege is needed. It's granted to the Administrators group by default, so
dvc in an admin terminal is a good option for occasional usage. For
regular users, it can be granted using the Local policy settings.
Windows 10 includes the Windows Security antivirus. If user wants to avoid antivirus scans on specific folders or files to improve the performance, then whitelist them in Windows Security as per this guide. For example, we can whitelist DVC binary files on Windows to speed up the processes.
dvc pull may fail in some cases when the folder path is longer than 260
characters. In the Windows API, the maximum allowed length for a path is 260
characters. If required, the user can explicitly enable long paths by following
With NTFS, users may want to disable
8dot3 as per
to disable the short-file name generation. It is important to do so for better
performance when the user has over 300K files in a single directory.
The performance of NTFS degrades while handling large volumes of files in a directory, as explained in this issue.
By default, DVC tries to use Less
as pager for the output of
dvc dag. Windows doesn't have the
available however. Fortunately, there is a easy way of installing it via
Chocolatey (please install the tool first):
$ choco install less
less can be installed in other ways, just make sure it's available in the
command line environment where you run
dvc. (This usually means adding the
less is installed to the
PATH environment variable.)