Копирование при записи: эффективная техника дублирования данных

Programming technique for efficiently duplicating data

Copy on write (COW), sometimes referred to as implicit sharing or shadowing, is a resource management technique used in computer programming to efficiently implement a "duplicate" or "copy" operation on modifiable resources (most commonly memory pages, storage sectors, files, and data structures).

Copy on write finds its main use in operating systems, sharing the physical memory of computers running multiple processes, in the implementation of the fork system call. Typically, the new process does not modify any memory and immediately executes a new process, replacing the address space entirely. It would waste processor time and memory to copy all of the old process's memory during the fork only to immediately discard the copy. Copy on write can be implemented efficiently using the page table by marking certain pages of memory as read only and keeping a count of the number of references to the page. When data is written to these pages, the operating system kernel intercepts the write attempt and allocates a new physical page, initialized with the copy on write data, although the allocation can be skipped if there is only one reference. The kernel then updates the page table with the new (writable) page, decrements the number of references, and performs the write. The new allocation ensures that a change in the memory of one process is not visible in another's. The copy on write technique can be extended to support efficient memory allocation by keeping one page of physical memory filled with zeros. When the memory is allocated, all the pages returned refer to the page of zeros and are all marked copy on write. This way, physical memory is not allocated for the process until data is written, allowing processes to reserve more virtual memory than physical memory and use memory sparsely, at the risk of running out of virtual address space. The combined algorithm is similar to demand paging.

COW is also used in library, application, and system code.

COW may also be used as the underlying mechanism for snapshots, such as those provided by logical volume management, file systems such as Btrfs, ZFS, ReFS and Bcachefs, and database servers such as Microsoft SQL Server. Typically, the snapshots store only the modified data, and are stored close to the original, so they are only a weak form of incremental backup and cannot substitute for a full backup.