천만개 이상의 많은 수의 file 을 NFS 서버를 이용해서 copy 하면 엄청나게 느린 문제가 있다. 단순히 파일 개수를 세는 작업도 엄청나게 느리다. ls 나 find 도 느리다.
Cause
The above problems happen mainly due to the NFS v4.0 limitation as described below. If the client uses NFS v4.0 to read and write a lot of files at the same time, the large number of OPEN/CLOSE requests in parallel may result in a bottleneck on the client because the OPEN/CLOSE operations are serialized in NFS v4.0.
https://www.tencentcloud.com/document/product/582/37491
Client Use Bottleneck due to Large Number of Small Files or Parallel Requests | Tencent Cloud
Background CFS supports both NFS v3.0 and NFS v4.0 (later version). NFS v3.0 is compatible with Windows clients while NFS v4.0 provides file locking and other features. Client Problem In cases that involve a large number of small files or mixed use of larg
www.tencentcloud.com
async, nfsvers=3 옵션을 줄 때 가장 빠르다.
https://www.linux.com/news/benchmarking-nfsv3-vs-nfsv4-file-operation-performance/
'컴퓨터 이야기~ > 소프트웨어' 카테고리의 다른 글
| AutoDerm 연구 (0) | 2023.03.19 |
|---|---|
| GPT-4 의 시험 성적 (0) | 2023.03.16 |
| Model Derm - Skin Lesion 개발 계획 (0) | 2022.01.02 |
| baytrail, 32bit EFI, ubuntu 설치 (0) | 2021.12.28 |
| Photoshop 6: Unable to continue because of a hardware or system error. (0) | 2020.12.27 |
