Maximizing the DICOM Standard for Digital Pathology Routing, Ingesting, and Storing
A Dicom Systems and Pure Storage White Paper
Dicom Systems and Pure Storage conducted testing focused on the routing functionality of the Dicom Systems Unifier platform and the management of the digitized pathology DICOM slides on Pure Storage. We also measured the Ingest performance of WSIs writing to Pure Storage to measure data storage’s impact. In the testing, we measured throughput, slide transmission count, and latency, broken into WSI routing and ingestion. The industry average size of a digital pathology slide, 1.3 GB, was used for this whitepaper to calculate results. It is important to note that in some cases, like radical prostatectomies, an uncompressed 20x WSI can require nearly 30 GB of storage. At the recommended 40x magnification, the same file size can increase to 100 GB.
Appendix A
Hardware Specifications
Hardware description:
| Sender 1 VMware ESXi, 7.0.3, 21930508 Intel(R) Xeon(R) CPU E7-8890 v4, 2.20GHz 16 CPUs 64 GB RAM 10 Gb/s network cards Disks: X90R3 FlashArray (SAN) | Sender 2 VMware ESXi, 7.0.3, 21930508 Intel(R) Xeon(R) CPU E7-8890 v4, 2.20GHz 16 CPUs 64 GB RAM 10 Gb/s network cards Disks: X90R3 FlashArray (SAN) |
Router / VNA Server | Sender 3 / Black hole receiver |
All VMs are located on the same hypervisor HW, separating the main router on one NUMA node from the other VMs located on the other NUMA node. For reference, the version of the Unifier is 4.0.33-12.el8.
Speed of Storage Platform
X90R3 FlashArray (SAN)
Max linear writing speed is 839 MB/s, and linear reading speed is 1131 MB/s. The writing speed can differ slightly, as local caching affects the process.
NFS-based disk 1. Purity FA C60, NFS 3.X; FC 16 Gb/s. TCP 25 GB/
Max linear writing speed is 1074 MB/s, and linear reading speed is 116 MB/s. The writing speed can differ slightly, as local caching affects the process.
NFS-based disk 2. Purity FA X90R3, NFS 3.X; FC 32 GB/s. TCP 100 GB/s
Max linear writing speed is 820 MB/s, and linear reading speed is 110 MB/s. The writing speed can differ slightly, as local caching affects the process.
Speed of Network:
Max network performance is 16,5 Gbit/s or ~2 GB/s.
Speed of RAM
Writing speed 11 GB/s. Reading speed 18 GB/s
Writing Speed:
Reading Speed:
Appendix B
Further information about Test 1.1
Statistics from the Pure Storage backend:
Unifier Platform DICOM Routing General Page Statistics:
Unifier Platform DICOM Routing Function Average speed:
Unifier Platform DICOM Routing Function Storage Utilization:
Unifier Platform DICOM Routing Function Network Utilization:
Unifier DICOM Routing Function CPU Utilization:
Unifier Platform DICOM Routing Function RAM Consumption:
Unifier Platform DICOM Routing Function Storage Consumption:
Unifier Platform DICOM Routing Function HTOP Statistics:
Unifier Platform DICOM Routing Function ATOP Statistics:
Unifier Platform DICOM Routing Function Glances:
Appendix C
Further information about Test 1.2
Statistics from the Pure Storage backend:
Unifier Platform DICOM Routing Function General Statistics:
Unifier Platform DICOM Routing Function Average Speed:
Unifier Platform DICOM Routing Function Storage Consumption:
Unifier Platform DICOM routing function storage utilization:
Unifier Platform DICOM routing function network utilization:
Unifier Platform DICOM routing function CPU utilization:
Unifier Platform DICOM Routing Function HTOP Statistics:
Unifier Platform DICOM Routing Function ATOP Statistics:
Unifier Platform DICOM Routing Function Glances:
Appendix D
Further information about Test 1.3
Statistics from the Pure Storage backend:
Unifier Platform DICOM Routing Function General Statistics:
Unifier Platform DICOM Routing Function Average Speed:
Speed variation in stats is due to tuning the senders’ script for better performance.
Unifier Platform DICOM Routing Function Storage Utilization:
Unifier Platform DICOM Routing Function Network Utilization:
Unifier Platform DICOM Routing Function CPU Utilization:
Unifier Platform DICOM Routing Function RAM Consumption:
Unifier Platform DICOM Routing Function Storage Consumption:
Unifier Platform DICOM Routing Function HTOP Statistics:
Unifier Platform DICOM Routing Function ATOP Statistics:
Unifier Platform DICOM Routing Function Glances:
Appendix E
Further information about Test 2.1
Details:
Statistics from the Storage backend. NFS-based storage:
Unifier Platform DICOM Ingest General Page Statistics:
Unifier Platform DICOM Ingest Average Speed:
Unifier Platform DICOM Ingest Storage Utilization:
Unifier Platform DICOM Ingest Network Utilization:
Unifier DICOM Ingest CPU Utilization:
Unifier Platform DICOM Ingest RAM Consumption:
Unifier Platform DICOM Ingest Storage Consumption:
Unifier Platform DICOM Ingest HTOP Statistics:
Unifier Platform DICOM Ingest ATOP Statistics:
Unifier Platform DICOM Ingest Glances:
Appendix F
Further information about Test 2.2
Details:
Statistics from the Storage backend. NFS-based storage:
Unifier Platform DICOM Ingest General Page Statistics:
Unifier Platform DICOM Ingest Average Speed:
Unifier Platform DICOM Ingest Storage Utilization:
Unifier Platform DICOM Ingest Network Utilization:
Unifier DICOM Ingest CPU Utilization:
Unifier Platform DICOM Ingest RAM Consumption:
Unifier Platform DICOM Ingest Storage Consumption:
Unifier Platform DICOM Ingest HTOP Statistics:
Unifier Platform DICOM Ingest ATOP Statistics:
Unifier Platform DICOM Ingest Glances:
Appendix G
Further information about Test 2.3
Details:
Statistics from the Storage backend. NFS-based storage:
Unifier Platform DICOM Ingest General Page Statistics:
Unifier Platform DICOM Ingest Average Speed:
Unifier Platform DICOM Ingest Storage Utilization:
Unifier Platform DICOM Ingest Network Utilization:
Unifier DICOM Ingest CPU Utilization:
Unifier Platform DICOM Ingest RAM Consumption:
Unifier Platform DICOM Ingest Storage Consumption:
Unifier Platform DICOM Ingest HTOP Statistics:
Unifier Platform DICOM Ingest ATOP Statistics:
Unifier Platform DICOM Ingest Glances:
