Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
DICOM INTERNATIONAL CONFERENCE & SEMINAR Oct 9-11, 2010 Rio de Janeiro, Brazil Whole Slide Imaging in DICOM Harry Solomon GE Healthcare WSI Supplements • Two DICOM Supplements developed by WG-26 Anatomic Pathology • Supplement 145: Whole Slide Imaging – Adopted August 2010 • Supplement 122: Specimen Module – Adopted June 2008 The Whole Slide Problem • Need image resolution comparable to optical microscope • Need image access as rapid as microscope (pan, zoom, focus) Yukako Yagi – UPMC Digital slides are huge • Sample size ~ 20mm x 15mm • Resolution of .25 μm/pixel (40X objective) • 80,000 x 60,000 pixels = 4.8 Gp • 24-bit color = 14.4 GB / slide • 40:1 compression = only 360 MB / typical slide Unless • Larger specimen • Higher resolution (100X objective) • Multiple focal planes • Multi-spectral imaging (16-bit / band) And • A typical study may be 10 slides Sup 145 Tiling and Multi-frame encoding • Whole Slide Image divided into tiles • Each tile encoded into a frame of multi-frame image object • Per-frame header gives spatial location for each tile: X, Y, and Z (focal plane) Multi-frame image object Fixed Header Per-frame header Dimension data Pixel data Multiple focal planes Z-planes (focal planes) ↑ Z ↑ Z Cover slip Specimen Slide substrate (glass) • Z-planes are identified as nominal physical height of image focal plane above reference surface (μm) • Z-plane information is used for relative spatial positioning of image planes, and nominal interplane distance • An image plane may track variable specimen thickness / surface contour, but only one Zvalue used Z planes may track curved surface Z plane 1 Z plane 2 Z plane 3 Z plane 4 Tile 1 Tile 2 Tile 3 Tile 4 Tile 5 Tile 6 Tile 7 Tile 8 Viktor Sebestyén Varga – 3DHISTECH Ltd. Total Pixel Matrix Total Pixel Matrix Origin Columns → Rows Frame Pixel Matrix Origin • Total pixel matrix origin at top left hand corner of imaged volume • Frame (tile) rows and columns align with total pixel matrix rows and columns • Frames limited to 216 columns and rows each • Total pixel matrix limited to 232 columns and rows Total pixel matrix coordinates used for frame location and for annotation Sparse tiling • Slides may have substantial area with no specimen • Empty tiles may be absent from multi-frame image Access: Navigation and Zoom Need to rapidly access: • High resolution image of small areas – Facilitated by tilling • Low resolution image of whole slide – For overview and navigation • Intermediate resolutions – Smooth zooming Lower resolution images may be pre-computed • Hierarchical pyramid • May add ~ 33% to size of data Tiling and multi-frame at all hierarchical levels Single frame image Thumbnail Image Multi-frame image (single object) Intermediate Image Baseline Image Multi-frame image (single object) may include multiple Z-planes, color planes All image objects typically in 1 DICOM Series Localizer image “flavor” • Thumbnail image (single frame) plus navigation links to each frame at each resolution – Each tile of other resolution images has its corresponding area identified in thumbnail • Full description of target tiles – Object Unique ID and frame number – Resolution – Z-plane, color • Multiple target frames can overlap – Different resolution, Z-plane, color, etc. • Presentation and any interactive behavior is not defined in standard Optical paths Illumination Filters Lens Illumination Method Lens Filters Sensor • Each combination of light source, lenses, illumination method, detected wavelengths, etc. used in a scan is an optical path • Three primary mandatory attributes: • Illumination color or wavelength • Illumination method (e.g., transmission, epifluorescence , darkfield, differential interference contrast) • Detection color • Additional optional attributes for lenses, filters, prisms, etc. • Examples: • Full spectrum light, transmission, RGB color sensors • UV excitation, epifluorescence, 535 nm emission filter, monochrome sensor Multi-spectral imaging • Typical color image stored with RGB or YBR photometric interpretation 3 x 8-bit RGB – 3 color values / pixel • Multi-spectral image stored with MONOCHROME photometric interpretation – 1 color value / pixel / color plane – Multiple color planes – may be stored in single image object – Each frame references its optical path in per-frame header n x 16-bit multi-spectral Standard DICOM mechanisms for annotation of WSI • Color Presentation State – Displayed Area Selection relative to WSI total matrix – Graphic and text annotation with sub-pixel location resolution, even with 8M columns or rows • Segmentation – Can be created pixel-by-pixel against selected frames of original image – 1-bit/source-pixel, or 8-bits/source-pixel – Display of segmentation implicitly invokes blending with source image • Structured Reporting – Captures measurements, clinical observations, analyses, and findings • Real World Value Mapping – Specifies a mapping of the stored pixel values of images into some real world value in defined units – Allows quantitative methods with monochrome images (original or derived) Anatomic Pathology Imaging Workflow Interpretation Worklist by accession Pathology order Slide preparation Slide preparation history data LIS / APLIS Specimen accessioning data Modality Worklist Query by slide barcode Gross specimen accessioning Surgical or biopsy procedure Workstation Imaging task w/ slide preparation history data Imaging task completion w/ list of images and specimen IDs Whole Slide Scanner Images Images w/ slide prep history Images – X-ray, U/S, optical, etc. PACS Images Sup 122 Specimen Module • Support for pathology lab workflow, specimen-based imaging – Gross specimens, blocks, vials, slides – Image-guided biopsy samples • Specimen Module at image level of hierarchy – Identification, processing history (especially stains applied) • Modality Worklist can convey Specimen Module – Enables automated slide scanning devices to fully populate image header – Processing history can be used to set up acquisition (based on stain) • Modality Performed Procedure Step identifies imaged specimen – Allows LIS/APLIS to track images for specimens Specimen Imaging Information Model Patient 1 1 Basic DICOM Information Model Disambiguates specimen and container Is source of Has n Study Container is target of image n Container may have more than one specimen 1 Contains Specimens have a physical derivation (preparation) from parent specimens n Equipment 1 Modality n Creates Series 1 When more than one specimen in an imaged container, each specimen is distinguished (e.g., by position or color-coding) Contains n Image 1 Is acquired on 1 Component Base, Coverslip 1 n Has Container Box, Block, Slide, etc. 1 n Specimen Contains Physical object n Is child of 1 1 n Has Preparation Step Collect, Sample, Stain, Process Enabling Transformation to Digital Pathology • Supplements 145 and 122 establish the foundation for a true market for digital imaging in anatomic pathology – Comparable in importance to the introduction of DICOM to radiology in 1993 • Enables quantitation and collaboration • In the next 5-10 years, we should expect a profound transformation of pathology from a highly manual process to a digital workflow • The use of the DICOM Standard across radiology, pathology, surgery, and radiation therapy opens the door to truly integrated data from screening to biopsy to diagnosis to treatment