文档介绍：High Resolution Spectral Video Acquisition & Computational Photography (计算摄像学) Oct 29 th, 2015 School of Electronic Science & Engineering Nanjing University XunCao ******@nju. Computational Photography putationalimagingtechniques techniquesisanordinaryphotograph,hatcouldnothavebeentakenby atraditionalcamera.(Wikipedia) Computationalphotographyisanemergingnewfieldcreatedbytheconvergence putationaltechniquesto producearicher,morevivid,perhapsmoreperceptuallymeaningful representationofourvisualworld.(CMUCourseIntroduction) Spatial Temporal Spectral(Color) Dynamic Range SD<720p HD 1920*1080 Gigapixel UHD 3840*2160 2D Stereo Multiview Light Field Gray scale RGB Multispectral Hyperspectral 10Hz 30Hz 60Hz 8bit 10/12bit 24bit 120Hz CP from PlenopticPerspective Depth & View (3D) Computational Imaging Technology &Engineering ?Spectral Camera –High Resolution Spectral Video Camera: PMIS ?MultiviewStereo Camera Array –High Accuracy 3D Reconstruction ?Super-Resolution Camera –Nano-Scale Pixel Camera –Gigapixelon Single Chip The lab focuses on 3 kinds putational cameras Grayscale Imaging sensor light source scene () I???() R?() S??( ) ( ) K R S d ? ???? K Color Imaging light source scene sensor () I???() R?() S??( ) ( ) R R R S d ? ????( ) ( ) G G R S d ? ????( ) ( ) B B R S d ? ????,, R G B ( ) Spectral Imaging ? ? light source scene Imaging system () I???() R?() R?? Spectral Video Capture-Challenge Spatial(x,y) * Spectral(λ)* Temporal(t) 1second ≈ 2 TB Spatially varying filter Prof. Columbia Univ. ?Scanning or Filter (including Traditional Spectrometers) [Kidono07][Gat00][Yamaguchi06][Schechner02]… Color Filter Array Filter wheel Programmable Filter Filter Scanning Key idea: Trade time for spectrum ings: ?Incapable of capturing dynamic scenes ?Low spectrum resolution Related Work PAMI ’02 Our Spectral Video Camera -PMIS 2007~2010:Prism-Mask