July 26, 2017, Wednesday, 206

From Image Media Laboratory

Jump to: navigation, search

Contents

Currently Active Projects (2017년 7월 현재)

   Computational Image Reconstruction on 4D Light Field

    (2016.06 ~ 2019.05)

  • We will address the problem of computational image reconstruction (deblurring, layer separation, superresolution, dehazing, etc) on 4D light fields.
  • Funded by National Research Foundation (미래창조과학부 중견연구자지원사업)



   On-Device Intelligent SW Platform

    (2017.03 ~ 2021.12)

  • Environment recognition and modeling using 3D stereo reconstruction and shape from motion on mobile GPU
  • Funded by Institute for Information & communications Technology Promotion (IITP) (미래창조과학부 정보통신·방송연구개발사업)



   Image-Based Human Modeling for Augmented Reality

    (2017.03 ~ 2018.08)



  • Image-based face, body, hair modeling for AR and VR
  • Funded by CoAsia Korea






Completed Projects (2004.3~2017.6)

   Mobile Augmented Reality

    (2016.07 ~ 2017.06)



  • Video augmented reality (AR) based on RGBD visual SLAM
  • Funded by SK Telecom



   Light Field Image Acquisition, Processing, and Understanding

    (2013.12 ~ 2016.11)

  • A fusion research which integrates adaptive computational imaging and multidimensional image processing/understanding
  • We will develop a new type of image acquisition and processing/understanding algorithms which overcome the limitation of conventional imaging
  • Funded by National Research Foundation (미래창조과학부 중견연구자지원사업)


  • Williem, Ki Won Shon, and In Kyu Park (corresponding author), "Spatio-angular consistent editing framework for 4D light field images," Multimedia Tools and Applications, vol. 75, no. 23, pp. 16615–16631, December 2016. LINK
  • Williem and In Kyu Park, "Robust light field depth estimation for noisy scene with occlusion," Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016), pp. 4396-4404, June 2016. PDF Poster
  • Williem, Ramesh Raskar, and In Kyu Park, "Depth map estimation and colorization of anaglyph images using local color prior and reverse intensity distribution," Proc. IEEE International Conference on Computer Vision (ICCV 2015), pp. 3460-3468, December 2015. PDF Poster



Image:AJin.jpg

   3D Scene Reconstruction Using Car Blackbox Images

   (2013.9 ~ 2016.8)

  • 3D scene reconstruction using car blackbox images for analyzing car accident
  • Funded by The Ministry of Science, ICT and Future Planning (미래창조과학부 디지털콘텐츠원천기술개발사업)


  • Man Hee Lee and In Kyu Park (corresponding author), "Blur invariant feature descriptor using multidirectional integral projection," ETRI Journal, vol. 38, no. 3, pp. 502-509, June 2016. PDF
  • Man Hee Lee, Minsu Cho, and In Kyu Park (corresponding author), "Feature description using local neighborhoods," Pattern Recognition Letters, vol. 68, pp. 76-82, December 2015.
  • Christian Simon and In Kyu Park, "Video tonal stabilization with automatic multiple anchor frames," Proc. The 18th IEEE International Symposium on Consumer Electronics (ISCE 2014), pp. 11-12, June 2014. [Best paper prize] PDF
  • Christian Simon and In Kyu Park, "Reflection removal for in-vehicle black box videos," Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2015), pp. 4231-4239, June 2015. PDF Ext. Abstract Poster



   Mobile CPU-GPU Fusion Processor

   (2012.6 ~ 2015.5)

  • Developing image processing framework on handheld GPU using OpenGL ES
  • Funded by The Ministry of Knowledge Economy (지식경제부 산업융합원천기술개발사업)


  • 강승헌, 이승재, 이만희, 박인규, "OpenCL 및 Embedded GPU를 이용한 영상 특징 추출 및 파노라마 영상 생성의 병렬화," 방송공학회 논문지, vol. 19, no.3, pp. 316-328, 2014년 5월. PDF
  • 이종환, 강승헌, 이만희, 이성철, 김학일, 박인규, "모바일 GPU를 이용한 실시간 병렬영상처리 라이브러리," 정보과학회논문지: 컴퓨팅의 실제 및 레터, vol. 20, no. 2, pp. 96-100, 2014년 2월. PDF




   GPU Parallel Energy Minimization on Massive Graphical Models

    (2012.5 ~ 2015.4)

  • Global optimization using graph cuts using massive GPU parallel computing and its application to 3D TV (stereo images)
  • Funded by National Research Foundation (교육과학기술부 일반연구자지원사업)
  • Williem, Ramesh Raskar, and In Kyu Park, "Depth map estimation and colorization of anaglyph images using local color prior and reverse intensity distribution," Proc. IEEE International Conference on Computer Vision (ICCV 2015), December 2015. PDF
  • Williem, Yu-Wing Tai, and In Kyu Park (corresponding author), "Accurate and real-time depth video acquisition using Kinect-stereo camera fusion," Optical Engineering, vol. 53, no. 4, 043110, April 2014. PDF
  • Young-kyu Choi and In Kyu Park, "Efficient GPU-based graph cuts for stereo matching," Proc. Ninth IEEE Embedded Vision Workshop (EVW2013 in conjunction with CVPR2013), June 2013. PDF
  • Young-kyu Choi, Williem, and In Kyu Park, “Memory-efficient belief propagation in stereo matching on GPU,” Proc. APSIPA Annual Summit and Conference, December 2012. PDF



   Low-Power Superresolution on Embedded GPU

    (2013.07 ~ 2014.07)


  • Funded by LG Electronics (LG전자)



   Image Quality Enhancement for Smartphone

    (2013.5 ~ 2013.10)


  • Developing fast and robust image processing algorithms for Galaxy S and Galaxy Note series
  • Funded by Samsung Electronics (삼성전자)
  • Christian Simon, Williem, and In Kyu Park (corresponding author), "Correcting geometric and photometric distortion of document images on a smartphone," Journal of Electronic Imaging, vol. 24, no. 1, 013038, January 2015. PDF




   Content-Based 3D Model Retrieval in Mobile Environment

   (2012.10 ~ 2013.6)

  • Developing 3D shape retrieval algorithm using noisy and partial 3D depth image
  • Funded by The Ministry of Knowledge Economy (지식경제부) and NHN Corporation
  • Min Soo Bae and In Kyu Park (corresponding author), "Content-based 3D model retrieval using a single depth image from a low-cost 3D camera," The Visual Computer, vol. 29, no. 6-8 (CGI 2013 special issue, 16.4% acceptance ratio), pp. 555-564, June 2013. PDF



   Real-Time Feature Extraction and Tracking on the GPU

    (2012.5~2012.8)























  • Real time SURF feature extraction and tracking (for shape from motion) using CUDA on the GPU
  • Funded by Electronics and Telecommunication Research Institute (ETRI)
  • 이만희, 박인규,"GPU를 활용한 특징 검출 및 추적의 가속화," 제25회 영상처리 및 이해에 관한 워크샵 논문집, 2013년 2월.



Image:LGElectronics.jpg

   Media Retargeting for Stereoscopic Video

   (2011.10 ~ 2012.8)


  • Developing content-adaptive image resizing algorithm for stereoscopic images and videos
  • Funded by The Ministry of Knowledge Economy (지식경제부) and LG Electronics (LG전자)
  • Jin Woo Yoo, Sehoon Yea, and In Kyu Park (corresponding author), "Content-driven retargeting of stereoscopic images," IEEE Signal Processing Letters, vol. 20, no. 5, pp. 519-522, May 2013. PDF



   Multiview Inverse Motion Photography

    (2009.5 ~ 2012.6)

  • Multiview motion deblurring and its application to 3D reconstruction
  • Funded by National Research Foundation (교육과학기술부 기초연구과제)
  • Hanyu Hong and In Kyu Park (corresponding author), "Single image motion deblurring using adaptive anisotropic regularization," Optical Engineering, vol. 49, no. 9, 097008, September 2010. PDF
  • 최호열, 박인규, "3차원 형상 복원을 위한 다중시점 영상 디블러링," 전자공학회 논문지, vol. 49, no. 11, pp. 47-55, 2012년 11월. PDF



   Video Summarization and 3D Effect for Smartphone

    (2011.4 ~ 2012.1)

























  • Developing video summarizatioin and 3D transition algorithms for brand-new Galaxy S and Galaxy Tab
  • Funded by Samsung Electronics (삼성전자)
  • 이원범, 윌리엄, 박인규, "스마트폰에서의 시공간적 중요도 기반의 비디오 요약," 방송공학회 논문지, vol. 18, no.2, pp. 185-195, 2013년 3월. PDF



   Realistic Broadcasting Research Center

    (2009.1~2011.12)



  • 3D video acquisition, transmission, and rendering
  • Funded by The Ministry of Knowledge Economy (대학IT연구센터(ITRC))
  • In Kyu Park, Nitin Singhal, Man Hee Lee, Sungdae Cho, and Chris W. Kim, "Design and performance evaluation of image processing algorithms on GPUs," IEEE Trans. on Parallel and Distributed Systems, vol. 22, no. 1, pp. 91-104, January 2011. PDF



   High Dynamic Range Video

   (2008.9 ~ 2011.8)

  





















  • Interdisciplinary research of image processing, vision, communication technologies for acquisition and processing of high dynamic range video
  • Funded by Korea Science and Engineering Foundation (한국연구재단 특정기초연구지원사업)
  • 박태장, 박인규, "두 장의 LDR 영상을 이용한 HDR 영상 취득 기법," 방송공학회 논문지, vol. 16, no.2, pp. 247-257, 2011년 3월. PDF
  • Tae Jang Park and In Kyu Park (corresponding author), "HDR image acquisition using multiple images with different aperture," Optical Engineering, vol. 51, no. 12, 127002, December 2012. PDF




   Machine Vision Inspection Using GPU Parallel Computing

    (2011.04 ~ 2011.8)


  • Parallelizing LCD panel inspection algorithm on the GPU
  • Funded by LG Electronics (LG전자)
  • 최호열, 박인규, 김일목, 김성훈, "GPU기반 블록 정합의 단계적 최적화," 제24회 신호처리합동학술대회 논문집, 2011년 9월. PDF



   3D Shape Acquisition on a Smartphone

   (2010.12 ~ 2011.7)


  


















  • Developing photometric stereo algorithm using mobile phone's camera and flash
  • Funded by The Ministry of Knowledge Economy (지식경제부) and Samsung Electronics (삼성전자)
  • Jae Hyun Won, Man Hee Lee, and In Kyu Park, "Active 3D shape acquisition using smartphones," Proc. Ninth IEEE International Workshop on Projector–Camera Systems (PROCAMS2012 in conjunction with CVPR2012), pp. 29-34, June 2012. PDF



   Accelerating Computer Vision Algorithms on Handheld GPU

    (2010.7 ~ 2010.12)

 















  • Developing stereo matching and feature detection algorithms on PowerVR SGX 540 for Samsung Galaxy S
  • Funded by Samsung Electronics (삼성전자)
  • Nitin Singhal, Jin Woo Yoo, Ho Yeol Choi, and In Kyu Park (corresponding author), "Implementation and optimization of image processing algorithms on embedded GPU," IEICE Transactions on Information and Systems, vol. E95-D, no. 5, pp. 1475-1484, May 2012. PDF



   Automatic 3D face modeling on a smartphone

    (2010.4 ~ 2010.11)


left]

  • Developing 3D face modeling algorithm using 2 views captured by and processed on a Samsung's Bada smartphone
  • Funded by Samsung Electronics (삼성전자)
  • Won Beom Lee, Man Hee Lee, and In Kyu Park, "Photorealistic 3D face modeling on a smartphone," Proc. Seventh IEEE Workshop on Embedded Computer Vision (ECVW2011 in conjunction with CVPR2011), pp. 163-168, June 2011. PDF



   3D Shape Reconstruction by Multi-View Stereo (MVS)

    (2008.9~2010.2)















  • Multiresolution volumetric/surfel modeling and rending using multiple views on the GPU
  • Funded by Ministry of Culture, Sports and Tourism (IT 원천기술개발사업)
  • Ju Yong Chang, Haesol Park, In Kyu Park (corresponding author), Kyoung Mu Lee, and Sang Uk Lee, "GPU-friendly multi-view stereo reconstruction using surfel representation and graph cuts," Computer Vision and Image Understanding, vo. 115, no. 5, pp. 620-634, May 2011. PDF



   Computational Photography (Mobile Photo Collage)

   (2009.5~2009.11)


















  • Automatic collage generation on the mobile handset (Samsung Omnia II)
  • Funded by Samsung Electronics (삼성전자)
  • Man Hee Lee, Nitin Singhal, Sungdae Cho, and In Kyu Park, "Mobile photo collage," Proc. Sixth IEEE Workshop on Embedded Computer Vision (ECVW2010 in conjunction with CVPR2010), June 2010. [Best paper prize] PDF
  • Available in Tstore



   Computational Motion Photography

   (2008.7~2009.6)

  • Interactive motion depiction using efficient user interface
  • Funded by Korean Research Foundation (학술진흥재단 신진교수연구과제)
  • Okihide Teramoto, In Kyu Park (corresponding author), and Takeo Igarashi, "Interactive motion photography from a single image," The Visual Computer, vol. 26, no. 11, pp. 1339-1348, November 2010. PDF
  • Android mobile version is available at Tstore



   3D Pose Estimation on the GPU

   (2007.1~2008.2)

  • Jointly Funded by Inha University, Korea Research Foundation (학술진흥재단 국제공동연구지원), and Mitsubishi Electric Research Laboratories (MERL)
  • Performed during 1-year visiting research at MERL
  • In Kyu Park, Marcel Germann, Michael D. Breitenstein, and Hanspeter Pfister, "Fast and automatic object pose estimation for range images on the GPU," Machine Vision and Applications, vol. 21, no. 5, pp. 749-766, August 2010. PDF



   Digital actor and 3-D avatar creation

    (2005.5~2007.4)


Image:Avatar.jpg

  • Automatic and UI-assisted parametric 3-D face modeling and animation
  • Funded by Korean Ministry of Commerce, Industry, and Energy (산업자원부 지역산업 기술혁신사업)
  • Chang Yeop Kim, Man Hee Lee, and In Kyu Park, "Feature-based interactive 3D face modeling," Proc. The 13th Japan-Korea Workshop on Frontiers of Computer Vision (FCV07), pp. 253-256, Busan, Korea, January 2007.



   GPU-based image processing library

   (2006.3~2006.11)


  • Design and development of image processing framework based on GPU and programmable shader
  • Funded by Samsung Electronics (삼성전자 위탁연구과제)
  • 이만희, 박인규, 원석진, 조성대, "GPU를 이용한 DWT 및 JPEG2000의 고속 연산," 전자공학회 논문지, vol. 44-SP, no. 6, pp. 9-15, 2007년 11월. PDF



   Multiresolution processing of 3-D video

   (2005.7~2006.6)

  • Multiresolution rendering of image-based and model-based 3-D video sequence
  • Funded by Korea Research Foundation (학술진흥재단 신진교수연구과제)
  • Man Hee Lee and In Kyu Park, "Accelerating depth image-based rendering using GPU," Lecture Notes In Computer Science (IWMRCS 2006: International Workshop on Multimedia Content Representation, Classification and Security), vol. 4105, pp. 562-569, September 2006. PDF



  Image-based 3-D surface modeling

  (2005.6~2005.12)



  • NURBS surface construction from matched curves in multiple calibrated images
  • Funded by Korean Ministry of Information and Communication (전자통신연구원 위탁연구과제)
  • Man Hee Lee and In Kyu Park (corresponding author), "Image-based modeling of 3D objects with curved surfaces," Computer Animation and Virtual Worlds, vol. 19, no. 2, pp. 93-109, May 2008. PDF









Involved Projects at SAIT (2001.9~2004.2)

3-D shape description and database retrieval (2002.7~2004.6)

  • Collaboration with Samsung Advanced Institute of Technology and Seoul National University
  • Proposed to and adopted by MPEG-7 Visual Ver.3
  • Duck Hoon Kim, In Kyu Park, Il Dong Yun, and Sang Uk Lee, "A new MPEG-7 standard: Perceptual 3-D shape descriptor," Lecture Notes In Computer Science (Advances in Multimedia Information Processing - PCM 2004: 5th Pacific Rim Conference on Multimedia), vol. 3332, pp. 238-245, December 2004. PDF

Image-based modeling and rendering (2001~2004)

  • Proposed and adopted as an international standard in MPEG-4 AFX (Animation Framework eXtension)
  • Leonid Levkovich-Maslyuk, Alexey Ignatenko, Alexander Zhirkov, Anton Konushin, In Kyu Park, Mahnjin Han, and Yuri Bayakovski, "Depth image-based representation and compression for static and animated 3D objects," IEEE Trans. on Circuits and Systems for Video Technology, vol. 14, no. 7, pp. 1032-1045, July 2004. PDF

3-D photorealistic face modeling (2002~2004)


  • In Kyu Park, Hui Zhang, and Vladimir Vezhnevets, "Image-based 3-D face modeling system," EURASIP Journal on Applied Signal Processing, vol. 2005, no. 13, pp. 2072-2090, August 2005. PDF
  • Hui Zhang and In Kyu Park, "Easy and convincing ear modeling for virtual human," Lecture Notes In Computer Science (Advances in Multimedia Information Processing - PCM 2004: 5th Pacific Rim Conference on Multimedia), vol. 3331, pp. 394-401, December 2004. PDF




Involved Projects at SNU (1995.3~2001.8)

Shape-adaptive 3-D mesh simplification


  • 2000-2001, Funded by Korean Ministry of Science and Technology
  • In Kyu Park, Sang Wook Lee, and Sang Uk Lee, "Shape-adaptive 3-D mesh simplification based on local optimality measurement," Journal of Visualization and Computer Animation, vol. 14, no. 2, pp. 93-106, May 2003. PDF

Efficient measurement of shape dissimilarity between 3-D models


  • Efficient measurement of shape dissimilarity between 3-D models
  • 2000-2001, Funded by Korean Ministry of Science and Technology
  • In Kyu Park, Kyoung Mu Lee, and Sang Uk Lee, "Efficient measurement of shape dissimilarity between 3-D models using Z-buffer and surface roving method," EURASIP Journal on Applied Signal Processing, vol. 2002, no. 10, October 2002. PDF

Multiresolution topology estimation of measured 3-D range data


  • 1997-1999, Funded by Korean Science and Engineering Foundation
  • In Kyu Park, Kyoung Mu Lee, and Sang Uk Lee, "Models and algorithms for efficient multiresolution topology estimation of measured 3-D range data," IEEE Trans. on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 33, no. 4, pp. 706-711, August 2003. PDF

NURBS surface reconstruction from measured 3-D range data


  • 1996-1997, Funded by Korean Science and Engineering Foundation
  • In Kyu Park, Il Dong Yun, and Sang Uk Lee, "Automatic 3-D model synthesis from measured range data," IEEE Trans. on Circuits and Systems for Video Technology, vol. 10, no. 2, pp. 293-301, March 2000. PDF

Model-based perceptual grouping for 3-D object recognition


  • 1998-2001, Funded by Agency for Defence Development
  • In Kyu Park, Kyoung Mu Lee, and Sang Uk Lee, "Perceptual grouping of line features in 3-D space: A model-based framework," Pattern Recognition, vol. 37, no. 1, pp. 145-159, January 2004. PDF

Content-based image retrieval using graph representation


  • 1995-1997
  • In Kyu Park, Il Dong Yun, and Sang Uk Lee, "Color image retrieval using hybrid graph representation," Image and Vision Computing, vol. 17, No. 7, pp. 465-474, May 1999. PDF

Development of visual interpreter for image processing


  • 1997, Funded by Samsung Electronics.



Development of 3-D range finder using space-encoding technique


  • 1996, Funded by LG Industrial Electronics.



Development of real-time image processing system


  • 1995, Funded by LG Industrial Electronics.