Dr Shaodi You

Dr. Shaodi You is a research scientist at Data61, (Previously known as NICTA) Canberra Research Lab and an adjunct lecturer of College of Engineering and Computer Science at Australian National University (ANU). He receives his Ph.D. and M.E. degrees from The University of Tokyo, Japan in 2015 and 2012 and his bachelor's degree from Tsinghua University, P. R. China in 2009. His research interests are 1. physics based vision, 2. perception based vision and learning, and 3. 3D geometry. He is currently the Chair of IEEE Computer Society, Australian Capital Territory Section, Australia.

 

Research Homepage: http://users.cecs.anu.edu.au/~shaodi.you/

 

Info. of ANU and Data61 Ph.D. scholarships (link)

ANU and Data61 offer various scholarships for potential Ph.D. students. Deadline for 2017 PhD students is Apr. 14th, 2017. See details here.

http://www.cvl.iis.u-tokyo.ac.jp/~yousd/Html/Schol...

My work is mainly focusing on three areas:
Perception Based Vision and Learning,
Physics Based Vision and
3D geometry.

 

Perception Based Vision and Learning

Perception

Perceptual based vision learning aiming to model and understanding human perception. And later propose computer vision and machine learning algorithms which incorporates such understanding. Specifically, I have been working on the topics: Prothetic vision, decolourization, saliency and manifold learning. (See research and projects)

 

 

Physics Based Vision

Liquid

Liquid optics is extremely challenging because it is transparent and non-rigid. The transparency means its appearance is totally determined by its environment. The non-rigidity means its shape is also highly dependent on the environment. Specifically, my research focus on rain and water drops. (See research and projects)

 

 

Non-rigid 3D geometry

3D

A few researches on modeling the non-rigidity of 3D objects. (See research and projects)

See details and download pdf: http://users.cecs.anu.edu.au/~shaodi.you/

 

[16] Shaodi You, Yasuyuki Matsushita, Sudipta Sinha, Yusuke Bou and Katsushi Ikeuchi, Multi-view Rectification of Folded Documents. IEEE TPAMI, Accepted, DOI: 10.1109/TPAMI.2017.2675980. 2017.
[pdf][webpage]

[15] Feng Lu, Lei He, Shaodi You, Zhixiang Hao, Identifying Surface BRDF from a Single 4D Light Field Image via Deep Neural Network, IEEE Journal on Selected Topics in Singal Processing. [pdf]

[14] Shijie Zhang, Lizhen Qu, Shaodi You, Zhenglu Yang and Jiawan Zhang, Automatic Generation of Grounded Visual Questions, International Joint Conference on Artificial Intelligence, IJCAI 2017. [pdf]

[13] Diming Zhamg, Fei Xue, Hao Huang and Shaodi You, VBMq: Pursuit Baremetal Perf ormance by Embracing Block I/O Parallelism in Virtualization, Frontier of Computer Science. Accepted.

[12] Bin Yue, Min Gui, Jiahui Guo, Zhenglu Yang, Jin-Mao Wei and Shaodi You, An Effective Framework for Question Answering over Freebase via Reconstructing Natural Sequences. WWW 2017.

[11] Yu Li, Shaodi You, Michael S. Brown, Robby T. Tan, Haze Visibility Enhancement, A Survey and Quantitative Benchmarking. Submitted to CVIU for review. (Major revision), 2016.

[10] David Feng, Nick Barnes, Shaodi You and Chris McCarthy, Local Background Enclosure for RGB-D Salient Object Detection, IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2016 Spotlihgt Presentation), June 26-July 1, 2016, Las Vegas, USA.
[pdf] [webpage]

[9] Shaodi You, Robby T. Tan, Rei Kawakami, Yasuhiro Mukaigawa and Katsushi Ikeuchi, Waterdrop Stereo, arXiv:1604.00730 [cs.CV].
[pdf]

[8] Shaodi You, Thing Locally, Fit Globally: Robust and Fast 3D Shape Matching via Adaptive Algebraic Fitting, Neural Computing, Accepted, DOI 10.1016/j.neucom.2016.06.086.
[pdf]

[7] Shaodi You, Robby T. Tan, Rei Kawakami, Yasuhiro Mukaigawa and Katsushi Ikeuchi, Adherent Raindrop: Modeling Detection and Removal in Video, IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol. 38, Issue 9, pp:1721-1733, 2016.
[pdf] [webpage]

[6] Shaodi You, Detection and Removal of Raindrop Images in A Video Sequence and Their Applications to Computer Vision Algorithms, Doctoral Thesis, The University of Tokyo, 2015.
[pdf]

[5] Shaodi You, Robby T. Tan, Rei Kawakami, Yasuhiro Mukaigawa and Katsushi Ikeuchi, Raindrop Detection and Removal from Long Range Trajectory, 12th Asian Conference on Computer Vision (ACCV 2014 Oral), Nov. 3-5, 2014, Singapore
[pdf] [webpage]

[4] Shaodi You, Robby T. Tan, Rei Kawakami and Katsushi Ikeuchi, Adherent Raindrop Detection and Removal in Video,IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2013), June 25-27, 2013, ortland, Oregon, USA
[pdf] [webpage]

[3] Shaodi You, Robby T. Tan, Rei Kawakami and Katsushi Ikeuchi,Robust and Fast Motion Estimation for Video Completion. IAPR Machine Vision Applications (MVA 2013), May 20-23, 2013, Kyoto, Japan.
[pdf]

[2] Shaodi You and Huimin Ma, Manifold Topological Multi-resolution Analysis Method, Pattern Recognition, Volume 44, Issue 8, August 2011, Pages 1629-1648
[pdf]

[1] Xiao Yu, Huimin Ma, Shaodi You, Ze Yuan, A Solution to Efficient Viewpoint Space Partition in 3D Object Recognition,International Conference on Image and Graphic 2009 (ICIG2009), Xi'an, China
[pdf]

 

Experience

 

2015.9-present

Research Scientist, Data61, CSIRO, Australia (previously known as NICTA)
- Working on prosthetic vision with Assoc. Prof. Nick Barnes.
- Bionic Vision Autralia

- Developing new model hyperspectral light field camera with Assoc. Prof. Antonio Robles-Kelly.

 

2016.1-present

 

Chair of Computer Society, IEEE ACT Section, Australia.

2015.10-present

Adjunct Lecturer, College of Engineering and Computer Science, Australian National University.
- Advising Ph.D student: David Fung (with Assoc. Prof. Nick Barnes. )
Advising Ph.D student: Xiang Wang, Yidong Wang, Zhichen Zhao, Tsinghua (with Assoc. Prof. Huimin Ma)

 

2014.4-2014.10

Internship at Microsoft Development, Shinagawa, Tokyo.
- Topic: Multiview rectification rectification of folded document
- Paper submitted, mobile app prototyped

- Coworkers: Dr. Yasuyuki Matsushita, Dr. Sudipta Sinha.

2013.2-2013.3

Visiting Multimedia and Geometry Group, Utrecht University, The Netherlands
- Video enhancement

2008.1-2010.3

3D Image System Simulation Lab, Tsinghua University
- Advisor: Assoc. Prof. Huimin Ma
- Topics: 3D object modeling and recognition, manifold learning

 

 

Professional Activities

 

Teaching

 

2016 Robotics (ANU, ENGN4627)
2016 Document Analysis (ANU, COMP4650)
2016 Individual Project (ANU, ENGN4200)

 

Reviewing

IEEE Trans. on Pattern Recognition and Machine Intelligence (TPAMI)
International Journal on Computer Vision (IJCV)
IEEE Transaction on Image Processing (TIP)
ACM SIGGRAPH
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
International Computer on Computer Vision (ICCV)
European Conference on Computer Vision (ECCV)

 

 

Education

 

2012.10-2015.9

 

PhD of Engineering, Computer Vision Lab. The University of Tokyo, Japan.
- Full Scholarship (Mext)
- Overall GPA: 4/4
.
- Advisors: Prof. Katsushi Ikeuchi ,
Assoc. Prof. Takeshi Oishi
- Mentors: Asst. Prof. Robby T. Tan,
Asst. Prof. Rei Kawakami
- Topics: robust outdoor vision, rainy scenes, computational photometry, 3D shape modeling

 

2010.4-2012.9

Master of Engineering, Computer Vision Lab. The University of Tokyo, Japan
- Full Scholarship (Panasonic)
- Overall GPA: 3.93/4

 

2005.8-2009.7

Bachelor of Engineering, Department of Electrical Engineering, Tsinghua University
- Advanced Courses in Math and Physics (sub major)
- Recommend for direct admission (free of entrance exam)
- Overall GPA: 88.4/100 (3.71/4)

 

2002.8-2005.7

Experimental High School Attached to Beijing Normal University
- National Science Class directed by The Ministry of Education of China
- Eligible for enter any university in China without exam

 


Publications

 

2016

David Feng, Nick Barnes, Shaodi You and Chris McCarthy. Local Background Enclosure for RGB-D Salient Object Detection. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2016, Spotlight Presentation). [pdf] [webpage]

 

2016

Shaodi You, Think Locally, Fit Globally, Robust and Fast Surface Matching via Algebraic Surface Fitting, Neural Computing, Special Issue on Multimodal Vision, Elsevier 2016. Accepted. [pdf]

 

2015

Shaodi You, Robby T. Tan, Rei Kawakami, Yasuhiro Mukaigawa and Katsushi Ikeuchi, Raindrop Detection and Removal from Long Range Trajectory.
- Accepted for publication in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2015
- [pdf] [webpage]

 

2015

Shaodi You, Detection and Removal of Raindrop Images in A Video Sequence and Their Applications to Computer Vision Algorithms
- Doctoral Thesis, The University of Tokyo, 2015.
- [pdf]

 

2014

Shaodi You, Robby T. Tan, Rei Kawakami, Yasuhiro Mukaigawa and Katsushi Ikeuchi, Raindrop Detection and Removal from Long Range Trajectory.
- 12th Asian Conference on Computer Vision (ACCV 2014 Oral), Nov. 3-5, 2014, Singapore
- [pdf] [webpage]

 

2013

Shaodi You, Robby T. Tan, Rei Kawakami and Katsushi Ikeuchi, Adherent Raindrop Detection and Removal in Video.
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2013), June 25-27, 2013, ortland, Oregon, USA
- [pdf] [webpage]

 

2013

Shaodi You, Robby T. Tan, Rei Kawakami and Katsushi Ikeuchi, Robust and Fast Motion Estimation for Video Completion.
- IAPR Machine Vision Applications (MVA 2013 Oral), May 20-23, 2013, Kyoto, Japan
- [pdf]

 

2011

Shaodi You and Huimin Ma, Manifold Topological Multi-Resolution Analysis Method.
- Pattern Recognition, Volume 44, Issue 8, August 2011, Pages 1629ィC1648
- [pdf]

 

2009

Shaodi You and Huimin Ma, Manifold Topological Multi-Resolution Analysis Method based on Spectral Analysis and Local Linearity.
- Bachelor Thesis, Tsinghua University, 2009
- Excellent Thesis Award

 

2009

Xiao Yu, Huimin Ma, Shaodi You and Ze Yuan, A solution for efficient viewpoint space partition in 3D object recognition.
- International Conference on Image and Graphic 2009 (ICIG2009 Oral), Xi'an, China
- [pdf]

 

 

Patents

 

Chinese Patent No. 201610279988.9

 

A System and A Method for Automatic Inspection of Protection Equipment and Operational Capability for Workers' Safety.

 

Chinese Patent No. 201610489505.8

An Automatic System and Methodology for Dust Pollution Monitoring in Construction Site using Image Captured by UAV.

 

 


Awards and Honors

 

2013.4-2015.9

 

Japanese Government (Monbunkagakusho: MEXT) Scholarship
- University referenced (Rank 1 among applicants)
- Allowance 5,328,000 JPY
- Full tuition fee coverage
- Research funding 3,000,000 JPY

 

2013.4-2015.9

Global Creative Leader, The University of Tokyo
- Research funding 2,200,000 JPY
- Allowance 4,500,000 JPY Granted (3,000,000 JPY withdrawed due to maximum income limit)

 

2013.4-2016.3

SCAT Scholarship
- Allowance 3,600,000 JPY Granted.
- Withdrawed due to maximum income limit

 

2013.4-2014.3

SEUT Doctoral Student Special Incentives Program
- Allowance 1,800,000 JPY Granted.
- Withdrawed due to maximum income limit

 

2010.4-2013.3

 

Panasonic Scholarship
- Allowance 6,120,000 JPY Granted. (900,000 JPY withdrawed due to early graduation)
- Full tuition fee coverage

- Six grants in China per year

 

2009.7

Excellent Thesis Paper, Tsinghua University
- Rank 1 / 90

 

2008.10

Scholarship for Academic Excellence(Class III), Tsinghua University

 

2006.12

Scholarship for Academic Excellence(Class II), Tsinghua University

 

2005.6

Honorable mention in 2004/2005 "First Step to Nobel Prize in Physics", Polish Academy of Science

 

2004.9

First Prize, Chinese Physics Olympic Contest (province-wide)
- Eligibility for direct college addmission without national standard exam.

 

2004.9

Second Prize, Chinese Chemistry Olympic Contest (province -wide)
- Eligibility for direct college addmission without national standard exam.

 

2004.5

First Prize, Chinese Biology Olympic Contest (province-wide)
- Eligibility for direct college addmission without national standard exam.

 

2003.9

Second Prize, Chinese Mathematics Olympic Contest (province-wide)
- Eligibility for direct college addmission without national standard exam.

 


Skills

 

Languages

Chinese(native), English(proficient), Japanese(proficient), French(beginner)

 

Artwork

Comics creations

 

Music

Piano, Erhu(two-stringed Chinese violin)

 


Activities

 

2012.9

 

Volunteer for local rebuilidng after 2011 Japan Earthquake

2015.4-2015.9

Volunteer for disaster relief in Tokyo

 

2010.4-2015.9

Chinese Student and Scholoar Association, The University of Tokyo
- 2011-present Manager of Tennis Circle

 

2005.9-2008.9

Red Cross Society of Tsinghua University
- 2007-2008 Manager of Department of Publicity
- Excellent member award in 2007

 

2005.9-present

Art Society of Tsinghua University
- 2007-2008 Leader of Comic Team

 

Updated:  8 September 2015/Responsible Officer:  Head of School/Page Contact:  CECS Marketing