Kun Zhou: Next-Generation 3D Digital Technology - Building a Colorful Digital World
On the morning of December 1, 2022, Kun Zhou, a professor at the College of Computer Science and Technology at Zhejiang University, ACM Fellow, and IEEE Fellow, delivered an exciting presentation titled "Next-Generation 3D Digital Technology - Building a Colorful Digital World" at the "Peking University Intelligence Science Frontier Forum." The presentation, conducted online, attracted the participation of many professors and students from School of Intelligence Science and Technology, Institute for Artificial Intelligence, Wangxuan Institute of Computer Technology, and School of Computer Science.
Firstly, Prof. Zhou briefly reviewed the development of the internet and content formats, summarizing the transition from a text and image-based content dissemination method during the portal website era to the emergence of video content in the mobile internet era. He mentioned that 3D digital content will become a core element in the next development stage of the internet, contributing to the construction of a rich content ecosystem along with other content formats. An important aspect of 3D digital content is the digitization and reconstruction of three-dimensional objects.
Next, Prof. Zhou introduced the research in the digital representation of 3D objects and the reconstruction of 3D digital objects from the real world. The digital representation of 3D objects includes the representation of geometric shapes and surface textures. The surface textures, as a high-dimensional function that changes with space, lighting, and viewing angles, depict the "colorful flow of light." Subsequently, Prof. Zhou introduced the current state of 3D digitalization technology and systems, summarizing the characteristics and problems of 3D scanners and texture scanners. He explained the challenges faced in the joint collection of geometric and texture data for complex objects and mentioned that data collection and reconstruction should be jointly optimized.
Then, Prof. Zhou introduced the progress of his team in the joint collection and reconstruction of geometric and texture data, including fixed texture scanners, fixed geometric and texture scanners, and handheld non-planar geometric and texture scanners. During the presentation, Prof. Zhou carefully explained the basic principles of their designed joint optimization software and hardware system, as well as the design ideas of the hardware devices and software algorithms. This research maps physical sampling and computational reconstruction into differentiable deep neural networks, achieving end-to-end software and hardware joint optimization, ultimately obtaining high-precision reconstruction results with less sampling rates.
In the conclusion of the presentation, Prof. Baoquan Chen, Prof. Zhouchen Lin, and other teachers and students engaged in discussions on issues related to the light source mode settings in acquisition devices, simulation calculations for LED light sources, preparation of training data, and material acquisition and reconstruction for multi-object scenes. Prof. Zhou provided further explanations and shared more insights and perspectives, allowing the audience to better comprehend the essence of the methods and recognize the challenges and opportunities in this field. Prof. Chen summarized and expressed gratitude for Prof. Zhou's excellent presentation, marking the successful conclusion of this event.
