Digitizing and Replicating the World of Materials
August 22, 2019 | EPFLEstimated reading time: 2 minutes
Is it possible to digitally replicate the way light shines off silk, the kaleidoscope of colors on butterfly wings, or the structure of fabrics, plastics, and stones? A team of researchers at EPFL’s Realistic Graphics Lab and Unity Labs in Grenoble, is developing computer models to do just that. Their process begins by meticulously digitizing any material they can lay their hands on, using a sophisticated machine called a gonio-photometer.
Imagine taking a photo of a car on a sunny day: the picture will only capture its appearance for that specific viewpoint and illumination, but it cannot tell us how the same car would look from another viewpoint later in the evening. In contrast to a camera, a gonio-photometer measures the light reflected by a material at different angles, capturing the essence of what gives the car’s painted surface its particular look: shiny, pearlescent, metallic, faded, etc. The resulting data is much richer than a single photograph and can be used to generate photorealistic computer images of objects made from those same materials within arbitrary virtual scenes.
The team at EPFL, led by Prof. Wenzel Jakob, studies the way in which light interacts with various materials so that this process can be reproduced in a software simulation. “Our goal is to put together a very comprehensive library of materials—not just to recreate them, but also to understand mathematically what makes them look the way that they do,” says Jakob. The researchers intend to digitize samples ranging from a sheet of paper and a piece of plastic from a pen to a butterfly wing and even a piece of fabric from a Darth Vader costume. “This kind of material data is invaluable in areas like architecture, computer vision, or the entertainment industry. We’ve recently started working with Weta Digital and Industrial Light & Magic, who make movies like Avatar and Star Wars,” he adds.
The gonio-photometer is an impressive machine some five meters long. It is operated in a room, whose walls have been covered with black cloth to absorb the light reflected by the sample being analyzed. The sample is placed in the center of the device, where it is observed from the tip of a robotic arm that spins with a speed of up to 3 meters per second so that measurements can be taken rapidly for many configurations. “A conventional camera only records red, green and blue color information that is visible to the human eye. We instead use a spectrometer that records hundreds of wavelengths throughout the entire visual spectrum, extending even to UV and infrared. That wealth of data provides us with much more information about a material that enables us to simulate its appearance extremely precisely,” says Jakob.
The team has developed a new algorithm that takes full control of the gonio-photometer to only capture a small subset of an inconceivably large four-dimensional space, enabling materials to be digitized much more rapidly than was previously possible. Jakob’s group also develops the Mitsuba Renderer, a widely used open source software platform that simulates light computationally to create photorealistic images of virtual worlds. With the acquired data, these simulations can now achieve an unprecedented level of accuracy.
On July 29, Jakob received ACM SIGGRAPH’s Significant New Researcher Award. ACM, the Association For Computing Machinery, announced that Jakob was selected for the prestigious prize in recognition of his theoretical and algorithmic contributions to the field, as well as for his work in developing open source software for research.
Suggested Items
I-Connect007 Editor’s Choice: Five Must-Reads for the Week
04/19/2024 | Marcy LaRont, PCB007 MagazineFor my must-read picks of the week, I’m highlighting Parker Capers, a young professional seeking employment, solid counsel from Dan Beaulieu on what your post-show plan should look like, more information and insight on “chiplets” and the need for secure data transfer standards from columnist Preeya Kuray, as well as Matt Stevenson’s design for reality wisdom. It’s a reminder to download one of our newest books (there are several) you don't want to miss if you are an assembler.
D Coupon Testing and Data Insights With GreenSource Fabrication
04/17/2024 | Marcy LaRont, PCB007 MagazineMarcy LaRont spoke with Steve Karas of GreenSource Fabrication at the SMTA UHDI conference in March. He presented a case study that GreenSource undertook with a customer on critical via reliability with advanced materials and used the experience to highlight the importance and effectiveness of D coupon testing. He also discussed GreenSource’s approach to data aggregation and a new system they developed to use collected data effectively.
Real Time with... IPC APEX EXPO 2024: Innovations in Thermal, Warpage, and Strain Metrology
04/17/2024 | Real Time with...IPC APEX EXPOEditor Nolan Johnson talks with Neil Hubble, president of Akrometrix, about the company's leadership in thermal, warpage, and strain metrology. Neil details how Akrometrix is committed to addressing customer challenges through technological evolution, innovative solutions, and a focus on data processing. A tabletop unit for thermal warpage testing is showcased at IPC APEX EXPO this year.
Signal Integrity Expert Donald Telian to Teach 'Signal Integrity, In Practice' Masterclass Globally
04/17/2024 | PRLOGDonald Telian and The EEcosystem announce the global tour of "Signal Integrity, In Practice," a groundbreaking LIVE masterclass designed to equip hardware engineers with essential skills for solving Signal Integrity (SI) challenges in today's fast-paced technological landscape.
SMT Prospects and Perspectives: AI Opportunities, Challenges, and Possibilities, Part 1
04/17/2024 | Dr. Jennie Hwang -- Column: SMT Perspectives and ProspectsIn this installment of my artificial intelligence (AI) series, I will touch on the key foundational technologies that propel and drive the development and deployment of AI, with special consideration of electronics packaging and assembly.