What’s all that 3D data for?

By Tessa de Alarcon

We’ve had a few posts (this one by Chelsea Kim and this one by Christy Ching) on creating 3D models using photogrammetry, and I thought I’d give some examples of what we are doing with that data once it’s collected. For some objects we are creating ortho-mosaics and these 2D images are going into reports as after treatment images as well as going into the catalogue model as record photography that also shows up in the online collection database. This wooden coffin 2017-20-1.3 is an example of this type of imaging.

2017-20-1.3 after treatment photos created using ortho mosaics generated from a 3D model created using photogrammetry.

For other objects we are also producing ortho-mosaics, but they are before treatment images. For example with E641 a wall painting that was previously on display.

E641 when it was on display

The wall painting is currently in two sections and each one has been imaged separately. These before treatment images have been used to create condition maps.

Before treatment ortho mosaics of E641 created with photogrammetry

The maps go into our reports and help provide visual documentation to support our written reports. For large objects, these kinds of condition maps are often easier to understand than written descriptions and can provide more precise information on the location of specific condition issues. Here you can see the condition map for E641. The map is not yet complete, I am still working on documenting one of the sections but I have combined the two maps into one image so you can see what that process looks like.

E641 condition map. The map for the section on the left is complete while the mapping on the section on the right is still in progress

The models can also be used to show surface distortion, so here in this screen shot of the 3D model of E641 you can see planar distortions in the wall painting where the fragments are not aligned. There may be a variety of causes leading to this distortion including poor alignment during the previous reconstruction or they may be the result of lifting/separation of the original material from its current modern backing.

Detail of E641. One the left is a mesh without the color added to the 3D mesh-model and on the right is the same area with the color and surface texture added to the model. The image on the left you can easily see the fragments and how they are misaligned in some areas.

I am currently working on learning how to create a 2D false color image where the colors reflect depth, so that we can have these planar distortions documented in 2D as well as being able to see them in the model.

So all together, this data is being used to document both the final condition of objects after treatment, as well as to document them before treatment. The models are also useful tools to assess complex condition issues and are valuable for evaluating next steps. For example, our current plan is to remove the wall painting from it’s current modern backing and put it on a new one. Our hope is to correct some of these planar distortions as a part of that process, and this model as well as one we make after treatment will be useful for evaluating the efficacy of the treatment and provide a base line for assessing its condition in the future.

2D to 3D

By Chelsea Kim

As an intern working with the conservation department, I have received the opportunity to work on many projects and experience things I never thought I would. Recently I have been working on this software called Reality Capture using photogrammetry. Photogrammetry is a process that uses an abundance of photographs to create a 3D model without any distortion from many overlapping images stitched together to form a detailed and geometrically corrected image called an orthomosaic. This process is usually used on larger objects, and this is because it’s too big to be in frame when taking pictures and has a lower quality with distortion which is far from perfect, and Christy Ching explains more in depth about this in her previous blog post.

I want to show how to create a digital three-dimensional model using the software, Reality Capture, and I’ll demonstrate with an example of the after-treatment photos of an Egyptian coffin.

To start off with, having pictures of the object is a must. For this example, they were already taken and edited in Photoshop, to adjust the white balance using adobe bridge ahead of time. Then I begin by opening the software and then under workflow at the top left corner, I select “inputs.”

Screenshot of the software highlighting where to click “Inputs” which is above “1. Add Imagery”

Then I select all the images making sure that they were a .jpeg file and then I click on “Align Images” as highlighted above. After the images are aligned, a transparent box surrounding the coffin appears. I adjust the box by dragging the control points around to make it as small as possible without cutting off any part of the coffin. As you can see in the image below, using E883C, the box is close to the coffin but does not intercept the coffin itself.

Screenshot of the Egyptian coffin E883C after the images were aligned with the transparent box adjusted to tightly around it.

Now for the fun part to see the coffin take shape, I click next to “Calculate Model” to select “Preview Quality” as highlighted below. Then I go to the tools bar to use the lasso option to erase all the unnecessary space around the coffin. Then after being satisfied with selected area, I click on “Filter Selection,” which turns the selected areas from orange to dark blue showing that it worked.

Screenshot of the coffin after selecting “Preview Quality.”

Finally, I go back to the Workflow bar to select “Texture” which is highlighted below and then it shows all the details of the 3D model without any distortion in high detail and quality.

Screenshot of the 3D model after being textured.

Special Photography for Larger Objects: Photogrammetry

By Christy Ching

Conservation Technician Christy Ching photographing the underside of an Egyptian coffin 2017-20-1.3 for photogrammetry.

One project I have really enjoyed working on as a pre-program conservation technician is documenting larger objects for a process called photogrammetry. Photogrammetry is a technology that gathers spatial and color information of an object from multiple photographs to form a geometrically corrected, highly detailed, stitched image called an orthomosaic. Essentially, photogrammetry creates a distortion-free, three-dimensional model of an object based on two-dimensional photos of every surface photographed in sections. 

Left: Four photographs of an ancient Egyptian coffin lid L-55-16B at various angles, which were used to create a 3-D model. Right: 3-D model draft of L-55-16B.

*L-55-16B (21-46-9) is a loan object from the Philadelphia Museum of Art (PMA)

This can be done for objects of any size. However, we are mostly reserving this technique for larger objects, specifically larger textiles and Egyptian coffins. This is because photographing the coffins and textiles normally with a single shot requires a greater distance between the object and the camera in order to fit the entirety of the object into the frame, and doing so reduces the image quality. Not only that, but the camera distortion that is inherent in all photographs will become more obvious. The resulting image will not be an accurate representation of the coffin or textile, which is not ideal for documentation purposes. 

The image on the left is a single-shot photograph of L-55-16B while the image on the right depicts the same coffin lid created by photogrammetry. When comparing the two images, the camera distortion in the single-shot photograph can be seen especially in the feet and head of the coffin lid.

With photogrammetry, we can take parts of the 3-D model and use them as high resolution, distortion-free, 2-D images of the object instead.

Six views of L-55-16B depicting the top, interior, and the four sides of the coffin lid generated using photogrammetry.

So far, a little less than ten coffins, a few textiles, a pithos fragment, and a giant granite relief have been documented using photogrammetry. The models and orthomosaic images are all generated by Jason Herrmann from CAAM, and we are very grateful that he is doing this for us! To learn a little bit more about the photogrammetry process, view this Digital Daily Dig here.

This project was made possible in part by the Institute of Museum and Library Services.

Examination of Wooden Tomb Models

Hi everyone! This is Alexis North, and I’m the project conservator at the Penn Museum working on the Egyptian storage move project, which has been referenced here on the blog a few times. I wanted to give a brief introduction on one of the projects I have been working on most recently in the Artifact Lab.

We recently received several new objects in the Artifact Lab. They are a collection of painted wooden models, depicting various aspects of daily life, which date to the First Intermediate Period and Middle Kingdom (2130-1784 BCE). Many of the models we have were excavated by Sir Flinders Petrie and the British School of Archaeology, through excavations the University of Pennsylvania supported.

Photo of tomb models on display, prior to deinstallation.

Photo of tomb models on display, prior to deinstallation.

These models had been on display in our Egyptian Daily Life gallery for quite a long time. However, due to the vibrations caused by the construction going on right outside the museum, the entire case had to be deinstalled and the objects moved for their protection. The models have very fragile painted surfaces, and are made of multiple pieces which could separate, fall over, and be damaged if exposed to vibrations within the case. They also in most cases have not be examined by a conservator since their acquisition.

Therefore they were all brought into the Artifact Lab for documentation and treatment. We started by photographing all the individual pieces, and assessing the condition of the painted surfaces. Many of the models have actively lifting and flaking paint, and the horizontal surfaces are also quite dirty.

The model most in need of treatment is this boat:

Detail of E14260.1, boat model, before deinstallation.

Detail of E14260.1, boat model, before deinstallation.

Boats have a lot of significance in ancient Egyptian culture and religion. They were the primary means of long-distance travel along the Nile, and the Egyptians believed that the gods traveled across the sky and through the underworld on boats. Boats were also used for fishing. This model depicts a transport boat, with oarsmen, a mast and rudder, and a canopy painted in a cowskin pattern where the tomb owner would have been represented sitting and enjoying his travels.

This model has some of the most serious flaking paint and discoloration, especially on the top and sides of the boat:

Detail of lost and lifting paint on top of boat, and grimy surface.

Detail of lost and lifting paint on top of boat, and grimy surface.

I began treating this model by taking detailed photos of the surface, then using those images to map different condition issues. Then I chose different treatment materials and techniques which work best for those issues.

Come back for the next post to see more about what we learned from examining this model, and how I chose to treat it. See you soon!

 

References:

Fleming, S. (1980). The Egyptian mummy: Secrets and science. University of Pennsylvania.

Taylor, John H. (2001). Death and the Afterlife in Ancient Egypt. The University of Chicago Press.

 

Alexis North is the Project Conservator for the Egyptian Storage Move Project, Penn Museum.