Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Watch your step! A frustrated total internal reflection approach to forensic footwear imaging

Abstract

Forensic image retrieval and processing are vital tools in the fight against crime e.g. during fingerprint capture. However, despite recent advances in machine vision technology and image processing techniques (and contrary to the claims of popular fiction) forensic image retrieval is still widely being performed using outdated practices involving inkpads and paper. Ongoing changes in government policy, increasing crime rates and the reduction of forensic service budgets increasingly require that evidence be gathered and processed more rapidly and efficiently. A consequence of this is that new, low-cost imaging technologies are required to simultaneously increase the quality and throughput of the processing of evidence. This is particularly true in the burgeoning field of forensic footwear analysis, where images of shoe prints are being used to link individuals to crime scenes. Here we describe one such approach based upon frustrated total internal reflection imaging that can be used to acquire images of regions where shoes contact rigid surfaces.

Introduction

Imaging footwear marks and cross matching shoe types does not provide as clear an identification of an individual as say fingerprint or DNA evidence. There are only a finite number of shoe types in circulation and only a small subset of these are found at crime scenes (this is particularly true in the UK). So how then, can we hope to use images of footwear that have been retrieved from a crime scene to differentiate between similar shoe types and identify an individual? The answer lies in the individual nature of the wear patterns that are exhibited by shoes worn by different people. A person’s gait determines how they distribute their weight when they walk and this results in different extents of mechanical wear being present at specific points on the soles of their shoes. These wear patterns are specific to the person wearing the shoes and could in principle be used as a means of identification. An excellent example of this was observed in a study performed by Fruchtenicht et al.1. These authors showed that the wear patterns formed on identical sets of boots worn by US marines during a training exercise, exhibited highly individual wear patterns. Although such wear patterns would not necessarily be able to identify a person as the perpetrator of a crime as readily as say fingerprint or DNA would, they could be used to link them (or at least their shoes) to a particular location–information that could be vital to law enforcement operatives.

A national footwear database (NFD) containing images of common shoe types has been developed in the UK to try to aid the processing of images that have been retrieved from crime scenes. The function of this database is very similar to that of the national fingerprint databases that currently exist in a number of countries in that it allows forensic scientists and practitioners to compare images of shoe prints obtained from crime scenes with a bank of images of known shoe types. It is also possible to compare images of shoeprints taken in custody, to marks that are found at crime scenes.

A key component in the process of forensic image comparison and analysis involves some method of collecting images of shoe prints from suspects. Previous studies have used fairly simple approaches based on commercially available footwear impression kits, where an ink pad (or reservoir of fluid), is used in conjunction with special sensitised paper to develop an image. This approach is very similar to that used during the retrieval of fingerprints. The resulting shoe prints are then typically scanned to digital format using flat-bed scanners1,2,3. Although this approach produces images of the contact regions in shoe prints that are of the required quality, the entire process is time consuming and can be costly in terms of the consumables (e.g. ink pads and sensitised paper) that are required. A more desirable approach is to use images acquired directly using digital methods.

The direct acquisition of images of shoeprints using digital techniques has, until now, presented a number of challenges. The most significant of these being that conventional illumination techniques (obtained using white light illumination) do not provide specific and detailed information about the regions where the shoe will contact a surface. However, there are a number of techniques that have been applied to measure surface contact between bare feet and a surface. These include the use of capacitive sensors, piezoelectric crystals, arrays of load cells and the mechanical deformation of elastomeric materials [see ref. 4 for a review]. One particular technique that has been used extensively for gait analysis and determining the distribution of contact points between feet and surfaces involves the use of frustrated total internal reflection (FTIR) imaging. This technique involves the use of an optical waveguide that is constructed from a sheet of glass, or plastic and on which the subject stands. It has been used successfully to image the contact regions of fingerprints5,6, as well as insect7,8,9, animal10 and human feet11 contacting hard surfaces. Its success in these areas has resulted in the development of imaging devices such as ‘CatWalk’ for measuring the gait of small animals10 and the ‘Multitoe’ direct touch controller12. FTIR imaging has also been used successfully in a number of microscopy related applications13,14.

In the FTIR technique, light is coupled into a transparent sheet of material by illumination from around its edges. This illumination is setup in such a way that the light is totally internally reflected inside the sheet–a condition which is achieved by ensuring that the light is always incident on the glass(plastic)/air interface at an angle that is larger than the critical angle, θc. This angle can easily be determined from the formula , where n is the refractive index of the sheet material15. For glass, which has a refractive index of ~1.5 at visible wavelengths16, the critical angle is ~42°. Above the critical angle, the light is reflected back inside the sheet material because it has a higher refractive index than air. However, the boundary conditions at the sheet/air interface dictate that the electric field and its spatial derivatives are continuous across the interface. The result of this is that an evanescent field is present which decays exponentially away from the sheet material and into the air15. This evanescent field decays over length scales that are comparable to the wavelength of the illuminating light (400–700 nm for visible wavelengths) and is capable of interacting with objects that come within this range of the sheet surface. An object such as a foot, a finger, or even a shoe which comes close to the surface of the glass/plastic sheet will change the boundary conditions experienced by the light reflecting/refracting at the surface of the sheet material. In the case of a shoe sole, this change in boundary conditions can be thought of as changing the refractive index above the waveguide from that of air to that of the shoe material. As many shoes are typically made from polymeric materials, they will have a higher refractive index than air17. This change in refractive index results in a change in the critical angle required for light to be totally internally reflected at this interface which is now given by the equation , where nshoe is the refractive index of the shoe material. The result of this change in refractive index, is that light in the regions where the shoe contacts the surface will no longer be totally internally reflected and will instead be transmitted into and scattered by the shoe sole. This scattering of light by the regions in contact (or close proximity) allows the contact regions to be detected and imaged.

Methods

The waveguide optical element used in FTIR illumination is made from a single piece of glass (or acrylic) that is 600 mm × 600 mm and 30 mm thick. Illumination of the waveguide element is achieved by wrapping ultrabright white LED strip lights around the roughened edge of the glass/acrylic sheet as shown in Fig. 1b. The LED strips are then held in place using black tape. This serves to secure the LED strip and to prevent ambient light from entering the waveguide at the edges. The edges of the two largest faces of the sheet are then masked using black tape (see Fig. 1b). This is done in such a way that light from the LEDs which subtends an angle of incidence less than the critical angle required for total internal reflection is prevented from escaping the waveguide sheet. As a result, only light with an angle of incidence greater than θc will be incident on the surface and will be confined within the waveguide as a result of total internal reflection. However, when a shoe comes into contact with the waveguide element, the condition for total internal reflection is changed and the contact regions are observed to strongly scatter the light. The shoes can then be imaged from below using the webcams (Fig. 1a,c,d).

To ensure that images of the entire sole print are captured, the webcams are each used to capture a short movie lasting only a few seconds, during which the person standing is asked to rock backwards and forwards, to mimic the action of walking (see movie S1 provided in supplementary information). The Python software then looks at each pixel in turn and extracts the largest intensity value measured by that pixel during the short movie sequence. In this way, images similar to that obtained in Fig. 1d can be obtained for the entire sole of the shoe (Fig. 1c). These images are then converted into black and white images (binarised, Fig. 1e) ready for comparison to the contact images stored on the national footwear database. This process is achieved by setting all pixels with an intensity greater than a chosen threshold value to 0 and values with intensities less than this value to 255 (8 bit image). In this way, the contact regions appear as black objects on a white background.

Conventional illumination is achieved using a second strip of LEDs mounted below the waveguide (see Fig. 1a). Images of shoes are collected using conventional illumination so that scuff marks, scratches and other marks that are not in contact with the surface can also be identified (Fig. 1f). The Python software is then used to alternate between conventional illumination and FTIR illumination via a series of simple relays that switch the power supplies of the two illumination sources on/off.

Results and Discussion

The images shown in Fig. 1e,f are the most useful types of image to forensic scientists. The white light (conventional) image in Fig. 1f can be used to identify individual marks that are not present in the regions contacting a surface, but which may nevertheless be able to identify a person, from say an imprint impression on a soft surface. Meanwhile, the image obtained using the waveguide illumination technique (Fig. 1e) can be used to identify contact regions and corresponding wear patterns. Examples of images of different shoe soles that were obtained using our device are shown in Fig. 2, along with the corresponding contact images.

The choice of threshold value used to binarise the images in Figs 1 and 2 is key in ensuring that a faithful representation of the contact regions is achieved. This process is semi-automated in the Python software used here, with the program selecting an initial guess for the threshold intensity value and then a user interface providing the operator with the ability to optimise this value. An example of how the automatic thresholding is achieved is shown in Fig. 3. The colour waveguide images acquired by the webcam (Fig. 3a) are initially converted to greyscale images (Fig. 3b) before being converted into binarised images (Fig. 3c). This binarisation process is performed by constructing an intensity histogram for the greyscale images by counting all the pixels at each intensity value (Fig. 3d). The data in this histogram is then fitted to a series of Lorentzian peaks. As Fig. 3 shows, the image histograms typically contain four peaks. The largest peak (centred at the lowest intensity value, Il) corresponds to the pixels in the background of the image as there are many more of these pixels than those obtained from the contact regions. The smaller peak at the highest pixel intensity value (Ih ~ 255) corresponds to the regions of intimate contact between the shoe and the waveguide. Two additional peaks are also present close to an intermediate intensity value, Im (Fig. 3d). These peaks correspond to regions of the image where the shoe sole is not in contact, but where it is close to the waveguide surface. The rectangles on the histogram and the corresponding images in Fig. 3d show which regions of the image (shown in black) are associated with each peak in the histogram.

The threshold value, Ith that is used to binarise the images is set by the software to be at a value . The operator/user is then given the opportunity to optimise this threshold value further for each shoe (left and right) separately, if required, by using slider controls on the user interface of the Python software. The intensity values quoted in Fig. 2 are for the threshold value chosen by the software (Ith) and the final user determined threshold value used to binarise the images (Iopt). These were found to be in good agreement for the majority of shoe types studied here. However, there are cases where, for example, the shoes are worn to the point where little of the tread pattern remains and the automatic threshold value does not quite work. Under these circumstances, a greater extent of user interaction is required to obtain the appropriate threshold value. It is worth noting at this point, that more sophisticated thresholding algorithms are available2,3,18. Although these could have been used here, the high quality of the images being collected and the favourable comparison of software and user defined threshold values indicates that our rather crude approach to thresholding works in most cases.

More sophisticated analyses of the images obtained using waveguide illumination can be used to extract information about the distribution of pressure exerted by a person standing/walking on a hard surface8. Figure 4 shows an example of an image of a shoe print and its corresponding pressure map that have been extracted from one of the waveguide illumination experiments (panels a and b). Panel c in this figure shows the results of a calibration experiment, where a small round section cut from a similar shoe sole was placed on the waveguide surface and known loads/pressures applied to it. Waveguide images were obtained and used to create a calibration curve that relates the average local pixel intensity to the applied pressure. In obtaining the images in this figure, the exposure times of the webcams were set to be lower than those used to obtain the contact images in Figs 1, 2, 3. This was done to ensure that the intensity in the contact regions does not saturate when pressure is applied. Although saturation of the intensity values can be helpful in producing the simple contact images, variability in the pixel intensity with applied pressure is essential for determining how pressure is distributed underneath the sole of a shoe. The plot shown in Fig. 4c is representative of the pressure response across the surface of the waveguide in the regions being imaged. Repeat measurements found that the calibration plot shown in Fig. 4c was insensitive to position on the waveguide surface–a characteristic that is desirable for rapid conversion of the image intensity data to pressure values. A third order polynomial fit to the pressure-intensity plot shown in Fig. 4c was used to convert pixel intensities in the waveguide illumination images to pressure values and hence to convert Fig. 4a into Fig. 4b.

Care was taken during the calibration experiments to ensure that the true contact area was used in calculating the applied pressure. The insets shown in Fig. 4c reveal that only a small portion of the small probe was in contact with the waveguide surface. The area of this contact region was used in conjunction with the applied load to calculate an average pressure. These pressure data were plotted against the average value of the pixel intensities in this contact region and the errors in the intensity were determined from the full width at half height of the peak in the intensity histogram corresponding to the contact regions.

There are potentially interesting uses for this type of pressure analysis in forensic science. For example, this kind of approach could be used to determine how an individual distributes their weight through their shoe soles when they walk and/or run and hence determine roughly how fast they may have been moving when they deposited a shoe print. Combined measurements of contact area and pressure distributions could also be used to determine how hard an individual might have kicked a surface such as a door (during forced entry), or even possibly another person. Both of these would require slightly different imaging setups to the one described here. Clearly the use of a rocking motion to mimic walking/running used here has limited applicability. However, the imaging setup described here could be easily incorporated into a simple walkway/catwalk design and sunk into the floor for convenience of access and imaging. Similarly, a vertically mounted waveguide could be used to perform simulated kicking measurements. There may also be further applications for this imaging technique in clinical studies of gait analysis, or in measurements of how athletes interact with surfaces during high impact activities such as running, jumping, or changing direction. The simplicity of the technique lends itself to the study of many different types of activity and a range of environments.

Additional Information

How to cite this article: Needham, J. A. and Sharp, J. S. Watch your step! A frustrated total internal reflection approach to forensic footwear imaging. Sci. Rep. 6, 21290; doi: 10.1038/srep21290 (2016).

References

  1. Fruchtenicht, T. L., Herzig, W. P. & Blackledge, R. D. The discrimination of two-dimensional military boot impressions based on wear patterns. Science and Justice 42(2), 97–104 (2002).

    Article  Google Scholar 

  2. Pavlou, M. & Allinson, N. M. Automated encoding of footwear patterns for fast indexing. Imaging and Vision Computing 27, 402–409 (2009).

    Article  Google Scholar 

  3. Lai, M.-Y. & Wang, L.-L. Automatic shoe-pattern boundary extraction by image-processing techniques. Robotics and Computer-Integrated Manufacturing 24, 217–227 (2008).

    Article  Google Scholar 

  4. Lord, M. Foot pressure measurement: a review of methodology. J. Biomed. Eng. 3, 91–99 (1981).

    CAS  Article  Google Scholar 

  5. Chennankara, B., Xu, W. Y., Lin, F. C., Drake, M. D. & Fiddy, M. A. Optical fingerprint recognition using a waveguide hologram. Applied Optics 34(20), 4079–4082 (1995).

    CAS  ADS  Article  Google Scholar 

  6. Drake, M. D., Lidd, M. L. & Fiddy, M. A. Waveguide hologram fingerprint entry device. Opt. Eng. 35(9), 2499–2505 (1996).

    ADS  Article  Google Scholar 

  7. Risse, B. et al. FIM, a novel ftir-based imaging method for high throughput locomotion analysis. PLOS ONE 8(1), e53963 (2013).

    CAS  ADS  Article  Google Scholar 

  8. Kain, J. et al. Leg-tracking and automated behavioural classification in Drosophila. Nature Communications 4, 1910 (2013).

    ADS  Article  Google Scholar 

  9. Mendes, C. S., Bartos, I., Akay, T., Marka, S. & Mann, R. S. Quantification of gait parameters in freely walking wild type and sensory deprived Drosophila melanogaster. eLife 2, e00231 (2013).

    Article  Google Scholar 

  10. Vrinten, D. H. & Hamers, F. F. T. ‘CatWalk’ automated quantitative gait analysis as a novel method to assess mechanical allodynia in the rat; a comparison with von Frey testing. Pain 102, 203–209 (2003).

    Article  Google Scholar 

  11. Betts, R. P. & Duckworth, T. A device for measuring plantar pressures under the sole of the foot. Engineering in Medicine 7(4), 223–228 (1978).

    Article  Google Scholar 

  12. Augsten, T. et al. Multitoe: high-precision interaction with back-projected floors based on high-resolutionmulti-touch input. Proc. 23rd ann. ACM symposium on User interface software and technology (UIST 10), 209–218 (2010).

  13. Sekatskii, S. K., Shubeita, G. T. & Dietler, G. Time-gated scanning near-field optical microscopy. Appl. Phys. Lett. 77, 2089 (2000).

    CAS  ADS  Article  Google Scholar 

  14. Ramachandran, S., Cohen, D. A., Quist, A. P. & Lal, R. High performance, LED powered, waveguide based total internal reflection microscopy. Scientific Reports 3, 2133 (2013).

    ADS  Article  Google Scholar 

  15. Hecht, E. Optics 2nd Ed., 104–108, (Addison-Wesley, Reading, Massachusetts, 1987).

  16. Weast, R. C. (Ed.), CRC Handbook of Chemistry and Physics 69th Ed., E-382–383 (CRC Press Inc., 1988).

  17. Brandrup, J., Immergut, E. H. & Grulke, E. A. (Eds.), Polymer Handbook 4thEd., VI592, (Volume 2, Wiley, Hoboken, New Jersey, 1999).

  18. AlGarni, G. & Hamiane, M. A novel technique for automatic shoeprint retrieval. Forensic Science International 181, 10–14 (2008).

    Article  Google Scholar 

Download references

Author information

Affiliations

Authors

Contributions

J.A.N. wrote the data acquisition software and collected most of the data in Figs 1,2 and 3. She also collected some of the data in Fig. 4. J.S.S. was responsible for conceiving the project idea, designing the footwear imaging device, collecting some of the data in Fig. 4 and writing the manuscript.

Figure 1
figure1

(a) Schematic diagram of the dual wave guide and conventional LED illumination apparatus for imaging shoe prints. (b) The waveguide is formed by wrapping ulltrabright LEDs around the perimeter of a thick glass (or perspex) sheet. The waveguide is masked so that only light incident on its surface at angles greater than θc is allowed to propagate. This light is confined inside the waveguide. (c) When a shoe contacts the waveguide surface, light is scattered strongly and can be imaged. (d) A gentle rocking motion of the shoes allows the wearer to mimic the walking action and a more complete image of the contact regions can be obtained. (e) The images in (d) are binarised to obtain a black and white representation of the contact regions of the shoes (black denotes the contact regions). (f) Conventional illumination can also be used to identify any defining features that are not in intimate contact with the waveguide surface.

Figure 2
figure2

Examples of conventional (1st column) and waveguide (2nd column) images as well as the corresponding binarised image (3rd column) obtained for different shoe types.

The last two columns show the software determined threshold (Ith) and the user optimised threshold (Iopt) values used to produce the binarised images for each shoe (left and right).

Figure 3
figure3

Thresholding the waveguide images in panel (a) involves converting the images to greyscale (panel (b)).

The greyscale images are then binarised to form a black and white image of the contact regions (panel (c)). Panel (d) shows an example of an intensity histogram (red area) collected from the greyscale image of the left shoe shown in panel (b). Several peaks are present at different intensities corresponding to the background pixels (Il), the contact regions (Ih) and regions of the shoe that are close to, but not in contact with, the waveguide surface (two peaks in the vicinity of Im). The solid black line in panel (d) is the result of a fit to the data using a sum of 4 Lorenztian peaks. The coloured rectangles and associated images show which peaks are associated with each of the features in the greyscale images. The threshold determined by the software is set to be at an intensity, Ith, that is 60% of the way between Im and Ih (see text).

Figure 4
figure4

Pressure analysis of contact shoe print.

Panel (a) shows a contact image obtained using waveguide illumination and panel (b) shows the corresponding pressure distribution that was obtained from this image. The conversion between panel (a) and panel (b) was performed using the calibration curve shown in panel (c), where measurements of applied pressure are related to the average pixel intensity in the contact regions. The solid line in this figure is the result of a 3rd order polynomial fit to the data. The insets show waveguide contact images of the small rubber probe used in the calibration experiments (see text). The dashed circles mark the edge of the circular probe and show that only a small proportion of the probe is in contact.

Ethics declarations

Competing interests

The authors declare no competing financial interests.

Electronic supplementary material

Rights and permissions

This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Needham, J., Sharp, J. Watch your step! A frustrated total internal reflection approach to forensic footwear imaging. Sci Rep 6, 21290 (2016). https://doi.org/10.1038/srep21290

Download citation

Further reading

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing