National Geographic

Photo-recognition software catches tigers by their stripes

Blogging on Peer-Reviewed ResearchTigers can no more change their stripes than leopards can change their spots. That’s a good thing too, for their unchanging patterns, as individually distinct as a human fingerprint, make it easier to track any single tiger over time.

That process is about to become even simpler with a computer programme that creates a three-dimensional model of a tiger’s skin and can compare different shots of an animal taken at different times or angles. The programme is the brainchild of Lex Hilby from an organisation called Conservation Research and it could allow conservationists to track surviving tigers and to source the origins of poached skins.

Tigers are endangered and secretive animals and conservationists are increasingly relying on camera traps to take photos of them as they wander through the forests of Asia. The traps provide a series of tiger mug-shots, which trained experts can match to one another based on the pattern of stripes. That gives them valuable data about the population density of the tigers, how long individuals survive for, and how widely they travel.

But as you might imagine, matching photos by eye is a laborious job and it will only get harder as the library of tiger snaps gets larger. Hilby’s software is designed to get around that problem, by automating the search process and suggesting only images from the back-catalogue that have a good chance of matching any new photo.

Tigers don’t pose for camera-traps, so the software has to be able to cope with shots taken from a wide range of angles and with tigers adopting different postures. To do that, it creates a three-dimensional model of a tiger.

Users use coloured dots to indicate the position of the shoulder, hips and tail and the upper and lower margins of the image; the programme does the rest. It essentially unwraps the striped pattern from the tiger’s flank and works out how it would look if it were laid out flat. It then compares the new image to every existing one and gives them a score based on how similar they are. The software is freely downloadable, and you can even have a go yourself.

Ullas Karanth from the Wildlife Conservation Society has tested Hilby’s programme using photos of tigers taken in the Nagarhole and Bandipur reserves in India. Over the last two decades, his team have identified anywhere from 264 to 298 tigers by carefully comparing different images by eye. Hilby’s programme analysed all of these shots, and for each image, it ranked all the others in terms of how similar they were.

The test was a success. For every image, the programme managed to place a photo of the same individual in the top spot 95% of the time, and in the top five positions on every go. It even managed to match up photos where the animal’s stances were off by 66 degrees, or those that were taken up to seven years apart.

With such accuracy, Hilby is confident that the programme can successfully match a new image to a tiger already in the database, even if that individual is represented by a single photo. As the photo library grows, so too with the programme’s infallibility.

Hilby also showed that he can also use his programme forensically, to trace the origin of illegally sold tiger skins. He used it to trace the origins of three skins confiscated from poachers in the last four years. Each one was strongly matched to a tiger in the photo library, and only one image where the skin was partially crumpled, posed any difficulties.

The programme could certainly be improved – at the moment, users have to mark out the boundaries of the tiger in each image by hand. Even so, that takes but a few minutes; at the moment, searching the entire image catalogue takes anywhere from 30 to 45 minutes. And Hilby is optimistic that the photo-fitting step could also be automated in the future.

But even in its current state, there’s a lot of potential. The tiger programme is based on software that has previously been used for cheetahs and grey seals, and it could also be used to track individuals of other patterned species such as leopards, zebras and salamanders.

Reference: Biology Letters doi:10.1098/rsbl.2009.0028

More on using technology to study wildlife:

Subscribe to the feed

There are 7 Comments. Add Yours.

  1. Lassi Hippeläinen
    March 11, 2009

    What is the rate of false positives?
    A test image:
    http://icanhascheezburger.com/2009/03/09/funny-pictures-just-add-shadows/

  2. Daniel J. Andrews
    March 11, 2009

    That’s an interesting program. One of our students for her thesis project mapped the patterns of Massassauga rattlesnakes and came up an identification system that allowed a user to recognize previously captured rattlesnakes (for when markings wore off). It was all done by hand though…I will forward this link on to her prof as I’m sure there’ll be other ideas (I did a red-backed salamander marking system a few years ago with only limited success).

  3. MattK
    March 11, 2009

    Apparently pattern recognition would work for Mudpuppies (Necturus maculosus) too. I have thought of collecting images and using them to keep track of population trends, demography, growth rate, longevity etc but it would be too time consuming without some of that fancy software. I’d definitely be interested in learning more about using pattern recognition with Massassaugas. Not knowing anything about the technique I would have guessed that Massassaugas would be difficult to recognize individually since the pattern is so regular, unlike the haphazardly placed dots on ‘puppies or the variable striping on tigers.

  4. Daniel J. Andrews
    March 13, 2009

    MattK…each Massasauga has unique set of markings, like fingerprints. She broke down her categories into something like Bowties (did the snake have a bow tie shaped dark mark on the neck), U-shapes (U-shape on the neck) etc. Then those categories were broken down into subcategories by counting and identifying the type of pattern on the rest of the body.
    So if a snake had 10 blotches the code would look something like Bowtie 1-U, 2-U, 3-U, 4-C, 5-C etc (C= c-shaped dark mark). When they captured a snake, the researcher would call off the marks, and as they were entered into the database it would list your choices till you only had one or two choices which you could then compare to the photographs.
    There were saddle-shapes, broken shapes, S-shapes. She spent a few months just categorizing the shapes before she started in on her file system.
    If you want more info I can give you the prof’s email who probably still has the work on file, and he can give you much better info than I can. My address is at yahoo.ca. First part is my last name, my first name, then the initial ‘j’, in that order and as one word (no spaces or underlines).

  5. rajiv shrivastava
    September 6, 2009

    i want to identified tiger by their skin

  6. Elizabeth Kobren
    October 12, 2009

    I want to know if there is a method for taking a couple of photos I have – without accurate identification – used by scammers. And see if the real individual has them posted on the internet.
    Elizabeth

  7. Alexis
    June 2, 2010

    I am interested in doing something similar with amphibians. I have been fiddling around with the I3S “Interactive Individual Identification System” http://www.reijns.com/i3s/download/I3S_download.html however, I was really interested in finding a program that identified markings itself, without doing all the annotation for each individual. Does anyone know of a program that would be helpful?

Add Your Comments

All fields required.

Related Posts