What determines post thumbnails?

Sometimes I will post a link and no thumbnail seems to be pulled from the link. Is this a case by case basis or do I need to do something else?