|
# Prompts for Image Classification |
|
|
|
Below are the class names and templates that are used for collecting the zero-shot classification scores in the paper. Each dataset has two lists `classes` and `templates`, where the string `{}` in the template is to be replaced with the corresponding class names. For the Facial Emotion Recognition 2013 dataset specifically, we used multiple class names for certain classes. |
|
|
|
This file contains prompt data for 26 of the 27 datasets shown in Table 9 of the paper; the text prompts for ImageNet (as well as other [ImageNet Testbed](https://modestyachts.github.io/imagenet-testbed/) datasets in Figure 13) can be found in [this notebook](https://github.com/openai/CLIP/blob/main/notebooks/Prompt_Engineering_for_ImageNet.ipynb), as well as how to ensemble predictions from multiple prompts using these templates. |
|
|
|
If you are viewing this document on GitHub, use the table of contents icon at the upper left to browse the datasets. |
|
|
|
|
|
## Birdsnap |
|
|
|
```bash |
|
classes = [ |
|
'Acadian Flycatcher', |
|
'Acorn Woodpecker', |
|
'Alder Flycatcher', |
|
'Allens Hummingbird', |
|
'Altamira Oriole', |
|
'American Avocet', |
|
'American Bittern', |
|
'American Black Duck', |
|
'American Coot', |
|
'American Crow', |
|
'American Dipper', |
|
'American Golden Plover', |
|
'American Goldfinch', |
|
'American Kestrel', |
|
'American Oystercatcher', |
|
'American Pipit', |
|
'American Redstart', |
|
'American Robin', |
|
'American Three toed Woodpecker', |
|
'American Tree Sparrow', |
|
'American White Pelican', |
|
'American Wigeon', |
|
'American Woodcock', |
|
'Anhinga', |
|
'Annas Hummingbird', |
|
'Arctic Tern', |
|
'Ash throated Flycatcher', |
|
'Audubons Oriole', |
|
'Bairds Sandpiper', |
|
'Bald Eagle', |
|
'Baltimore Oriole', |
|
'Band tailed Pigeon', |
|
'Barn Swallow', |
|
'Barred Owl', |
|
'Barrows Goldeneye', |
|
'Bay breasted Warbler', |
|
'Bells Vireo', |
|
'Belted Kingfisher', |
|
'Bewicks Wren', |
|
'Black Guillemot', |
|
'Black Oystercatcher', |
|
'Black Phoebe', |
|
'Black Rosy Finch', |
|
'Black Scoter', |
|
'Black Skimmer', |
|
'Black Tern', |
|
'Black Turnstone', |
|
'Black Vulture', |
|
'Black and white Warbler', |
|
'Black backed Woodpecker', |
|
'Black bellied Plover', |
|
'Black billed Cuckoo', |
|
'Black billed Magpie', |
|
'Black capped Chickadee', |
|
'Black chinned Hummingbird', |
|
'Black chinned Sparrow', |
|
'Black crested Titmouse', |
|
'Black crowned Night Heron', |
|
'Black headed Grosbeak', |
|
'Black legged Kittiwake', |
|
'Black necked Stilt', |
|
'Black throated Blue Warbler', |
|
'Black throated Gray Warbler', |
|
'Black throated Green Warbler', |
|
'Black throated Sparrow', |
|
'Blackburnian Warbler', |
|
'Blackpoll Warbler', |
|
'Blue Grosbeak', |
|
'Blue Jay', |
|
'Blue gray Gnatcatcher', |
|
'Blue headed Vireo', |
|
'Blue winged Teal', |
|
'Blue winged Warbler', |
|
'Boat tailed Grackle', |
|
'Bobolink', |
|
'Bohemian Waxwing', |
|
'Bonapartes Gull', |
|
'Boreal Chickadee', |
|
'Brandts Cormorant', |
|
'Brant', |
|
'Brewers Blackbird', |
|
'Brewers Sparrow', |
|
'Bridled Titmouse', |
|
'Broad billed Hummingbird', |
|
'Broad tailed Hummingbird', |
|
'Broad winged Hawk', |
|
'Bronzed Cowbird', |
|
'Brown Creeper', |
|
'Brown Pelican', |
|
'Brown Thrasher', |
|
'Brown capped Rosy Finch', |
|
'Brown crested Flycatcher', |
|
'Brown headed Cowbird', |
|
'Brown headed Nuthatch', |
|
'Bufflehead', |
|
'Bullocks Oriole', |
|
'Burrowing Owl', |
|
'Bushtit', |
|
'Cackling Goose', |
|
'Cactus Wren', |
|
'California Gull', |
|
'California Quail', |
|
'California Thrasher', |
|
'California Towhee', |
|
'Calliope Hummingbird', |
|
'Canada Goose', |
|
'Canada Warbler', |
|
'Canvasback', |
|
'Canyon Towhee', |
|
'Canyon Wren', |
|
'Cape May Warbler', |
|
'Carolina Chickadee', |
|
'Carolina Wren', |
|
'Caspian Tern', |
|
'Cassins Finch', |
|
'Cassins Kingbird', |
|
'Cassins Sparrow', |
|
'Cassins Vireo', |
|
'Cattle Egret', |
|
'Cave Swallow', |
|
'Cedar Waxwing', |
|
'Cerulean Warbler', |
|
'Chestnut backed Chickadee', |
|
'Chestnut collared Longspur', |
|
'Chestnut sided Warbler', |
|
'Chihuahuan Raven', |
|
'Chimney Swift', |
|
'Chipping Sparrow', |
|
'Cinnamon Teal', |
|
'Clapper Rail', |
|
'Clarks Grebe', |
|
'Clarks Nutcracker', |
|
'Clay colored Sparrow', |
|
'Cliff Swallow', |
|
'Common Black Hawk', |
|
'Common Eider', |
|
'Common Gallinule', |
|
'Common Goldeneye', |
|
'Common Grackle', |
|
'Common Ground Dove', |
|
'Common Loon', |
|
'Common Merganser', |
|
'Common Murre', |
|
'Common Nighthawk', |
|
'Common Raven', |
|
'Common Redpoll', |
|
'Common Tern', |
|
'Common Yellowthroat', |
|
'Connecticut Warbler', |
|
'Coopers Hawk', |
|
'Cordilleran Flycatcher', |
|
'Costas Hummingbird', |
|
'Couchs Kingbird', |
|
'Crested Caracara', |
|
'Curve billed Thrasher', |
|
'Dark eyed Junco', |
|
'Dickcissel', |
|
'Double crested Cormorant', |
|
'Downy Woodpecker', |
|
'Dunlin', |
|
'Dusky Flycatcher', |
|
'Dusky Grouse', |
|
'Eared Grebe', |
|
'Eastern Bluebird', |
|
'Eastern Kingbird', |
|
'Eastern Meadowlark', |
|
'Eastern Phoebe', |
|
'Eastern Screech Owl', |
|
'Eastern Towhee', |
|
'Eastern Wood Pewee', |
|
'Elegant Trogon', |
|
'Elf Owl', |
|
'Eurasian Collared Dove', |
|
'Eurasian Wigeon', |
|
'European Starling', |
|
'Evening Grosbeak', |
|
'Ferruginous Hawk', |
|
'Ferruginous Pygmy Owl', |
|
'Field Sparrow', |
|
'Fish Crow', |
|
'Florida Scrub Jay', |
|
'Forsters Tern', |
|
'Fox Sparrow', |
|
'Franklins Gull', |
|
'Fulvous Whistling Duck', |
|
'Gadwall', |
|
'Gambels Quail', |
|
'Gila Woodpecker', |
|
'Glaucous Gull', |
|
'Glaucous winged Gull', |
|
'Glossy Ibis', |
|
'Golden Eagle', |
|
'Golden crowned Kinglet', |
|
'Golden crowned Sparrow', |
|
'Golden fronted Woodpecker', |
|
'Golden winged Warbler', |
|
'Grasshopper Sparrow', |
|
'Gray Catbird', |
|
'Gray Flycatcher', |
|
'Gray Jay', |
|
'Gray Kingbird', |
|
'Gray cheeked Thrush', |
|
'Gray crowned Rosy Finch', |
|
'Great Black backed Gull', |
|
'Great Blue Heron', |
|
'Great Cormorant', |
|
'Great Crested Flycatcher', |
|
'Great Egret', |
|
'Great Gray Owl', |
|
'Great Horned Owl', |
|
'Great Kiskadee', |
|
'Great tailed Grackle', |
|
'Greater Prairie Chicken', |
|
'Greater Roadrunner', |
|
'Greater Sage Grouse', |
|
'Greater Scaup', |
|
'Greater White fronted Goose', |
|
'Greater Yellowlegs', |
|
'Green Jay', |
|
'Green tailed Towhee', |
|
'Green winged Teal', |
|
'Groove billed Ani', |
|
'Gull billed Tern', |
|
'Hairy Woodpecker', |
|
'Hammonds Flycatcher', |
|
'Harlequin Duck', |
|
'Harriss Hawk', |
|
'Harriss Sparrow', |
|
'Heermanns Gull', |
|
'Henslows Sparrow', |
|
'Hepatic Tanager', |
|
'Hermit Thrush', |
|
'Herring Gull', |
|
'Hoary Redpoll', |
|
'Hooded Merganser', |
|
'Hooded Oriole', |
|
'Hooded Warbler', |
|
'Horned Grebe', |
|
'Horned Lark', |
|
'House Finch', |
|
'House Sparrow', |
|
'House Wren', |
|
'Huttons Vireo', |
|
'Iceland Gull', |
|
'Inca Dove', |
|
'Indigo Bunting', |
|
'Killdeer', |
|
'King Rail', |
|
'Ladder backed Woodpecker', |
|
'Lapland Longspur', |
|
'Lark Bunting', |
|
'Lark Sparrow', |
|
'Laughing Gull', |
|
'Lazuli Bunting', |
|
'Le Contes Sparrow', |
|
'Least Bittern', |
|
'Least Flycatcher', |
|
'Least Grebe', |
|
'Least Sandpiper', |
|
'Least Tern', |
|
'Lesser Goldfinch', |
|
'Lesser Nighthawk', |
|
'Lesser Scaup', |
|
'Lesser Yellowlegs', |
|
'Lewiss Woodpecker', |
|
'Limpkin', |
|
'Lincolns Sparrow', |
|
'Little Blue Heron', |
|
'Loggerhead Shrike', |
|
'Long billed Curlew', |
|
'Long billed Dowitcher', |
|
'Long billed Thrasher', |
|
'Long eared Owl', |
|
'Long tailed Duck', |
|
'Louisiana Waterthrush', |
|
'Magnificent Frigatebird', |
|
'Magnolia Warbler', |
|
'Mallard', |
|
'Marbled Godwit', |
|
'Marsh Wren', |
|
'Merlin', |
|
'Mew Gull', |
|
'Mexican Jay', |
|
'Mississippi Kite', |
|
'Monk Parakeet', |
|
'Mottled Duck', |
|
'Mountain Bluebird', |
|
'Mountain Chickadee', |
|
'Mountain Plover', |
|
'Mourning Dove', |
|
'Mourning Warbler', |
|
'Muscovy Duck', |
|
'Mute Swan', |
|
'Nashville Warbler', |
|
'Nelsons Sparrow', |
|
'Neotropic Cormorant', |
|
'Northern Bobwhite', |
|
'Northern Cardinal', |
|
'Northern Flicker', |
|
'Northern Gannet', |
|
'Northern Goshawk', |
|
'Northern Harrier', |
|
'Northern Hawk Owl', |
|
'Northern Mockingbird', |
|
'Northern Parula', |
|
'Northern Pintail', |
|
'Northern Rough winged Swallow', |
|
'Northern Saw whet Owl', |
|
'Northern Shrike', |
|
'Northern Waterthrush', |
|
'Nuttalls Woodpecker', |
|
'Oak Titmouse', |
|
'Olive Sparrow', |
|
'Olive sided Flycatcher', |
|
'Orange crowned Warbler', |
|
'Orchard Oriole', |
|
'Osprey', |
|
'Ovenbird', |
|
'Pacific Golden Plover', |
|
'Pacific Loon', |
|
'Pacific Wren', |
|
'Pacific slope Flycatcher', |
|
'Painted Bunting', |
|
'Painted Redstart', |
|
'Palm Warbler', |
|
'Pectoral Sandpiper', |
|
'Peregrine Falcon', |
|
'Phainopepla', |
|
'Philadelphia Vireo', |
|
'Pied billed Grebe', |
|
'Pigeon Guillemot', |
|
'Pileated Woodpecker', |
|
'Pine Grosbeak', |
|
'Pine Siskin', |
|
'Pine Warbler', |
|
'Piping Plover', |
|
'Plumbeous Vireo', |
|
'Prairie Falcon', |
|
'Prairie Warbler', |
|
'Prothonotary Warbler', |
|
'Purple Finch', |
|
'Purple Gallinule', |
|
'Purple Martin', |
|
'Purple Sandpiper', |
|
'Pygmy Nuthatch', |
|
'Pyrrhuloxia', |
|
'Red Crossbill', |
|
'Red Knot', |
|
'Red Phalarope', |
|
'Red bellied Woodpecker', |
|
'Red breasted Merganser', |
|
'Red breasted Nuthatch', |
|
'Red breasted Sapsucker', |
|
'Red cockaded Woodpecker', |
|
'Red eyed Vireo', |
|
'Red headed Woodpecker', |
|
'Red naped Sapsucker', |
|
'Red necked Grebe', |
|
'Red necked Phalarope', |
|
'Red shouldered Hawk', |
|
'Red tailed Hawk', |
|
'Red throated Loon', |
|
'Red winged Blackbird', |
|
'Reddish Egret', |
|
'Redhead', |
|
'Ring billed Gull', |
|
'Ring necked Duck', |
|
'Ring necked Pheasant', |
|
'Rock Pigeon', |
|
'Rock Ptarmigan', |
|
'Rock Sandpiper', |
|
'Rock Wren', |
|
'Rose breasted Grosbeak', |
|
'Roseate Tern', |
|
'Rosss Goose', |
|
'Rough legged Hawk', |
|
'Royal Tern', |
|
'Ruby crowned Kinglet', |
|
'Ruby throated Hummingbird', |
|
'Ruddy Duck', |
|
'Ruddy Turnstone', |
|
'Ruffed Grouse', |
|
'Rufous Hummingbird', |
|
'Rufous crowned Sparrow', |
|
'Rusty Blackbird', |
|
'Sage Thrasher', |
|
'Saltmarsh Sparrow', |
|
'Sanderling', |
|
'Sandhill Crane', |
|
'Sandwich Tern', |
|
'Says Phoebe', |
|
'Scaled Quail', |
|
'Scarlet Tanager', |
|
'Scissor tailed Flycatcher', |
|
'Scotts Oriole', |
|
'Seaside Sparrow', |
|
'Sedge Wren', |
|
'Semipalmated Plover', |
|
'Semipalmated Sandpiper', |
|
'Sharp shinned Hawk', |
|
'Sharp tailed Grouse', |
|
'Short billed Dowitcher', |
|
'Short eared Owl', |
|
'Snail Kite', |
|
'Snow Bunting', |
|
'Snow Goose', |
|
'Snowy Egret', |
|
'Snowy Owl', |
|
'Snowy Plover', |
|
'Solitary Sandpiper', |
|
'Song Sparrow', |
|
'Sooty Grouse', |
|
'Sora', |
|
'Spotted Owl', |
|
'Spotted Sandpiper', |
|
'Spotted Towhee', |
|
'Spruce Grouse', |
|
'Stellers Jay', |
|
'Stilt Sandpiper', |
|
'Summer Tanager', |
|
'Surf Scoter', |
|
'Surfbird', |
|
'Swainsons Hawk', |
|
'Swainsons Thrush', |
|
'Swallow tailed Kite', |
|
'Swamp Sparrow', |
|
'Tennessee Warbler', |
|
'Thayers Gull', |
|
'Townsends Solitaire', |
|
'Townsends Warbler', |
|
'Tree Swallow', |
|
'Tricolored Heron', |
|
'Tropical Kingbird', |
|
'Trumpeter Swan', |
|
'Tufted Titmouse', |
|
'Tundra Swan', |
|
'Turkey Vulture', |
|
'Upland Sandpiper', |
|
'Varied Thrush', |
|
'Veery', |
|
'Verdin', |
|
'Vermilion Flycatcher', |
|
'Vesper Sparrow', |
|
'Violet green Swallow', |
|
'Virginia Rail', |
|
'Wandering Tattler', |
|
'Warbling Vireo', |
|
'Western Bluebird', |
|
'Western Grebe', |
|
'Western Gull', |
|
'Western Kingbird', |
|
'Western Meadowlark', |
|
'Western Sandpiper', |
|
'Western Screech Owl', |
|
'Western Scrub Jay', |
|
'Western Tanager', |
|
'Western Wood Pewee', |
|
'Whimbrel', |
|
'White Ibis', |
|
'White breasted Nuthatch', |
|
'White crowned Sparrow', |
|
'White eyed Vireo', |
|
'White faced Ibis', |
|
'White headed Woodpecker', |
|
'White rumped Sandpiper', |
|
'White tailed Hawk', |
|
'White tailed Kite', |
|
'White tailed Ptarmigan', |
|
'White throated Sparrow', |
|
'White throated Swift', |
|
'White winged Crossbill', |
|
'White winged Dove', |
|
'White winged Scoter', |
|
'Wild Turkey', |
|
'Willet', |
|
'Williamsons Sapsucker', |
|
'Willow Flycatcher', |
|
'Willow Ptarmigan', |
|
'Wilsons Phalarope', |
|
'Wilsons Plover', |
|
'Wilsons Snipe', |
|
'Wilsons Warbler', |
|
'Winter Wren', |
|
'Wood Stork', |
|
'Wood Thrush', |
|
'Worm eating Warbler', |
|
'Wrentit', |
|
'Yellow Warbler', |
|
'Yellow bellied Flycatcher', |
|
'Yellow bellied Sapsucker', |
|
'Yellow billed Cuckoo', |
|
'Yellow billed Magpie', |
|
'Yellow breasted Chat', |
|
'Yellow crowned Night Heron', |
|
'Yellow eyed Junco', |
|
'Yellow headed Blackbird', |
|
'Yellow rumped Warbler', |
|
'Yellow throated Vireo', |
|
'Yellow throated Warbler', |
|
'Zone tailed Hawk', |
|
] |
|
|
|
templates = [ |
|
'a photo of a {}, a type of bird.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## CIFAR10 |
|
|
|
```bash |
|
classes = [ |
|
'airplane', |
|
'automobile', |
|
'bird', |
|
'cat', |
|
'deer', |
|
'dog', |
|
'frog', |
|
'horse', |
|
'ship', |
|
'truck', |
|
] |
|
|
|
templates = [ |
|
'a photo of a {}.', |
|
'a blurry photo of a {}.', |
|
'a black and white photo of a {}.', |
|
'a low contrast photo of a {}.', |
|
'a high contrast photo of a {}.', |
|
'a bad photo of a {}.', |
|
'a good photo of a {}.', |
|
'a photo of a small {}.', |
|
'a photo of a big {}.', |
|
'a photo of the {}.', |
|
'a blurry photo of the {}.', |
|
'a black and white photo of the {}.', |
|
'a low contrast photo of the {}.', |
|
'a high contrast photo of the {}.', |
|
'a bad photo of the {}.', |
|
'a good photo of the {}.', |
|
'a photo of the small {}.', |
|
'a photo of the big {}.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## CIFAR100 |
|
|
|
```bash |
|
classes = [ |
|
'apple', |
|
'aquarium fish', |
|
'baby', |
|
'bear', |
|
'beaver', |
|
'bed', |
|
'bee', |
|
'beetle', |
|
'bicycle', |
|
'bottle', |
|
'bowl', |
|
'boy', |
|
'bridge', |
|
'bus', |
|
'butterfly', |
|
'camel', |
|
'can', |
|
'castle', |
|
'caterpillar', |
|
'cattle', |
|
'chair', |
|
'chimpanzee', |
|
'clock', |
|
'cloud', |
|
'cockroach', |
|
'couch', |
|
'crab', |
|
'crocodile', |
|
'cup', |
|
'dinosaur', |
|
'dolphin', |
|
'elephant', |
|
'flatfish', |
|
'forest', |
|
'fox', |
|
'girl', |
|
'hamster', |
|
'house', |
|
'kangaroo', |
|
'keyboard', |
|
'lamp', |
|
'lawn mower', |
|
'leopard', |
|
'lion', |
|
'lizard', |
|
'lobster', |
|
'man', |
|
'maple tree', |
|
'motorcycle', |
|
'mountain', |
|
'mouse', |
|
'mushroom', |
|
'oak tree', |
|
'orange', |
|
'orchid', |
|
'otter', |
|
'palm tree', |
|
'pear', |
|
'pickup truck', |
|
'pine tree', |
|
'plain', |
|
'plate', |
|
'poppy', |
|
'porcupine', |
|
'possum', |
|
'rabbit', |
|
'raccoon', |
|
'ray', |
|
'road', |
|
'rocket', |
|
'rose', |
|
'sea', |
|
'seal', |
|
'shark', |
|
'shrew', |
|
'skunk', |
|
'skyscraper', |
|
'snail', |
|
'snake', |
|
'spider', |
|
'squirrel', |
|
'streetcar', |
|
'sunflower', |
|
'sweet pepper', |
|
'table', |
|
'tank', |
|
'telephone', |
|
'television', |
|
'tiger', |
|
'tractor', |
|
'train', |
|
'trout', |
|
'tulip', |
|
'turtle', |
|
'wardrobe', |
|
'whale', |
|
'willow tree', |
|
'wolf', |
|
'woman', |
|
'worm', |
|
] |
|
|
|
templates = [ |
|
'a photo of a {}.', |
|
'a blurry photo of a {}.', |
|
'a black and white photo of a {}.', |
|
'a low contrast photo of a {}.', |
|
'a high contrast photo of a {}.', |
|
'a bad photo of a {}.', |
|
'a good photo of a {}.', |
|
'a photo of a small {}.', |
|
'a photo of a big {}.', |
|
'a photo of the {}.', |
|
'a blurry photo of the {}.', |
|
'a black and white photo of the {}.', |
|
'a low contrast photo of the {}.', |
|
'a high contrast photo of the {}.', |
|
'a bad photo of the {}.', |
|
'a good photo of the {}.', |
|
'a photo of the small {}.', |
|
'a photo of the big {}.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## CLEVRCounts |
|
|
|
```bash |
|
classes = [ |
|
'10', |
|
'3', |
|
'4', |
|
'5', |
|
'6', |
|
'7', |
|
'8', |
|
'9', |
|
] |
|
|
|
templates = [ |
|
'a photo of {} objects.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## Caltech101 |
|
|
|
```bash |
|
classes = [ |
|
'background', |
|
'off-center face', |
|
'centered face', |
|
'leopard', |
|
'motorbike', |
|
'accordion', |
|
'airplane', |
|
'anchor', |
|
'ant', |
|
'barrel', |
|
'bass', |
|
'beaver', |
|
'binocular', |
|
'bonsai', |
|
'brain', |
|
'brontosaurus', |
|
'buddha', |
|
'butterfly', |
|
'camera', |
|
'cannon', |
|
'side of a car', |
|
'ceiling fan', |
|
'cellphone', |
|
'chair', |
|
'chandelier', |
|
'body of a cougar cat', |
|
'face of a cougar cat', |
|
'crab', |
|
'crayfish', |
|
'crocodile', |
|
'head of a crocodile', |
|
'cup', |
|
'dalmatian', |
|
'dollar bill', |
|
'dolphin', |
|
'dragonfly', |
|
'electric guitar', |
|
'elephant', |
|
'emu', |
|
'euphonium', |
|
'ewer', |
|
'ferry', |
|
'flamingo', |
|
'head of a flamingo', |
|
'garfield', |
|
'gerenuk', |
|
'gramophone', |
|
'grand piano', |
|
'hawksbill', |
|
'headphone', |
|
'hedgehog', |
|
'helicopter', |
|
'ibis', |
|
'inline skate', |
|
'joshua tree', |
|
'kangaroo', |
|
'ketch', |
|
'lamp', |
|
'laptop', |
|
'llama', |
|
'lobster', |
|
'lotus', |
|
'mandolin', |
|
'mayfly', |
|
'menorah', |
|
'metronome', |
|
'minaret', |
|
'nautilus', |
|
'octopus', |
|
'okapi', |
|
'pagoda', |
|
'panda', |
|
'pigeon', |
|
'pizza', |
|
'platypus', |
|
'pyramid', |
|
'revolver', |
|
'rhino', |
|
'rooster', |
|
'saxophone', |
|
'schooner', |
|
'scissors', |
|
'scorpion', |
|
'sea horse', |
|
'snoopy (cartoon beagle)', |
|
'soccer ball', |
|
'stapler', |
|
'starfish', |
|
'stegosaurus', |
|
'stop sign', |
|
'strawberry', |
|
'sunflower', |
|
'tick', |
|
'trilobite', |
|
'umbrella', |
|
'watch', |
|
'water lilly', |
|
'wheelchair', |
|
'wild cat', |
|
'windsor chair', |
|
'wrench', |
|
'yin and yang symbol', |
|
] |
|
|
|
templates = [ |
|
'a photo of a {}.', |
|
'a painting of a {}.', |
|
'a plastic {}.', |
|
'a sculpture of a {}.', |
|
'a sketch of a {}.', |
|
'a tattoo of a {}.', |
|
'a toy {}.', |
|
'a rendition of a {}.', |
|
'a embroidered {}.', |
|
'a cartoon {}.', |
|
'a {} in a video game.', |
|
'a plushie {}.', |
|
'a origami {}.', |
|
'art of a {}.', |
|
'graffiti of a {}.', |
|
'a drawing of a {}.', |
|
'a doodle of a {}.', |
|
'a photo of the {}.', |
|
'a painting of the {}.', |
|
'the plastic {}.', |
|
'a sculpture of the {}.', |
|
'a sketch of the {}.', |
|
'a tattoo of the {}.', |
|
'the toy {}.', |
|
'a rendition of the {}.', |
|
'the embroidered {}.', |
|
'the cartoon {}.', |
|
'the {} in a video game.', |
|
'the plushie {}.', |
|
'the origami {}.', |
|
'art of the {}.', |
|
'graffiti of the {}.', |
|
'a drawing of the {}.', |
|
'a doodle of the {}.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## Country211 |
|
|
|
```bash |
|
classes = [ |
|
'Andorra', |
|
'United Arab Emirates', |
|
'Afghanistan', |
|
'Antigua and Barbuda', |
|
'Anguilla', |
|
'Albania', |
|
'Armenia', |
|
'Angola', |
|
'Antarctica', |
|
'Argentina', |
|
'Austria', |
|
'Australia', |
|
'Aruba', |
|
'Aland Islands', |
|
'Azerbaijan', |
|
'Bosnia and Herzegovina', |
|
'Barbados', |
|
'Bangladesh', |
|
'Belgium', |
|
'Burkina Faso', |
|
'Bulgaria', |
|
'Bahrain', |
|
'Benin', |
|
'Bermuda', |
|
'Brunei Darussalam', |
|
'Bolivia', |
|
'Bonaire, Saint Eustatius and Saba', |
|
'Brazil', |
|
'Bahamas', |
|
'Bhutan', |
|
'Botswana', |
|
'Belarus', |
|
'Belize', |
|
'Canada', |
|
'DR Congo', |
|
'Central African Republic', |
|
'Switzerland', |
|
"Cote d'Ivoire", |
|
'Cook Islands', |
|
'Chile', |
|
'Cameroon', |
|
'China', |
|
'Colombia', |
|
'Costa Rica', |
|
'Cuba', |
|
'Cabo Verde', |
|
'Curacao', |
|
'Cyprus', |
|
'Czech Republic', |
|
'Germany', |
|
'Denmark', |
|
'Dominica', |
|
'Dominican Republic', |
|
'Algeria', |
|
'Ecuador', |
|
'Estonia', |
|
'Egypt', |
|
'Spain', |
|
'Ethiopia', |
|
'Finland', |
|
'Fiji', |
|
'Falkland Islands', |
|
'Faeroe Islands', |
|
'France', |
|
'Gabon', |
|
'United Kingdom', |
|
'Grenada', |
|
'Georgia', |
|
'French Guiana', |
|
'Guernsey', |
|
'Ghana', |
|
'Gibraltar', |
|
'Greenland', |
|
'Gambia', |
|
'Guadeloupe', |
|
'Greece', |
|
'South Georgia and South Sandwich Is.', |
|
'Guatemala', |
|
'Guam', |
|
'Guyana', |
|
'Hong Kong', |
|
'Honduras', |
|
'Croatia', |
|
'Haiti', |
|
'Hungary', |
|
'Indonesia', |
|
'Ireland', |
|
'Israel', |
|
'Isle of Man', |
|
'India', |
|
'Iraq', |
|
'Iran', |
|
'Iceland', |
|
'Italy', |
|
'Jersey', |
|
'Jamaica', |
|
'Jordan', |
|
'Japan', |
|
'Kenya', |
|
'Kyrgyz Republic', |
|
'Cambodia', |
|
'St. Kitts and Nevis', |
|
'North Korea', |
|
'South Korea', |
|
'Kuwait', |
|
'Cayman Islands', |
|
'Kazakhstan', |
|
'Laos', |
|
'Lebanon', |
|
'St. Lucia', |
|
'Liechtenstein', |
|
'Sri Lanka', |
|
'Liberia', |
|
'Lithuania', |
|
'Luxembourg', |
|
'Latvia', |
|
'Libya', |
|
'Morocco', |
|
'Monaco', |
|
'Moldova', |
|
'Montenegro', |
|
'Saint-Martin', |
|
'Madagascar', |
|
'Macedonia', |
|
'Mali', |
|
'Myanmar', |
|
'Mongolia', |
|
'Macau', |
|
'Martinique', |
|
'Mauritania', |
|
'Malta', |
|
'Mauritius', |
|
'Maldives', |
|
'Malawi', |
|
'Mexico', |
|
'Malaysia', |
|
'Mozambique', |
|
'Namibia', |
|
'New Caledonia', |
|
'Nigeria', |
|
'Nicaragua', |
|
'Netherlands', |
|
'Norway', |
|
'Nepal', |
|
'New Zealand', |
|
'Oman', |
|
'Panama', |
|
'Peru', |
|
'French Polynesia', |
|
'Papua New Guinea', |
|
'Philippines', |
|
'Pakistan', |
|
'Poland', |
|
'Puerto Rico', |
|
'Palestine', |
|
'Portugal', |
|
'Palau', |
|
'Paraguay', |
|
'Qatar', |
|
'Reunion', |
|
'Romania', |
|
'Serbia', |
|
'Russia', |
|
'Rwanda', |
|
'Saudi Arabia', |
|
'Solomon Islands', |
|
'Seychelles', |
|
'Sudan', |
|
'Sweden', |
|
'Singapore', |
|
'St. Helena', |
|
'Slovenia', |
|
'Svalbard and Jan Mayen Islands', |
|
'Slovakia', |
|
'Sierra Leone', |
|
'San Marino', |
|
'Senegal', |
|
'Somalia', |
|
'South Sudan', |
|
'El Salvador', |
|
'Sint Maarten', |
|
'Syria', |
|
'Eswatini', |
|
'Togo', |
|
'Thailand', |
|
'Tajikistan', |
|
'Timor-Leste', |
|
'Turkmenistan', |
|
'Tunisia', |
|
'Tonga', |
|
'Turkey', |
|
'Trinidad and Tobago', |
|
'Taiwan', |
|
'Tanzania', |
|
'Ukraine', |
|
'Uganda', |
|
'United States', |
|
'Uruguay', |
|
'Uzbekistan', |
|
'Vatican', |
|
'Venezuela', |
|
'British Virgin Islands', |
|
'United States Virgin Islands', |
|
'Vietnam', |
|
'Vanuatu', |
|
'Samoa', |
|
'Kosovo', |
|
'Yemen', |
|
'South Africa', |
|
'Zambia', |
|
'Zimbabwe', |
|
] |
|
|
|
templates = [ |
|
'a photo i took in {}.', |
|
'a photo i took while visiting {}.', |
|
'a photo from my home country of {}.', |
|
'a photo from my visit to {}.', |
|
'a photo showing the country of {}.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## DescribableTextures |
|
|
|
```bash |
|
classes = [ |
|
'banded', |
|
'blotchy', |
|
'braided', |
|
'bubbly', |
|
'bumpy', |
|
'chequered', |
|
'cobwebbed', |
|
'cracked', |
|
'crosshatched', |
|
'crystalline', |
|
'dotted', |
|
'fibrous', |
|
'flecked', |
|
'freckled', |
|
'frilly', |
|
'gauzy', |
|
'grid', |
|
'grooved', |
|
'honeycombed', |
|
'interlaced', |
|
'knitted', |
|
'lacelike', |
|
'lined', |
|
'marbled', |
|
'matted', |
|
'meshed', |
|
'paisley', |
|
'perforated', |
|
'pitted', |
|
'pleated', |
|
'polka-dotted', |
|
'porous', |
|
'potholed', |
|
'scaly', |
|
'smeared', |
|
'spiralled', |
|
'sprinkled', |
|
'stained', |
|
'stratified', |
|
'striped', |
|
'studded', |
|
'swirly', |
|
'veined', |
|
'waffled', |
|
'woven', |
|
'wrinkled', |
|
'zigzagged', |
|
] |
|
|
|
templates = [ |
|
'a photo of a {} texture.', |
|
'a photo of a {} pattern.', |
|
'a photo of a {} thing.', |
|
'a photo of a {} object.', |
|
'a photo of the {} texture.', |
|
'a photo of the {} pattern.', |
|
'a photo of the {} thing.', |
|
'a photo of the {} object.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## EuroSAT |
|
|
|
```bash |
|
classes = [ |
|
'forest', |
|
'permanent crop land', |
|
'residential buildings or homes or apartments', |
|
'river', |
|
'pasture land', |
|
'lake or sea', |
|
'brushland or shrubland', |
|
'annual crop land', |
|
'industrial buildings or commercial buildings', |
|
'highway or road', |
|
] |
|
|
|
templates = [ |
|
'a centered satellite photo of {}.', |
|
'a centered satellite photo of a {}.', |
|
'a centered satellite photo of the {}.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## FGVCAircraft |
|
|
|
```bash |
|
classes = [ |
|
'707-320', |
|
'727-200', |
|
'737-200', |
|
'737-300', |
|
'737-400', |
|
'737-500', |
|
'737-600', |
|
'737-700', |
|
'737-800', |
|
'737-900', |
|
'747-100', |
|
'747-200', |
|
'747-300', |
|
'747-400', |
|
'757-200', |
|
'757-300', |
|
'767-200', |
|
'767-300', |
|
'767-400', |
|
'777-200', |
|
'777-300', |
|
'A300B4', |
|
'A310', |
|
'A318', |
|
'A319', |
|
'A320', |
|
'A321', |
|
'A330-200', |
|
'A330-300', |
|
'A340-200', |
|
'A340-300', |
|
'A340-500', |
|
'A340-600', |
|
'A380', |
|
'ATR-42', |
|
'ATR-72', |
|
'An-12', |
|
'BAE 146-200', |
|
'BAE 146-300', |
|
'BAE-125', |
|
'Beechcraft 1900', |
|
'Boeing 717', |
|
'C-130', |
|
'C-47', |
|
'CRJ-200', |
|
'CRJ-700', |
|
'CRJ-900', |
|
'Cessna 172', |
|
'Cessna 208', |
|
'Cessna 525', |
|
'Cessna 560', |
|
'Challenger 600', |
|
'DC-10', |
|
'DC-3', |
|
'DC-6', |
|
'DC-8', |
|
'DC-9-30', |
|
'DH-82', |
|
'DHC-1', |
|
'DHC-6', |
|
'DHC-8-100', |
|
'DHC-8-300', |
|
'DR-400', |
|
'Dornier 328', |
|
'E-170', |
|
'E-190', |
|
'E-195', |
|
'EMB-120', |
|
'ERJ 135', |
|
'ERJ 145', |
|
'Embraer Legacy 600', |
|
'Eurofighter Typhoon', |
|
'F-16A/B', |
|
'F/A-18', |
|
'Falcon 2000', |
|
'Falcon 900', |
|
'Fokker 100', |
|
'Fokker 50', |
|
'Fokker 70', |
|
'Global Express', |
|
'Gulfstream IV', |
|
'Gulfstream V', |
|
'Hawk T1', |
|
'Il-76', |
|
'L-1011', |
|
'MD-11', |
|
'MD-80', |
|
'MD-87', |
|
'MD-90', |
|
'Metroliner', |
|
'Model B200', |
|
'PA-28', |
|
'SR-20', |
|
'Saab 2000', |
|
'Saab 340', |
|
'Spitfire', |
|
'Tornado', |
|
'Tu-134', |
|
'Tu-154', |
|
'Yak-42', |
|
] |
|
|
|
templates = [ |
|
'a photo of a {}, a type of aircraft.', |
|
'a photo of the {}, a type of aircraft.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## FacialEmotionRecognition2013 |
|
|
|
```bash |
|
classes = [ |
|
['angry'], |
|
['disgusted'], |
|
['fearful'], |
|
['happy', 'smiling'], |
|
['sad', 'depressed'], |
|
['surprised', 'shocked', 'spooked'], |
|
['neutral', 'bored'], |
|
] |
|
|
|
templates = [ |
|
'a photo of a {} looking face.', |
|
'a photo of a face showing the emotion: {}.', |
|
'a photo of a face looking {}.', |
|
'a face that looks {}.', |
|
'they look {}.', |
|
'look at how {} they are.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## Flowers102 |
|
|
|
```bash |
|
classes = [ |
|
'pink primrose', |
|
'hard-leaved pocket orchid', |
|
'canterbury bells', |
|
'sweet pea', |
|
'english marigold', |
|
'tiger lily', |
|
'moon orchid', |
|
'bird of paradise', |
|
'monkshood', |
|
'globe thistle', |
|
'snapdragon', |
|
"colt's foot", |
|
'king protea', |
|
'spear thistle', |
|
'yellow iris', |
|
'globe flower', |
|
'purple coneflower', |
|
'peruvian lily', |
|
'balloon flower', |
|
'giant white arum lily', |
|
'fire lily', |
|
'pincushion flower', |
|
'fritillary', |
|
'red ginger', |
|
'grape hyacinth', |
|
'corn poppy', |
|
'prince of wales feathers', |
|
'stemless gentian', |
|
'artichoke', |
|
'sweet william', |
|
'carnation', |
|
'garden phlox', |
|
'love in the mist', |
|
'mexican aster', |
|
'alpine sea holly', |
|
'ruby-lipped cattleya', |
|
'cape flower', |
|
'great masterwort', |
|
'siam tulip', |
|
'lenten rose', |
|
'barbeton daisy', |
|
'daffodil', |
|
'sword lily', |
|
'poinsettia', |
|
'bolero deep blue', |
|
'wallflower', |
|
'marigold', |
|
'buttercup', |
|
'oxeye daisy', |
|
'common dandelion', |
|
'petunia', |
|
'wild pansy', |
|
'primula', |
|
'sunflower', |
|
'pelargonium', |
|
'bishop of llandaff', |
|
'gaura', |
|
'geranium', |
|
'orange dahlia', |
|
'pink and yellow dahlia', |
|
'cautleya spicata', |
|
'japanese anemone', |
|
'black-eyed susan', |
|
'silverbush', |
|
'californian poppy', |
|
'osteospermum', |
|
'spring crocus', |
|
'bearded iris', |
|
'windflower', |
|
'tree poppy', |
|
'gazania', |
|
'azalea', |
|
'water lily', |
|
'rose', |
|
'thorn apple', |
|
'morning glory', |
|
'passion flower', |
|
'lotus', |
|
'toad lily', |
|
'anthurium', |
|
'frangipani', |
|
'clematis', |
|
'hibiscus', |
|
'columbine', |
|
'desert-rose', |
|
'tree mallow', |
|
'magnolia', |
|
'cyclamen', |
|
'watercress', |
|
'canna lily', |
|
'hippeastrum', |
|
'bee balm', |
|
'air plant', |
|
'foxglove', |
|
'bougainvillea', |
|
'camellia', |
|
'mallow', |
|
'mexican petunia', |
|
'bromelia', |
|
'blanket flower', |
|
'trumpet creeper', |
|
'blackberry lily', |
|
] |
|
|
|
templates = [ |
|
'a photo of a {}, a type of flower.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## Food101 |
|
|
|
```bash |
|
classes = [ |
|
'apple pie', |
|
'baby back ribs', |
|
'baklava', |
|
'beef carpaccio', |
|
'beef tartare', |
|
'beet salad', |
|
'beignets', |
|
'bibimbap', |
|
'bread pudding', |
|
'breakfast burrito', |
|
'bruschetta', |
|
'caesar salad', |
|
'cannoli', |
|
'caprese salad', |
|
'carrot cake', |
|
'ceviche', |
|
'cheese plate', |
|
'cheesecake', |
|
'chicken curry', |
|
'chicken quesadilla', |
|
'chicken wings', |
|
'chocolate cake', |
|
'chocolate mousse', |
|
'churros', |
|
'clam chowder', |
|
'club sandwich', |
|
'crab cakes', |
|
'creme brulee', |
|
'croque madame', |
|
'cup cakes', |
|
'deviled eggs', |
|
'donuts', |
|
'dumplings', |
|
'edamame', |
|
'eggs benedict', |
|
'escargots', |
|
'falafel', |
|
'filet mignon', |
|
'fish and chips', |
|
'foie gras', |
|
'french fries', |
|
'french onion soup', |
|
'french toast', |
|
'fried calamari', |
|
'fried rice', |
|
'frozen yogurt', |
|
'garlic bread', |
|
'gnocchi', |
|
'greek salad', |
|
'grilled cheese sandwich', |
|
'grilled salmon', |
|
'guacamole', |
|
'gyoza', |
|
'hamburger', |
|
'hot and sour soup', |
|
'hot dog', |
|
'huevos rancheros', |
|
'hummus', |
|
'ice cream', |
|
'lasagna', |
|
'lobster bisque', |
|
'lobster roll sandwich', |
|
'macaroni and cheese', |
|
'macarons', |
|
'miso soup', |
|
'mussels', |
|
'nachos', |
|
'omelette', |
|
'onion rings', |
|
'oysters', |
|
'pad thai', |
|
'paella', |
|
'pancakes', |
|
'panna cotta', |
|
'peking duck', |
|
'pho', |
|
'pizza', |
|
'pork chop', |
|
'poutine', |
|
'prime rib', |
|
'pulled pork sandwich', |
|
'ramen', |
|
'ravioli', |
|
'red velvet cake', |
|
'risotto', |
|
'samosa', |
|
'sashimi', |
|
'scallops', |
|
'seaweed salad', |
|
'shrimp and grits', |
|
'spaghetti bolognese', |
|
'spaghetti carbonara', |
|
'spring rolls', |
|
'steak', |
|
'strawberry shortcake', |
|
'sushi', |
|
'tacos', |
|
'takoyaki', |
|
'tiramisu', |
|
'tuna tartare', |
|
'waffles', |
|
] |
|
|
|
templates = [ |
|
'a photo of {}, a type of food.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## GTSRB |
|
|
|
```bash |
|
classes = [ |
|
'red and white circle 20 kph speed limit', |
|
'red and white circle 30 kph speed limit', |
|
'red and white circle 50 kph speed limit', |
|
'red and white circle 60 kph speed limit', |
|
'red and white circle 70 kph speed limit', |
|
'red and white circle 80 kph speed limit', |
|
'end / de-restriction of 80 kph speed limit', |
|
'red and white circle 100 kph speed limit', |
|
'red and white circle 120 kph speed limit', |
|
'red and white circle red car and black car no passing', |
|
'red and white circle red truck and black car no passing', |
|
'red and white triangle road intersection warning', |
|
'white and yellow diamond priority road', |
|
'red and white upside down triangle yield right-of-way', |
|
'stop', |
|
'empty red and white circle', |
|
'red and white circle no truck entry', |
|
'red circle with white horizonal stripe no entry', |
|
'red and white triangle with exclamation mark warning', |
|
'red and white triangle with black left curve approaching warning', |
|
'red and white triangle with black right curve approaching warning', |
|
'red and white triangle with black double curve approaching warning', |
|
'red and white triangle rough / bumpy road warning', |
|
'red and white triangle car skidding / slipping warning', |
|
'red and white triangle with merging / narrow lanes warning', |
|
'red and white triangle with person digging / construction / road work warning', |
|
'red and white triangle with traffic light approaching warning', |
|
'red and white triangle with person walking warning', |
|
'red and white triangle with child and person walking warning', |
|
'red and white triangle with bicyle warning', |
|
'red and white triangle with snowflake / ice warning', |
|
'red and white triangle with deer warning', |
|
'white circle with gray strike bar no speed limit', |
|
'blue circle with white right turn arrow mandatory', |
|
'blue circle with white left turn arrow mandatory', |
|
'blue circle with white forward arrow mandatory', |
|
'blue circle with white forward or right turn arrow mandatory', |
|
'blue circle with white forward or left turn arrow mandatory', |
|
'blue circle with white keep right arrow mandatory', |
|
'blue circle with white keep left arrow mandatory', |
|
'blue circle with white arrows indicating a traffic circle', |
|
'white circle with gray strike bar indicating no passing for cars has ended', |
|
'white circle with gray strike bar indicating no passing for trucks has ended', |
|
] |
|
|
|
templates = [ |
|
'a zoomed in photo of a "{}" traffic sign.', |
|
'a centered photo of a "{}" traffic sign.', |
|
'a close up photo of a "{}" traffic sign.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## HatefulMemes |
|
|
|
```bash |
|
classes = [ |
|
'meme', |
|
'hatespeech meme', |
|
] |
|
|
|
templates = [ |
|
'a {}.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## KITTI |
|
|
|
```bash |
|
classes = [ |
|
'a photo i took of a car on my left or right side.', |
|
'a photo i took with a car nearby.', |
|
'a photo i took with a car in the distance.', |
|
'a photo i took with no car.', |
|
] |
|
|
|
templates = [ |
|
'{}', |
|
] |
|
``` |
|
|
|
|
|
|
|
## Kinetics700 |
|
|
|
```bash |
|
classes = [ |
|
'abseiling', |
|
'acting in play', |
|
'adjusting glasses', |
|
'air drumming', |
|
'alligator wrestling', |
|
'answering questions', |
|
'applauding', |
|
'applying cream', |
|
'archaeological excavation', |
|
'archery', |
|
'arguing', |
|
'arm wrestling', |
|
'arranging flowers', |
|
'arresting', |
|
'assembling bicycle', |
|
'assembling computer', |
|
'attending conference', |
|
'auctioning', |
|
'baby waking up', |
|
'backflip (human)', |
|
'baking cookies', |
|
'bandaging', |
|
'barbequing', |
|
'bartending', |
|
'base jumping', |
|
'bathing dog', |
|
'battle rope training', |
|
'beatboxing', |
|
'bee keeping', |
|
'being excited', |
|
'being in zero gravity', |
|
'belly dancing', |
|
'bench pressing', |
|
'bending back', |
|
'bending metal', |
|
'biking through snow', |
|
'blasting sand', |
|
'blending fruit', |
|
'blowdrying hair', |
|
'blowing bubble gum', |
|
'blowing glass', |
|
'blowing leaves', |
|
'blowing nose', |
|
'blowing out candles', |
|
'bobsledding', |
|
'bodysurfing', |
|
'bookbinding', |
|
'bottling', |
|
'bouncing ball (not juggling)', |
|
'bouncing on bouncy castle', |
|
'bouncing on trampoline', |
|
'bowling', |
|
'braiding hair', |
|
'breading or breadcrumbing', |
|
'breakdancing', |
|
'breaking boards', |
|
'breaking glass', |
|
'breathing fire', |
|
'brush painting', |
|
'brushing floor', |
|
'brushing hair', |
|
'brushing teeth', |
|
'building cabinet', |
|
'building lego', |
|
'building sandcastle', |
|
'building shed', |
|
'bulldozing', |
|
'bungee jumping', |
|
'burping', |
|
'busking', |
|
'calculating', |
|
'calligraphy', |
|
'canoeing or kayaking', |
|
'capoeira', |
|
'capsizing', |
|
'card stacking', |
|
'card throwing', |
|
'carrying baby', |
|
'carrying weight', |
|
'cartwheeling', |
|
'carving ice', |
|
'carving marble', |
|
'carving pumpkin', |
|
'carving wood with a knife', |
|
'casting fishing line', |
|
'catching fish', |
|
'catching or throwing baseball', |
|
'catching or throwing frisbee', |
|
'catching or throwing softball', |
|
'celebrating', |
|
'changing gear in car', |
|
'changing oil', |
|
'changing wheel (not on bike)', |
|
'chasing', |
|
'checking tires', |
|
'checking watch', |
|
'cheerleading', |
|
'chewing gum', |
|
'chiseling stone', |
|
'chiseling wood', |
|
'chopping meat', |
|
'chopping wood', |
|
'clam digging', |
|
'clapping', |
|
'clay pottery making', |
|
'clean and jerk', |
|
'cleaning gutters', |
|
'cleaning pool', |
|
'cleaning shoes', |
|
'cleaning toilet', |
|
'cleaning windows', |
|
'climbing a rope', |
|
'climbing ladder', |
|
'climbing tree', |
|
'closing door', |
|
'coloring in', |
|
'combing hair', |
|
'contact juggling', |
|
'contorting', |
|
'cooking chicken', |
|
'cooking egg', |
|
'cooking on campfire', |
|
'cooking sausages (not on barbeque)', |
|
'cooking scallops', |
|
'cosplaying', |
|
'coughing', |
|
'counting money', |
|
'country line dancing', |
|
'cracking back', |
|
'cracking knuckles', |
|
'cracking neck', |
|
'crawling baby', |
|
'crocheting', |
|
'crossing eyes', |
|
'crossing river', |
|
'crying', |
|
'cumbia', |
|
'curling (sport)', |
|
'curling eyelashes', |
|
'curling hair', |
|
'cutting apple', |
|
'cutting cake', |
|
'cutting nails', |
|
'cutting orange', |
|
'cutting pineapple', |
|
'cutting watermelon', |
|
'dancing ballet', |
|
'dancing charleston', |
|
'dancing gangnam style', |
|
'dancing macarena', |
|
'deadlifting', |
|
'dealing cards', |
|
'decorating the christmas tree', |
|
'decoupage', |
|
'delivering mail', |
|
'digging', |
|
'dining', |
|
'directing traffic', |
|
'disc golfing', |
|
'diving cliff', |
|
'docking boat', |
|
'dodgeball', |
|
'doing aerobics', |
|
'doing jigsaw puzzle', |
|
'doing laundry', |
|
'doing nails', |
|
'doing sudoku', |
|
'drawing', |
|
'dribbling basketball', |
|
'drinking shots', |
|
'driving car', |
|
'driving tractor', |
|
'drooling', |
|
'drop kicking', |
|
'drumming fingers', |
|
'dumpster diving', |
|
'dunking basketball', |
|
'dyeing eyebrows', |
|
'dyeing hair', |
|
'eating burger', |
|
'eating cake', |
|
'eating carrots', |
|
'eating chips', |
|
'eating doughnuts', |
|
'eating hotdog', |
|
'eating ice cream', |
|
'eating nachos', |
|
'eating spaghetti', |
|
'eating watermelon', |
|
'egg hunting', |
|
'embroidering', |
|
'entering church', |
|
'exercising arm', |
|
'exercising with an exercise ball', |
|
'extinguishing fire', |
|
'faceplanting', |
|
'falling off bike', |
|
'falling off chair', |
|
'feeding birds', |
|
'feeding fish', |
|
'feeding goats', |
|
'fencing (sport)', |
|
'fidgeting', |
|
'filling cake', |
|
'filling eyebrows', |
|
'finger snapping', |
|
'fixing bicycle', |
|
'fixing hair', |
|
'flint knapping', |
|
'flipping bottle', |
|
'flipping pancake', |
|
'fly tying', |
|
'flying kite', |
|
'folding clothes', |
|
'folding napkins', |
|
'folding paper', |
|
'front raises', |
|
'frying vegetables', |
|
'gargling', |
|
'geocaching', |
|
'getting a haircut', |
|
'getting a piercing', |
|
'getting a tattoo', |
|
'giving or receiving award', |
|
'gold panning', |
|
'golf chipping', |
|
'golf driving', |
|
'golf putting', |
|
'gospel singing in church', |
|
'grinding meat', |
|
'grooming cat', |
|
'grooming dog', |
|
'grooming horse', |
|
'gymnastics tumbling', |
|
'hammer throw', |
|
'hand washing clothes', |
|
'head stand', |
|
'headbanging', |
|
'headbutting', |
|
'helmet diving', |
|
'herding cattle', |
|
'high fiving', |
|
'high jump', |
|
'high kick', |
|
'historical reenactment', |
|
'hitting baseball', |
|
'hockey stop', |
|
'holding snake', |
|
'home roasting coffee', |
|
'hopscotch', |
|
'hoverboarding', |
|
'huddling', |
|
'hugging (not baby)', |
|
'hugging baby', |
|
'hula hooping', |
|
'hurdling', |
|
'hurling (sport)', |
|
'ice climbing', |
|
'ice fishing', |
|
'ice skating', |
|
'ice swimming', |
|
'inflating balloons', |
|
'installing carpet', |
|
'ironing', |
|
'ironing hair', |
|
'javelin throw', |
|
'jaywalking', |
|
'jetskiing', |
|
'jogging', |
|
'juggling balls', |
|
'juggling fire', |
|
'juggling soccer ball', |
|
'jumping bicycle', |
|
'jumping into pool', |
|
'jumping jacks', |
|
'jumping sofa', |
|
'jumpstyle dancing', |
|
'karaoke', |
|
'kicking field goal', |
|
'kicking soccer ball', |
|
'kissing', |
|
'kitesurfing', |
|
'knitting', |
|
'krumping', |
|
'land sailing', |
|
'laughing', |
|
'lawn mower racing', |
|
'laying bricks', |
|
'laying concrete', |
|
'laying decking', |
|
'laying stone', |
|
'laying tiles', |
|
'leatherworking', |
|
'letting go of balloon', |
|
'licking', |
|
'lifting hat', |
|
'lighting candle', |
|
'lighting fire', |
|
'listening with headphones', |
|
'lock picking', |
|
'long jump', |
|
'longboarding', |
|
'looking at phone', |
|
'looking in mirror', |
|
'luge', |
|
'lunge', |
|
'making a cake', |
|
'making a sandwich', |
|
'making balloon shapes', |
|
'making bubbles', |
|
'making cheese', |
|
'making horseshoes', |
|
'making jewelry', |
|
'making latte art', |
|
'making paper aeroplanes', |
|
'making pizza', |
|
'making slime', |
|
'making snowman', |
|
'making sushi', |
|
'making tea', |
|
'making the bed', |
|
'marching', |
|
'marriage proposal', |
|
'massaging back', |
|
'massaging feet', |
|
'massaging legs', |
|
'massaging neck', |
|
"massaging person's head", |
|
'metal detecting', |
|
'milking cow', |
|
'milking goat', |
|
'mixing colours', |
|
'moon walking', |
|
'mopping floor', |
|
'mosh pit dancing', |
|
'motorcycling', |
|
'mountain climber (exercise)', |
|
'moving baby', |
|
'moving child', |
|
'moving furniture', |
|
'mowing lawn', |
|
'mushroom foraging', |
|
'needle felting', |
|
'news anchoring', |
|
'opening bottle (not wine)', |
|
'opening coconuts', |
|
'opening door', |
|
'opening present', |
|
'opening refrigerator', |
|
'opening wine bottle', |
|
'packing', |
|
'paragliding', |
|
'parasailing', |
|
'parkour', |
|
'passing American football (in game)', |
|
'passing American football (not in game)', |
|
'passing soccer ball', |
|
'peeling apples', |
|
'peeling banana', |
|
'peeling potatoes', |
|
'person collecting garbage', |
|
'petting animal (not cat)', |
|
'petting cat', |
|
'petting horse', |
|
'photobombing', |
|
'photocopying', |
|
'picking apples', |
|
'picking blueberries', |
|
'pillow fight', |
|
'pinching', |
|
'pirouetting', |
|
'planing wood', |
|
'planting trees', |
|
'plastering', |
|
'playing accordion', |
|
'playing american football', |
|
'playing badminton', |
|
'playing bagpipes', |
|
'playing basketball', |
|
'playing bass guitar', |
|
'playing beer pong', |
|
'playing billiards', |
|
'playing blackjack', |
|
'playing cards', |
|
'playing cello', |
|
'playing checkers', |
|
'playing chess', |
|
'playing clarinet', |
|
'playing controller', |
|
'playing cricket', |
|
'playing cymbals', |
|
'playing darts', |
|
'playing didgeridoo', |
|
'playing dominoes', |
|
'playing drums', |
|
'playing field hockey', |
|
'playing flute', |
|
'playing gong', |
|
'playing guitar', |
|
'playing hand clapping games', |
|
'playing harmonica', |
|
'playing harp', |
|
'playing ice hockey', |
|
'playing keyboard', |
|
'playing kickball', |
|
'playing laser tag', |
|
'playing lute', |
|
'playing mahjong', |
|
'playing maracas', |
|
'playing marbles', |
|
'playing monopoly', |
|
'playing netball', |
|
'playing nose flute', |
|
'playing oboe', |
|
'playing ocarina', |
|
'playing organ', |
|
'playing paintball', |
|
'playing pan pipes', |
|
'playing piano', |
|
'playing piccolo', |
|
'playing pinball', |
|
'playing ping pong', |
|
'playing poker', |
|
'playing polo', |
|
'playing recorder', |
|
'playing road hockey', |
|
'playing rounders', |
|
'playing rubiks cube', |
|
'playing saxophone', |
|
'playing scrabble', |
|
'playing shuffleboard', |
|
'playing slot machine', |
|
'playing squash or racquetball', |
|
'playing tennis', |
|
'playing trombone', |
|
'playing trumpet', |
|
'playing ukulele', |
|
'playing violin', |
|
'playing volleyball', |
|
'playing with trains', |
|
'playing xylophone', |
|
'poaching eggs', |
|
'poking bellybutton', |
|
'pole vault', |
|
'polishing furniture', |
|
'polishing metal', |
|
'popping balloons', |
|
'pouring beer', |
|
'pouring milk', |
|
'pouring wine', |
|
'preparing salad', |
|
'presenting weather forecast', |
|
'pretending to be a statue', |
|
'pull ups', |
|
'pulling espresso shot', |
|
'pulling rope (game)', |
|
'pumping fist', |
|
'pumping gas', |
|
'punching bag', |
|
'punching person (boxing)', |
|
'push up', |
|
'pushing car', |
|
'pushing cart', |
|
'pushing wheelbarrow', |
|
'pushing wheelchair', |
|
'putting in contact lenses', |
|
'putting on eyeliner', |
|
'putting on foundation', |
|
'putting on lipstick', |
|
'putting on mascara', |
|
'putting on sari', |
|
'putting on shoes', |
|
'putting wallpaper on wall', |
|
'raising eyebrows', |
|
'reading book', |
|
'reading newspaper', |
|
'recording music', |
|
'repairing puncture', |
|
'riding a bike', |
|
'riding camel', |
|
'riding elephant', |
|
'riding mechanical bull', |
|
'riding mule', |
|
'riding or walking with horse', |
|
'riding scooter', |
|
'riding snow blower', |
|
'riding unicycle', |
|
'ripping paper', |
|
'roasting marshmallows', |
|
'roasting pig', |
|
'robot dancing', |
|
'rock climbing', |
|
'rock scissors paper', |
|
'roller skating', |
|
'rolling eyes', |
|
'rolling pastry', |
|
'rope pushdown', |
|
'running on treadmill', |
|
'sailing', |
|
'salsa dancing', |
|
'saluting', |
|
'sanding floor', |
|
'sanding wood', |
|
'sausage making', |
|
'sawing wood', |
|
'scrambling eggs', |
|
'scrapbooking', |
|
'scrubbing face', |
|
'scuba diving', |
|
'seasoning food', |
|
'separating eggs', |
|
'setting table', |
|
'sewing', |
|
'shaking hands', |
|
'shaking head', |
|
'shaping bread dough', |
|
'sharpening knives', |
|
'sharpening pencil', |
|
'shaving head', |
|
'shaving legs', |
|
'shearing sheep', |
|
'shining flashlight', |
|
'shining shoes', |
|
'shoot dance', |
|
'shooting basketball', |
|
'shooting goal (soccer)', |
|
'shooting off fireworks', |
|
'shopping', |
|
'shot put', |
|
'shouting', |
|
'shoveling snow', |
|
'shredding paper', |
|
'shucking oysters', |
|
'shuffling cards', |
|
'shuffling feet', |
|
'side kick', |
|
'sieving', |
|
'sign language interpreting', |
|
'silent disco', |
|
'singing', |
|
'sipping cup', |
|
'situp', |
|
'skateboarding', |
|
'ski ballet', |
|
'ski jumping', |
|
'skiing crosscountry', |
|
'skiing mono', |
|
'skiing slalom', |
|
'skipping rope', |
|
'skipping stone', |
|
'skydiving', |
|
'slacklining', |
|
'slapping', |
|
'sled dog racing', |
|
'sleeping', |
|
'slicing onion', |
|
'smashing', |
|
'smelling feet', |
|
'smoking', |
|
'smoking hookah', |
|
'smoking pipe', |
|
'snatch weight lifting', |
|
'sneezing', |
|
'snorkeling', |
|
'snowboarding', |
|
'snowkiting', |
|
'snowmobiling', |
|
'somersaulting', |
|
'spelunking', |
|
'spinning plates', |
|
'spinning poi', |
|
'splashing water', |
|
'spray painting', |
|
'spraying', |
|
'springboard diving', |
|
'square dancing', |
|
'squat', |
|
'squeezing orange', |
|
'stacking cups', |
|
'stacking dice', |
|
'standing on hands', |
|
'staring', |
|
'steer roping', |
|
'steering car', |
|
'sticking tongue out', |
|
'stomping grapes', |
|
'stretching arm', |
|
'stretching leg', |
|
'sucking lolly', |
|
'surfing crowd', |
|
'surfing water', |
|
'surveying', |
|
'sweeping floor', |
|
'swimming backstroke', |
|
'swimming breast stroke', |
|
'swimming butterfly stroke', |
|
'swimming front crawl', |
|
'swimming with dolphins', |
|
'swimming with sharks', |
|
'swing dancing', |
|
'swinging baseball bat', |
|
'swinging on something', |
|
'sword fighting', |
|
'sword swallowing', |
|
'tackling', |
|
'tagging graffiti', |
|
'tai chi', |
|
'taking photo', |
|
'talking on cell phone', |
|
'tango dancing', |
|
'tap dancing', |
|
'tapping guitar', |
|
'tapping pen', |
|
'tasting beer', |
|
'tasting food', |
|
'tasting wine', |
|
'testifying', |
|
'texting', |
|
'threading needle', |
|
'throwing axe', |
|
'throwing ball (not baseball or American football)', |
|
'throwing discus', |
|
'throwing knife', |
|
'throwing snowballs', |
|
'throwing tantrum', |
|
'throwing water balloon', |
|
'tickling', |
|
'tie dying', |
|
'tightrope walking', |
|
'tiptoeing', |
|
'tobogganing', |
|
'tossing coin', |
|
'tossing salad', |
|
'training dog', |
|
'trapezing', |
|
'treating wood', |
|
'trimming or shaving beard', |
|
'trimming shrubs', |
|
'trimming trees', |
|
'triple jump', |
|
'twiddling fingers', |
|
'tying bow tie', |
|
'tying knot (not on a tie)', |
|
'tying necktie', |
|
'tying shoe laces', |
|
'unboxing', |
|
'uncorking champagne', |
|
'unloading truck', |
|
'using a microscope', |
|
'using a paint roller', |
|
'using a power drill', |
|
'using a sledge hammer', |
|
'using a wrench', |
|
'using atm', |
|
'using bagging machine', |
|
'using circular saw', |
|
'using inhaler', |
|
'using megaphone', |
|
'using puppets', |
|
'using remote controller (not gaming)', |
|
'using segway', |
|
'vacuuming car', |
|
'vacuuming floor', |
|
'visiting the zoo', |
|
'wading through mud', |
|
'wading through water', |
|
'waiting in line', |
|
'waking up', |
|
'walking on stilts', |
|
'walking the dog', |
|
'walking through snow', |
|
'walking with crutches', |
|
'washing dishes', |
|
'washing feet', |
|
'washing hair', |
|
'washing hands', |
|
'watching tv', |
|
'water skiing', |
|
'water sliding', |
|
'watering plants', |
|
'waving hand', |
|
'waxing armpits', |
|
'waxing back', |
|
'waxing chest', |
|
'waxing eyebrows', |
|
'waxing legs', |
|
'weaving basket', |
|
'weaving fabric', |
|
'welding', |
|
'whistling', |
|
'windsurfing', |
|
'winking', |
|
'wood burning (art)', |
|
'wrapping present', |
|
'wrestling', |
|
'writing', |
|
'yarn spinning', |
|
'yawning', |
|
'yoga', |
|
'zumba' |
|
] |
|
|
|
templates = [ |
|
'a photo of {}.', |
|
'a photo of a person {}.', |
|
'a photo of a person using {}.', |
|
'a photo of a person doing {}.', |
|
'a photo of a person during {}.', |
|
'a photo of a person performing {}.', |
|
'a photo of a person practicing {}.', |
|
'a video of {}.', |
|
'a video of a person {}.', |
|
'a video of a person using {}.', |
|
'a video of a person doing {}.', |
|
'a video of a person during {}.', |
|
'a video of a person performing {}.', |
|
'a video of a person practicing {}.', |
|
'a example of {}.', |
|
'a example of a person {}.', |
|
'a example of a person using {}.', |
|
'a example of a person doing {}.', |
|
'a example of a person during {}.', |
|
'a example of a person performing {}.', |
|
'a example of a person practicing {}.', |
|
'a demonstration of {}.', |
|
'a demonstration of a person {}.', |
|
'a demonstration of a person using {}.', |
|
'a demonstration of a person doing {}.', |
|
'a demonstration of a person during {}.', |
|
'a demonstration of a person performing {}.', |
|
'a demonstration of a person practicing {}.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## MNIST |
|
|
|
```bash |
|
classes = [ |
|
'0', |
|
'1', |
|
'2', |
|
'3', |
|
'4', |
|
'5', |
|
'6', |
|
'7', |
|
'8', |
|
'9', |
|
] |
|
|
|
templates = [ |
|
'a photo of the number: "{}".', |
|
] |
|
``` |
|
|
|
|
|
|
|
## OxfordPets |
|
|
|
```bash |
|
classes = [ |
|
'Abyssinian', |
|
'Bengal', |
|
'Birman', |
|
'Bombay', |
|
'British Shorthair', |
|
'Egyptian Mau', |
|
'Maine Coon', |
|
'Persian', |
|
'Ragdoll', |
|
'Russian Blue', |
|
'Siamese', |
|
'Sphynx', |
|
'american bulldog', |
|
'american pit bull terrier', |
|
'basset hound', |
|
'beagle', |
|
'boxer', |
|
'chihuahua', |
|
'english cocker spaniel', |
|
'english setter', |
|
'german shorthaired', |
|
'great pyrenees', |
|
'havanese', |
|
'japanese chin', |
|
'keeshond', |
|
'leonberger', |
|
'miniature pinscher', |
|
'newfoundland', |
|
'pomeranian', |
|
'pug', |
|
'saint bernard', |
|
'samoyed', |
|
'scottish terrier', |
|
'shiba inu', |
|
'staffordshire bull terrier', |
|
'wheaten terrier', |
|
'yorkshire terrier', |
|
] |
|
|
|
templates = [ |
|
'a photo of a {}, a type of pet.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## PascalVOC2007 |
|
|
|
```bash |
|
classes = [ |
|
'aeroplane', |
|
'bicycle', |
|
'bird', |
|
'boat', |
|
'bottle', |
|
'bus', |
|
'car', |
|
'cat', |
|
'chair', |
|
'cow', |
|
'dog', |
|
'horse', |
|
'motorbike', |
|
'person', |
|
'sheep', |
|
'sofa', |
|
'diningtable', |
|
'pottedplant', |
|
'train', |
|
'tvmonitor', |
|
] |
|
|
|
templates = [ |
|
'a photo of a {}.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## PatchCamelyon |
|
|
|
```bash |
|
classes = [ |
|
'lymph node', |
|
'lymph node containing metastatic tumor tissue', |
|
] |
|
|
|
templates = [ |
|
'this is a photo of {}', |
|
] |
|
``` |
|
|
|
|
|
|
|
## RESISC45 |
|
|
|
```bash |
|
classes = [ |
|
'airplane', |
|
'airport', |
|
'baseball diamond', |
|
'basketball court', |
|
'beach', |
|
'bridge', |
|
'chaparral', |
|
'church', |
|
'circular farmland', |
|
'cloud', |
|
'commercial area', |
|
'dense residential', |
|
'desert', |
|
'forest', |
|
'freeway', |
|
'golf course', |
|
'ground track field', |
|
'harbor', |
|
'industrial area', |
|
'intersection', |
|
'island', |
|
'lake', |
|
'meadow', |
|
'medium residential', |
|
'mobile home park', |
|
'mountain', |
|
'overpass', |
|
'palace', |
|
'parking lot', |
|
'railway', |
|
'railway station', |
|
'rectangular farmland', |
|
'river', |
|
'roundabout', |
|
'runway', |
|
'sea ice', |
|
'ship', |
|
'snowberg', |
|
'sparse residential', |
|
'stadium', |
|
'storage tank', |
|
'tennis court', |
|
'terrace', |
|
'thermal power station', |
|
'wetland', |
|
] |
|
|
|
templates = [ |
|
'satellite imagery of {}.', |
|
'aerial imagery of {}.', |
|
'satellite photo of {}.', |
|
'aerial photo of {}.', |
|
'satellite view of {}.', |
|
'aerial view of {}.', |
|
'satellite imagery of a {}.', |
|
'aerial imagery of a {}.', |
|
'satellite photo of a {}.', |
|
'aerial photo of a {}.', |
|
'satellite view of a {}.', |
|
'aerial view of a {}.', |
|
'satellite imagery of the {}.', |
|
'aerial imagery of the {}.', |
|
'satellite photo of the {}.', |
|
'aerial photo of the {}.', |
|
'satellite view of the {}.', |
|
'aerial view of the {}.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## SST2 |
|
|
|
```bash |
|
classes = [ |
|
'negative', |
|
'positive', |
|
] |
|
|
|
templates = [ |
|
'a {} review of a movie.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## STL10 |
|
|
|
```bash |
|
classes = [ |
|
'airplane', |
|
'bird', |
|
'car', |
|
'cat', |
|
'deer', |
|
'dog', |
|
'horse', |
|
'monkey', |
|
'ship', |
|
'truck', |
|
] |
|
|
|
templates = [ |
|
'a photo of a {}.', |
|
'a photo of the {}.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## SUN397 |
|
|
|
```bash |
|
classes = [ |
|
'abbey', |
|
'airplane cabin', |
|
'airport terminal', |
|
'alley', |
|
'amphitheater', |
|
'amusement arcade', |
|
'amusement park', |
|
'anechoic chamber', |
|
'apartment building outdoor', |
|
'apse indoor', |
|
'aquarium', |
|
'aqueduct', |
|
'arch', |
|
'archive', |
|
'arrival gate outdoor', |
|
'art gallery', |
|
'art school', |
|
'art studio', |
|
'assembly line', |
|
'athletic field outdoor', |
|
'atrium public', |
|
'attic', |
|
'auditorium', |
|
'auto factory', |
|
'badlands', |
|
'badminton court indoor', |
|
'baggage claim', |
|
'bakery shop', |
|
'balcony exterior', |
|
'balcony interior', |
|
'ball pit', |
|
'ballroom', |
|
'bamboo forest', |
|
'banquet hall', |
|
'bar', |
|
'barn', |
|
'barndoor', |
|
'baseball field', |
|
'basement', |
|
'basilica', |
|
'basketball court outdoor', |
|
'bathroom', |
|
'batters box', |
|
'bayou', |
|
'bazaar indoor', |
|
'bazaar outdoor', |
|
'beach', |
|
'beauty salon', |
|
'bedroom', |
|
'berth', |
|
'biology laboratory', |
|
'bistro indoor', |
|
'boardwalk', |
|
'boat deck', |
|
'boathouse', |
|
'bookstore', |
|
'booth indoor', |
|
'botanical garden', |
|
'bow window indoor', |
|
'bow window outdoor', |
|
'bowling alley', |
|
'boxing ring', |
|
'brewery indoor', |
|
'bridge', |
|
'building facade', |
|
'bullring', |
|
'burial chamber', |
|
'bus interior', |
|
'butchers shop', |
|
'butte', |
|
'cabin outdoor', |
|
'cafeteria', |
|
'campsite', |
|
'campus', |
|
'canal natural', |
|
'canal urban', |
|
'candy store', |
|
'canyon', |
|
'car interior backseat', |
|
'car interior frontseat', |
|
'carrousel', |
|
'casino indoor', |
|
'castle', |
|
'catacomb', |
|
'cathedral indoor', |
|
'cathedral outdoor', |
|
'cavern indoor', |
|
'cemetery', |
|
'chalet', |
|
'cheese factory', |
|
'chemistry lab', |
|
'chicken coop indoor', |
|
'chicken coop outdoor', |
|
'childs room', |
|
'church indoor', |
|
'church outdoor', |
|
'classroom', |
|
'clean room', |
|
'cliff', |
|
'cloister indoor', |
|
'closet', |
|
'clothing store', |
|
'coast', |
|
'cockpit', |
|
'coffee shop', |
|
'computer room', |
|
'conference center', |
|
'conference room', |
|
'construction site', |
|
'control room', |
|
'control tower outdoor', |
|
'corn field', |
|
'corral', |
|
'corridor', |
|
'cottage garden', |
|
'courthouse', |
|
'courtroom', |
|
'courtyard', |
|
'covered bridge exterior', |
|
'creek', |
|
'crevasse', |
|
'crosswalk', |
|
'cubicle office', |
|
'dam', |
|
'delicatessen', |
|
'dentists office', |
|
'desert sand', |
|
'desert vegetation', |
|
'diner indoor', |
|
'diner outdoor', |
|
'dinette home', |
|
'dinette vehicle', |
|
'dining car', |
|
'dining room', |
|
'discotheque', |
|
'dock', |
|
'doorway outdoor', |
|
'dorm room', |
|
'driveway', |
|
'driving range outdoor', |
|
'drugstore', |
|
'electrical substation', |
|
'elevator door', |
|
'elevator interior', |
|
'elevator shaft', |
|
'engine room', |
|
'escalator indoor', |
|
'excavation', |
|
'factory indoor', |
|
'fairway', |
|
'fastfood restaurant', |
|
'field cultivated', |
|
'field wild', |
|
'fire escape', |
|
'fire station', |
|
'firing range indoor', |
|
'fishpond', |
|
'florist shop indoor', |
|
'food court', |
|
'forest broadleaf', |
|
'forest needleleaf', |
|
'forest path', |
|
'forest road', |
|
'formal garden', |
|
'fountain', |
|
'galley', |
|
'game room', |
|
'garage indoor', |
|
'garbage dump', |
|
'gas station', |
|
'gazebo exterior', |
|
'general store indoor', |
|
'general store outdoor', |
|
'gift shop', |
|
'golf course', |
|
'greenhouse indoor', |
|
'greenhouse outdoor', |
|
'gymnasium indoor', |
|
'hangar indoor', |
|
'hangar outdoor', |
|
'harbor', |
|
'hayfield', |
|
'heliport', |
|
'herb garden', |
|
'highway', |
|
'hill', |
|
'home office', |
|
'hospital', |
|
'hospital room', |
|
'hot spring', |
|
'hot tub outdoor', |
|
'hotel outdoor', |
|
'hotel room', |
|
'house', |
|
'hunting lodge outdoor', |
|
'ice cream parlor', |
|
'ice floe', |
|
'ice shelf', |
|
'ice skating rink indoor', |
|
'ice skating rink outdoor', |
|
'iceberg', |
|
'igloo', |
|
'industrial area', |
|
'inn outdoor', |
|
'islet', |
|
'jacuzzi indoor', |
|
'jail cell', |
|
'jail indoor', |
|
'jewelry shop', |
|
'kasbah', |
|
'kennel indoor', |
|
'kennel outdoor', |
|
'kindergarden classroom', |
|
'kitchen', |
|
'kitchenette', |
|
'labyrinth outdoor', |
|
'lake natural', |
|
'landfill', |
|
'landing deck', |
|
'laundromat', |
|
'lecture room', |
|
'library indoor', |
|
'library outdoor', |
|
'lido deck outdoor', |
|
'lift bridge', |
|
'lighthouse', |
|
'limousine interior', |
|
'living room', |
|
'lobby', |
|
'lock chamber', |
|
'locker room', |
|
'mansion', |
|
'manufactured home', |
|
'market indoor', |
|
'market outdoor', |
|
'marsh', |
|
'martial arts gym', |
|
'mausoleum', |
|
'medina', |
|
'moat water', |
|
'monastery outdoor', |
|
'mosque indoor', |
|
'mosque outdoor', |
|
'motel', |
|
'mountain', |
|
'mountain snowy', |
|
'movie theater indoor', |
|
'museum indoor', |
|
'music store', |
|
'music studio', |
|
'nuclear power plant outdoor', |
|
'nursery', |
|
'oast house', |
|
'observatory outdoor', |
|
'ocean', |
|
'office', |
|
'office building', |
|
'oil refinery outdoor', |
|
'oilrig', |
|
'operating room', |
|
'orchard', |
|
'outhouse outdoor', |
|
'pagoda', |
|
'palace', |
|
'pantry', |
|
'park', |
|
'parking garage indoor', |
|
'parking garage outdoor', |
|
'parking lot', |
|
'parlor', |
|
'pasture', |
|
'patio', |
|
'pavilion', |
|
'pharmacy', |
|
'phone booth', |
|
'physics laboratory', |
|
'picnic area', |
|
'pilothouse indoor', |
|
'planetarium outdoor', |
|
'playground', |
|
'playroom', |
|
'plaza', |
|
'podium indoor', |
|
'podium outdoor', |
|
'pond', |
|
'poolroom establishment', |
|
'poolroom home', |
|
'power plant outdoor', |
|
'promenade deck', |
|
'pub indoor', |
|
'pulpit', |
|
'putting green', |
|
'racecourse', |
|
'raceway', |
|
'raft', |
|
'railroad track', |
|
'rainforest', |
|
'reception', |
|
'recreation room', |
|
'residential neighborhood', |
|
'restaurant', |
|
'restaurant kitchen', |
|
'restaurant patio', |
|
'rice paddy', |
|
'riding arena', |
|
'river', |
|
'rock arch', |
|
'rope bridge', |
|
'ruin', |
|
'runway', |
|
'sandbar', |
|
'sandbox', |
|
'sauna', |
|
'schoolhouse', |
|
'sea cliff', |
|
'server room', |
|
'shed', |
|
'shoe shop', |
|
'shopfront', |
|
'shopping mall indoor', |
|
'shower', |
|
'skatepark', |
|
'ski lodge', |
|
'ski resort', |
|
'ski slope', |
|
'sky', |
|
'skyscraper', |
|
'slum', |
|
'snowfield', |
|
'squash court', |
|
'stable', |
|
'stadium baseball', |
|
'stadium football', |
|
'stage indoor', |
|
'staircase', |
|
'street', |
|
'subway interior', |
|
'subway station platform', |
|
'supermarket', |
|
'sushi bar', |
|
'swamp', |
|
'swimming pool indoor', |
|
'swimming pool outdoor', |
|
'synagogue indoor', |
|
'synagogue outdoor', |
|
'television studio', |
|
'temple east asia', |
|
'temple south asia', |
|
'tennis court indoor', |
|
'tennis court outdoor', |
|
'tent outdoor', |
|
'theater indoor procenium', |
|
'theater indoor seats', |
|
'thriftshop', |
|
'throne room', |
|
'ticket booth', |
|
'toll plaza', |
|
'topiary garden', |
|
'tower', |
|
'toyshop', |
|
'track outdoor', |
|
'train railway', |
|
'train station platform', |
|
'tree farm', |
|
'tree house', |
|
'trench', |
|
'underwater coral reef', |
|
'utility room', |
|
'valley', |
|
'van interior', |
|
'vegetable garden', |
|
'veranda', |
|
'veterinarians office', |
|
'viaduct', |
|
'videostore', |
|
'village', |
|
'vineyard', |
|
'volcano', |
|
'volleyball court indoor', |
|
'volleyball court outdoor', |
|
'waiting room', |
|
'warehouse indoor', |
|
'water tower', |
|
'waterfall block', |
|
'waterfall fan', |
|
'waterfall plunge', |
|
'watering hole', |
|
'wave', |
|
'wet bar', |
|
'wheat field', |
|
'wind farm', |
|
'windmill', |
|
'wine cellar barrel storage', |
|
'wine cellar bottle storage', |
|
'wrestling ring indoor', |
|
'yard', |
|
'youth hostel', |
|
] |
|
|
|
templates = [ |
|
'a photo of a {}.', |
|
'a photo of the {}.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## StanfordCars |
|
|
|
```bash |
|
classes = [ |
|
'AM General Hummer SUV 2000', |
|
'Acura RL Sedan 2012', |
|
'Acura TL Sedan 2012', |
|
'Acura TL Type-S 2008', |
|
'Acura TSX Sedan 2012', |
|
'Acura Integra Type R 2001', |
|
'Acura ZDX Hatchback 2012', |
|
'Aston Martin V8 Vantage Convertible 2012', |
|
'Aston Martin V8 Vantage Coupe 2012', |
|
'Aston Martin Virage Convertible 2012', |
|
'Aston Martin Virage Coupe 2012', |
|
'Audi RS 4 Convertible 2008', |
|
'Audi A5 Coupe 2012', |
|
'Audi TTS Coupe 2012', |
|
'Audi R8 Coupe 2012', |
|
'Audi V8 Sedan 1994', |
|
'Audi 100 Sedan 1994', |
|
'Audi 100 Wagon 1994', |
|
'Audi TT Hatchback 2011', |
|
'Audi S6 Sedan 2011', |
|
'Audi S5 Convertible 2012', |
|
'Audi S5 Coupe 2012', |
|
'Audi S4 Sedan 2012', |
|
'Audi S4 Sedan 2007', |
|
'Audi TT RS Coupe 2012', |
|
'BMW ActiveHybrid 5 Sedan 2012', |
|
'BMW 1 Series Convertible 2012', |
|
'BMW 1 Series Coupe 2012', |
|
'BMW 3 Series Sedan 2012', |
|
'BMW 3 Series Wagon 2012', |
|
'BMW 6 Series Convertible 2007', |
|
'BMW X5 SUV 2007', |
|
'BMW X6 SUV 2012', |
|
'BMW M3 Coupe 2012', |
|
'BMW M5 Sedan 2010', |
|
'BMW M6 Convertible 2010', |
|
'BMW X3 SUV 2012', |
|
'BMW Z4 Convertible 2012', |
|
'Bentley Continental Supersports Conv. Convertible 2012', |
|
'Bentley Arnage Sedan 2009', |
|
'Bentley Mulsanne Sedan 2011', |
|
'Bentley Continental GT Coupe 2012', |
|
'Bentley Continental GT Coupe 2007', |
|
'Bentley Continental Flying Spur Sedan 2007', |
|
'Bugatti Veyron 16.4 Convertible 2009', |
|
'Bugatti Veyron 16.4 Coupe 2009', |
|
'Buick Regal GS 2012', |
|
'Buick Rainier SUV 2007', |
|
'Buick Verano Sedan 2012', |
|
'Buick Enclave SUV 2012', |
|
'Cadillac CTS-V Sedan 2012', |
|
'Cadillac SRX SUV 2012', |
|
'Cadillac Escalade EXT Crew Cab 2007', |
|
'Chevrolet Silverado 1500 Hybrid Crew Cab 2012', |
|
'Chevrolet Corvette Convertible 2012', |
|
'Chevrolet Corvette ZR1 2012', |
|
'Chevrolet Corvette Ron Fellows Edition Z06 2007', |
|
'Chevrolet Traverse SUV 2012', |
|
'Chevrolet Camaro Convertible 2012', |
|
'Chevrolet HHR SS 2010', |
|
'Chevrolet Impala Sedan 2007', |
|
'Chevrolet Tahoe Hybrid SUV 2012', |
|
'Chevrolet Sonic Sedan 2012', |
|
'Chevrolet Express Cargo Van 2007', |
|
'Chevrolet Avalanche Crew Cab 2012', |
|
'Chevrolet Cobalt SS 2010', |
|
'Chevrolet Malibu Hybrid Sedan 2010', |
|
'Chevrolet TrailBlazer SS 2009', |
|
'Chevrolet Silverado 2500HD Regular Cab 2012', |
|
'Chevrolet Silverado 1500 Classic Extended Cab 2007', |
|
'Chevrolet Express Van 2007', |
|
'Chevrolet Monte Carlo Coupe 2007', |
|
'Chevrolet Malibu Sedan 2007', |
|
'Chevrolet Silverado 1500 Extended Cab 2012', |
|
'Chevrolet Silverado 1500 Regular Cab 2012', |
|
'Chrysler Aspen SUV 2009', |
|
'Chrysler Sebring Convertible 2010', |
|
'Chrysler Town and Country Minivan 2012', |
|
'Chrysler 300 SRT-8 2010', |
|
'Chrysler Crossfire Convertible 2008', |
|
'Chrysler PT Cruiser Convertible 2008', |
|
'Daewoo Nubira Wagon 2002', |
|
'Dodge Caliber Wagon 2012', |
|
'Dodge Caliber Wagon 2007', |
|
'Dodge Caravan Minivan 1997', |
|
'Dodge Ram Pickup 3500 Crew Cab 2010', |
|
'Dodge Ram Pickup 3500 Quad Cab 2009', |
|
'Dodge Sprinter Cargo Van 2009', |
|
'Dodge Journey SUV 2012', |
|
'Dodge Dakota Crew Cab 2010', |
|
'Dodge Dakota Club Cab 2007', |
|
'Dodge Magnum Wagon 2008', |
|
'Dodge Challenger SRT8 2011', |
|
'Dodge Durango SUV 2012', |
|
'Dodge Durango SUV 2007', |
|
'Dodge Charger Sedan 2012', |
|
'Dodge Charger SRT-8 2009', |
|
'Eagle Talon Hatchback 1998', |
|
'FIAT 500 Abarth 2012', |
|
'FIAT 500 Convertible 2012', |
|
'Ferrari FF Coupe 2012', |
|
'Ferrari California Convertible 2012', |
|
'Ferrari 458 Italia Convertible 2012', |
|
'Ferrari 458 Italia Coupe 2012', |
|
'Fisker Karma Sedan 2012', |
|
'Ford F-450 Super Duty Crew Cab 2012', |
|
'Ford Mustang Convertible 2007', |
|
'Ford Freestar Minivan 2007', |
|
'Ford Expedition EL SUV 2009', |
|
'Ford Edge SUV 2012', |
|
'Ford Ranger SuperCab 2011', |
|
'Ford GT Coupe 2006', |
|
'Ford F-150 Regular Cab 2012', |
|
'Ford F-150 Regular Cab 2007', |
|
'Ford Focus Sedan 2007', |
|
'Ford E-Series Wagon Van 2012', |
|
'Ford Fiesta Sedan 2012', |
|
'GMC Terrain SUV 2012', |
|
'GMC Savana Van 2012', |
|
'GMC Yukon Hybrid SUV 2012', |
|
'GMC Acadia SUV 2012', |
|
'GMC Canyon Extended Cab 2012', |
|
'Geo Metro Convertible 1993', |
|
'HUMMER H3T Crew Cab 2010', |
|
'HUMMER H2 SUT Crew Cab 2009', |
|
'Honda Odyssey Minivan 2012', |
|
'Honda Odyssey Minivan 2007', |
|
'Honda Accord Coupe 2012', |
|
'Honda Accord Sedan 2012', |
|
'Hyundai Veloster Hatchback 2012', |
|
'Hyundai Santa Fe SUV 2012', |
|
'Hyundai Tucson SUV 2012', |
|
'Hyundai Veracruz SUV 2012', |
|
'Hyundai Sonata Hybrid Sedan 2012', |
|
'Hyundai Elantra Sedan 2007', |
|
'Hyundai Accent Sedan 2012', |
|
'Hyundai Genesis Sedan 2012', |
|
'Hyundai Sonata Sedan 2012', |
|
'Hyundai Elantra Touring Hatchback 2012', |
|
'Hyundai Azera Sedan 2012', |
|
'Infiniti G Coupe IPL 2012', |
|
'Infiniti QX56 SUV 2011', |
|
'Isuzu Ascender SUV 2008', |
|
'Jaguar XK XKR 2012', |
|
'Jeep Patriot SUV 2012', |
|
'Jeep Wrangler SUV 2012', |
|
'Jeep Liberty SUV 2012', |
|
'Jeep Grand Cherokee SUV 2012', |
|
'Jeep Compass SUV 2012', |
|
'Lamborghini Reventon Coupe 2008', |
|
'Lamborghini Aventador Coupe 2012', |
|
'Lamborghini Gallardo LP 570-4 Superleggera 2012', |
|
'Lamborghini Diablo Coupe 2001', |
|
'Land Rover Range Rover SUV 2012', |
|
'Land Rover LR2 SUV 2012', |
|
'Lincoln Town Car Sedan 2011', |
|
'MINI Cooper Roadster Convertible 2012', |
|
'Maybach Landaulet Convertible 2012', |
|
'Mazda Tribute SUV 2011', |
|
'McLaren MP4-12C Coupe 2012', |
|
'Mercedes-Benz 300-Class Convertible 1993', |
|
'Mercedes-Benz C-Class Sedan 2012', |
|
'Mercedes-Benz SL-Class Coupe 2009', |
|
'Mercedes-Benz E-Class Sedan 2012', |
|
'Mercedes-Benz S-Class Sedan 2012', |
|
'Mercedes-Benz Sprinter Van 2012', |
|
'Mitsubishi Lancer Sedan 2012', |
|
'Nissan Leaf Hatchback 2012', |
|
'Nissan NV Passenger Van 2012', |
|
'Nissan Juke Hatchback 2012', |
|
'Nissan 240SX Coupe 1998', |
|
'Plymouth Neon Coupe 1999', |
|
'Porsche Panamera Sedan 2012', |
|
'Ram C/V Cargo Van Minivan 2012', |
|
'Rolls-Royce Phantom Drophead Coupe Convertible 2012', |
|
'Rolls-Royce Ghost Sedan 2012', |
|
'Rolls-Royce Phantom Sedan 2012', |
|
'Scion xD Hatchback 2012', |
|
'Spyker C8 Convertible 2009', |
|
'Spyker C8 Coupe 2009', |
|
'Suzuki Aerio Sedan 2007', |
|
'Suzuki Kizashi Sedan 2012', |
|
'Suzuki SX4 Hatchback 2012', |
|
'Suzuki SX4 Sedan 2012', |
|
'Tesla Model S Sedan 2012', |
|
'Toyota Sequoia SUV 2012', |
|
'Toyota Camry Sedan 2012', |
|
'Toyota Corolla Sedan 2012', |
|
'Toyota 4Runner SUV 2012', |
|
'Volkswagen Golf Hatchback 2012', |
|
'Volkswagen Golf Hatchback 1991', |
|
'Volkswagen Beetle Hatchback 2012', |
|
'Volvo C30 Hatchback 2012', |
|
'Volvo 240 Sedan 1993', |
|
'Volvo XC90 SUV 2007', |
|
'smart fortwo Convertible 2012', |
|
] |
|
|
|
templates = [ |
|
'a photo of a {}.', |
|
'a photo of the {}.', |
|
'a photo of my {}.', |
|
'i love my {}!', |
|
'a photo of my dirty {}.', |
|
'a photo of my clean {}.', |
|
'a photo of my new {}.', |
|
'a photo of my old {}.', |
|
] |
|
``` |
|
|
|
|
|
|
|
## UCF101 |
|
|
|
```bash |
|
classes = [ |
|
'Apply Eye Makeup', |
|
'Apply Lipstick', |
|
'Archery', |
|
'Baby Crawling', |
|
'Balance Beam', |
|
'Band Marching', |
|
'Baseball Pitch', |
|
'Basketball', |
|
'Basketball Dunk', |
|
'Bench Press', |
|
'Biking', |
|
'Billiards', |
|
'Blow Dry Hair', |
|
'Blowing Candles', |
|
'Body Weight Squats', |
|
'Bowling', |
|
'Boxing Punching Bag', |
|
'Boxing Speed Bag', |
|
'Breast Stroke', |
|
'Brushing Teeth', |
|
'Clean And Jerk', |
|
'Cliff Diving', |
|
'Cricket Bowling', |
|
'Cricket Shot', |
|
'Cutting In Kitchen', |
|
'Diving', |
|
'Drumming', |
|
'Fencing', |
|
'Field Hockey Penalty', |
|
'Floor Gymnastics', |
|
'Frisbee Catch', |
|
'Front Crawl', |
|
'Golf Swing', |
|
'Haircut', |
|
'Hammer Throw', |
|
'Hammering', |
|
'Hand Stand Pushups', |
|
'Handstand Walking', |
|
'Head Massage', |
|
'High Jump', |
|
'Horse Race', |
|
'Horse Riding', |
|
'Hula Hoop', |
|
'Ice Dancing', |
|
'Javelin Throw', |
|
'Juggling Balls', |
|
'Jump Rope', |
|
'Jumping Jack', |
|
'Kayaking', |
|
'Knitting', |
|
'Long Jump', |
|
'Lunges', |
|
'Military Parade', |
|
'Mixing', |
|
'Mopping Floor', |
|
'Nunchucks', |
|
'Parallel Bars', |
|
'Pizza Tossing', |
|
'Playing Cello', |
|
'Playing Daf', |
|
'Playing Dhol', |
|
'Playing Flute', |
|
'Playing Guitar', |
|
'Playing Piano', |
|
'Playing Sitar', |
|
'Playing Tabla', |
|
'Playing Violin', |
|
'Pole Vault', |
|
'Pommel Horse', |
|
'Pull Ups', |
|
'Punch', |
|
'Push Ups', |
|
'Rafting', |
|
'Rock Climbing Indoor', |
|
'Rope Climbing', |
|
'Rowing', |
|
'Salsa Spin', |
|
'Shaving Beard', |
|
'Shotput', |
|
'Skate Boarding', |
|
'Skiing', |
|
'Skijet', |
|
'Sky Diving', |
|
'Soccer Juggling', |
|
'Soccer Penalty', |
|
'Still Rings', |
|
'Sumo Wrestling', |
|
'Surfing', |
|
'Swing', |
|
'Table Tennis Shot', |
|
'Tai Chi', |
|
'Tennis Swing', |
|
'Throw Discus', |
|
'Trampoline Jumping', |
|
'Typing', |
|
'Uneven Bars', |
|
'Volleyball Spiking', |
|
'Walking With Dog', |
|
'Wall Pushups', |
|
'Writing On Board', |
|
'Yo Yo', |
|
] |
|
|
|
templates = [ |
|
'a photo of a person {}.', |
|
'a video of a person {}.', |
|
'a example of a person {}.', |
|
'a demonstration of a person {}.', |
|
'a photo of the person {}.', |
|
'a video of the person {}.', |
|
'a example of the person {}.', |
|
'a demonstration of the person {}.', |
|
'a photo of a person using {}.', |
|
'a video of a person using {}.', |
|
'a example of a person using {}.', |
|
'a demonstration of a person using {}.', |
|
'a photo of the person using {}.', |
|
'a video of the person using {}.', |
|
'a example of the person using {}.', |
|
'a demonstration of the person using {}.', |
|
'a photo of a person doing {}.', |
|
'a video of a person doing {}.', |
|
'a example of a person doing {}.', |
|
'a demonstration of a person doing {}.', |
|
'a photo of the person doing {}.', |
|
'a video of the person doing {}.', |
|
'a example of the person doing {}.', |
|
'a demonstration of the person doing {}.', |
|
'a photo of a person during {}.', |
|
'a video of a person during {}.', |
|
'a example of a person during {}.', |
|
'a demonstration of a person during {}.', |
|
'a photo of the person during {}.', |
|
'a video of the person during {}.', |
|
'a example of the person during {}.', |
|
'a demonstration of the person during {}.', |
|
'a photo of a person performing {}.', |
|
'a video of a person performing {}.', |
|
'a example of a person performing {}.', |
|
'a demonstration of a person performing {}.', |
|
'a photo of the person performing {}.', |
|
'a video of the person performing {}.', |
|
'a example of the person performing {}.', |
|
'a demonstration of the person performing {}.', |
|
'a photo of a person practicing {}.', |
|
'a video of a person practicing {}.', |
|
'a example of a person practicing {}.', |
|
'a demonstration of a person practicing {}.', |
|
'a photo of the person practicing {}.', |
|
'a video of the person practicing {}.', |
|
'a example of the person practicing {}.', |
|
'a demonstration of the person practicing {}.', |
|
] |
|
``` |
|
|
|
|
|
|