Update README.md
#2
by
reach-vb
HF staff
- opened
README.md
CHANGED
@@ -22,6 +22,28 @@ The model is trained using a "bipartite matching loss": one compares the predict
|
|
22 |
|
23 |
You can use the raw model for object detection. See the [model hub](https://huggingface.co/models?search=facebook/detr) to look for all available DETR models.
|
24 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
25 |
## Download
|
26 |
|
27 |
Install `huggingface-hub`
|
|
|
22 |
|
23 |
You can use the raw model for object detection. See the [model hub](https://huggingface.co/models?search=facebook/detr) to look for all available DETR models.
|
24 |
|
25 |
+
## Evaluation - Variants
|
26 |
+
|
27 |
+
| Variant | Parameters | Size (MB) | Weight Precision | Act. Precision | IoU | Pixel accuracy |
|
28 |
+
|-------------------------------------------------------------------------------------------------------|-----------:|----------:|------------------|----------------|------:|---------------:|
|
29 |
+
| [facebook/detr-resnet-50-panoptic (PyTorch)](https://huggingface.co/facebook/detr-resnet-50-panoptic) | 43M | 172 | Float32 | Float32 | 0.393 | 0.746 |
|
30 |
+
| [DETRResnet50SemanticSegmentationF32](DETRResnet50SemanticSegmentationF32.mlpackage) | 43M | 171 | Float32 | Float32 | 0.393 | 0.746 |
|
31 |
+
| [DETRResnet50SemanticSegmentationF16](DETRResnet50SemanticSegmentationF16.mlpackage) | 43M | 86 | Float16 | Float16 | 0.395 | 0.746 |
|
32 |
+
|
33 |
+
IoU and Pixel accuracy measured on 512 images from the COCO dataset. The ground truth labels were extracted from the panoptic segmentation annotations, transformed to semantic segmentation masks. Input images were resized so that the smaller edge equals 448, then center-cropped.
|
34 |
+
|
35 |
+
## Evaluation - Inference time
|
36 |
+
|
37 |
+
The following results refer to DETRResnet50SemanticSegmentationF16. The compute units for MacBook Pro (M1 Max) were manually selected to "CPU and Neural Engine".
|
38 |
+
|
39 |
+
| Device | OS | Inference time (ms) | Dominant compute unit |
|
40 |
+
| -------------------- | ---- | ------------------: | --------------------- |
|
41 |
+
| iPhone 14 | 17.5 | | Neural Engine |
|
42 |
+
| iPhone 14 Pro Max | 17.5 | | Neural Engine |
|
43 |
+
| iPhone 15 | 17.0 | | Neural Engine |
|
44 |
+
| iPhone 15 Pro Max | 17.5 | 40 | Neural Engine |
|
45 |
+
| MacBook Pro (M1 Max) | 14.5 | 43 | Neural Engine |
|
46 |
+
|
47 |
## Download
|
48 |
|
49 |
Install `huggingface-hub`
|