Update README.md
Browse files
README.md
CHANGED
@@ -34,8 +34,9 @@ tags:
|
|
34 |
- Nesterov: True
|
35 |
- **Scheduler**: CosineAnnealingLR (T_max: 200)
|
36 |
- **Training Epochs**: 62
|
37 |
-
- **Batch Size**:
|
38 |
-
- **Hardware**: Single GPU (NVIDIA GeForce RTX 3090)
|
|
|
39 |
|
40 |
### Algorithm
|
41 |
The **CF-k** algorithm was used for inexact unlearning. This method systematically removes the influence of a specific class from the model while retaining the ability to classify the remaining classes. Each resulting model (`cifar10_resnet18_CF-k_X.pth`) corresponds to a scenario where a single class (`X`) has been unlearned. The CF-k algorithm provides an efficient framework for evaluating the robustness and adaptability of models under inexact unlearning constraints.
|
@@ -46,53 +47,18 @@ For more details on the CF-k algorithm, refer to the [GitHub repository](https:/
|
|
46 |
|
47 |
## Results
|
48 |
|
49 |
-
| Model |
|
50 |
-
|
51 |
-
| cifar10_resnet18_CF-k_0.pth | Airplane
|
52 |
-
| cifar10_resnet18_CF-k_1.pth | Automobile
|
53 |
-
| cifar10_resnet18_CF-k_2.pth | Bird
|
54 |
-
| cifar10_resnet18_CF-k_3.pth | Cat
|
55 |
-
| cifar10_resnet18_CF-k_4.pth | Deer
|
56 |
-
| cifar10_resnet18_CF-k_5.pth | Dog
|
57 |
-
| cifar10_resnet18_CF-k_6.pth | Frog
|
58 |
-
| cifar10_resnet18_CF-k_7.pth | Horse
|
59 |
-
| cifar10_resnet18_CF-k_8.pth | Ship
|
60 |
-
| cifar10_resnet18_CF-k_9.pth | Truck
|
61 |
|
62 |
|
63 |
-
---
|
64 |
-
|
65 |
-
### Notes
|
66 |
-
|
67 |
-
1. **Forget Class Accuracy and Loss**:
|
68 |
-
- Across all excluded classes, the forget class accuracy is consistently `0.0`, demonstrating the effectiveness of the **CF-k** method in completely excluding the target classes.
|
69 |
-
- The forget class loss varies slightly, ranging from `4.348` ("Frog") to `5.098` ("Cat"), suggesting that some classes might be slightly more challenging to suppress completely in terms of loss.
|
70 |
-
|
71 |
-
2. **Retain Class Accuracy and Loss**:
|
72 |
-
- The retain class accuracy is consistently high across all excluded classes, ranging from `81.22%` ("Airplane") to `96.54%` ("Cat"). This indicates that the method effectively preserves performance on the remaining classes.
|
73 |
-
- Retain class loss is minimal, with the lowest being `0.122` for "Cat" and the highest being `0.578` for "Airplane." This suggests that the model maintains stable performance with minimal degradation on the retained classes.
|
74 |
-
|
75 |
-
3. **Class-Specific Observations**:
|
76 |
-
- "Cat" shows the highest retain class accuracy (96.54%) and the lowest retain class loss (0.122), making it the least affected by the exclusion of other classes.
|
77 |
-
- "Airplane" exhibits the lowest retain class accuracy (81.22%) and the highest retain class loss (0.578), indicating a potential trade-off in preserving performance for this class.
|
78 |
-
- Variations in retain class accuracy and forget class loss across different excluded classes highlight the potential influence of class-specific features on model performance.
|
79 |
-
|
80 |
-
---
|
81 |
-
|
82 |
-
### Conclusion
|
83 |
-
|
84 |
-
The results illustrate that the **CF-k method** is highly effective in achieving class-specific exclusion while maintaining strong performance on the retained classes. However, minor variations in performance across classes reveal opportunities for further refinement:
|
85 |
-
|
86 |
-
- **Strengths**:
|
87 |
-
- The forget class accuracy remains at `0.0` for all excluded classes, achieving complete suppression of the target classes.
|
88 |
-
- Retain class accuracy is high across the board, with most classes exceeding `95%`, showing the robustness of the method in retaining knowledge.
|
89 |
-
|
90 |
-
- **Weaknesses**:
|
91 |
-
- "Airplane" has noticeably lower retain class accuracy (81.22%) and higher retain class loss (0.578), indicating that certain classes may be more challenging to balance during the exclusion process.
|
92 |
-
- Slight variations in forget class loss suggest that the suppression process may not be uniformly effective across all classes.
|
93 |
-
|
94 |
-
- **Future Work**:
|
95 |
-
- Investigate why certain classes, such as "Airplane," are more impacted in terms of retain class accuracy and loss. Class-specific characteristics or relationships with other classes might influence this outcome.
|
96 |
-
- Explore adaptive mechanisms to optimize the trade-off between exclusion and retention for more balanced performance across all classes.
|
97 |
-
- Conduct additional experiments to determine if similar patterns emerge in other datasets or architectures, which could validate the generalizability of the method.
|
98 |
|
|
|
34 |
- Nesterov: True
|
35 |
- **Scheduler**: CosineAnnealingLR (T_max: 200)
|
36 |
- **Training Epochs**: 62
|
37 |
+
- **Batch Size**: 64
|
38 |
+
- **Hardware**: Single GPU (NVIDIA GeForce RTX 3090)
|
39 |
+
- **Number of Retrain**: 1
|
40 |
|
41 |
### Algorithm
|
42 |
The **CF-k** algorithm was used for inexact unlearning. This method systematically removes the influence of a specific class from the model while retaining the ability to classify the remaining classes. Each resulting model (`cifar10_resnet18_CF-k_X.pth`) corresponds to a scenario where a single class (`X`) has been unlearned. The CF-k algorithm provides an efficient framework for evaluating the robustness and adaptability of models under inexact unlearning constraints.
|
|
|
47 |
|
48 |
## Results
|
49 |
|
50 |
+
| Model | Forget Class | Forget class acc(loss) | Retain class acc(loss) |
|
51 |
+
|--------------------------------|--------------|-------------------------|-------------------------|
|
52 |
+
| cifar10_resnet18_CF-k_0.pth | Airplane | 0.0 (4.659) | 95.49 (0.168) |
|
53 |
+
| cifar10_resnet18_CF-k_1.pth | Automobile | 0.0 (4.571) | 95.34 (0.181) |
|
54 |
+
| cifar10_resnet18_CF-k_2.pth | Bird | 0.0 (4.879) | 95.89 (0.158) |
|
55 |
+
| cifar10_resnet18_CF-k_3.pth | Cat | 0.0 (5.165) | 96.56 (0.127) |
|
56 |
+
| cifar10_resnet18_CF-k_4.pth | Deer | 0.0 (4.562) | 95.52 (0.170) |
|
57 |
+
| cifar10_resnet18_CF-k_5.pth | Dog | 0.0 (4.862) | 96.30 (0.137) |
|
58 |
+
| cifar10_resnet18_CF-k_6.pth | Frog | 0.0 (4.458) | 95.37 (0.185) |
|
59 |
+
| cifar10_resnet18_CF-k_7.pth | Horse | 0.0 (4.514) | 95.23 (0.179) |
|
60 |
+
| cifar10_resnet18_CF-k_8.pth | Ship | 0.0 (4.577) | 95.38 (0.178) |
|
61 |
+
| cifar10_resnet18_CF-k_9.pth | Truck | 0.0 (4.644) | 95.53 (0.174) |
|
62 |
|
63 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
64 |
|