Yurim0507 commited on
Commit
4d27354
·
verified ·
1 Parent(s): 14a82e0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -49
README.md CHANGED
@@ -34,8 +34,9 @@ tags:
34
  - Nesterov: True
35
  - **Scheduler**: CosineAnnealingLR (T_max: 200)
36
  - **Training Epochs**: 62
37
- - **Batch Size**: 128
38
- - **Hardware**: Single GPU (NVIDIA GeForce RTX 3090)
 
39
 
40
  ### Algorithm
41
  The **CF-k** algorithm was used for inexact unlearning. This method systematically removes the influence of a specific class from the model while retaining the ability to classify the remaining classes. Each resulting model (`cifar10_resnet18_CF-k_X.pth`) corresponds to a scenario where a single class (`X`) has been unlearned. The CF-k algorithm provides an efficient framework for evaluating the robustness and adaptability of models under inexact unlearning constraints.
@@ -46,53 +47,18 @@ For more details on the CF-k algorithm, refer to the [GitHub repository](https:/
46
 
47
  ## Results
48
 
49
- | Model | Excluded Class | Forget class acc(loss) | Retain class acc(loss) |
50
- |--------------------------------|----------------|-------------------------|-------------------------|
51
- | cifar10_resnet18_CF-k_0.pth | Airplane | 0.0 (4.993) | 81.22 (0.578) |
52
- | cifar10_resnet18_CF-k_1.pth | Automobile | 0.0 (4.546) | 95.41 (0.174) |
53
- | cifar10_resnet18_CF-k_2.pth | Bird | 0.0 (4.819) | 95.93 (0.154) |
54
- | cifar10_resnet18_CF-k_3.pth | Cat | 0.0 (5.098) | 96.54 (0.122) |
55
- | cifar10_resnet18_CF-k_4.pth | Deer | 0.0 (4.526) | 95.49 (0.165) |
56
- | cifar10_resnet18_CF-k_5.pth | Dog | 0.0 (4.843) | 96.28 (0.134) |
57
- | cifar10_resnet18_CF-k_6.pth | Frog | 0.0 (4.348) | 95.31 (0.176) |
58
- | cifar10_resnet18_CF-k_7.pth | Horse | 0.0 (4.440) | 95.26 (0.175) |
59
- | cifar10_resnet18_CF-k_8.pth | Ship | 0.0 (4.453) | 95.44 (0.171) |
60
- | cifar10_resnet18_CF-k_9.pth | Truck | 0.0 (4.657) | 95.59 (0.167) |
61
 
62
 
63
- ---
64
-
65
- ### Notes
66
-
67
- 1. **Forget Class Accuracy and Loss**:
68
- - Across all excluded classes, the forget class accuracy is consistently `0.0`, demonstrating the effectiveness of the **CF-k** method in completely excluding the target classes.
69
- - The forget class loss varies slightly, ranging from `4.348` ("Frog") to `5.098` ("Cat"), suggesting that some classes might be slightly more challenging to suppress completely in terms of loss.
70
-
71
- 2. **Retain Class Accuracy and Loss**:
72
- - The retain class accuracy is consistently high across all excluded classes, ranging from `81.22%` ("Airplane") to `96.54%` ("Cat"). This indicates that the method effectively preserves performance on the remaining classes.
73
- - Retain class loss is minimal, with the lowest being `0.122` for "Cat" and the highest being `0.578` for "Airplane." This suggests that the model maintains stable performance with minimal degradation on the retained classes.
74
-
75
- 3. **Class-Specific Observations**:
76
- - "Cat" shows the highest retain class accuracy (96.54%) and the lowest retain class loss (0.122), making it the least affected by the exclusion of other classes.
77
- - "Airplane" exhibits the lowest retain class accuracy (81.22%) and the highest retain class loss (0.578), indicating a potential trade-off in preserving performance for this class.
78
- - Variations in retain class accuracy and forget class loss across different excluded classes highlight the potential influence of class-specific features on model performance.
79
-
80
- ---
81
-
82
- ### Conclusion
83
-
84
- The results illustrate that the **CF-k method** is highly effective in achieving class-specific exclusion while maintaining strong performance on the retained classes. However, minor variations in performance across classes reveal opportunities for further refinement:
85
-
86
- - **Strengths**:
87
- - The forget class accuracy remains at `0.0` for all excluded classes, achieving complete suppression of the target classes.
88
- - Retain class accuracy is high across the board, with most classes exceeding `95%`, showing the robustness of the method in retaining knowledge.
89
-
90
- - **Weaknesses**:
91
- - "Airplane" has noticeably lower retain class accuracy (81.22%) and higher retain class loss (0.578), indicating that certain classes may be more challenging to balance during the exclusion process.
92
- - Slight variations in forget class loss suggest that the suppression process may not be uniformly effective across all classes.
93
-
94
- - **Future Work**:
95
- - Investigate why certain classes, such as "Airplane," are more impacted in terms of retain class accuracy and loss. Class-specific characteristics or relationships with other classes might influence this outcome.
96
- - Explore adaptive mechanisms to optimize the trade-off between exclusion and retention for more balanced performance across all classes.
97
- - Conduct additional experiments to determine if similar patterns emerge in other datasets or architectures, which could validate the generalizability of the method.
98
 
 
34
  - Nesterov: True
35
  - **Scheduler**: CosineAnnealingLR (T_max: 200)
36
  - **Training Epochs**: 62
37
+ - **Batch Size**: 64
38
+ - **Hardware**: Single GPU (NVIDIA GeForce RTX 3090)
39
+ - **Number of Retrain**: 1
40
 
41
  ### Algorithm
42
  The **CF-k** algorithm was used for inexact unlearning. This method systematically removes the influence of a specific class from the model while retaining the ability to classify the remaining classes. Each resulting model (`cifar10_resnet18_CF-k_X.pth`) corresponds to a scenario where a single class (`X`) has been unlearned. The CF-k algorithm provides an efficient framework for evaluating the robustness and adaptability of models under inexact unlearning constraints.
 
47
 
48
  ## Results
49
 
50
+ | Model | Forget Class | Forget class acc(loss) | Retain class acc(loss) |
51
+ |--------------------------------|--------------|-------------------------|-------------------------|
52
+ | cifar10_resnet18_CF-k_0.pth | Airplane | 0.0 (4.659) | 95.49 (0.168) |
53
+ | cifar10_resnet18_CF-k_1.pth | Automobile | 0.0 (4.571) | 95.34 (0.181) |
54
+ | cifar10_resnet18_CF-k_2.pth | Bird | 0.0 (4.879) | 95.89 (0.158) |
55
+ | cifar10_resnet18_CF-k_3.pth | Cat | 0.0 (5.165) | 96.56 (0.127) |
56
+ | cifar10_resnet18_CF-k_4.pth | Deer | 0.0 (4.562) | 95.52 (0.170) |
57
+ | cifar10_resnet18_CF-k_5.pth | Dog | 0.0 (4.862) | 96.30 (0.137) |
58
+ | cifar10_resnet18_CF-k_6.pth | Frog | 0.0 (4.458) | 95.37 (0.185) |
59
+ | cifar10_resnet18_CF-k_7.pth | Horse | 0.0 (4.514) | 95.23 (0.179) |
60
+ | cifar10_resnet18_CF-k_8.pth | Ship | 0.0 (4.577) | 95.38 (0.178) |
61
+ | cifar10_resnet18_CF-k_9.pth | Truck | 0.0 (4.644) | 95.53 (0.174) |
62
 
63
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
64