Spaces:
Runtime error
Runtime error
DamonDemon
commited on
Commit
•
bd93788
1
Parent(s):
1564b79
add unlearned methods
Browse files- src/display/about.py +16 -14
src/display/about.py
CHANGED
@@ -18,23 +18,25 @@ We show that this dataset plays a pivotal role in establishing a standardized an
|
|
18 |
LLM_BENCHMARKS_TEXT = f"""
|
19 |
# Context
|
20 |
|
21 |
-
##
|
22 |
|
23 |
-
We evaluate
|
|
|
|
|
|
|
|
|
|
|
|
|
24 |
|
25 |
-
- <a href="https://en.wikipedia.org/wiki/Tic-tac-toe" target="_blank"> Tic-Tac-Toe</a>
|
26 |
-
- <a href="https://en.wikipedia.org/wiki/Connect_Four" target="_blank"> Connect-4 </a>
|
27 |
-
- <a href="https://en.wikipedia.org/wiki/Breakthrough_(board_game)" target="_blank"> Breakthrough</a>
|
28 |
-
- <a href="https://en.wikipedia.org/wiki/Nim" target="_blank"> Nim</a>
|
29 |
-
- <a href="https://en.wikipedia.org/wiki/First-price_sealed-bid_auction" target="_blank"> Blind Auction</a>
|
30 |
-
- <a href="https://en.wikipedia.org/wiki/Kuhn_poker" target="_blank"> Kuhn Poker</a>
|
31 |
-
- <a href="https://en.wikipedia.org/wiki/Liar\%27s_dice" target="_blank"> Liar's Dice</a>
|
32 |
-
- <a href="https://arxiv.org/pdf/1706.05125.pdf" target="_blank"> Negotiation</a>
|
33 |
-
- <a href="https://en.wikipedia.org/wiki/Pig_(dice_game)" target="_blank"> Pig</a>
|
34 |
-
- <a href="https://en.wikipedia.org/wiki/Prisoner\%27s_dilemma" target="_blank"> Prisoner's Dilemma</a>
|
35 |
|
36 |
## Metrics
|
37 |
-
-
|
|
|
|
|
|
|
|
|
|
|
|
|
38 |
|
39 |
|
40 |
|
@@ -54,7 +56,7 @@ FAQ_TEXT = """
|
|
54 |
|
55 |
|
56 |
EVALUATION_QUEUE_TEXT = """
|
57 |
-
# Evaluation for the
|
58 |
|
59 |
"""
|
60 |
|
|
|
18 |
LLM_BENCHMARKS_TEXT = f"""
|
19 |
# Context
|
20 |
|
21 |
+
## Evaluated MU Methods
|
22 |
|
23 |
+
We evaluate 5 most recently proposed MU methods for DMs:
|
24 |
+
|
25 |
+
- <a href="https://erasing.baulab.info" target="_blank"> ESD </a>
|
26 |
+
- <a href="https://arxiv.org/abs/2303.17591" target="_blank"> FMN </a>
|
27 |
+
- <a href="https://unified.baulab.info" target="_blank"> UCE </a>
|
28 |
+
- <a href="https://arxiv.org/abs/2303.13516" target="_blank"> CA </a>
|
29 |
+
- <a href="https://arxiv.org/abs/2310.12508" target="_blank"> Salun </a>
|
30 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
31 |
|
32 |
## Metrics
|
33 |
+
- Unlearning accuracy (<strong>UA</strong>): It represents the proportion of images generated by the unlearned DM using the unlearning target-related prompt, which are not correctly classified into the corresponding class for the case.
|
34 |
+
- In-domain retain accuracy (<strong>IRA</strong>): It is given by the classification accuracy of images generated by the unlearned DM using innocent prompts (not relevant to the unlearning target) in the same domain.
|
35 |
+
- Cross-domain retain accuracy (<strong>CRA</strong>): Similar to IRA, it is given by the classification accuracy of images generated by the unlearned DM using innocent prompts but in different domains.
|
36 |
+
- <strong>FID</strong> score: evaluate the distribution-wise generation quality of the unlearned DM.
|
37 |
+
- <strong>run-time</strong>
|
38 |
+
- <strong>storage</strong> space requirements
|
39 |
+
- <strong>memory</strong> costs
|
40 |
|
41 |
|
42 |
|
|
|
56 |
|
57 |
|
58 |
EVALUATION_QUEUE_TEXT = """
|
59 |
+
# Evaluation for the UnlearnCanvas Benchmark
|
60 |
|
61 |
"""
|
62 |
|