DamonDemon commited on
Commit
bd93788
1 Parent(s): 1564b79

add unlearned methods

Browse files
Files changed (1) hide show
  1. src/display/about.py +16 -14
src/display/about.py CHANGED
@@ -18,23 +18,25 @@ We show that this dataset plays a pivotal role in establishing a standardized an
18
  LLM_BENCHMARKS_TEXT = f"""
19
  # Context
20
 
21
- ## How it works
22
 
23
- We evaluate LLMs on 10 widely recognized game-theoretic tasks, including
 
 
 
 
 
 
24
 
25
- - <a href="https://en.wikipedia.org/wiki/Tic-tac-toe" target="_blank"> Tic-Tac-Toe</a>
26
- - <a href="https://en.wikipedia.org/wiki/Connect_Four" target="_blank"> Connect-4 </a>
27
- - <a href="https://en.wikipedia.org/wiki/Breakthrough_(board_game)" target="_blank"> Breakthrough</a>
28
- - <a href="https://en.wikipedia.org/wiki/Nim" target="_blank"> Nim</a>
29
- - <a href="https://en.wikipedia.org/wiki/First-price_sealed-bid_auction" target="_blank"> Blind Auction</a>
30
- - <a href="https://en.wikipedia.org/wiki/Kuhn_poker" target="_blank"> Kuhn Poker</a>
31
- - <a href="https://en.wikipedia.org/wiki/Liar\%27s_dice" target="_blank"> Liar's Dice</a>
32
- - <a href="https://arxiv.org/pdf/1706.05125.pdf" target="_blank"> Negotiation</a>
33
- - <a href="https://en.wikipedia.org/wiki/Pig_(dice_game)" target="_blank"> Pig</a>
34
- - <a href="https://en.wikipedia.org/wiki/Prisoner\%27s_dilemma" target="_blank"> Prisoner's Dilemma</a>
35
 
36
  ## Metrics
37
- - <strong> Unlearning accuracy (UA):</strong> It represents the proportion of images generated by the unlearned DM using the unlearning target-related prompt, which are not correctly classified into the corresponding class for the case.
 
 
 
 
 
 
38
 
39
 
40
 
@@ -54,7 +56,7 @@ FAQ_TEXT = """
54
 
55
 
56
  EVALUATION_QUEUE_TEXT = """
57
- # Evaluation for the GTBench leaderboard
58
 
59
  """
60
 
 
18
  LLM_BENCHMARKS_TEXT = f"""
19
  # Context
20
 
21
+ ## Evaluated MU Methods
22
 
23
+ We evaluate 5 most recently proposed MU methods for DMs:
24
+
25
+ - <a href="https://erasing.baulab.info" target="_blank"> ESD </a>
26
+ - <a href="https://arxiv.org/abs/2303.17591" target="_blank"> FMN </a>
27
+ - <a href="https://unified.baulab.info" target="_blank"> UCE </a>
28
+ - <a href="https://arxiv.org/abs/2303.13516" target="_blank"> CA </a>
29
+ - <a href="https://arxiv.org/abs/2310.12508" target="_blank"> Salun </a>
30
 
 
 
 
 
 
 
 
 
 
 
31
 
32
  ## Metrics
33
+ - Unlearning accuracy (<strong>UA</strong>): It represents the proportion of images generated by the unlearned DM using the unlearning target-related prompt, which are not correctly classified into the corresponding class for the case.
34
+ - In-domain retain accuracy (<strong>IRA</strong>): It is given by the classification accuracy of images generated by the unlearned DM using innocent prompts (not relevant to the unlearning target) in the same domain.
35
+ - Cross-domain retain accuracy (<strong>CRA</strong>): Similar to IRA, it is given by the classification accuracy of images generated by the unlearned DM using innocent prompts but in different domains.
36
+ - <strong>FID</strong> score: evaluate the distribution-wise generation quality of the unlearned DM.
37
+ - <strong>run-time</strong>
38
+ - <strong>storage</strong> space requirements
39
+ - <strong>memory</strong> costs
40
 
41
 
42
 
 
56
 
57
 
58
  EVALUATION_QUEUE_TEXT = """
59
+ # Evaluation for the UnlearnCanvas Benchmark
60
 
61
  """
62