bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "mmengine.config.config.ConfigDict",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "collections.OrderedDict",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
19.7 MB
init
bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "torch.FloatStorage",
- "mmengine.config.config.ConfigDict"
How to fix it?
19.7 MB
init
bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "mmengine.config.config.ConfigDict",
- "collections.OrderedDict",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
19.7 MB
init
bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch.FloatStorage",
- "mmengine.config.config.ConfigDict",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler"
How to fix it?
19.7 MB
init
mp_rank_00_model_states.pt
Detected Pickle imports (13)
- "collections.OrderedDict",
- "__builtin__.set",
- "mmengine.logging.history_buffer.HistoryBuffer",
- "numpy.ndarray",
- "numpy.dtype",
- "__builtin__.getattr",
- "torch._utils._rebuild_tensor_v2",
- "numpy.core.multiarray.scalar",
- "torch.BFloat16Storage",
- "numpy.core.multiarray._reconstruct",
- "mmengine.config.config.ConfigDict",
- "_codecs.encode",
- "torch.Size"
How to fix it?
14 MB
init
