Initial commit
5d13203
verified
bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
Detected Pickle imports (6)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
12 GB
Initial commit
bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
Detected Pickle imports (6)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler"
How to fix it?
12 GB
Initial commit
bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
Detected Pickle imports (6)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
12 GB
Initial commit
bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
Detected Pickle imports (6)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
12 GB
Initial commit
bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt
Detected Pickle imports (6)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
12 GB
Initial commit
bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt
Detected Pickle imports (6)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch.FloatStorage",
- "deepspeed.utils.tensor_fragment.fragment_address"
How to fix it?
12 GB
Initial commit
bf16_zero_pp_rank_6_mp_rank_00_optim_states.pt
Detected Pickle imports (6)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler"
How to fix it?
12 GB
Initial commit
bf16_zero_pp_rank_7_mp_rank_00_optim_states.pt
Detected Pickle imports (6)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.utils.tensor_fragment.fragment_address",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler"
How to fix it?
12 GB
Initial commit
-
16.1 GB
Initial commit