23 pickle imports?

#5
by isopods-and-millipedes - opened

I notice 23 pickle imports in this project.
I'm not sure how to tell if they are harmful.

/training_args.bin

Detected Pickle imports (8)

"transformers.trainer_utils.IntervalStrategy",
"transformers.trainer_utils.HubStrategy",
"transformers.training_args.TrainingArguments",
"accelerate.utils.dataclasses.DistributedType",
"transformers.training_args.OptimizerNames",
"torch.device",
"accelerate.state.PartialState",
"transformers.trainer_utils.SchedulerType"

/checkpoint-801/rng_state.pth

Detected Pickle imports (7)

"numpy.dtype",
"torch.ByteStorage",
"numpy.ndarray",
"numpy.core.multiarray._reconstruct",
"torch._utils._rebuild_tensor_v2",
"collections.OrderedDict",
"_codecs.encode"

/checkpoint-801/training_args.bin

Detected Pickle imports (8)

"transformers.trainer_utils.IntervalStrategy",
"transformers.trainer_utils.HubStrategy",
"transformers.training_args.TrainingArguments",
"accelerate.utils.dataclasses.DistributedType",
"transformers.training_args.OptimizerNames",
"torch.device",
"accelerate.state.PartialState",
"transformers.trainer_utils.SchedulerType"

isopods-and-millipedes changed discussion title from pickles? to 23 pickle imports?

Sign up or log in to comment