knguyennguyen's picture
Add new SentenceTransformer model.
3b198cd verified
metadata
tags:
  - sentence-transformers
  - sentence-similarity
  - feature-extraction
  - generated_from_trainer
  - dataset_size:11397
  - loss:MultipleNegativesRankingLoss
base_model: sentence-transformers/all-mpnet-base-v2
widget:
  - source_sentence: a leather jacket for casual occasions and weekend trips for men
    sentences:
      - >-
        Title: Blazer Jackets for Women Business Casual Suit Coat Zipper Crop
        Cardigan Work Outfits Office Long Sleeve Boyfriend Blazers Descripion:
        ["Blazer Jackets for Women Business Casual Suit Coat Zipper Crop
        Cardigan Work Outfits Office Long Sleeve Boyfriend Blazers/Women's
        Casual Blazers Open Front Long Sleeve Button Work Office Blazer Jacket"
         '【 Feature:】'
         "✨ Women blazer casual, open front cardigan jacket comes with long sleeve and label collar. ✨ Occasion: Women's lapel pocket blazer suit perfect for casual, daily life, work office, going out, night out, travel, vacation, holiday, spring, fall, winter, etc. ✨ Women's Casual Lightweight Open Front Cardigan is extremely comfortable! It can be dressed up for business or work, or dressed down for a casual look! Good quality and versatile!"
         '【 Size Chart】'
         "Size:S US:6 EU:36 Bust:98cm/38.58'' Sleeve:60cm/23.62'' Front Length:60cm/23.62'' Size:M US:8 EU:38 Bust:102cm/40.16'' Sleeve:61cm/24.02'' Front Length:61cm/24.02'' Size:L US:10 EU:40 Bust:106cm/41.73'' Sleeve:62cm/24.41'' Front Length:62cm/24.41'' Size:XL US:12 EU:42 Bust:110cm/43.31'' Sleeve:63cm/24.80'' Front Length:63cm/24.80''"
         '❤️ Please Refer to Our Size Chart for Choosing Your Most Suitable Open Front Lapel Blazer Suit/Long Sleeves Buttons Work Suit/Flap Pockets Suit Outerwear Coat, Work Blazer Suit for Women/Basic Lapel Collar Blazer Jacket for Women.'
         "❤️BDFCY'S SERVICE:"
         '💕About Shipping: ✨ Standard Shipping: 8-15 Biz Days to Arrive ✨ Expedited Shipping: 3-5 Biz Days to Arrive 💕Guarantee: * We endeavors 100% customer satisfaction service and experience. * If you receive damaged or wrong items,please contact us, we will provide you a satisfactory solution asap, please rest assured to purchase.* If you are satisfied with our product or service,hope you can leave your positive message,thanks for your encouragement.']
      - >-
        Title: LZJDS Mens Wool Coats Casual Regular Fit Trenchcoats Double
        Collar Thick Winter Peacoats Mid-Length Jacket Overcoat Descripion:
        ["★Mens trench coat autumn winter long jacket overcoat business woolen
        coat with double collar (removable) to resist the cold and keep warm.
        The fashion trend of woolen coat is becoming more and more fierce. The
        design of this coat provides a new standardMaterial: wool blend +
        polyester (30% wool 70% polyester fiber)Color: black, gray, camelSize:
        M-170, L-175, XL-180, XXL-185, XXXL-190, XXXXL-195Style: business
        gentlemanFeatures: thick, single-breasted, double-layer collar, side
        slit pockets★Packing list: 1*Men's thick windbreaker coat★Notes:1.
        Please carefully refer to our size suggestion pictures (not the Amazon
        size chart). The jacket is a slim fit, slightly smaller than expected2.
        We are trying to take a photo to show the color of the item, but it may
        be different depending on the settings of the monitor3. Due to
        long-distance transportation. The coat may be a little crumpled when
        delivered, we are glad that you can iron it before wearing it, it will
        look much better."]
      - >-
        Title: Men Brown Air Force A-2 Leather Flight Bomber Jacket - ww2 flight
        jacket - Men Navy G-1 Jacket - Brown Bomber leather Jacket Descripion:
        ["The G1 Men leather jacket is a premium quality, vintage jacket
        designed to provide a rugged and stylish look for men. The G1Leather
        jacket is made of high-quality distressed leather that gives it a
        unique, worn-in appearance. The Distressed Brown leather jacket features
        a stylish collar with a button closure and a front zipper closure. The
        G1 Men jacket also comes with two spacious pockets on the front for
        storing your essentials. The Leather jacket Men' cuffs and hemline are
        made of rib-knit fabric, which provides a comfortable fit and protects
        against cold winds. The Brown Bomber jacket is a timeless classic that
        never goes out of style. It is perfect for casual occasions, such as a
        night out with friends or a weekend trip. This jacket will keep you
        looking stylish while also providing the warmth and comfort you need."]
  - source_sentence: a shirt jacket for warmth and comfort in rugged conditions for men
    sentences:
      - >-
        Title: Carhartt Men's Big & Tall Relaxed Fit Heavyweight Flannel
        Sherpa-Lined Shirt Jacket, Brown, 3X-Large Descripion: ["This men's
        Carhartt shirt jac blends the comfort of a hoodie with the ruggedness of
        a jacket. Made from heavyweight flannel with a plush sherpa lining and a
        relaxed fit. Features two outer pockets plus an inner pocket on the
        chest. 8-ounce, 100% cotton ringspun flannel. Sherpa fleece lining for
        warmth. Carhartt strong triple-stitched main seams. Relaxed fit. Spread
        collar. Two-snap adjustable cuffs with extended plackets. Antique-finish
        nickel snaps. Two chest pockets with flaps and snap closures #Interior
        chest pocket. Replaces 104452. Imported"]
      - >-
        Title: Tommy Hilfiger Men's Lightweight Active Water Resistant Hooded
        Rain Jacket Descripion: ['Lightweight updated hooded rain slicker with
        red white and navy center front contrast zipper tape.']
      - >-
        Title: UGFashions Icy Hot Jacket Kurt Russell Death Proof Stuntman Mike
        Racing Costume Silver Satin Jacket Descripion: ["Icy Hot Silver Race
        Driver Costume Silver Satin Jacket Icy Hot Death Proof Stuntsman Mike
        Kurt Russell Silver Jacket This Stuntman Mike Racing Jacket turned Kurt
        Russell into a Hollywood celebrity. It is the Stuntman Mike jacket that
        Kurt Russell wore in his movie Death Proof. He looked smart and stylish
        wearing this Death Proof Satin Jacket. Now you can buy this silver
        jacket. Icy Hot Racing Costume Jacket has following features Item
        Specifications: Manufactured from Satin material Front Zipper closure |
        icy hot jacket Inside Viscose Lining | death proof jacket Shirt style
        collar | kurt russell jacket Button Cuffs | stuntman mike satin jacket
        Patches at back and on Sleeves | racing costume jacket Waist Side
        Pockets We have multiple resources for entire operations including
        manufacturing, packaging and shipping to minimize the risk for the item
        being late or defective. We accept returns/ exchanges are possible
        within 30 day time period after delivery. Size chart is provided at the
        end in images section so you can select the perfect size for your body
        and even if it doesn't fit, we are available 24/7 to guide you for
        further steps. QC is done 2-3 times to make sure that whatever item is
        being sent to the buyer gets delivered in accurate and perfect
        condition"]
  - source_sentence: >-
      men's windbreaker with a lightweight design, weather-resistant fabric, and
      adjustable features for comfort and convenience.
    sentences:
      - >-
        Title: Zafy Leather Geniune Leather Women Jacket Small Red Descripion:
        ['High-Quality men Leather Jacket - The " Zafy Leather" is known for its
        leather quality. The jackets are crafted by professional artisans so
        that it must be slim fit, stylish and comfortable to wear. The color may
        differ slightly due to photography lights or different screen resolution
        setting. The solid color you get from us will not fade easily and built
        to last for years. Best Gift for her: Its soft touch makes it the best
        choice as a gift on the occasion of Birthday Day, Christmas Gift and
        Anniversary. Maintainance Tips: Clean leather jacket with little liquid
        cleaner using soft cotton cloth. Do not wash with water or direct
        sunlight exposure may damage color.']
      - >-
        Title: Cosplay.fm Women's Cosplay Costume Red Jacket with Hat
        Descripion: ['cosplay outfit consists of a red jacket, pants, socks,
        belt, and gloves. Made with nice materials, PU leather, cotton and
        polyester.Bulma costume will definitely make you the most eye-catching
        in cosplay shows, parties, comic cons, stage performances, etc.']
      - >-
        Title: Columbia Men's M Fkt Ii Windbreaker Jacket Descripion: ["Ultra
        light and weather-repelling, this protective and packable windbreaker is
        a must for running in wet, blustery weather. \u2028\u2028 You will be
        comfortably shielded in this stain and water resistant windbreaker. It's
        the perfect lightweight layer and first line of defense to combat chilly
        winds and light drizzle. Its full length zippered front allows you to
        dial in the protection on the fly, while a zip-closed security pocket
        keeps essentials close by. Sleeves with elastic at the cuffs and
        thumbholes keep hands and arms comfortable, while elastic at the hem and
        reflective detail adds a touch of safety. This coat can pack down into
        its own pocket for easy travel. Columbia offers this jacket in multiple
        colors and sizes. Active Fit. To ensure the size you choose is right,
        utilize our sizing chart and the following measurement instructions: For
        the sleeves, start at the center back of your neck and measure across
        the shoulder and down to the sleeve. If you come up with a partial
        number, round up to the next even number. For the chest, measure at the
        fullest part of the chest, under the armpits and over the shoulder
        blades, keeping the tape measure firm and level."]
  - source_sentence: >-
      women's waterproof jacket with a detachable hood, adjustable cuffs, and
      multiple storage pockets.
    sentences:
      - >-
        Title: Camii Mia-Rain-Jackets-for-Women-Waterproof Hooded Jacket
        Drawstring Lightweight Hiking Mountain Camping Descripion: ["Camii Mia
        is very known for its simplicity and elegance in extremely well made and
        durable products. We have the desire that makes the fashion art more
        efficient and easy going. That's how we change the world. We strive to
        make perfect blend of design, material and color. Hope you will like our
        work.  Camii Mia women's 3 in 1 Rain jacket featuring detachable hood
        with elastic drawstring, adjustable cuffs with velcro, 2 zippered
        slanted hand pockests and 5 internal hand pocket. Windproof, durable and
        breathable fabric and removable warm polar fleece linning could
        guarantees the best heat retention. Keep your body from wind, rain and
        cold weather. Suitable for outdoor occasions such as hiking, camping,
        climbing, traveling, skiing, snowboarding and other outdoor sports. 
        Size Measurement: Small -- Chest 43.3''(110cm), Shoulder 16.5'' , Sleeve
        23.8'', Length 25.6'' Medium -- Chest 46.5''(118cm), Shoulder 17.7'',
        Sleeve 25'', Length 27.2'' Large -- Chest 48.8''(124cm), Shoulder
        19.9'', Sleeve 25.8'', Length 29.1'' X-Large -- Chest 52''(132cm),
        Shoulder 21.1'', Sleeve 27'', Length 30.7'' XX-Large -- Chest
        53.5''(136cm), Shoulder 21.7'', Sleeve 27', Length 30.7'' If you're not
        sure about your size, please tell us your weight, bust and height in lbs
        and inches. Let's help you to make choice. Thanks!"]
      - >-
        Title: Mountain Warehouse Womens Waterproof Ski Jacket - Slim Fit for
        Winter Descripion: ['Get ready to face the elements in the Slalom
        Extreme Ski Jacket. Fully waterproof with taped seams, the jacket is
        breathable and features RECCO technology, a detachable snowskirt, inner
        stretch ski cuffs and underarm zips. Ref: 031369']
      - >-
        Title: The Classo Bomberium Black Bomber Men Leather Jacket Descripion:
        ['We have introduce our products with high quality leather and
        Craftsmanship. We have aim to provide excellent quality leather product
        to our valued customer in affordable price with elegant Style. When you
        wear our outerwear feel comfortable. We make our own leather and do
        stitching. It is soft Lambskin leather which has been created by Famous
        tendery that product remarkable skin.  We also make this item in faux
        leather which is called Artificial Leather. We are offering both leather
        for leather lovers and faux leather jacket who do not want to wear
        Animal Skin.  Note" The color and shade may vary from the picture you
        are seeing in the laptop due to LED color and scheme.']
  - source_sentence: >-
      men's winter jacket with a water-resistant exterior, thermal insulation,
      and multiple pockets for storage.
    sentences:
      - >-
        Title: Bon Bebe Baby-boys Newborn Champ 3 Piece Velour Jacket And Pant
        Set Descripion: ['Velour, button-front, hooded jacket with embroidered
        applique. 100 percent cotton printed bodysuit with lap shoulder neck
        opening and 3-snap closure at inseam for easy on-off dressing. Velour
        pant with elastic waistband.']
      - >-
        Title: Yansguard Men's Cycling Jerseys Tops Biking Shirts Short Sleeve
        Bike Clothing Full Zipper Bicycle Jacket Gray, M (jersey008),J-G-M
        Descripion: ['100% Polyester.Ultra-soft and UV protection.Full zipper in
        front, easy to wear and take offHigh quality Moisture Wicking Fabric,
        quick-dry feature makes you feel more comfortableWith 5 Pockets for safe
        storage, one of which has a zipper and is waterproof!.There are
        reflective signs on the back of cycling jersey to enhance the safety of
        cycling at night']
      - >-
        Title: Columbia Men's Grand Wall Jacket Descripion: ['Perfect for Fall
        and Winter, the Columbia Men’s Grand Wall Jacket combines a classic
        outdoor look with advanced technology to keep you warm and dry. Crafted
        from water resistant fabric, packed with our down-like Thermarator
        insulation, and lined with our signature Omni-HEAT reflective dots –
        this is your new go-to cold weather coat. Complete with zippered hand
        pockets, a chest pocket for important essentials, and binding at the
        cuffs — perfect to help block the cold, and lock your comfy body heat
        in. This men’s winter jacket is offered in multiple sizes and colors.
        Extended sizing available. Regular Fit. To ensure the size you choose is
        right, utilize our sizing chart and the following measurement
        instructions: For the sleeves, start at the center back of your neck and
        measure across the shoulder and down to the sleeve. If you come up with
        a partial number, round up to the next even number. For the chest,
        measure at the fullest part of the chest, under the armpits and over the
        shoulder blades, keeping the tape measure firm and level.']
pipeline_tag: sentence-similarity
library_name: sentence-transformers

SentenceTransformer based on sentence-transformers/all-mpnet-base-v2

This is a sentence-transformers model finetuned from sentence-transformers/all-mpnet-base-v2. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

  • Model Type: Sentence Transformer
  • Base model: sentence-transformers/all-mpnet-base-v2
  • Maximum Sequence Length: 256 tokens
  • Output Dimensionality: 768 tokens
  • Similarity Function: Cosine Similarity

Model Sources

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: MPNetModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("knguyennguyen/mpnet_jacket4k_adjusted")
# Run inference
sentences = [
    "men's winter jacket with a water-resistant exterior, thermal insulation, and multiple pockets for storage.",
    "Title: Columbia Men's Grand Wall Jacket Descripion: ['Perfect for Fall and Winter, the Columbia Men’s Grand Wall Jacket combines a classic outdoor look with advanced technology to keep you warm and dry. Crafted from water resistant fabric, packed with our down-like Thermarator insulation, and lined with our signature Omni-HEAT reflective dots – this is your new go-to cold weather coat. Complete with zippered hand pockets, a chest pocket for important essentials, and binding at the cuffs — perfect to help block the cold, and lock your comfy body heat in. This men’s winter jacket is offered in multiple sizes and colors. Extended sizing available. Regular Fit. To ensure the size you choose is right, utilize our sizing chart and the following measurement instructions: For the sleeves, start at the center back of your neck and measure across the shoulder and down to the sleeve. If you come up with a partial number, round up to the next even number. For the chest, measure at the fullest part of the chest, under the armpits and over the shoulder blades, keeping the tape measure firm and level.']",
    "Title: Yansguard Men's Cycling Jerseys Tops Biking Shirts Short Sleeve Bike Clothing Full Zipper Bicycle Jacket Gray, M (jersey008),J-G-M Descripion: ['100% Polyester.Ultra-soft and UV protection.Full zipper in front, easy to wear and take offHigh quality Moisture Wicking Fabric, quick-dry feature makes you feel more comfortableWith 5 Pockets for safe storage, one of which has a zipper and is waterproof!.There are reflective signs on the back of cycling jersey to enhance the safety of cycling at night']",
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Training Details

Training Dataset

Unnamed Dataset

  • Size: 11,397 training samples
  • Columns: sentence_0 and sentence_1
  • Approximate statistics based on the first 1000 samples:
    sentence_0 sentence_1
    type string string
    details
    • min: 8 tokens
    • mean: 24.5 tokens
    • max: 59 tokens
    • min: 31 tokens
    • mean: 155.6 tokens
    • max: 256 tokens
  • Samples:
    sentence_0 sentence_1
    a heated vest for staying warm in winter Title: Yi-Create Heated Vest with Battery Pack Included,Unisex Heated Jacket for Men & Women,7.4v 7000mAh Quick Heated Closing Descripion: ['Yi-create Heated Vest with Battery Pack Included,Unisex Heated Jacket for Men & Women,7.4v 7000mAh Quick Heated Clothing with 3 Heating Levels,Lightweight USB Electric Heated Vest with 8 Heating Zone']
    a mid-layer jacket for cold-weather sports and casual wear for men. men's mid-layer jacket with a combination of moisture-wicking panels and a warm, textured fabric. Title: Spyder Active Sports Men's Bandit Half Zip Mid-Layer Jacket Descripion: ['An excellent first layer for its combo of wicking side panels and warm sweater knit bonded to fleece everywhere else, the half zip bandit is made for cold-weather sports, but is stylish enough for just sauntering around town.']
    a down jacket for camping and hiking adventures Title: Helly-Hansen Mens Verglas Icefall Down Jacket Descripion: ["An essential piece in anyone's pack; a lightweight down insulator, ready for your next adventure."]
  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

Training Hyperparameters

Non-Default Hyperparameters

  • per_device_train_batch_size: 128
  • per_device_eval_batch_size: 128
  • num_train_epochs: 5
  • multi_dataset_batch_sampler: round_robin

All Hyperparameters

Click to expand
  • overwrite_output_dir: False
  • do_predict: False
  • eval_strategy: no
  • prediction_loss_only: True
  • per_device_train_batch_size: 128
  • per_device_eval_batch_size: 128
  • per_gpu_train_batch_size: None
  • per_gpu_eval_batch_size: None
  • gradient_accumulation_steps: 1
  • eval_accumulation_steps: None
  • torch_empty_cache_steps: None
  • learning_rate: 5e-05
  • weight_decay: 0.0
  • adam_beta1: 0.9
  • adam_beta2: 0.999
  • adam_epsilon: 1e-08
  • max_grad_norm: 1
  • num_train_epochs: 5
  • max_steps: -1
  • lr_scheduler_type: linear
  • lr_scheduler_kwargs: {}
  • warmup_ratio: 0.0
  • warmup_steps: 0
  • log_level: passive
  • log_level_replica: warning
  • log_on_each_node: True
  • logging_nan_inf_filter: True
  • save_safetensors: True
  • save_on_each_node: False
  • save_only_model: False
  • restore_callback_states_from_checkpoint: False
  • no_cuda: False
  • use_cpu: False
  • use_mps_device: False
  • seed: 42
  • data_seed: None
  • jit_mode_eval: False
  • use_ipex: False
  • bf16: False
  • fp16: False
  • fp16_opt_level: O1
  • half_precision_backend: auto
  • bf16_full_eval: False
  • fp16_full_eval: False
  • tf32: None
  • local_rank: 0
  • ddp_backend: None
  • tpu_num_cores: None
  • tpu_metrics_debug: False
  • debug: []
  • dataloader_drop_last: False
  • dataloader_num_workers: 0
  • dataloader_prefetch_factor: None
  • past_index: -1
  • disable_tqdm: False
  • remove_unused_columns: True
  • label_names: None
  • load_best_model_at_end: False
  • ignore_data_skip: False
  • fsdp: []
  • fsdp_min_num_params: 0
  • fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
  • fsdp_transformer_layer_cls_to_wrap: None
  • accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
  • deepspeed: None
  • label_smoothing_factor: 0.0
  • optim: adamw_torch
  • optim_args: None
  • adafactor: False
  • group_by_length: False
  • length_column_name: length
  • ddp_find_unused_parameters: None
  • ddp_bucket_cap_mb: None
  • ddp_broadcast_buffers: False
  • dataloader_pin_memory: True
  • dataloader_persistent_workers: False
  • skip_memory_metrics: True
  • use_legacy_prediction_loop: False
  • push_to_hub: False
  • resume_from_checkpoint: None
  • hub_model_id: None
  • hub_strategy: every_save
  • hub_private_repo: False
  • hub_always_push: False
  • gradient_checkpointing: False
  • gradient_checkpointing_kwargs: None
  • include_inputs_for_metrics: False
  • eval_do_concat_batches: True
  • fp16_backend: auto
  • push_to_hub_model_id: None
  • push_to_hub_organization: None
  • mp_parameters:
  • auto_find_batch_size: False
  • full_determinism: False
  • torchdynamo: None
  • ray_scope: last
  • ddp_timeout: 1800
  • torch_compile: False
  • torch_compile_backend: None
  • torch_compile_mode: None
  • dispatch_batches: None
  • split_batches: None
  • include_tokens_per_second: False
  • include_num_input_tokens_seen: False
  • neftune_noise_alpha: None
  • optim_target_modules: None
  • batch_eval_metrics: False
  • eval_on_start: False
  • use_liger_kernel: False
  • eval_use_gather_object: False
  • batch_sampler: batch_sampler
  • multi_dataset_batch_sampler: round_robin

Framework Versions

  • Python: 3.11.11
  • Sentence Transformers: 3.1.1
  • Transformers: 4.45.2
  • PyTorch: 2.5.1+cu121
  • Accelerate: 1.2.1
  • Datasets: 3.2.0
  • Tokenizers: 0.20.3

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply},
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}