---
license: apache-2.0
pipeline_tag: text2text-generation
tags:
- llama
- llm
---

This is LoRA checkpoint fine-tuned with the following CLI. The fine-tuning process is logged in [W&B dashboard](https://wandb.ai/chansung18/alpaca_lora/runs/pgvpsy2x?workspace=user-chansung18). I have used DGX workstation with 8 x A100(40G).

```console
python finetune.py \
    --base_model='elinas/llama-13b-hf-transformers-4.29' \
    --data_path='alpaca_data_gpt4.json' \
    --num_epochs=10 \
    --cutoff_len=1024 \
    --group_by_length \
    --output_dir='./lora-alpacagpt4-13b-elinas' \
    --lora_target_modules='[q_proj,k_proj,v_proj,o_proj]' \
    --lora_r=16 \
    --lora_alpha=32 \
    --batch_size=1024 \
    --micro_batch_size=40
```

This LoRA checkpoint is recommended to be used with `transformers >= 4.29` which should be installed with the following command currently(4/30/2023).
```console
pip install git+https://github.com/huggingface/transformers.git
```

Please find out the example usage and results in the accompanied [notebook](https://huggingface.co./LLMs/AlpacaGPT4-LoRA-13B-elina/blob/main/alpacagpt4-lora-13b.ipynb). For the example outputs are listed below as well.

**1. Instruction: Compose an engaging travel blog post about a recent trip to Hawaii, highlighting cultural experiences and must-see attractions.**

I recently took the journey of my lifetime - a weeklong adventure through one of nature's most beautiful creations: Hawaii! I had heard so much about this magical island paradise before going but nothing could prepare me for how truly breathtaking it was in real life. From hiking along verdant mountain trails to swimming with turtles beneath clear turquoise waters, every moment felt like something out of a fairytale. But above all else, what made our visit to Hawaii so memorable were its rich culture and traditions that we experienced firsthand.

One of the highlights of our time there was learning more about Native Hawaiian culture at Puuhonua O Honaunau National Historical Park, also known as "the place of refuge." Here, ancient laws were upheld which allowed wrongdoers who broke certain rules or protocols (like stealing) the chance for redemption if they reached the sacred grounds within 24 hours. This history is fascinating to learn about, particularly since many aspects of traditional Hawaiian culture are still very alive today. The park offers guided tours led by passionate volunteer tour guides who give great insight into the significance behind each feature on site, such as the sacred temple and carved stones called ki‘is. You can even participate in ceremonies held here on special occasions throughout the year. It's not often you get to connect with a destination’s history and heritage in such an intimate way – definitely don’t miss out on this unique opportunity when planning your own trip!

Another unforgettable experience was enjoying some local cuisine. We tried shave ice and malasadas from the famous Leonard's Bakery right near the airport after landing in Honolulu. These iconic desserts have been delighting visitors for years, and it doesn't take long to see why – the delicate flavors of strawberry, vanilla, and coconut will leave you craving more. Later during our stay, we headed to Old Lahaina Luau located just outside Maui to partake in their signature Polynesian feast. Enjoy live entertainment while dining on Kalua pig cooked underground for eight whole hours and poi prepared using sweet potatoes instead of kalo. To top things off, indulge in fresh fruits like mangoes, papaya, and pineapples, sourced straight from Hawaiian farms and delivered daily. Overall, it was the perfect introduction to Hawaiian food, full of bright colors, complex textures, and bold flavor combinations that left us feeling happy and satisfied.

The final experience that really stood out for me was visiting Pipiwai Trail at Kipuka Mahoe State Monument, accessible via Waimoku Falls Trailhead. While driving up winding roads flanked by lush green jungle foliage, we couldn't help but be awestruck by the beauty surrounding us. Eventually reaching the trailhead, we embarked upon the hike itself, passing by cascading waterfalls, peaceful pools, and towering bamboos. After several miles, we arrived at a large open field filled with colorful flowers, where we saw locals setting up picnic blankets alongside wild chickens pecking away at seeds scattered around them. There's no better way to end a day than relaxing amidst nature and taking in everything she has to offer. We spent over three hours exploring the entire area before making our way back down, grateful for the serene atmosphere and stunning scenery we had encountered along the way.

Overall, our trip to Hawaii lived up to expectations and then some! Every aspect of this wonderful destination was beyond captivating - from natural landscapes to vibrant cultures and cuisines - making it impossible not to fall in love. So if you ever find yourself dreaming of escape to a tropical paradise, book your ticket now because once you go, you won’t want to come home. Aloha!

**2. Instruction: Can you help me write a formal email to a potential business partner proposing a joint venture?**

Dear [Potential Business Partner],

Greetings!

I am writing this message on behalf of my company, which specializes in providing market analysis services. Our aim is to use our extensive experience and knowledge in the industry to deliver exceptional results for customers worldwide. We are seeking new opportunities to expand our operations by forming strategic partnerships with companies like yours that share similar objectives. It was brought to my attention that your organization has a proven track record in customer satisfaction and quality assurance within its own area of expertise. This makes us believe there may be significant synergies between both entities when it comes to working together towards mutually beneficial outcomes. I propose we explore the possibilities of a long-term cooperation that would allow each party to bring their unique skill sets into play while taking advantage of the other's strengths.

Our goal will be to provide top notch analysis of current trends and emerging markets, while also bringing about improved efficiency to all our clients. Your input and involvement will no doubt add value to such an endeavor. With these thoughts in mind, let’s get started exploring what could become an effective collaboration opportunity for both parties involved. Please feel free to contact me anytime if you have questions or need additional information from my end.

**3. Instruction: What factors would you consider when designing an inclusive and accessible public transportation system?**

When designing a more inclusive and accessible public transit, there are several key components to take into account. These include:

1) Physical accessibility for people with disabilities such as wheelchair ramps or lifts in vehicles;
2) Communications systems that provide information on routes, schedules, stops and alerts in multiple formats (e.g., braille, audio, large print);
3) Safe and secure infrastructure including cameras, lighting, security staff/services at bus stations and trains stations;
4) Service animals policy – ensuring people travel with their service animals without discrimination;
5) Accessible fare payment options - this includes physical ticket vending machines which can be used by visually impaired customers, pre-paid cards and cashless payments (such as NFC/contactless cards), mobile app integrating with the ticket validation process etc.;
6) Information about how the transportation network functions and relevant rules e.g., boarding etiquette and protocol, behaviour guidelines during emergencies or evacuations, policies around bringing food and drink onto the vehicle, luggage limitations etc..
7) Training of all personnel working within the transit agency on providing services to passengers with various needs, sensitivity towards individuals with disability, awareness of safety measures and protocols during crisis situations involving persons with disability etc.

**4. Instruction: What are some potential implications of using a single-use plastic bottle versus a reusable bottle on both the environment and human health?**

Using a single-use plastic bottle instead of a reusable one has various negative impacts on our ecosystem, as well as public health. Some key concerns are outlined below:

1. Plastics waste in landfills - The accumulation of single use water bottles is rapidly growing, with an estimated 30 billion being thrown away every year worldwide [1]. In addition to the obvious visual pollution that accompanies discarded plastics littering the streets, these objects take up valuable space in already overcrowded landfill sites, where they may remain for hundreds or thousands of years before breaking down into smaller pieces [2][3]. Once released into nature from the site, these microplastics can be carried by wind and rivers and eventually make their way into the ocean, harming aquatic life and entering the food chain [4]. Even when incinerated, burning plastics releases hazardous chemical compounds such as benzo(a)pyrene, known carcinogens[5], and polycyclic aromatic hydrocarbons (PAHs), which are mutagenic and toxic to humans at high doses.[6] Thus, the presence of large quantities of plastics not only detract from the natural beauty of surroundings but also pose significant risks to the health of living organisms and ultimately us.
2. Petroleum usage - The production of most plastics requires crude oil, a finite resource which is extracted through dangerous methods like hydraulic fracturing ('fracking')[7],[8].[9] Additionally, petrochemical manufacture contributes significantly to air pollutants including carbon dioxide emissions10, nitrous oxides ([NOX])and sulfur dioxides([SO2]). These greenhouse gases contribute to climate change, causing sea level rise, more intense storms, droughts and heat waves[11]. Given its ubiquity across industries and products, reducing plastic consumption represents an important step toward mitigating the damage caused by fossil fuels extraction and utilization. Furthermore, lessening demand for plastic items will reduce pressure on companies to seek new sources of raw material, potentially curbing deforestation[12].
3. Chemical leaching - Many types of plastics contain additives like Bisphenol A (BPAs)[13]that have been linked to hormonal imbalances, infertility and even certain types of cancer upon chronic exposure [14]. Reports show that BPS, used as a replacement for BPA in some consumer goods,[15]is just as harmful[16]; thus the cycle continues. With each use and subsequent disposal, the chemical components within the plastic migrate, seeping into soil and groundwater and finally finding their way into our bodies either via ingestion or contact with skin or breathing. Ultimately, this creates greater risk for long term disease development.
4. Impact on wildlife - Animals often mistake plastic debris for food, consuming it without realizing the danger[17]. This results in obstructions, injuries and death due to starvation. For instance, fish commonly mistake bits of floating plastic for zooplankton, which they feed on, mistaking them for actual prey [18]. Marine animals and birds consume pieces of plastic mistakenly thinking they're jellyfish [19][20], clogging vital organs. Turtles are particularly prone to entanglement and suffocation because plastic bags resemble Jellyfish [21], while balloons appear attractive to monkeys who unknowingly swallow them, leading to painful digestive issues [22][23]. All in all, plastics cause unnecessary suffering to innocent creatures simply trying to survive.

In conclusion, although single-use plastic bottles seem convenient at first glance, their effects on our planet and health far outweigh any benefits. By making responsible choices and switching to alternatives like stainless steel, glass or aluminium, we can collectively help slow the pace of environmental destruction and improve overall quality of life for ourselves and future generations.