Spaces:
Sleeping
Sleeping
RatanPrakash
commited on
product overview updated
Browse files
app.py
CHANGED
@@ -177,76 +177,67 @@ elif app_mode=="Project Details":
|
|
177 |
# Project Overview
|
178 |
st.write("## Project Overview:")
|
179 |
st.write("""
|
180 |
-
|
181 |
-
|
182 |
-
- Train the model to read details from various products, including FMCG, OTC items, health supplements, personal care, and household items.
|
183 |
|
184 |
-
|
185 |
-
- Validate expiry dates using OCR to read expiry and MRP details printed on items.
|
186 |
|
187 |
-
|
188 |
-
|
189 |
|
190 |
-
|
191 |
-
- Assess the freshness of fruits and vegetables by analyzing various visual cues and patterns.
|
192 |
-
""")
|
193 |
|
194 |
-
|
195 |
-
Our project aims to leverage OCR and image recognition to enhance product packaging analysis and freshness detection.
|
196 |
-
""")
|
197 |
-
|
198 |
-
# Proposal Round
|
199 |
-
st.write("## Proposal Round:")
|
200 |
-
st.write("""
|
201 |
-
**Format:** Use Case Submission & Code Review
|
202 |
-
- Selected teams will submit detailed use case scenarios they plan to solve.
|
203 |
-
- The submission should include a proposal outlining their approach and the code developed so far.
|
204 |
-
- The GRID team will provide a set of images for testing the model.
|
205 |
-
- Since this is an elimination stage, participants are encouraged to submit a video simulation of their solution on the image set provided to them, ensuring they can clearly articulate what they have solved.
|
206 |
-
- Teams working on detecting the freshness of produce may choose any fresh fruit/vegetable/bread, etc., and submit the freshness index based on the model.
|
207 |
-
- The video will help demonstrate the effectiveness of their approach and provide a visual representation of their solution.
|
208 |
|
209 |
-
|
210 |
-
|
211 |
-
|
212 |
-
|
213 |
-
|
214 |
-
|
215 |
-
|
216 |
-
|
217 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
218 |
|
219 |
-
Our project focuses on developing an advanced system that utilizes Optical Character Recognition (OCR) and image recognition techniques to automate the extraction of product details from packaging. This will not only improve accuracy but also increase efficiency in assessing product freshness.
|
220 |
""")
|
221 |
-
|
222 |
-
# Proposed Solution
|
223 |
-
st.write("## Proposed Solution:")
|
224 |
-
st.write("""
|
225 |
-
Our solution is designed to tackle the problem by implementing the following key components:
|
226 |
-
|
227 |
-
### 1. OCR for Product Detail Extraction
|
228 |
-
We will use OCR technology to accurately extract critical information from product packaging, including:
|
229 |
-
- Brand name
|
230 |
-
- Pack size
|
231 |
-
- Expiry date
|
232 |
-
- MRP details
|
233 |
-
|
234 |
-
This will allow for real-time analysis of product information, ensuring that customers receive accurate data about their purchases.
|
235 |
-
|
236 |
-
### 2. Freshness Detection using Image Recognition
|
237 |
-
In conjunction with OCR, our model will utilize image recognition to assess the freshness of fruits, vegetables, and other perishable items. The model will be trained to classify products based on their appearance, detecting signs of spoilage and degradation.
|
238 |
-
|
239 |
-
### 3. Data Validation and Reporting
|
240 |
-
Our system will not only extract data but also validate expiry dates against the current date to ensure product safety. The results will be compiled into a user-friendly report that can be easily interpreted by retail staff.
|
241 |
-
|
242 |
-
### 4. Video Simulation
|
243 |
-
To effectively demonstrate our solution, we will create a video simulation showcasing the functionality of our system. This will include real-time examples of how our model processes images and extracts relevant information.
|
244 |
-
|
245 |
-
### 5. Proposal Submission
|
246 |
-
As part of the proposal round, we will provide a comprehensive submission outlining our approach, methodology, and the code developed thus far. This submission will highlight the effectiveness of our solution and our readiness to proceed to the final stage of the challenge.
|
247 |
|
248 |
-
Our team is committed to delivering a robust solution that not only meets but exceeds the expectations of the Amazon Sambhav Challenge.
|
249 |
-
""")
|
250 |
|
251 |
elif app_mode == "Team Details":
|
252 |
st.write("## Meet Our Team:")
|
|
|
177 |
# Project Overview
|
178 |
st.write("## Project Overview:")
|
179 |
st.write("""
|
180 |
+
### Problem Statement
|
181 |
+
_Develop a system that automates Amazon product listings from social media content, extracting and organizing details from posts to generate accurate, engaging, and optimized listings._
|
|
|
182 |
|
183 |
+
---
|
|
|
184 |
|
185 |
+
### Solution Overview
|
186 |
+
Our system simplifies the listing process by analyzing social media content, using OCR, image recognition, LLMs, and internet data to create professional Amazon listings.
|
187 |
|
188 |
+
---
|
|
|
|
|
189 |
|
190 |
+
### Task Breakdown
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
191 |
|
192 |
+
#### Task 1: OCR for Image and Label Details
|
193 |
+
**Objective:** Extract core product details from images, labels, and packaging found in social media posts.
|
194 |
+
- **Tools:** PaddleOCR, LLMs.
|
195 |
+
- **Approach:**
|
196 |
+
- Use PaddleOCR to scan images for text, identifying product names, brands, and key features.
|
197 |
+
- Apply LLMs to refine extracted data, categorize key information (product name, type, features), and enhance product descriptions.
|
198 |
+
- Integrate internet sources to cross-verify product details, retrieve additional information, and collect metadata like the brand background or product specs.
|
199 |
+
|
200 |
+
---
|
201 |
+
|
202 |
+
#### Additional Task: Image Recognition & Object Counting
|
203 |
+
**Objective:** Quantify objects within social media images for batch products or multi-item listings.
|
204 |
+
- **Tools:** YOLOv8.
|
205 |
+
- **Approach:**
|
206 |
+
- Train YOLOv8 on a relevant dataset to recognize specific product types or packaging layouts.
|
207 |
+
- Use object detection counts to provide quantitative data (e.g., "3-item bundle"), enhancing accuracy in listings.
|
208 |
+
|
209 |
+
---
|
210 |
+
|
211 |
+
#### Task 2: Data Validation & Structuring
|
212 |
+
**Objective:** Organize and validate extracted information, ensuring it’s formatted to meet Amazon’s listing requirements.
|
213 |
+
- **Tools:** Regex, LLMs.
|
214 |
+
- **Approach:**
|
215 |
+
- Format and validate extracted details into Amazon-compliant structures (titles, descriptions, bullet points).
|
216 |
+
- Use regex and parser tools for accuracy checks.
|
217 |
+
- Leverage LLMs to create compelling descriptions and marketing brochures.
|
218 |
+
- Search online for supplementary media (images/videos) to enrich the listing.
|
219 |
+
|
220 |
+
---
|
221 |
+
|
222 |
+
#### Task 3: Amazon API Integration
|
223 |
+
**Objective:** Connect with Amazon’s API to publish fully formed product listings directly.
|
224 |
+
- **Tools:** Amazon MWS or Selling Partner API.
|
225 |
+
- **Approach:**
|
226 |
+
- Send structured listing data (text, media, product details) to Amazon’s API endpoints.
|
227 |
+
- Handle feedback for submission errors and make necessary adjustments.
|
228 |
+
- Develop a UI/dashboard for users to preview and edit listings before publishing.
|
229 |
+
|
230 |
+
---
|
231 |
+
|
232 |
+
### Future Enhancements
|
233 |
+
- **Model Improvement:** Further refine OCR and parsing accuracy.
|
234 |
+
- **Dashboard Development:** Enable users to preview and customize listings.
|
235 |
+
- **Multi-Market Compatibility:** Expand support to other e-commerce platforms.
|
236 |
+
|
237 |
+
This approach automates listing creation directly from social media content, helping sellers quickly launch optimized Amazon product pages.
|
238 |
|
|
|
239 |
""")
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
240 |
|
|
|
|
|
241 |
|
242 |
elif app_mode == "Team Details":
|
243 |
st.write("## Meet Our Team:")
|