MythicalCow commited on
Commit
6154f77
1 Parent(s): 74582bf

readme update

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md CHANGED
@@ -100,6 +100,21 @@ widget:
100
 
101
  '
102
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
103
 
104
  # SentenceTransformer based on Snowflake/snowflake-arctic-embed-s
105
 
 
100
 
101
  '
102
  ---
103
+ # Github and Technical Report
104
+ To view our technical report and for access to other model and dataset related scripts visit our github [Github](https://github.com/khoj-ai/timely/tree/main)
105
+
106
+ # Timely: An Embeddings Model For Temporal Reasoning
107
+
108
+ At Khoj, we develop open-source personal AI to simplify how people engage with machines. The RAG component in modern AI systems commonly uses an embedding model to retrieve relevant documents for a user query. This retrieved-context enables accurate and personalized responses.
109
+
110
+ However, most of these models struggle with temporal reasoning. For instance, if asked "Where was I last summer?", the model would struggle to understand the framing of that question. It requires us to understand the relativity of time (that 2010 is before 2011), and when summer might be (between May - September).
111
+
112
+ When we express dates, we often use shorthands like ‘back in June’, ‘on summer break’, and ‘06/15’; all syntaxes that models don’t presently handle well. As such, your embedding model may not find documents with dates within that specific period. This limitation is significant, given the importance of time and date in language and daily life.
113
+
114
+ To address this problem, we propose **Timely**, a comprehensive pipeline for date-aware dataset generation, model fine-tuning, and benchmarking. Specifically, our goal is to create models that can:
115
+
116
+ 1. Identify natural language dates in queries and documents better
117
+ 2. Can handle relative and soft data filters more naturally (e.g. discerning that June is closer than November when talking about Spring).
118
 
119
  # SentenceTransformer based on Snowflake/snowflake-arctic-embed-s
120