HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code Generation
Paper
•
2412.21199
•
Published
•
13
YLVV
non-profit
AI & ML interests
None defined yet.
Recent Activity
View all activity
ylvv's activity
yilunzhaoÂ
authored
2
papers
12 days ago
RaidonShogunÂ
authored
a
paper
12 days ago
freeskyÂ
authored
a
paper
12 days ago
entropyhuÂ
authored
a
paper
12 days ago
yilunzhaoÂ
authored
a
paper
20 days ago
yilunzhaoÂ
authored
13
papers
2 months ago
Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization
Paper
•
2311.09184
•
Published
•
1
Investigating Data Contamination in Modern Benchmarks for Large Language Models
Paper
•
2311.09783
•
Published
•
2
MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoning
Paper
•
2311.10537
•
Published
•
3
Prioritizing Safeguarding Over Autonomy: Risks of LLM Agents for Science
Paper
•
2402.04247
•
Published
•
1
Evaluating LLMs at Detecting Errors in LLM Responses
Paper
•
2404.03602
•
Published
•
2
FOLIO: Natural Language Reasoning with First-Order Logic
Paper
•
2209.00840
•
Published
ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examples
Paper
•
2210.12374
•
Published
Enhancing Few-shot Text-to-SQL Capabilities of Large Language Models: A Study on Prompt Design Strategies
Paper
•
2305.12586
•
Published
Open-FinLLMs: Open Multimodal Large Language Models for Financial Applications
Paper
•
2408.11878
•
Published
•
55
Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation
Paper
•
2212.07981
•
Published
ReIFE: Re-evaluating Instruction-Following Evaluation
Paper
•
2410.07069
•
Published
TOMATO: Assessing Visual Temporal Reasoning Capabilities in Multimodal Foundation Models
Paper
•
2410.23266
•
Published
•
20
M3SciQA: A Multi-Modal Multi-Document Scientific QA Benchmark for Evaluating Foundation Models
Paper
•
2411.04075
•
Published
•
16
freeskyÂ
authored
a
paper
4 months ago