AI & ML Papers
Photo
🔥 Self-Supervised Prompt Optimization
📅 Published on Feb 7, 2025
🔗 Links:
• arXiv: https://arxiv.org/abs/2502.06855
• PDF: https://arxiv.org/pdf/2502.06855
• GitHub: https://github.com/geekan/metagpt ⭐ 67.7k
🚀 Spaces citing this paper:
• https://huggingface.co/spaces/XiangJinYu/SPO
• https://huggingface.co/spaces/tang-x/SPO
• https://huggingface.co/spaces/ositamiles/SPO
━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus
#SelfSupervisedLearning #PromptOptimization #LargeLanguageModels #NaturalLanguageProcessing #LanguageModelEvaluation
💡 The paper proposes a self supervised framework called Self Supervised Prompt Optimization that optimizes prompts for large language models without requiring external references. The problem addressed is that manually designed prompts require expertise and iterative experimentation, while existing prompt optimization methods rely heavily on external references such as ground truth or human evaluation, which can be costly to obtain. The proposed method derives evaluation and optimization signals purely from output comparisons, where a large language model evaluator selects superior prompts through pairwise output comparisons, and a large language model optimizer aligns outputs with task requirements. The results show that the proposed method outperforms state of the art prompt optimization methods, achieving comparable or superior results with significantly lower costs and fewer samples, demonstrating its effectiveness and efficiency. The method can optimize prompts for both closed and open ended tasks, and can be applied in real world scenarios where external references are unavailable or costly to obtain.
📅 Published on Feb 7, 2025
🔗 Links:
• arXiv: https://arxiv.org/abs/2502.06855
• PDF: https://arxiv.org/pdf/2502.06855
• GitHub: https://github.com/geekan/metagpt ⭐ 67.7k
🚀 Spaces citing this paper:
• https://huggingface.co/spaces/XiangJinYu/SPO
• https://huggingface.co/spaces/tang-x/SPO
• https://huggingface.co/spaces/ositamiles/SPO
━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus
#SelfSupervisedLearning #PromptOptimization #LargeLanguageModels #NaturalLanguageProcessing #LanguageModelEvaluation
arXiv.org
Self-Supervised Prompt Optimization
Well-designed prompts are crucial for enhancing Large language models' (LLMs) reasoning capabilities while aligning their outputs with task requirements across diverse domains. However, manually...