✨SciCoQA: Quality Assurance for Scientific Paper--Code Alignment
📝 Summary:
SciCoQA is a dataset containing 611 paper-code discrepancies for identifying mismatches between scientific publications and code. It shows that even advanced language models struggle significantly to detect these issues, with the best model finding less than half of real-world discrepancies.
🔹 Publication Date: Published on Jan 19
🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2601.12910
• PDF: https://arxiv.org/pdf/2601.12910
• Project Page: https://ukplab.github.io/scicoqa
• Github: https://github.com/UKPLab/scicoqa
✨ Datasets citing this paper:
• https://huggingface.co/datasets/UKPLab/scicoqa
✨ Spaces citing this paper:
• https://huggingface.co/spaces/UKPLab/scicoqa
==================================
For more data science resources:
✓ https://xn--r1a.website/DataScienceT
#SciCoQA #AcademicIntegrity #CodeQuality #NLP #ResearchData
📝 Summary:
SciCoQA is a dataset containing 611 paper-code discrepancies for identifying mismatches between scientific publications and code. It shows that even advanced language models struggle significantly to detect these issues, with the best model finding less than half of real-world discrepancies.
🔹 Publication Date: Published on Jan 19
🔹 Paper Links:
• arXiv Page: https://arxiv.org/abs/2601.12910
• PDF: https://arxiv.org/pdf/2601.12910
• Project Page: https://ukplab.github.io/scicoqa
• Github: https://github.com/UKPLab/scicoqa
✨ Datasets citing this paper:
• https://huggingface.co/datasets/UKPLab/scicoqa
✨ Spaces citing this paper:
• https://huggingface.co/spaces/UKPLab/scicoqa
==================================
For more data science resources:
✓ https://xn--r1a.website/DataScienceT
#SciCoQA #AcademicIntegrity #CodeQuality #NLP #ResearchData
👍1