#python #agent_evaluation #agent_plugins #agent_security #agent_skills #agentic_ai #benchmark #claude_code #codex #evaluate #evaluation #plugin #plugin_evaluation #security_scanner #skill_eval #skill_evals #skill_evaluation #skill_evaluator #skills
SkillEvaluator checks the quality and security of AI agent skills, which are folders of instructions and supporting files. It can find repeated or overlapping guidance and compare agent task results with and without a skill. Its reports help developers identify problems and understand whether a skill improves performance. It can also check changed skills during the software review process.
https://github.com/NVIDIA/SkillEvaluator
SkillEvaluator checks the quality and security of AI agent skills, which are folders of instructions and supporting files. It can find repeated or overlapping guidance and compare agent task results with and without a skill. Its reports help developers identify problems and understand whether a skill improves performance. It can also check changed skills during the software review process.
https://github.com/NVIDIA/SkillEvaluator
GitHub
GitHub - NVIDIA/SkillEvaluator: Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection…
Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affec...