GitHub adds metrics to track AI security findings and developers’ fixes
The public preview tracks resolved findings and use of autofix suggestions, but requires GitHub Code Security or Advanced Security and excludes Enterprise Server.
Loading page…
The public preview tracks resolved findings and use of autofix suggestions, but requires GitHub Code Security or Advanced Security and excludes Enterprise Server.
Listen to this story
GitHub’s October 13 update gives administrators an organization- and enterprise-level view of what happens after AI Scan flags pull-request issues: findings, resolutions, remediation rates, repository trends, and developer uptake of autofix suggestions. The public preview is limited to github.com and GitHub Enterprise Cloud customers with GitHub Code Security or GitHub Advanced Security; Enterprise Server is excluded. The reporting can inform rollout and investment decisions, but GitHub has not reported evidence that the dashboard or AI Scan improved security outcomes.
The “Code scanning on pull requests” page replaces “CodeQL pull requests” and now separates CodeQL and AI Scan metrics into distinct tabs.
The AI Scan tab shows findings with and without autofix suggestions, while separate metrics track how often developers apply those suggestions.
Administrators can review repositories generating findings and see trends over a selected reporting period.
GitHub is giving security teams a way to track what happens after AI Scan flags an issue—not just how many findings it produces. On October 13, it added organization- and enterprise-level metrics to security overview, letting administrators see resolved findings, remediation rates and developers’ use of suggested fixes in one place.
The metrics cover AI Scan for pull requests. Administrators can see how many findings were generated and how many were resolved, alongside the remediation rate. That puts the volume of findings and the rate of resolution in the same reporting view.
The view also identifies repositories that generated findings and shows trends over the selected reporting period. Security teams can therefore examine activity across their organization or enterprise rather than review individual pull requests to assemble that picture.
Suggested fixes get their own measures. GitHub tracks how often developers applied autofix suggestions, while the AI Scan tab separates findings that include a suggestion from those that do not. The dashboard distinguishes the availability of a proposed fix from developers’ use of those suggestions.
To find the metrics, administrators should look for “Code scanning on pull requests” in security overview. That is the new name for the “CodeQL pull requests” page. It now has separate CodeQL and AI Scan tabs, rather than placing both sets of metrics under the old CodeQL page name.
Existing CodeQL pull-request metrics remain available under the CodeQL tab. The AI Scan tab shows total findings, including the split between findings with and without an autofix suggestion. The change adds an AI Scan reporting view while retaining the existing CodeQL metrics in their own tab.
GitHub says the metrics are intended to help security teams evaluate AI Scan’s effectiveness, understand developer response and make rollout and investment decisions. Its October 13 changelog introduces the measurement tools; it does not present a measured improvement in security outcomes.
Loading discussion...
Join the conversation
Explain how much weight you would give fixes people actually use.
Be the first to share a perspective or an experience.
Reader comments
Newest comments first. Replies stay oldest first.