GitHub scraper and API skills

Site: github.com

GitHub has a complete REST and GraphQL API, but /trending is not in it — no endpoint reproduces the editorial star-velocity ranking that page is built on. These skills cover that gap and use the API where the API is genuinely the better tool.

Working with GitHub

  • Trending is read from the page, because search/repositories sorted by stars does not reproduce it.
  • Pull-request extraction uses the REST API, where the unauthenticated limit is 60 requests/hour shared across all repos — roughly six PRs per hour without a token.

2 GitHub skills

GitHub scraping questions

Does GitHub have an API?
Yes — REST and GraphQL, and it is the right tool for pull-request data. It does not cover /trending, which has no API equivalent.
Is scraping GitHub legal?
Reading data that GitHub publishes publicly is generally treated as lawful in the US — hiQ v. LinkedIn found that scraping a public site does not by itself violate the Computer Fraud and Abuse Act. That is not the whole question: GitHub's terms of service, its robots.txt, the rate at which you request pages, and any personal or copyrighted data you collect all carry their own obligations, and the rules differ outside the US. These skills read public pages at human-scale rates and never bypass a login. Treat this as background, not legal advice.
What data can I extract from GitHub?
Trending repositories with language, period and star deltas; and for a pull request, its title, state, reviewers, review comments and changed files.

Related hubs