The data scraping used by this project ^ is slowed down by Twitter’s API limits, and I wanted to build out a faster way to generate these beautiful social network graphs. By analyzing the network requests a Twitter webpage makes when loading data, I built out a scraper that collects data from Twitter’s private GraphQL API. My scraper outperformed existing scrapers as it bypassed the public API’s limitations.
Twitter GraphQL API Scraper
URL
Caption
Reverse engineered Twitter’s internal GraphQL API to scrape profile data