What's New
Stay updated with our latest features, improvements, and upcoming changes
Improvements
May 27, 2025
Now shorts will only be in the shorts array in youtube search
Now, you can be sure that only shorts will be in the shorts array in youtube search. Previously shorts were in the videos array. And lives are in their own array now in the youtube search results.
New Features
May 14, 2025
New LinkedIn Post endpoint
You can now scrape a public Linkedin post! Works for articles and posts, and you can get the transcript! I might separate the article and post endpoints in the future. Let me know what you think: adrian@thewebscrapingguy.com
Google Search API
You can now scrape Google search results! Hoping it helps you find creators, and whatever else you need.
New Features
May 14, 2025
New LinkedIn Profile endpoint
You can now fetch a LinkedIn profile page! Unfortunately you can't get job title or work history though :( Linkedin is lame and now hides that publicly. Check out the docs for more info.
New Features
May 10, 2025
New Pinterest Search API endpoint
You can now search Pinterest! Check out the docs for more info.
New Features
May 7, 2025
New Instagram Highlights API endpoint
You can now fetch Instagram stories highlights! Check out the docs for more info.
Improvements
May 15, 2025
Dedicated endpoint to get Facebook Transcripts
Pass a URL to /v1/facebook/post/transcript to get the transcript for a Facebook post. Pass a post or reel url.
Improvements
May 14, 2025
Speed improvement for Truth Social API
Now can pass a user_id to get posts for a user (107780257626128497 is Trumps id), which will increase response times. Made some other improvements that should improve speed.
Coming Soon
May 6, 2025
LinkedIn Company API
API endpoint for fetching the Linkedin company page
Pinterest Profile API
Endpoint for fetching a Pinterest profile page
Pinterest Board API
Endpoint for fetching a Pinterest board page
Bluesky Endpoints
Planning to add all publicly available endpoints from Bluesky soon
Public Facebook Groups API
Scraping public posts and comments from Facebook groups