What's New

Stay updated with our latest features, improvements, and upcoming changes

Improvements

May 27, 2025

Now shorts will only be in the shorts array in youtube search

Now, you can be sure that only shorts will be in the shorts array in youtube search. Previously shorts were in the videos array. And lives are in their own array now in the youtube search results.

New Features

May 14, 2025

New LinkedIn Post endpoint

You can now scrape a public Linkedin post! Works for articles and posts, and you can get the transcript! I might separate the article and post endpoints in the future. Let me know what you think: adrian@thewebscrapingguy.com

Google Search API

You can now scrape Google search results! Hoping it helps you find creators, and whatever else you need.

New Features

May 14, 2025

New LinkedIn Profile endpoint

You can now fetch a LinkedIn profile page! Unfortunately you can't get job title or work history though :( Linkedin is lame and now hides that publicly. Check out the docs for more info.

New Features

May 10, 2025

New Pinterest Search API endpoint

You can now search Pinterest! Check out the docs for more info.

New Features

May 7, 2025

New Instagram Highlights API endpoint

You can now fetch Instagram stories highlights! Check out the docs for more info.

Improvements

May 15, 2025

Dedicated endpoint to get Facebook Transcripts

Pass a URL to /v1/facebook/post/transcript to get the transcript for a Facebook post. Pass a post or reel url.

Improvements

May 14, 2025

Speed improvement for Truth Social API

Now can pass a user_id to get posts for a user (107780257626128497 is Trumps id), which will increase response times. Made some other improvements that should improve speed.

Coming Soon

May 6, 2025

LinkedIn Company API

API endpoint for fetching the Linkedin company page

Pinterest Profile API

Endpoint for fetching a Pinterest profile page

Pinterest Board API

Endpoint for fetching a Pinterest board page

Bluesky Endpoints

Planning to add all publicly available endpoints from Bluesky soon

Public Facebook Groups API

Scraping public posts and comments from Facebook groups