Field notes
Writing on scraping,
data, and building on APIs.
Tutorials, playbooks, and field notes from building one of the most complete social APIs on the market.
Latest post
7 Best Twitter Scrapers and APIs in 2026
Compare seven current Twitter and X scrapers for public profiles, exact posts, search, bulk exports, official access, and open source projects. Prices and limits verified August 25, 2026.
All posts
86 total
7 Best LinkedIn Scrapers in 2026: APIs, No-Code, and Bulk Data
Compare seven LinkedIn scrapers for public profile APIs, bulk records, Sales Navigator exports, no-code automation, emails, and official access.
6 Best TikTok Scrapers and APIs in 2026
Compare six TikTok scrapers for app APIs, Actor runs, bulk records, daily quotas, custom parsers, and self-hosted code, with current pricing and honest limits.
Apify Instagram Reels Scraper vs ScrapeCreators: 50 Profiles Tested
I requested up to 12 Reels from each of 50 major Instagram profiles. ScrapeCreators was 13.6 times faster and much cheaper, while Apify covered more profiles on the first attempt.
Apify Instagram Posts Scraper vs ScrapeCreators: 600 Posts Tested
I fetched 12 recent posts from each of 50 major Instagram profiles. ScrapeCreators returned 600 posts for 50 credits and finished almost 12 times faster than Apify.
Apify Instagram Profile Scraper vs ScrapeCreators: 50 Profiles Tested
I fetched the same 50 major Instagram profiles through Apify and ScrapeCreators. Both returned every profile, while ScrapeCreators was 2.43 times faster and 14.9% cheaper.
Apify Instagram Scraper vs ScrapeCreators: 1,000 URLs Tested
I ran 1,000 public Instagram post and Reel URLs through Apify and ScrapeCreators. Here are the actual costs, first-attempt success rates, and speed results.
6 Best YouTube Scrapers and APIs in 2026
Compare six YouTube scrapers for app APIs, search feeds, Actor runs, subtitles, daily quotas, and bulk records, with current pricing and honest limits.
5 Best Facebook Marketplace APIs and Scrapers in 2026
Compare five ways to collect Facebook Marketplace listings, from Meta's research API to managed APIs, Actors, data pipelines, and browser bots.
Best Social Media Scraping APIs to Use in 2026
A practical comparison of 10 social media scraping APIs for developers and AI agents, including ScrapeCreators, SociaVault, Apify, EnsembleData, Supadata, and Bright Data.
4 New Instagram APIs for Search, Replies, and Tagged Posts
ScrapeCreators added native Instagram search, Popular topic search, user tagged posts, and public comment replies. Here is what each endpoint returns and when to use it.
Why ScrapeCreators API Cache Hits Cost 0 Credits
Use cache_max_age on supported ScrapeCreators endpoints. A valid cache hit returns in about a second for 0 credits, while a cache miss runs a normal live fetch.
Research Public Instagram Reels With an AI Skill
A copyable AI skill for comparing public Instagram Reels from selected profiles, pulling post context where needed, and reporting the limits behind play-count comparisons.
Monitor Meta Ad Library Creative With an AI Skill
A copyable AI skill for monitoring public Meta Ad Library creative. Save a baseline, compare visible changes, and return source URLs and caveats instead of overclaiming ad performance.
Turn TikTok Transcripts Into Content Briefs With an AI Skill
A copyable AI skill that turns public TikTok transcripts into an auditable content brief: source URLs, hooks, themes, evidence, and ideas that still need human review.
How to build a TikTok creator research skill with AI
Use an AI skill to turn a niche and customer into TikTok searches, analyze what creators say, calculate recent average views, and collect only business emails they publish in public bios.
How to Write Instagram Reel Hooks From Transcripts
I stopped guessing at hooks. I scraped a creator's top Reels, saved the transcripts, and turned first lines into a hook bank I can open in Cursor.
How to Scrape Facebook Comments from Posts and Reels
Scrape public Facebook comments from posts and reels with an API. Compare the official Graph API, hosted scrapers, no-code tools, and Python.
Best SERP API in 2026: 10 tools priced and compared
Compare 10 SERP APIs by search coverage, result depth, billing unit, delivery mode, and fit for SEO tools or AI agents. Prices verified August 29, 2026.
How to Download TikTok Videos and Store Them on a CDN
Learn how to programmatically download TikTok videos and store them in cloud CDNs like Supabase, S3, or Cloudinary.
7 Best Instagram Scrapers in 2026: APIs and No-Code Tools
Compare seven Instagram scraper APIs and no-code tools by coverage, workflow, pricing, and limits. Includes a clear pick for each use case.
What Are Social Media Intelligence APIs? How to Use Them
Discover how Scrape Creators API enables rapid social media data extraction across all major platforms.
How to Bypass Google's Anti-Scraping Restrictions
Learn how to scrape Google search results using a straightforward approach with the Impit package and custom parsing logic.
How to Scrape Amazon Creator Shops for Influencer Product Data
Scrape Creators now supports extracting product data from Amazon Creator Shop pages
How to Search Nested JavaScript Objects by Key
Function that searches deeply nested JavaScript objects for specific keys when working with complex API responses and scraped data structures.
What Is Logo.dev? A Simple API for Adding Company Logos
Logo.dev is a simple HTTP API for company logos by domain—the practical successor many teams wanted after Clearbit's logo product changed. Every SaaS dashboard, CRM, and email template still needs crisp brand marks without maintaining your own asset library. I…
How to Build a Twitter Thread Scraper in 5 Simple Steps
Learn how to build a complete Twitter thread scraper using Old Bird v2 API and AI code generation in just 5 steps.
Firecrawl vs Scrape Creators: Which Social Scraping API Should You Use?
Firecrawl actively blocks Instagram, YouTube, and TikTok scraping, creating a significant market gap for social media data extraction services.
How to Scrape All Videos from a YouTube Channel
Scrape every public video from a YouTube channel with a hosted API, the official YouTube Data API, or yt-dlp. Compare setup, pagination, costs, and limits.
How to Detect TikTok Shop Products in Creator Videos
Scrape Creators API now identifies specific TikTok Shop products that creators promote in their videos.
3 Ways to Use Proxies in Node.js: Impit, Axios, and Fetch
Learn three different methods for implementing proxy support in Node.js applications using Impit, Axios, and Fetch.
How to Build Production-Ready Scraping Infrastructure
This deep dive on Scrape Creators reveals the technical architecture powering a production scraping service thousands of requests daily.
The Ultimate Guide to Ad Library APIs: Facebook, Google, LinkedIn & Reddit
A practical guide to choosing an ad library API for Meta, Google, LinkedIn, TikTok, and Reddit, with current access limits, costs, and tested request examples.
How to Scrape Instagram Data: The Complete Guide (2026)
This comprehensive guide covers profiles, posts, comments, and creative workarounds for Instagram's restrictions.
X (Twitter) API Pricing in 2026: Pay-Per-Use Costs and Alternatives
X now charges per resource read and per write action. See the current rates, real cost examples, and when a public-data API is the better fit.
How to Find TikTok Creator Regions: The Hidden Method TikTok Doesn't Want You to Know
TikTok removed the region display from creator profiles, but the location data still exists hidden in video metadata. This simple scraping method uncovers it.
How I Built a Profitable Scraping API from a Lululemon Problem
The unexpected journey from coding bootcamp graduate to successful API entrepreneur and why the best business ideas come from solving real problems
How I Built a One-Person API Business That Extracts Structured Data from Every Social Platform
Learn how I built Scrape Creators as a solo developer, a profitable API business that provides instant access to structured data from social platforms.
What Are API Businesses? A Practical Guide for Solo Developers
API businesses are the lawn-mowing services of the internet. Simple, steady, and boring, but perfect for solo developers seeking freedom.
Social Media Scraping Trends: What 10M+ API Calls Reveal
Analysis of over 10 million Scrape Creators API calls reveals that Instagram profiles dominate scraping activity but TikTok transcripts are the surprising #2.
How to Use the Scrape Creators n8n Node Without HTTP Calls
The Scrape Creators Community Node is now available on n8n Cloud, eliminating the need for complex HTTP requests and API calls when scraping social media data.
What Happens When Social Media Companies Catch You Scraping? A Platform-by-Platform Guide
Here's what you can realistically expect from each major platform when they discover your scraping operations.
Is Web Scraping Legal? A Guide Based on Recent Court Rulings
Multiple federal court rulings against Meta and Twitter, have established that web scraping publicly accessible data is legal
Best Cheap Residential Proxies for Web Scraping
Cheap and reliable residential proxy options for web scraping include Evomi at $0.49/GB, Dataimpulse at $1/GB, and Webshare for $230/month.
How to Solve TikTok Slider Captchas: A Developer's Guide
Learn how to programmatically solve TikTok's slider captchas using Puppeteer and SadCaptcha API when scraping TikTok Shop or other TikTok content.
Firecrawl vs Scrape Creators: Which Tool Should You Use?
Firecrawl handles general web scraping, while Scrape Creators specializes in social media. Compare features, pricing, and when each one fits.
Apify vs Scrape Creators: Which One Fits Your Scraping Job?
Compare Apify and Scrape Creators by workflow, pricing, API design, social-data coverage, and a dated 1,000-URL Instagram benchmark.
Scrape Creators vs ScrapingBee: A Comprehensive Comparison
Scrape Creators is a focused ScrapingBee alternative for social media data. Compare current pricing, credits, concurrency, outputs, and honest limits.
Social Media Scraping in 2026: Platform Rules, Risks, and Workarounds
Social media scraping enforcement varies wildly across platforms. Learn which platforms fight back and which don't care.
How to Access ESPN's Hidden API for Free Sports Data
Discover how to access ESPN’s hidden API and pull live sports data for free with simple GET requests.
Why You Shouldn't Use Puppeteer or Selenium for Web Scraping
Puppeteer and Selenium are slow, costly, and detectable. Learn why they’re a last resort for scraping and what to use instead.
The Legality of Scraping Twitter: A Developer's Guide
Scraping Twitter in 2025? Learn what’s legal, what’s not, and how developers can safely access Twitter data without risking lawsuits or bans.
Web Scraping Best Practices: 5 Common Mistakes to Avoid
Learn the 5 most common web scraping mistakes (and how to avoid them). From Puppeteer pitfalls to proxy best practices, here’s how to scrape smarter.
How to Use TikTok Comments for Investment Research
Discover how one investor turned $20K into $80M by reading TikTok comments, and how you can automate the process with Scrape Creators API.
How to Scrape YouTube Videos, Shorts, Transcripts, and Comments
Scrape Creators Unofficial YouTube API lets you search videos & shorts, fetch channel details, get lightning fast transcripts, and extract comments. In real time
How to Search and Scrape TikTok Shop Products
Search TikTok Shop by keyword, list every product in a store, then hydrate details and promo videos. Covers search, shop catalog, product detail, and analytics workflows.
How to Scrape Twitch Creator Profiles with an Unofficial API
A practical guide to Twitch profile scraping: compare Twitch Helix, managed scraper APIs, no-code collectors, and DIY requests, then make a real profile API call.
How to Scrape Threads Profiles, Posts, and Keywords
Scrape public Threads profiles, posts, and keywords instantly with the Scrape Creators Unofficial Threads API, no business account or app required.
How to Get Pinterest Data with an Unofficial Pinterest API
Scrape Pinterest pins, boards, and user pins instantly with JSON results, no business account needed. Get images, links, videos, recipes, and more fast.
Best Pay-As-You-Go Scraping APIs (No Monthly Commitment Required)
Compare five pay-as-you-go scraping APIs by billing unit, minimum purchase, credit expiration, target coverage, and the real cost of a usable result.
5 Best Proxy Providers for Web Scraping (Pricing and Performance)
Looking for the best proxy for scraping in 2025? Here's my honest review of 5 proxy providers I've actually used, what works, what sucks, and what's worth it.
How to Get the Estimated Age & Gender of a Social Media Creator (Using Just Their Profile Pic)
Learn how to detect a creator’s age and gender using Amazon Rekognition or the Scrape Creators API. Perfect for influencer analysis or ad targeting.
How to See How Much a TikTok Shop is Making Daily (And Build Your Own FastMoss/Kalodata)
Learn how to estimate daily sales of any TikTok Shop product using Scrape Creators. Build your own FastMoss or Kalodata style tracker fast.
How to Access TikTok Shop on Desktop Without Logging In
TikTok Shop is now publicly available on desktop with no login required. Scrape product data, stock, affiliate videos, and more, easily and at scale.
How to Get Someone’s TikTok Followers (and What You Can Do With Them)
Learn how to scrape someone’s TikTok followers with Scrape Creators. Get usernames, regions, avatars, then enrich the data to reveal demographics.
How to Scrape Linktree (and Find Emails or Social Links)
Learn how to scrape Linktree pages to find emails and social links using Node.js. A step-by-step guide with real-world examples and bonus tips.
How to Find Emails of YouTube Creators (Without Breaking the Rules)
Learn how to find YouTube influencer emails the right way. Explore software tools, APIs, and the best methods to get contact info from public profiles.
How to Find Emails and Followers of Public Instagram Accounts (3 Proven Methods)
Learn how to find emails and followers of public Instagram accounts using paid tools, scrapers, or behind the login APIs. Get results fast, even without coding.
10 best web scraping APIs in 2026
The best web scraping API depends on the target. Compare 10 options by data type, billing unit, rendering, extraction, and maintenance burden.
How to Get Snapchat Follower Counts, Stories, and Spotlights
Use a Snapchat follower count API to read public profile counts, Stories, and Spotlights. See the exact fields, limits, live test results, and tracking code.
How to Scrape Instagram Comments from Any Public Post
A practical guide to scraping comments and replies from public Instagram posts, handling cursors, filtering dates, and choosing between Meta's API and a public-data API.
How to Scrape Twitter (X) Data in 2026: 3 Practical Methods
Learn how to scrape Twitter and X data with a hosted API, the official X API, or your own browser workflow. Includes current limits, costs, code, and honest tradeoffs.
How to Scrape LinkedIn Public Data in 2026: Four Practical Methods
A practical guide to LinkedIn scraping with official APIs, managed public-data APIs, hosted tools, and self-built browser automation.
Facebook Group Scraper API: Posts, Comments, and Workflow
Scrape public Facebook group posts, comments, and group metadata through a REST API. See the real request flow, limits, pricing, and safer use cases.
How to Get Reddit Posts, Comments, and Trends with an Unofficial API
Skip Reddit’s rate limits and complexity. This unofficial Reddit API gives you fast, reliable access to posts, comments, and search, with pay-as-you-go pricing.
How to Track Influencers and Analyze Instagram Bios at Scale
Get real-time access to Instagram bios, follower counts, recent posts, and related creators, with no login, no rate limits, and no app approval. Ideal for influencer tracking and marketing tools.
How to Spy on Your Competitors’ Facebook Ads with One API Call
Stop scrolling and start scraping. Learn how to spy on your competitors’ Facebook ads with just one API call using Scrape Creators, no login or rate limits required.
How to Find Out If a TikTok User Has a TikTok Shop
Learn how to programmatically detect if a TikTok user has a TikTok Shop using Scrape Creators. Great for marketers, UGC creators, SaaS tools, and agencies looking to sell services or analyze shop data at scale.
How to Tell If a TikTok Video Is an Ad
Want to know if a TikTok video was turned into an ad? Learn how to check the isAd flag in the HTML and why it matters for influencer and ad strategy.
How to Tell If a TikTok Video Is Promoting a TikTok Shop Product
Learn how to spot the “Eligible for commission” label, identify affiliate content, and get this data via API.
Best Truth Social API for Tracking Trump's Posts
Want to get Trumps but not sure how? Automatically get them with our unofficial Truth Social API
How to Scrape Images from TikTok Slideshows
Ever wondered how to extract TikTok images from a TikTok photo carousel? This article explains exactly how to do it
How to Scrape YouTube Transcripts with Node.js
Scrape YouTube Transcripts fast with this method
How to Access Instagram Public Data Without Rate Limits
An Instagram public data API serves profiles and posts as JSON—without the Graph API's approval maze for read-only public fields. Official limits and app review slow down prototypes. Unofficial public endpoints help when you only need what's visible without lo…
6 Facebook Ad Library scrapers compared for 2026
Compare six Facebook Ad Library scraper options for APIs, no-code workflows, browser exports, creative research, and official ad-transparency research.
5 Best YouTube Transcript API Options in 2026
Compare five practical ways to get YouTube transcripts, including hosted APIs, an open-source Python library, and Google's owner-only captions API.