DEV Community

Scraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How I scraped 50k YouTube subtitles in 2 weeks for $7 (and the legal gray zones)

How I scraped 50k YouTube subtitles in 2 weeks for $7 (and the legal gray zones)

Comments
4 min read
API or browser agent? We picked yes.

API or browser agent? We picked yes.

Comments
7 min read
ISP proxies, AI crawlers, and the slow death of datacenter IPs: 2026 in numbers

ISP proxies, AI crawlers, and the slow death of datacenter IPs: 2026 in numbers

Comments
8 min read
I Tested 15 LLMs for Web Scraping and Built Heuristics Instead

I Tested 15 LLMs for Web Scraping and Built Heuristics Instead

Comments
3 min read
How I Sniffed Xiaohongshu's Collection API in 90 Seconds — and Why CORS Made Me Rewrite the Whole Approach

How I Sniffed Xiaohongshu's Collection API in 90 Seconds — and Why CORS Made Me Rewrite the Whole Approach

Comments
6 min read
6 Apify actors I actually use myself

6 Apify actors I actually use myself

Comments
3 min read
Anti-bot without the arms race: what Camoufox does differently

Anti-bot without the arms race: what Camoufox does differently

1
Comments
4 min read
Web Crawling e Web Scraping

Web Crawling e Web Scraping

Comments
3 min read
I stopped using headless Chrome as the default scraper

I stopped using headless Chrome as the default scraper

8
Comments 1
5 min read
Reddit Subreddit Tracker 深度测评:批量追踪 Reddit 热门内容

Reddit Subreddit Tracker 深度测评:批量追踪 Reddit 热门内容

Comments
1 min read
Authenticated Scraping: Why Session Persistence Matters

Authenticated Scraping: Why Session Persistence Matters

1
Comments
5 min read
The Hybrid Vinted Scraping Architecture That Outperforms Pure Browser Crawls

The Hybrid Vinted Scraping Architecture That Outperforms Pure Browser Crawls

Comments
8 min read
How to Scrape LinkedIn Data: Complete Guide for 2026

How to Scrape LinkedIn Data: Complete Guide for 2026

1
Comments
8 min read
Scrape vs Crawl vs Map: Picking the Right Anakin API for the Job

Scrape vs Crawl vs Map: Picking the Right Anakin API for the Job

Comments
4 min read
How Agentic Search Actually Works: The Research Loop Link-Fetching Agents Miss

How Agentic Search Actually Works: The Research Loop Link-Fetching Agents Miss

Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.