Overview
Scrapes TikTok search results for given keywords, collecting profile and reel data—likes, views, comments—for competitive and trend analysis.
We developed a keyword‑driven scraper that discovers and collects profile and reel data from TikTok search results, enabling insight into trending content and creators.
Key Features
- Keyword search interface retrieves top‑ranking profiles and reels.
- Extracts reel statistics such as views, likes, comments, and shares.
- Captures profile details including username, follower and following counts, and bio metadata.
- Stores all results in CSV for easy downstream processing and visualization.
- Modular architecture supports scheduled or on‑demand scraping sessions.
- Implements proxy rotation and request‑signature generation to maintain stability.
Technologies Used
PythonUnofficial TikTok APIRequestsSeleniumJSONCSV2CaptchaProxy Rotators
Challenges
TikTok lacks a fully open API and employs dynamic request signatures and anti‑bot measures, making automated data access complex.
Solution
Integrated a headless‑browser crawler with a reverse‑engineered TikTok API wrapper, using rotating proxies and signature generation to bypass anti‑scraping defenses.
Results
Provided marketing teams with actionable intelligence on trending creators, hashtags, and content formats, reducing manual research time and improving campaign targeting.