X (Twitter) Collector Architecture
Profile and tweet collection via Brightdata API
Internal Components
Service Configuration
Replicas1
Poll Interval300s
Batch Size10 links
APIBrightdata
Database Outputs
x_profilesProfile + tweetsx_profile_linksJunction tablesocial_linksVerification statusPipeline Position
Upstream
Website Scraper (X/Twitter URLs)
Downstream
Email Finder (names for patterns)