AI-Powered Price Scraper & Monitoring System (Multi-Website)

We are looking for an experienced developer to build a scalable AI-powered price scraping and monitoring system. The system should automatically extract product pricing data from multiple e-commerce websites and store it in a structured database for monitoring and analysis.

The system must support multi-tenant architecture, role-based permissions, subscription tiers, and Stripe payment integration.

The goal is to allow different companies to monitor product prices across multiple websites, with usage limits based on subscription plans.

Project Scope

1. Target Websites
• Scrape product prices from 7–10 e-commerce websites
• Support dynamic content (JavaScript-rendered pages)
• Proxy rotation & anti-bot handling
• Scheduled scraping
• Historical price tracking
• Price change alerts (email or webhook)
• Handle pagination and product variations

2. Multi-Tenant Architecture
• Super Admin role
• Manage all companies
• Manage subscription plans
• View system-wide usage
• Suspend / activate companies

2. Data Extraction
• Extract product name
• Current price
• Original price (if available)
• SKU / Product ID
• Availability status
• Timestamp

3.1 Company Admin role
• Manage company users
• Set scraping targets (websites & products)
• View company usage stats

3.2 Company Users
• View price tracking dashboard
• Access only assigned websites/products

3.3 Subscription & Usage Limits
System must support different plan levels:

Each plan should control:
• Maximum number of websites
• Maximum number of products
• Scraping frequency (e.g., 1h / 3h / 6h / 24h)
• Maximum concurrent scraping jobs
• Historical data retention length

Stripe Integration
• Stripe subscription integration
• Monthly / Yearly billing (7 days free trial)
• Webhook handling for subscription status updates
• Automatic feature unlock based on plan
• Auto suspend account if payment fails
• Admin ability to manually upgrade/downgrade plan


4. AI-Assisted Selector Detection
• Use AI or intelligent selector logic to detect price elements
• System should adapt if minor DOM changes occur
• Minimize manual reconfiguration

5. Infrastructure
• Proxy rotation support
• Anti-bot handling
• Headless browser support (e.g., Puppeteer / Playwright)
• Scalable deployment (Docker preferred)

6. Database & Storage
• Store data in MySQL
• Historical price tracking
• Ability to compare price changes

7. Monitoring & Automation
• Scheduled scraping (e.g., every 1–6 hours)
• Email or webhook alerts when price changes
• Logging and error reporting

8. Dashboard
• Admin and users dashboard
• Search by product
• View historical price chart

Technical Requirements
Preferred stack:
• Laravel
• Playwright / Puppeteer / Scrapy
• REST API architecture
• Docker deployment

Deliverables
• Fully working scraping system
• Deployment guide
• Source code
• Documentation
• 2 weeks post-delivery support

Bonus
Experience with anti-bot bypass, rotating residential proxies, and large-scale scraping is highly preferred.

If interested, please include your portfolio and examples of similar scraping projects.