Scraping, Storage, Analysis project utilizing LLMs

Several leading industry professionals in a specialist area of marketing have identified a gap in the market with a pressing need, which if achieved promises to shake up a rather static part of the marketing world.

We are in the beginning phases of seeking a technical individual to partner with. Someone who can help make this product a reality.

The individual will need to be well versed in the following:

Creating AI agents to do the following:
- Scraping and storing large amount of information, specifically from social and publishing platforms (potentially using Crawl4)
- Regular tracking of performance metrics/stats of interest
- Converting video and audio to text at scale (potentially utilizing Whisper)
- Deep text analysis and analytics

Also:
- Building of front ends (preferably React), user management (potentially Clerk) and visualization of data
- Database creation, management and efficient storage
- Implementation and management of digital analytics pipelines (potentially snowplow)
- Creation of analytics pipelines for automated analysis, especially using ML approaches like CasualImpact and visualizing the outputs

More information and a detailed brief can be given in an overview call. NDA may be required before the call.