classified website data scrapper
Summary
Freelancer Client is hiring: classified website data scrapper.
Location: Remote
I need a clean, repeatable script that goes through a target classified site, collects full information—titles and descriptions, prices with current availability, and all associated images—and pushes every record straight into my existing SQL database. Product information is the sole focus; other content such as user reviews or contact details is out of scope for now.
Loop through every product URL on the site (pagination included)
Extract the three data points above with accurate parsing and basic validation
Download or reference images so they can be stored or linked from the SQL tables
Insert or update rows in the database without creating duplicates, using an upsert strategy
Skills: Python, SQL, Web Scraping, MySQL, Elasticsearch, Scrapy, BeautifulSoup, Selenium
Budget: $1500–$12500 USD
Source: Freelancer Client via Remote / Online. Apply on the source website.
Original
I need a clean, repeatable script that goes through a target classified site, collects full information—titles and descriptions, prices with current availability, and all associated images—and pushes every record straight into my existing SQL database. Product information is the sole focus; other content such as user reviews or contact details is out of scope for now.
The script should:
• Loop through every product URL on the site (pagination included)
• Extract the three data points above with accurate parsing and basic validation
• Download or reference images so they can be stored or linked from the SQL tables
• Insert or update rows in the database without creating duplicates, using an upsert strategy
I am comfortable provisioning a staging table and sharing schema details, but I expect you to handle the connection logic, error handling, and logging so I can drop the task into a daily cron job the moment it is delivered. Python with BeautifulSoup, Scrapy, or Selenium is preferred, yet I am open to any language that can demonstrate reliability and future maintainability.
Please deliver well-commented source code, a brief README with setup steps, and a sample SQL dump or migration file so I can verify the data structure before we move to production.
Location & Details
Apply on source →About this listing
This remote opportunity was imported from Freelancer and is shown here for discovery. To apply, follow the link to the original posting.