Web Developer - Web Scraping and WordPress Integration Specialist
We are seeking an experienced web developer to create and maintain an automated system for scraping car listings from a third-party website and importing them into our WordPress-based automotive marketplace.
## Key Responsibilities:
- Develop a robust web scraping script to extract car listing data from a specified automotive website- Create an automated process to run the scraping script nightly- Implement logic to identify and remove duplicate listings- Build a WordPress integration to automatically import scraped data into our website- Ensure the entire process runs seamlessly without manual intervention
## Required Skills and Experience:
- Extensive experience with web scraping techniques and tools (e.g., Python with BeautifulSoup or Scrapy)- Strong knowledge of WordPress development, including custom post types and the WordPress REST API- Proficiency in PHP and JavaScript- Familiarity with task scheduling in Linux environments (e.g., cron jobs)- Experience with database management, particularly MySQL- Solid understanding of HTML and CSS for parsing web content- Knowledge of ethical web scraping practices and robots.txt protocols
The ideal candidate will be able to create a seamless, automated workflow that reliably updates our WordPress site with fresh, de-duplicated car listings on a nightly basis. This role requires a blend of technical expertise in web scraping, WordPress development, and system automation.
Success story sharing