Data Scraping for my RocketReach Account

200.0 GBP

200.0 GBP peopleperhour Technology & Programming Overseas
13 hour ago

Description

**Please note that I will only respond to or accept someone who has answered the interview questions**
I have a RocketReach account and would like to automate the process of gathering contact information for a specific search query (e.g., "Ophthalmology"). My RocketReach account manager has confirmed that the website can be scraped as required, so I need a solution to automate this process effectively.
Requirements:
1. Phase 1: Automating "Get Contact Info"
The scraper should log in to my RocketReach account.Navigate to a specific search query (e.g., "Ophthalmology").For every profile returned in the search results, the script should click the "Get Contact Info" button to unlock contact information for that profile.The script must handle large searches (e.g., 25,000 contacts spanning 500 pages).Pagination must be automated, ensuring that every profile on all pages is processed.
2. Phase 2: Scraping Contact Details
After Phase 1 is complete, I need the scraper (or a separate script) to return to the same search query.For every profile on all pages, the scraper should extract and compile the following details:
Full NameJob TitleCompanyWork EmailPersonal EmailPhone (if available)
Delay Handling: Contact information may take time to fully load after being unlocked. A delay should be programmed between scraping actions for each profile to ensure all data is fully available before moving to the next profile. The delay should mimic natural human interaction to avoid detection.The output should be saved to an Excel spreadsheet in an organized format with the above fields as columns.Additional Requirements:Error Handling: Ensure the scraper gracefully handles scenarios such as missing data, captchas, rate limits, or changes in website structure.Performance: Since the searches can be large, the script should be efficient and able to handle high volumes without crashing.Documentation: Provide clear instructions on how to run the script, along with any required dependencies or setup.
Deliverables:
Phase 1 Script: Automates the "Get Contact Info" action for all profiles in the search results.Phase 2 Script: Scrapes the unlocked contact details and exports them to an Excel spreadsheet, with delay handling implemented to ensure all data loads properly.
Documentation: Instructions on how to:
Install and run the scripts.Handle potential errors or limitations (e.g., captchas or rate limits).Modify the script for different search queries if needed.
Notes:Please ensure the script can handle long runtimes for large searches or include a mechanism to resume progress if interrupted.If you recommend a particular technology or approach (e.g., Selenium, BeautifulSoup, Puppeteer, etc.), please outline it in your proposal.I am open to suggestions on whether a single script or separate scripts for each phase would be better.

关注公众号,不定期副业成功案例分享
Follow WeChat

Success story sharing

Want to stay one step ahead of the latest teleworks?

Subscribe Now

Similar Teleworks

We are seeking a talented and experienced WordPress Developer with expertise in web scraping to join our dynamic team. The ideal candidate will be responsible for developing and maintaining an automated system to extract car listing data from a target website and seamlessly import it into our WordPress-based platform. Key Responsibilities: - Design and implement a robust web scraping solution to extract comprehensive car listing data, including make, model, color, images, and other relevant details. - Develop a WordPress integration system to automatically import and update scraped data into our website. - Create a scheduling system to run the scraper at specified intervals (nightly or multiple times per day) and on-demand. - Implement logic to remove listings from the WordPress site when they are no longer available on the target site. - Ensure data integrity by preventing duplicate entries and maintaining data accuracy. - Optimize the scraping process for efficiency and scalability. - Troubleshoot and resolve any issues that arise during the scraping or import process. ### Required Skills and Qualifications: - Proven experience in web scraping techniques and technologies (e.g., Python with BeautifulSoup, Scrapy, or Selenium). - Strong proficiency in WordPress development, including custom plugin creation and database management. - Excellent knowledge of PHP, HTML, CSS, and JavaScript. - Experience with RESTful APIs and WordPress hooks. - Familiarity with scheduling tools like cron jobs for automated tasks. - Strong problem-solving skills and attention to detail. - Ability to work independently and as part of a team. - Excellent communication skills to collaborate with team members and stakeholders. ### Preferred Qualifications: - Experience with image processing and handling in web scraping contexts. - Knowledge of ethical web scraping practices and legal considerations. - Familiarity with version control systems (e.g., Git). - Experience with performance optimization for large datasets. ### Project Requirements: - Develop a scraper that can extract all relevant car listing data, including images. - Create a WordPress integration that automatically imports and updates scraped data. - Implement a scheduling system for regular scraping (nightly or multiple times daily). - Develop an on-demand scraping feature for immediate updates. - Ensure the system removes listings from WordPress when they're no longer on the target site. - Implement duplicate detection and prevention mechanisms. - Optimize the entire process for efficiency and scalability. ### Important Notes: - This is a long-term project with the opportunity to work with a UK-based company. - **Generic applications will not be considered.** Please tailor your application to this specific role and demonstrate your relevant experience. - All shortlisted candidates **MUST** attend a video interview as part of the selection process. If you're passionate about web development, have a knack for data extraction, and enjoy solving complex challenges, we'd love to hear from you. Join our team and help build an innovative solution that bridges web scraping with WordPress functionality! To apply, please submit your tailored application highlighting your specific experience with web scraping and WordPress development, along with your availability for a video interview.
350.0 GBP Technology & Programming peopleperhour Overseas
1 days ago