Web Scraping Expert Required

200.0 GBP

200.0 GBP peopleperhour Technology & Programming Overseas
2 days ago

Description

Web Scraping Expert Required: I am seeking a skilled web scraping expert to assist in extracting data from approximately 20 travel websites, each containing approximately 20,000 listings. The goal is to establish a daily connection between the scraped data and an API to facilitate its utilization in a price comparison website. While exploring options like browse.ai, I have recognized the potential for cost-effectiveness by engaging a dedicated individual to set up the necessary infrastructure. Please reach out with any specific queries you may have regarding the websites to be scraped. Your assistance in this matter would be greatly appreciated.

Go Now
关注公众号,不定期副业成功案例分享
Follow WeChat

Success story sharing

Want to stay one step ahead of the latest teleworks?

Subscribe Now

Similar Teleworks

Data Scraping and Training for a GPT Chatbot Introduction: We are seeking an experienced freelancer to collect, structure, and utilize relevant data from various online sources to train a chatbot based on the OpenAI API. The chatbot will be integrated into our WordPress website, and must provide accurate and quick responses on topics related to aesthetic medicine and the treatments offered by our clinic. Main Tasks: 1. Data Scraping • Identify and list relevant websites containing public information about aesthetic medicine (FAQs, treatment descriptions, etc.). • Collect data using appropriate scraping tools while adhering to regulations (legal notices, terms of use). • Organize the collected data in a structured format such as JSON or CSV. 2. Data Structuring and Preparation for Training • Filter and clean the data to ensure quality and relevance. • Structure the data into question-answer pairs, descriptions, or specific contexts. • Prepare a training file in JSONL format for use with the OpenAI API. 3. Documentation and Handover • Provide detailed documentation on the scraping, data cleaning. • Include recommendations for regular updates to the data and future model re-training. Required Skills: • Expertise in web scraping with tools such as Beautiful Soup, Scrapy, or Octoparse. • Experience in data manipulation (cleaning, structuring, JSON/CSV formats). • Strong understanding of machine learning concepts and natural language processing (NLP). • Strict adherence to regulations and best practices for data collection and usage (GDPR, legal notices). Deliverables: • Collected, cleaned, and structured data in JSON or CSV format. • A training file in JSONL format ready for use with the OpenAI API. • Comprehensive documentation of the process, including tools and methodologies used. Selection Process: 1. Review of proposals and portfolios. To Apply: If you are interested in this project and possess the required skills, please send us: • Your CV or portfolio. • A technical proposal describing your approach to scraping (and training ?). • A budget estimate.
10.0 USD Technology & Programming peopleperhour Overseas
1 days ago
Reddnet Enterprises seeks a talented freelance developer to help expand their digital presence. The growing startup, engaged in e-commerce and services, requires an experienced professional to design and build a modern and feature-rich website. The new website must effectively represent Reddnet's diverse range of products and offerings in an intuitive and visually appealing manner for both desktop and mobile users. Key functionality such as an online store, booking/reservation system, and client/member portal must be incorporated to enhance customer experience and drive business goals. Optimization for SEO will be critical to reach targeted audiences and generate increased traffic. Candidates considered for the role should possess a portfolio demonstrating proven skills in frontend and backend web development using modern technologies and frameworks. Proficiency with HTML, CSS, PHP, JavaScript and responsive design is essential. Experience designing and implementing e-commerce solutions, content management systems and custom solutions based on client requirements would be highly valued. The successful freelancer will work closely with stakeholders to understand needs, propose designs/architecture and deliver the new website on budget and schedule. Strong communication, project management and problem-solving abilities are a must to ensure the project is completed smoothly and to satisfaction. This is an exciting opportunity to make an impact at a growing startup and help scale their operations through strategic use of online tools and presence.
26.0 USD Technology & Programming peopleperhour Overseas
3 days ago
Hi All , I am looking for part auto colour coding and part Data match reconcilliation sheet. After copying over data from the Client side in the "Client Raw Data" tab and my Company raw data in the "My Company Raw Data" tab in the results tab I want to try and match up the data to see where there is a break in the data set for me to investigate further. For the purpouse of making it easier to understand I have matched by line the client side and My company side results in the "Results" tab - however this my not be organised this way, as data on both side could be unfiltered or sorted or lines missing. So this is just so it is easier to view. I need a) Where there is a match for the cells to go green b) Company Name match - this is based off if the name fully matches on both the client side and mine or if an alternative name matches e.g Client name is Delta on the company side , however on my company side it shows as Delta 1. It has to search the Alternate name tab - to see if the alternate name matches or not? c) where there is an amount only match for example a message should appear in the Amount match cell " Exact amount found only) - thus I would need to investigate further. d) I need the colour coding as per the example - this is to help me work though the data and errors quickly as possible. I dont want to use macros or VBA - as I want to try and replicate this my self by looking at the formulas and colour coding myself. Thanks
30.0 GBP Technology & Programming peopleperhour Overseas
1 days ago

HuntsBot,a one-stop outsourcing task, remote job, product ideas sharing and subscription platform, which supports DingTalk, Lark, WeCom, Email and Telegram robot subscription. The platform will push outsourcing task requirements, remote work opportunities, product ideas to every subscribed user with timely, stable and reliable.

简体中文 English

Platform

Support

Links

Contact US

Any questions or suggestions during use, you can contact us in the following ways:

Email: huntsbot@xinbeitime.com

Copyright© 2022-2023 www.huntsbot.com 浙ICP备2022000860号-4 All Rights Reserved.