1001 Freelance Projects
Latest Projects from
Freelance Marketplaces
View Project
View this project in detail
(Note: you will be redirected to external marketplace)
Project title:
Assignment: Web Crawling of Medication Data
Posted by:
External project from PeoplePerHour
Started:
18-Nov-2024 04:24 GMT
Description:
Here's a refined assignment outline for your software freelancer project, including necessary clarifications and added details for crawling medication data:

---

### Assignment: Web Crawling of Medication Data for Inhaled Drugs (ATC Code R03)

#### Project Overview
Develop a web scraping tool to extract data on inhaled medications (ATC code R03) from the official medical and pharmaceutical websites of Spain, Argentina, and Chile. The extracted data should be formatted into a CSV file with specific columns as defined in the attached Excel file.

#### Target Websites
- **Spain**: [CIMA](https://cima.aemps.es/cima/publico/listaclinica.html) (AEMPS - Agencia Española de Medicamentos y Productos Sanitarios)
- **Argentina**: Relevant national pharmaceutical website(s)
- **Chile**: Relevant national pharmaceutical website(s)

**Note**: The freelancer must identify and ensure access to reliable sources for Argentina and Chile.

#### Objectives
- Extract all inhaled medication with ATC code R03.
- Populate a CSV file with the specified structure (refer to the attached Excel sheet for column specifications).

#### Data Structure
Each entry in the CSV should include, but is not limited to, the following columns:
- `Name`
- `Drug Format`
- `Dosage`
- `Drug Class`
- `Drug Type`
- `ATC Code`
- `Total Puffs per Inhaler`
- `Puffs a Day`
- `Link` to the source page
- `Image URL` of the product
- `Video URL` (if available)
- Additional data fields based on information structure on the source websites

Refer to the attached Excel file for the exact layout and any additional required fields.

#### Example of Data Format
```json
{
"dosage": 322,
"drugFormat": "HFA",
"drugClass": "ICS",
"drugType": "ACLIDINIO BROMURO",
"id": "1a478549-31ca-d61f-a9da-35cdc4616230",
"image": "https://cima.aemps.es/cima/fotos/thumbnails/formafarmac/12778002/12778002_formafarmac.jpg",
"link": "https://cima.aemps.es/cima/publico/detalle.html?nregistro=12778002",
"name": "EKLIRA GENUAIR 322 MICROGRAMOS POLVO PARA INHALACION",
"puffsADay": 0,
"shortName": "ACLIDINIO BROMURO",
"totalPuffsPerInhaler": 60,
"video": "https://zorgatlasweb.nl/inhalatie/Films_Nederlands/Dosisaerosol.mp4",
"atc_code": "R03BB05"
}
```

#### Requirements
1. **Web Scraping Framework**: Use Python libraries such as `BeautifulSoup` and `Selenium` for scraping. Alternatively, any proven web scraping tool is acceptable.
2. **Data Cleaning**: Ensure consistency in data formatting and structure.
3. **Output File**: The final output must be a CSV file with columns as defined in the attached Excel template.
4. **Documentation**: Provide a clear README file explaining:
- How to run the scraping tool.
- Requirements for execution (e.g., Python version, dependencies).
- Any challenges or limitations encountered during the project.

#### Important Notes
- The tool should handle potential changes in website structure with minimal adjustments.
- Data accuracy and integrity are paramount; cross-verify results to ensure reliability.
- Respect website terms of service and avoid overloading sites with requests (implement proper rate limiting).
- Ensure proper handling of errors and unexpected issues (e.g., CAPTCHA).

#### Deadline
Specify the project completion date and any milestones for progress updates.

#### Deliverables
1. A Python script or package for web crawling.
2. A CSV file with structured data as per the given specifications.
3. README file with instructions for running the script and an overview of the project.

#### Contact
Reach out for clarification or further questions related to project details.

---

Make sure the assignment template is aligned with your needs and modify as needed.
Project ID:
3409093
Project category:
Project budget:
View this project in detail
(Note: you will be redirected to external marketplace)
Last Projects / Browse Projects
  Project Started
Expert Copywriter Needed for B2B Content
Category: Article Writing, Content Writing, Copywriting, Ghostwriting, Product Descriptions
Budget: €12 - €18 EUR
13 Jan 2025 11:04 GMT
Epic Sounds for an Adventure Game
Category: Audio Production, Audio Services, Music, Sound Design
Budget: $1500 - $3000 USD
13 Jan 2025 11:04 GMT
MikroTik BGP Expert Needed
Category: Cisco, Linux, Network Administration, System Admin
Budget: ₹12500 - ₹37500 INR
13 Jan 2025 11:03 GMT
CRM & Automation Specialist for B2B
Category: CRM, PHP, Salesforce App Development, Salesforce.com, Software Architecture
Budget: €12 - €18 EUR
13 Jan 2025 11:02 GMT
Ongoing Maintenance for Guest Management Website
Category: GitHub, MongoDB, Next.js, Node.js, Visual Studio
Budget: $30 - $250 USD
13 Jan 2025 11:01 GMT
Personalized Python Data Analytics Tutorials
Category: Data Analysis, Data Analytics, Data Mining, Machine Learning (ML), Python
Budget: $30 - $250 USD
13 Jan 2025 11:01 GMT
Enhance My Wix Site's Design & SEO
Category: Graphic Design, HTML, PHP, SEO, Web Design
Budget: $30 - $250 USD
13 Jan 2025 11:01 GMT
Excel Roster Maker with Macros
Category: Excel, Excel Macros
Budget: $30 - $250 AUD
13 Jan 2025 11:00 GMT
SQL Data Entry Specialist
Category: Data Entry, Data Processing, Database Administration, Excel, SQL
Budget: ₹750 - ₹1250 INR
13 Jan 2025 11:00 GMT
Experienced Virtual Assistant for B2B Support (Spanish & English)
Category: Customer Support, Data Entry, Excel, Market Research, Virtual Assistant
Budget: €6 - €12 EUR
13 Jan 2025 11:00 GMT
Persistent iOS Auth Issue in React Native App
Category: IOS Development, IPhone, Mobile App Development, PhoneGap, React Native
Budget: €250 - €750 EUR
13 Jan 2025 10:59 GMT
Professional Digital Leaflet Design
Category: Brochure Design, Graphic Design, Illustration, Poster Design
Budget: £20 - £250 GBP
13 Jan 2025 10:59 GMT
Tailwind HTML Templates from Figma Design
Category: Front End Design, Frontend Development, HTML, TailWind, Tailwind CSS
Budget: €30 - €250 EUR
13 Jan 2025 10:58 GMT
Food Delivery Executive for Adastra
Category: Internet Of Things (IoT), Mobile Accessibility, Motorbike
Budget: ₹400 - ₹750 INR
13 Jan 2025 10:58 GMT
Business PDF Typing from Printed Papers
Category: Copy Typing, Data Entry, Editing, PDF, Word
Budget: ₹750 - ₹1250 INR
13 Jan 2025 10:58 GMT
Browse All Projects
Projects by Skills ...
android
ajax
asp
aspnet
cms
cpp
csharp
css
delphi
design
drupal
excel
facebook
flash
html
java
javascript
joomla
iphone
mysql
photoshop
php
python
ruby
seo
sql
sysadm
translate
typing
twitter
vbnet
xml
wordpress
writing
New!
Проекты на русском
(Projects in Russian)

Copyright © 2005-2024
1001 Freelance Projects