Expected duration: 1 - 2 weeks We need a web scraping application [written in C# or python?] probably using www.Scrapy.org or similar that we can host in AWS and call from another application via API that gets the following data fields from a given website: 1. The Text of web pages in plain text format, with no header or footer info, and no picture descriptions or Alt-text. We are specifically looking to include the pages that contain the following information (which we will be feeding into ChatGPT to summarise, so the data does not need to be structured (see Appendix as examples for Mole Valley Farmers): a. Summary of the products or services they sell b. Recent News/blogs c. Address (from Contact us page or elsewhere, but probably not the footer as this may be the legal address) d. Opening Hours (from Contact us page or elsewhere) 2. Twitter page (https://twitter.com/molevalley ) 3. LinkedIn (https://www.linkedin.com/company/mole-valley-farmers/
