We have a business which pulls information from over 3,000+ websites in the UK. We pull information such as Make, model and size from numerous pages from these websites. The data we get needs to be accurate, it's not unusual to have multiple selectors for one site.
As part of this, retailers change their pages frequently and this then affects how we get the data and it breaks the selectors we generate which then means we can't get data.
We're looking to find the best way to solve this issue, either through Ai/LLM to generate selectors automatically or another way to do this on a mass level.
The ideal solution we're looking for is: We find a way to auto generate selectors when they're broken for multiple sites, ideally we put the information into an LLM which then auto generates these and we insert it back into our technology.
We're looking someone who has experience with LLM's/Ai and has worked on scraping data from multiple sites previously.
Note: Don't apply without showing clear experience on LLM's and/or scraping. The ideal client will have experience in solving this issue previously.
