Validating profile... 0% complete

What is your current level of experience in freelance work?

 

 

Python Script for Regulatory Web Scraping

I'm looking for an experienced Python developer to create web scraping scripts. I will provide links of webs where relevant legislative and regulatory documents are published and he will provide the code that daily web scrapes the source for new documents with their metadata, processes the document with ai and then saves the metadata and summary and tags generated with ai in mongodb. Requirements: - Scrape data from government websites - Long documents processing with llm, dividing in chunks to fit into context window - Output data in a structured format ( JSON saved in mongodb) Ideal Skills and Experience: - Proficiency in Python and web scraping libraries (e.g., BeautifulSoup, Scrapy) - Experience with data extraction from government websites - Profiency in LLMs and ai coding tool...