This is a ReadMe template to help save you time and effort.
You're sections headers will be used to reference location of destination.
This Script is for extracted all the data from the Agmarknet(https://agmarknet.gov.in/Default.aspx) site in order to collect data about the different commodities in different district of India with respect to dates.This app is complete automated all it takes two input 1.Commodity name 2. Date and extract all the data according to it and store into MongoDB database.
- Python
- Web Scrapping
- Pandas
- Selenium
- MongoDB
It can be used in below simple steps:-
- Install all the requirement libraries using below code.
pip install -r requirements.txt
-
Now open your terminal and make sure your are in app directory
-
Before running the python file make sure that you have google chrome installed and download the web driver for the same according to your chrome version from (https://chromedriver.chromium.org/downloads)
-
After downloading the chrome web driver please update its path in code in main_func.py in path variable.
-
After navigating to app directory type the below code in terminal for running app
python run app.py
- Twitter - @taronic777
- LinkedIn - Tarun Yadav