You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
You should use requests to fetch the contents of the web page, and lxml to parse the HTML contents into a DocumentTree. You can then use XPath queries to extract the information that you need from the page: https://docs.python-guide.org/scenarios/scrape/
Edit: We can use the AskBot API to programmatically scrape ROS Answers [https://github.com/ASKBOT/askbot-devel/blob/master/askbot/doc/source/api.rst]
ChrisTimperley
changed the title
Implement url_to_question method for scraping info from ROS Answers question URLs
Implement scrape_question method for scraping info from ROS Answers question URLs
Jul 2, 2020
Depends on the completion #4You should use requests to fetch the contents of the web page, andlxml
to parse the HTML contents into a DocumentTree. You can then use XPath queries to extract the information that you need from the page: https://docs.python-guide.org/scenarios/scrape/Edit: We can use the AskBot API to programmatically scrape ROS Answers [https://github.com/ASKBOT/askbot-devel/blob/master/askbot/doc/source/api.rst]
Should use the following API end point: https://answers.ros.org/api/v1/questions/299232/
Requests should be used to interact with the AskBot API
The text was updated successfully, but these errors were encountered: