====== Screen Scraping the AT&T Home Base Unit ====== Initial Notes \\ Under Construction http://192.168.1.1/index.html#login http://192.168.1.1/index.html#dataUsed 932.11 GB ===== Useful-Seeming Websites ===== https://kazuar.github.io/scraping-tutorial/ http://docs.python-requests.org/en/master/user/install/ (not used) http://stanford.edu/~mgorkove/cgi-bin/rpython_tutorials/webscraping_with_lxml.php (not clear needed; could use built-in) https://askubuntu.com/questions/851401/where-to-find-geckodriver-needed-by-selenium-python-package (for help installing Selenium) https://github.com/mozilla/geckodriver https://github.com/mozilla/geckodriver/issues/371 (need virtual display) https://groups.google.com/forum/#!topic/selenium-users/eOHZAu2xLkk https://stackoverflow.com/questions/36122160/how-to-wait-a-page-is-loaded-in-python-selenium (might be needed to wait) https://stackoverflow.com/questions/16114244/get-contents-of-entire-page-using-selenium (driver.page_source) https://docs.python.org/2/library/xml.etree.elementtree.html#xml.etree.ElementTree.Element.iter