{"id":361,"date":"2017-11-11T07:18:53","date_gmt":"2017-11-11T07:18:53","guid":{"rendered":"http:\/\/wizardofbots.com\/network\/?post_type=product&#038;p=361"},"modified":"2017-11-13T20:24:34","modified_gmt":"2017-11-13T20:24:34","slug":"course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium","status":"publish","type":"product","link":"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/","title":{"rendered":"[COURSE &#038; SOURCE] Setup and how to scrape all Yelp with Python + Selenium"},"content":{"rendered":"<p>This course is for educational purposes. We go through into how Yelp is designed and how you can search from the interface with proper parameters. This will go through all zipcodes in USA with or without a keyword and grab all leads and put them into a CSV.<\/p>\n<p>What you will learn:<\/p>\n<ul>\n<li>How to setup Linux in VirtualBox which can be either on OSX or Windows.<\/li>\n<li>How to setup Linux on Linode, install Docker and VNC so you connect remotely and configure.<\/li>\n<li>Setup Python, Selenium and Chrome WebDriver. Install required libraries for this code.<\/li>\n<li>How to scrape with XPath and some tips for make it reliable.<\/li>\n<li>Caveats on how to get proper text and trim data.<\/li>\n<li>Open and iterate a txt file with a list of locations or zipcodes and loop through them in Python.<\/li>\n<li>How to configure Selenium to use Proxies.<\/li>\n<li>How to save grabbed leads into CSV.<\/li>\n<\/ul>\n<p>Here is a preview of what you will have.<\/p>\n<p><iframe loading=\"lazy\" width=\"720\" height=\"405\" src=\"https:\/\/www.youtube.com\/embed\/N-vq7LQIAU0?feature=oembed\" frameborder=\"0\" gesture=\"media\" allowfullscreen><\/iframe><\/p>\n<h1><a href=\"http:\/\/wizardofbots.com\/network\/my-courses\/\"><strong>IF YOU ALREADY BOUGHT, ACCESS HERE:<\/strong><\/a><\/h1>\n<div class=\"wpcw_fe_course_title\">Yelp Scraper: Python + Selenium. Docker \/ VirtualBox \/ Local (Win\/Linux\/OSX) Configuration<\/div><table id=\"wpcw_fe_course\" class=\"wpcw_fe_table\" cellspacing=\"0\" cellborder=\"0\"><tr class=\"wpcw_fe_module  \" id=\"wpcw_fe_module_group_1\">\n\t\t\t\t\t\t\t<td>Module 1<\/td>\n\t\t\t\t\t\t\t<td colspan=\"1\">Setting up Docker \/ VirtualBox \/ Local (Win\/OSX\/Linux)<\/td>\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t<\/tr>\n\t\t\t\t\t<tr class=\"wpcw_fe_unit  wpcw_fe_module_group_1\">\n\t\t\t\t\t\t<td>Unit 1<\/td>\n\t\t\t\t\t\t<td colspan=\"1\" class=\"wpcw_fe_unit\">Part 1: Getting set up in Linode, access your server and setup with Docker instance (25 min).<\/td>\n\t\t\t\t\t<\/tr><\/table>\n","protected":false},"excerpt":{"rendered":"<ul>\n<li>Learn how to use Python and Selenium together<\/li>\n<li>Install a Fresh Linux and configure it (reliability)<\/li>\n<li>Learn how to scrape text with selenium<\/li>\n<li>Learn how to navigate with selenium commands.<\/li>\n<li>More&#8230;<\/li>\n<\/ul>\n","protected":false},"featured_media":362,"comment_status":"open","ping_status":"closed","template":"","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0},"product_cat":[48,132,130],"product_tag":[136,138,134,133,137,135],"class_list":{"0":"post-361","1":"product","2":"type-product","3":"status-publish","4":"has-post-thumbnail","6":"product_cat-courses","7":"product_cat-python-courses","8":"product_cat-selenium","9":"product_tag-docker","10":"product_tag-linux","11":"product_tag-python","12":"product_tag-selenium","13":"product_tag-virtualbox","14":"product_tag-vnc","16":"first","17":"instock","18":"sale","19":"downloadable","20":"virtual","21":"purchasable","22":"product-type-simple"},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>[COURSE &amp; SOURCE] Setup and how to scrape all Yelp with Python + Selenium - Wizard Of Bots<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"[COURSE &amp; SOURCE] Setup and how to scrape all Yelp with Python + Selenium - Wizard Of Bots\" \/>\n<meta property=\"og:description\" content=\"Learn how to use Python and Selenium together  Install a Fresh Linux and configure it (reliability)  Learn how to scrape text with selenium  Learn how to navigate with selenium commands.  More...\" \/>\n<meta property=\"og:url\" content=\"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/\" \/>\n<meta property=\"og:site_name\" content=\"Wizard Of Bots\" \/>\n<meta property=\"article:modified_time\" content=\"2017-11-13T20:24:34+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/wizardofbots.com\/network\/wp-content\/uploads\/2017\/11\/niceyelpselenium.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"506\" \/>\n\t<meta property=\"og:image:height\" content=\"594\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/\",\"url\":\"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/\",\"name\":\"[COURSE & SOURCE] Setup and how to scrape all Yelp with Python + Selenium - Wizard Of Bots\",\"isPartOf\":{\"@id\":\"https:\/\/wizardofbots.com\/network\/#website\"},\"primaryImageOfPage\":{\"@id\":\"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/#primaryimage\"},\"image\":{\"@id\":\"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/wizardofbots.com\/network\/wp-content\/uploads\/2017\/11\/niceyelpselenium.jpg\",\"datePublished\":\"2017-11-11T07:18:53+00:00\",\"dateModified\":\"2017-11-13T20:24:34+00:00\",\"breadcrumb\":{\"@id\":\"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/#primaryimage\",\"url\":\"http:\/\/wizardofbots.com\/network\/wp-content\/uploads\/2017\/11\/niceyelpselenium.jpg\",\"contentUrl\":\"http:\/\/wizardofbots.com\/network\/wp-content\/uploads\/2017\/11\/niceyelpselenium.jpg\",\"width\":506,\"height\":594},{\"@type\":\"BreadcrumbList\",\"@id\":\"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/wizardofbots.com\/network\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"[COURSE &#038; SOURCE] Setup and how to scrape all Yelp with Python + Selenium\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/wizardofbots.com\/network\/#website\",\"url\":\"https:\/\/wizardofbots.com\/network\/\",\"name\":\"Wizard Of Bots\",\"description\":\"Botting and AI community\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/wizardofbots.com\/network\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"[COURSE & SOURCE] Setup and how to scrape all Yelp with Python + Selenium - Wizard Of Bots","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/","og_locale":"en_US","og_type":"article","og_title":"[COURSE & SOURCE] Setup and how to scrape all Yelp with Python + Selenium - Wizard Of Bots","og_description":"Learn how to use Python and Selenium together  Install a Fresh Linux and configure it (reliability)  Learn how to scrape text with selenium  Learn how to navigate with selenium commands.  More...","og_url":"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/","og_site_name":"Wizard Of Bots","article_modified_time":"2017-11-13T20:24:34+00:00","og_image":[{"width":506,"height":594,"url":"http:\/\/wizardofbots.com\/network\/wp-content\/uploads\/2017\/11\/niceyelpselenium.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/","url":"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/","name":"[COURSE & SOURCE] Setup and how to scrape all Yelp with Python + Selenium - Wizard Of Bots","isPartOf":{"@id":"https:\/\/wizardofbots.com\/network\/#website"},"primaryImageOfPage":{"@id":"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/#primaryimage"},"image":{"@id":"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/#primaryimage"},"thumbnailUrl":"http:\/\/wizardofbots.com\/network\/wp-content\/uploads\/2017\/11\/niceyelpselenium.jpg","datePublished":"2017-11-11T07:18:53+00:00","dateModified":"2017-11-13T20:24:34+00:00","breadcrumb":{"@id":"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/#primaryimage","url":"http:\/\/wizardofbots.com\/network\/wp-content\/uploads\/2017\/11\/niceyelpselenium.jpg","contentUrl":"http:\/\/wizardofbots.com\/network\/wp-content\/uploads\/2017\/11\/niceyelpselenium.jpg","width":506,"height":594},{"@type":"BreadcrumbList","@id":"http:\/\/wizardofbots.com\/network\/product\/course-source-setup-and-how-to-scrape-all-yelp-with-python-selenium\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/wizardofbots.com\/network\/"},{"@type":"ListItem","position":2,"name":"[COURSE &#038; SOURCE] Setup and how to scrape all Yelp with Python + Selenium"}]},{"@type":"WebSite","@id":"https:\/\/wizardofbots.com\/network\/#website","url":"https:\/\/wizardofbots.com\/network\/","name":"Wizard Of Bots","description":"Botting and AI community","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/wizardofbots.com\/network\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"http:\/\/wizardofbots.com\/network\/wp-json\/wp\/v2\/product\/361"}],"collection":[{"href":"http:\/\/wizardofbots.com\/network\/wp-json\/wp\/v2\/product"}],"about":[{"href":"http:\/\/wizardofbots.com\/network\/wp-json\/wp\/v2\/types\/product"}],"replies":[{"embeddable":true,"href":"http:\/\/wizardofbots.com\/network\/wp-json\/wp\/v2\/comments?post=361"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/wizardofbots.com\/network\/wp-json\/wp\/v2\/media\/362"}],"wp:attachment":[{"href":"http:\/\/wizardofbots.com\/network\/wp-json\/wp\/v2\/media?parent=361"}],"wp:term":[{"taxonomy":"product_cat","embeddable":true,"href":"http:\/\/wizardofbots.com\/network\/wp-json\/wp\/v2\/product_cat?post=361"},{"taxonomy":"product_tag","embeddable":true,"href":"http:\/\/wizardofbots.com\/network\/wp-json\/wp\/v2\/product_tag?post=361"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}