About
LearnDesk
Learn  
Topics
Topics
Topics
Topics
Topics
Topics
Topics
Teach
  Teach Online
  Schedule
  Items
  Billing
  Users
  Marketing
  Analytics
  Settings
  Change School
Account
 

The Complete Python Course

Intro to Python
Welcome to this Course
Overview of the Course Curriculum
Our Python Coding Environment
Writing Our First Code: Variables and Printing
Numbers in Python
Calculating the Remainder of a Division
Python Strings
Python String Formatting
Getting User Input in Python
Booleans and Comparisons in Python
and & or in Python
Lists in Python
Tuples in Python
Sets in Python
Advanced Set Operations
Python Dictionaries
Length and Sum
Joining a List
Python Fundamentals
If Statements in Python
While Loops in Python
For Loops in Python
Destructuring Syntax
Iterating Over Dictionaries
Break and Continue
The Else Keyword with Loops
Finding Prime Numbers with for Loops
List Slicing in Python
List Comprehension in Python
Comprehensions with Conditionals
Set and Dictionary Comprehensions
The Zip Function
Functions in Python
Preview
Arguments and Parameters
Functions and Return Values in Python
Default Parameter Values
Lambda Functions in Python
First Class and Higher Order Functions
Milestone Project 1
Installing Python in Your Computer
Installing PyCharm in Your Computer
Creating Our First PyCharm Project
Setting up PyCharm Font and Display Settings
Coding Our Application's Menu in Python
Adding New Movies to Our Application
Showing the User Their Movies
Finding Movies and Retrieving their Details
Object-Oriented Programming with Python
Intro to Object-Oriented Programming with Python
More About Classes and Objects
Parameter Naming in Python
Magic Methods in Python
Inheritance in Python
The @property Decorator
@classmethod and @staticmethod in Python
More @classmethod and @staticmethod Examples
Errors in Python
Intro to Errors in Python
Built in Errors in Python
Raising Errors in Python
Creating Our Own Errors in Python
Dealing with Python Errors
The On-success Block and Re-raising Exceptions
Debugging with Pycharm
Files in Python
Files in Python
Python Exercise: Copying Files
CSV Files with Python
JSON Files with Python
Using the with Syntax in Python
Importing Our Own Files
Python Relative Imports: children
Python Relative Imports: Parents
Import Errors and Running as a Python Script
Databases in Python and Milestone Project 2
Intro to Milestone Project 2
Milestone Project with Lists
Storing Books in Files
Using JSON instead of CSV
Intro to Databases with Python
Using SQLite in Python
Some Database Jargon
Creating Our Books Table Using Python
Inserting Books Using Python
Select Examples
Getting all Our Books
Update and Delete
Filtering with Where
Finishing the Milestone Project
Ordering and Limiting
Developing Our Context Manager in Python
Errors in Context Managers
Type Hinting in Python
Typing in Python
Further Reading
Advanced built-in Functions in Python
Generators in Python
Python Generator Classes and Iterators
Iterables in Python
The Filter() Function in Python
The map() Function in Python
any() and all() in Python
The Enumerate() Function
Advanced Python Development
Mutability in Python
Argument Mutability in Python
Default Values for Parameters
Mutable Default Arguments (Bad Idea)
Argument Unpacking in Python
Queues in Python
Some Interesting Python Collections
Timezones
Dates and Time in Python
Timing Your Code with Python
Regular Expressions
Regex Examples
Regex in Python
Introduction to Logging in Python
Logging to a File and other Features
Web Scraping with Python
Understanding HTML with BeautifulSoup
More Complex HTML Parsing
Structuring Our Parsing Program Better
Splitting HTML Locators Out of Our Python Class
Understanding HTML with the Browser
Scraping Our First Website with Python
Milestone Project 3: A Quote Scraper
Quotes Project 2: Structuring a Scraping app in Python
Quotes Project 3: Getting our Locators
Quotes Project 4: Crafting Our Quote Parser
Quotes Project 5: The Quotes Page
Quotes Project 6: Recap of the Project
Milestone Project 4: A Book Scraper + Application
Books Project 2: Recap of HTML Locators
Books Project 3: Creating Locators in Python
Books Project 4: Creating Our Page
Books Project 5: Creating Our Book Parser
Books Project 6: Writing Our App File
Books Project 7: Sorting the Books
Books Project 8: Constructing Our Menu
ASIDE: The Best Way to Write User Menus
Books Project 9: Getting Multiple Pages
Books Project 10: Multiple Pages in Python
Books Project 11: Getting the Page Count in Python
Books Project 12: Adding Logging to Our Python Project
A Word on Scraping Pages with JavaScript
Browser Automation with Selenium
Introduction to this Section
Review of Our Quotes Scraping Code
Downloading Chromedriver
Using Chrome in Our Scraping Code
Our New Page Locators
Interacting with Dropdowns
Selecting tags
Searching for quotes
Encapsulating Logic More Simply
Adding Some Error Handling
Implicit and Explicit Waits in Selenium
Adding Waits to Our Program Code
Asynchronous Python Development
Browser Automation with Selenium
Processes and Threads
The Python GIL
Using Python concurrent.futures: The ThreadPoolExecutor
Don't Kill Threads
Multiprocessing in Python
Using Python concurrent.futures: the ProcessPoolExecutor
Dealing with Shared State in Threads
Queuing in Threads with Shared State
Using Python Generators Instead of Threads
Our First Single-Threaded Task Scheduler in Python
Yielding from Another Iterator in Python
Receiving Data Through Yield
The Async and Await Keywords
Watch these Talks for More Explanations and Examples
Our Asynchronous Scraper
Making Our First async Request in Python
Getting Multiple Pages Efficiently
Using async_timeout for Security
Adding Some Error Handling
Implicit and Explicit Waits in Selenium
Adding Waits to Our Program Code
Python on the Console and Managing Project Dependencies
Browser Automation with Selenium
Processes and Threads
The Python GIL
Using Python concurrent.futures: The ThreadPoolExecutor
Don't Kill Threads
Multiprocessing in Python
Web Development with Flask
Setting up Our Project with Pipenv
Our First Flask Endpoint
Returning Information with Flask and Pythons
Rendering HTML with Flask and Python
Error Pages and Jinja2 Inheritance
Rendering forms with Flask and Python
Accessing Post form Data with Flask
Putting our form in a Single Endpoint
Using Jinja2 for Loops to Create a Nicer Homepage
Adding Navigation to our Website
Interacting with APIs with Python
Signing up to OpenExchangeRates
Getting all Exchange Rates from the API
Creating a Currency Exchange Library
Caching Functions with Functools
TTL Caches with Cachetools
Decorators in Python
A Simple Decorator in Python
Using a @syntax
Functools Wraps in Python
Decorating Functions with Parameters
Decorators with Parameters
Functions that Accept Multiple Arguments
Generic Decorators for Any Function
Advanced Object-Oriented Programming
Advanced Object-Oriented Programming
Intro to ABCs in Python
Intro to ABCs in Python
The Relationship Between ABCs and interfaces
The Property Setter in Python
GUI Development with Tkinter
Setting up Tkinter
Hello World in Tkinter
Labels and Fields
Packing Components
Using Frames for Different Layouts
Starting Our Text Editor Project
Tkinter Notebooks and Creating Files
Adding a Menu to Our Application
Saving Files to Disk
Opening Files
Binding Shortcuts in Tkinter
Checking Our Tabs for Unsaved Changes
Confirming Exit with Unsaved Changes
Closing Individual Tabs
Adding Another Menu
Adding a Permanent Scrollbar to Our Text Area
Unit Testing with Python
Introduction to this Section
Testing Functions
Testing for Errors
Testing our Multiplication Function
Writing a Printer Class for Testing
Testing Classes
More Printer Tests
Testing External Libraries
Conclusion of this Section
Algorithms and Data Structures
Presentation: Queues, Stacks, and Complexity
Presentation: Binary Search
Presentation: Binary Trees
Presentation: Traversal of Binary trees
Presentation: Adding Elements to a Binary Tree
Adding Elements to a Binary Tree in Python
Recursion and Inorder Traversal in Python
Finding Nodes in a Tree with Python
How do You Delete Nodes from a Binary Tree?
Deleting Nodes in Code with Python
Deleting Nodes with Two Children in Code
Testing Our Binary Tree
Python Libraries
Python Libraries Overview
Using pylint
Using yapf
Sending e-mails with Smtplib
Sending e-mails with Smtplib
Creating a re-usable Mailgun Library
Sneak Peek: My IDE Setup
Python Reference/Refresher
Variables in Python
String Formatting in Python
Getting User Input
Lists, Tuples, and Sets
Advanced Set Operations
Booleans in Python
If Statements in Python
The in Keyword
If Statements with the 'in' Keyword
Loops in Python
List Comprehensions
Dictionaries
Destructuring Variables
Functions in Python
Function Arguments and Parameters
Default Parameter Values
Functions Returning Values
Lambda Functions in Python
Dictionary Comprehensions
Unpacking Arguments
Unpacking Keyword Arguments
Object-Oriented Programming in Python
Magic Methods: __str__ and __repr__
Class Methods and Static Methods
Class Inheritance
Class Composition
Type Hinting
How Imports Work in Python
Relative Imports in Python
Errors in Python
Custom Error Classes
First-class Functions
Simple Decorators in Python
The 'at' Syntax for Decorators
Decorating Functions with Parameters
Decorators with Parameters
Mutability in Python
Mutable Default Parameters (and Why They're a Bad Idea)

Web Scraping with Python

The Complete Python Course
By: Packt Publishing
Share the link to this page
Copied
  Twitter
  Email
Add the class to your calendar
Print
  Completed

In this section, we’ll do Web Scraping with Pythons.

  • Understanding HTML with BeautifulSoup
  • More complex HTML parsing
  • Structuring our parsing program better
  • Splitting HTML locators out of our Python class
  • Understanding HTML with the browser
  • Scraping our first website with Python
  • Milestone Project 3: A Quote Scraper
  • Quotes Project 2: Structuring a scraping app in Python
  • Quotes Project 3: Getting our locators
  • Quotes Project 4: Crafting our quote parser
  • Quotes Project 5: The quotes page
  • Quotes Project 6: Recap of the project
  • Milestone Project 4: A Book Scraper + application
  • Books Project 2: Recap of HTML locators
  • Books Project 3: Creating locators in Python
  • Books Project 4: Creating our page
  • Books Project 5: Creating our book parser
  • Books Project 6: Writing our app file
  • Books Project 7: Sorting the books
  • Books Project 8: Constructing our menu
  • ASIDE: The best way to write user menus
  • Books Project 9: Getting multiple pages
  • Books Project 10: Multiple pages in Python
  • Books Project 11: Getting the page count in Python
  • Books Project 12: Adding logging to our Python project
  • A word on scraping pages with JavaScript
We'll cover the following topics in this section:
Previous
Next
Home
Search
Saved
Trending Classes
Filter
The latest and the best classes on LearnDesk
Filter by Interest
Close
All Topics
Academics
Business
Creative
Health and Fitness
LifeStyle
Personal Development
Software
Admissions
Engineering
Hardware
Hospitality
Humanities
Chinese
Languages
Maths
Other
Pharma
Research
Science
Social Science
Teaching
Test Preparation
K-12
School
Accounting
Advertising
Analysis
Analytics
Business Communication
eCommerce
Entrepreneurship
Finance
Finance - India
Freelancing
Internet of Things
Digital Transformation
Human Resources
Industry
Management
Marketing
Media
Operations
Other
Project Management
Public Relations
Real Estate
Sales
Strategy
Arts & Crafts
Audio Editing
Audio Production
Dance
Design
Film Production
Music
Photography
Video Production
Writing
Dieting
Fitness
Food Safety
Games
Medical
Medical Professionals
Meditation
Mental Health
Pregnancy
Safety & First Aid
Self Defense
Sports
Beauty & Makeup
Food
Fashion
Gaming
Home Improvement
Parenting
Pet Care & Training
Relationships
Sustainable Living
Travel
Career Development
Learning
Religion and Spirituality
Self-Improvement
Accounting
Amazon Web Services
App Development
Continuous Integration
Backup Software
Business Automation
Computational Fluid Dynamics
Business Intelligence
Computer Aided Design (CAD)
Content Management System
Customer Relationship Management
Database
Data Mining
E-Commerce
Enterprise Asset Management
Enterprise Resource Planning
Game Development
Google Cloud
Linux
Artificial Intelligence
Machine Learning
Master Data Management
Microsoft
Music Software
Network and Security
Open Source
Operating System
Other
Process Management
Productivity Software
Programming Languages
Robotics
Supply Chain Management
Testing
Teaching
Web Development

Sign Up

Sign Up

Share

Share with friends, get 20% off
Invite your friends to LearnDesk learning marketplace. For each purchase they make, you get 20% off (upto $10) on your next purchase.