We will learn how to execute the technique of prospecting data on the internet known as Web Scraping using Python in SQL Server.
Knowing the subjects and techniques:
What is Web Scraping?
Stages of the Web Scraping and the packages Python;
To install new packages in SQL Server Python;
To declare a variable for Script Python;
To obtain code of the internet page with Python (requests);
To analyze the code HTML and to convert in objects (BeatifulSoup);
To create DataFrame to store the values (pandas);
To add values in DataFrame;
To make available the result (OutputDataset);
To execute the script Python (sp_execute_external_script);
To create Procedure (PROCEDURE);
To execute Procedure;
To consult table with the result (SELECT);
#microsoft #dataplataform #sqlserver #machinelearning #python #webscraping
Path to find the application 'pip' in the servant where SQL Server 2019 is installed :
C:\Program Files\Microsoft SQL Server\MSSQL15.MSSQLSERVER\PYTHON_SERVICES\Scripts
#Note: Alter the path according to the version of SQL Server used
Code to install the packages in SQL Server:
pip install requests
pip install bs4
pi install html5lib
pip install lxml
#Note: It is important to understand that the packages can depend on other packages and the number of specific versions according to SQL Server installation
Notebook with complete code in the github:
https://github.with / fabioms-br / sqlserverCaminho to find the application 'pip' in the servant where SQL Server 2019 is installed :
Auf dieser Seite können Sie das Online-Video Web Scraping? With Python in the SQL Query | SQL Server mit der Dauer stunde minuten sekunde in guter Qualität ansehen, das der Benutzer fabioms 23 Februar 2022 hochgeladen hat, den Link mit Freunden und Bekannten teilen, dieses Video wurde auf Youtube bereits 2,558 Mal angesehen und es wurde von 120 den Zuschauern gefallen. Viel Spaß beim Betrachtenden Zuschauern gefallen!