We will learn how to execute the technique of prospecting data on the internet known as Web Scraping using Python in SQL Server.
Knowing the subjects and techniques:
What is Web Scraping?
Stages of the Web Scraping and the packages Python;
To install new packages in SQL Server Python;
To declare a variable for Script Python;
To obtain code of the internet page with Python (requests);
To analyze the code HTML and to convert in objects (BeatifulSoup);
To create DataFrame to store the values (pandas);
To add values in DataFrame;
To make available the result (OutputDataset);
To execute the script Python (sp_execute_external_script);
To create Procedure (PROCEDURE);
To execute Procedure;
To consult table with the result (SELECT);
#microsoft #dataplataform #sqlserver #machinelearning #python #webscraping
Path to find the application 'pip' in the servant where SQL Server 2019 is installed :
C:\Program Files\Microsoft SQL Server\MSSQL15.MSSQLSERVER\PYTHON_SERVICES\Scripts
#Note: Alter the path according to the version of SQL Server used
Code to install the packages in SQL Server:
pip install requests
pip install bs4
pi install html5lib
pip install lxml
#Note: It is important to understand that the packages can depend on other packages and the number of specific versions according to SQL Server installation
Notebook with complete code in the github:
https://github.with / fabioms-br / sqlserverCaminho to find the application 'pip' in the servant where SQL Server 2019 is installed :
Nesta página do site você pode assistir ao vídeo on-line Web Scraping? With Python in the SQL Query | SQL Server duração hora minuto segundo em boa qualidade , que foi baixado pelo usuário fabioms 23 Fevereiro 2022, compartilhe o link com seus amigos e conhecidos, no youtube este vídeo já foi visto 2,558 vezes e gostou 120 espectadores. Boa visualização!