DocumentCloud Batch Upload Script | Linux version
This video provides an overview of the Batch Upload Script on a computer using the Linux operating system. It was written to upload the CIA Crest files, a collection that contains almost 1 million files.
It keeps track of which files were uploaded successfully, As a result, it can be stopped and restarted and it will pick up where it left off and errors can be retried. It uploads files in batches. It can be stopped gracefully by pressing Ctrl+C (once) while it is running.
The following links and commands are referenced in the video:
GitHub repo: https://github.com/MuckRock/dc_batch_...
pip install -r requirements.txt
As a reminder, your DocumentCloud account must be verified in order to use the script. The following link will take you to the submission form to start the process: https://airtable.com/shrZrgdmuOwW0ZLPM
0:00 Installing Python and Pip
1:55 Fetching the Batch Upload Script
2:55 Installing Script requirements in requirements.txt
3:35 Finding the Project ID you want to upload to
4:10 Finding the file path of the directory of documents you want to upload documents from
4:50 Setting local environment variables DC_USERNAME and DC_PASSWORD to be able to use the script
6:05 Generating a CSV file that describes all of the Documents we intend to upload
7:52 Running the script to upload our documents
8:20 Note about delayed indexing
8:55 Successful upload
Sur cette page du site, vous pouvez voir la vidéo en ligne DocumentCloud Batch Upload Script | Linux version durée heure minute seconde en bonne qualité , qui a été Téléchargé par l'utilisateur MuckRockNews 10 janvier 2023, Partagez le lien avec vos amis et connaissances, sur youtube cette vidéo a déjà été regardée 25 fois et il a aimé 0 téléspectateurs. Bon visionnage!
