DocumentCloud Batch Upload Script | Linux version
This video provides an overview of the Batch Upload Script on a computer using the Linux operating system. It was written to upload the CIA Crest files, a collection that contains almost 1 million files.
It keeps track of which files were uploaded successfully, As a result, it can be stopped and restarted and it will pick up where it left off and errors can be retried. It uploads files in batches. It can be stopped gracefully by pressing Ctrl+C (once) while it is running.
The following links and commands are referenced in the video:
GitHub repo: https://github.com/MuckRock/dc_batch_...
pip install -r requirements.txt
As a reminder, your DocumentCloud account must be verified in order to use the script. The following link will take you to the submission form to start the process: https://airtable.com/shrZrgdmuOwW0ZLPM
0:00 Installing Python and Pip
1:55 Fetching the Batch Upload Script
2:55 Installing Script requirements in requirements.txt
3:35 Finding the Project ID you want to upload to
4:10 Finding the file path of the directory of documents you want to upload documents from
4:50 Setting local environment variables DC_USERNAME and DC_PASSWORD to be able to use the script
6:05 Generating a CSV file that describes all of the Documents we intend to upload
7:52 Running the script to upload our documents
8:20 Note about delayed indexing
8:55 Successful upload
On this page of the site you can watch the video online DocumentCloud Batch Upload Script | Linux version with a duration of hours minute second in good quality, which was uploaded by the user MuckRockNews 10 January 2023, share the link with friends and acquaintances, this video has already been watched 25 times on youtube and it was liked by 0 viewers. Enjoy your viewing!
