DocumentCloud Batch Upload Script | Linux version
This video provides an overview of the Batch Upload Script on a computer using the Linux operating system. It was written to upload the CIA Crest files, a collection that contains almost 1 million files.
It keeps track of which files were uploaded successfully, As a result, it can be stopped and restarted and it will pick up where it left off and errors can be retried. It uploads files in batches. It can be stopped gracefully by pressing Ctrl+C (once) while it is running.
The following links and commands are referenced in the video:
GitHub repo: https://github.com/MuckRock/dc_batch_...
pip install -r requirements.txt
As a reminder, your DocumentCloud account must be verified in order to use the script. The following link will take you to the submission form to start the process: https://airtable.com/shrZrgdmuOwW0ZLPM
0:00 Installing Python and Pip
1:55 Fetching the Batch Upload Script
2:55 Installing Script requirements in requirements.txt
3:35 Finding the Project ID you want to upload to
4:10 Finding the file path of the directory of documents you want to upload documents from
4:50 Setting local environment variables DC_USERNAME and DC_PASSWORD to be able to use the script
6:05 Generating a CSV file that describes all of the Documents we intend to upload
7:52 Running the script to upload our documents
8:20 Note about delayed indexing
8:55 Successful upload
Auf dieser Seite können Sie das Online-Video DocumentCloud Batch Upload Script | Linux version mit der Dauer stunde minuten sekunde in guter Qualität ansehen, das der Benutzer MuckRockNews 10 Januar 2023 hochgeladen hat, den Link mit Freunden und Bekannten teilen, dieses Video wurde auf Youtube bereits 25 Mal angesehen und es wurde von 0 den Zuschauern gefallen. Viel Spaß beim Betrachtenden Zuschauern gefallen!
