DocumentCloud Batch Upload Script | Linux version
This video provides an overview of the Batch Upload Script on a computer using the Linux operating system. It was written to upload the CIA Crest files, a collection that contains almost 1 million files.
It keeps track of which files were uploaded successfully, As a result, it can be stopped and restarted and it will pick up where it left off and errors can be retried. It uploads files in batches. It can be stopped gracefully by pressing Ctrl+C (once) while it is running.
The following links and commands are referenced in the video:
GitHub repo: https://github.com/MuckRock/dc_batch_...
pip install -r requirements.txt
As a reminder, your DocumentCloud account must be verified in order to use the script. The following link will take you to the submission form to start the process: https://airtable.com/shrZrgdmuOwW0ZLPM
0:00 Installing Python and Pip
1:55 Fetching the Batch Upload Script
2:55 Installing Script requirements in requirements.txt
3:35 Finding the Project ID you want to upload to
4:10 Finding the file path of the directory of documents you want to upload documents from
4:50 Setting local environment variables DC_USERNAME and DC_PASSWORD to be able to use the script
6:05 Generating a CSV file that describes all of the Documents we intend to upload
7:52 Running the script to upload our documents
8:20 Note about delayed indexing
8:55 Successful upload
In questa pagina del sito puoi guardare il video online DocumentCloud Batch Upload Script | Linux version della durata di ore minuti seconda in buona qualità , che l'utente ha caricato MuckRockNews 10 gennaio 2023, condividi il link con amici e conoscenti, su youtube questo video è già stato visto 25 volte e gli è piaciuto 0 spettatori. Buona visione!
