DocumentCloud Batch Upload Script | Linux version
This video provides an overview of the Batch Upload Script on a computer using the Linux operating system. It was written to upload the CIA Crest files, a collection that contains almost 1 million files.
It keeps track of which files were uploaded successfully, As a result, it can be stopped and restarted and it will pick up where it left off and errors can be retried. It uploads files in batches. It can be stopped gracefully by pressing Ctrl+C (once) while it is running.
The following links and commands are referenced in the video:
GitHub repo: https://github.com/MuckRock/dc_batch_...
pip install -r requirements.txt
As a reminder, your DocumentCloud account must be verified in order to use the script. The following link will take you to the submission form to start the process: https://airtable.com/shrZrgdmuOwW0ZLPM
0:00 Installing Python and Pip
1:55 Fetching the Batch Upload Script
2:55 Installing Script requirements in requirements.txt
3:35 Finding the Project ID you want to upload to
4:10 Finding the file path of the directory of documents you want to upload documents from
4:50 Setting local environment variables DC_USERNAME and DC_PASSWORD to be able to use the script
6:05 Generating a CSV file that describes all of the Documents we intend to upload
7:52 Running the script to upload our documents
8:20 Note about delayed indexing
8:55 Successful upload
На этой странице сайта вы можете посмотреть видео онлайн DocumentCloud Batch Upload Script | Linux version длительностью часов минут секунд в хорошем качестве, которое загрузил пользователь MuckRockNews 10 Январь 2023, поделитесь ссылкой с друзьями и знакомыми, на youtube это видео уже посмотрели 25 раз и оно понравилось 0 зрителям. Приятного просмотра!
