Write a CloudQuery Source Plugin in Python
A 10-minute hands-on demo of how to write a CloudQuery Plugin from start to finish, using the XKCD API as an example.
CloudQuery has a lot of built-in plugins, but sometimes… you need a plugin for something that isn’t already covered.
This tutorial takes you on a deep dive into how source plugins work and how to build your own using the new Python SDK. To do this, we show you how to develop source plugins for CloudQuery in Python using the XKCD API.
The new CloudQuery Python SDK opens up source plugin development to many more developers than before. Enabling easy integration with popular Python libraries that connect to APIs for things like Fintech data, GIS data, or network telemetry.
Links:
CloudQuery website: https://cql.ink/47gzyZ6
Plugin Developer Documentation: https://cql.ink/47hrXcu
CloudQuery Architecture: https://cql.ink/3sjhWgd
Python Template: https://cql.ink/3FIUrjW
Result of this tutorial: https://cql.ink/40q1NlY
Join our Discord: https://cql.ink/40nU2g1
Chapters:
00:00 - Overview
00:45 - The Template Repo
01:24 - The XKCD API
02:18 - Building the Table
05:51 - Building the API Client
08:02 - Editing the Config Spec
08:27 - Setting the Plugin’s Name and Version
09:08 - Testing the Plugin and Fixing Common Mistakes
10:45 - Outro
#dataanalytics #dataengineer #devops #platformengineering #elt #etl #multicloud #python #plugin #development #programming #tutorial #xkcd
On this page of the site you can watch the video online Write a CloudQuery Source Plugin in Python with a duration of hours minute second in good quality, which was uploaded by the user CloudQuery 20 October 2023, share the link with friends and acquaintances, this video has already been watched 1,005 times on youtube and it was liked by 17 viewers. Enjoy your viewing!
