Google BigQuery Connectivity

Modified on Thu, 14 Oct, 2021 at 3:56 PM

In Omniscope Evo it is possible to import data from, and publish data to Google BigQuery tables via community blocks.

  • Google BigQuery Import Table allows you to import an entire table from Google BigQuery into Omniscope

  • Google BigQuery Custom SQL allows you to to specify a custom SQL query to run in Google BigQuery, and import the query result into Omniscope

  • Google BigQuery writer allows you to publish data to a Google BigQuery table. You can use the block to create/replace tables, as well as append data to an existing table.

The custom blocks have been written using the Python programming language. You will need a Python interpreter installed on your machine in order to use these blocks. Alternatively, you could use Docker to run custom blocks.

For more information on how to setup custom blocks see: or running custom blocks in Docker:

All the blocks will need a json key file in order to be able to connect to Google BigQuery. The path of the key can be specified as a system variable, or specified in the block option. 

To generate a json key file you will need a service account with BigQuery User role. When using the custom block to publish records the service account will also need the BigQuery Data Editor role.

You can learn more about how to create a service account and generate keys here:

Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select at least one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article