Google BigQuery Connectivity

In Omniscope Evo it is possible to import data from, and publish data to Google BigQuery tables via community blocks.

• Google BigQuery Import Table allows you to import an entire table from Google BigQuery into Omniscope

• Google BigQuery Custom SQL allows you to to specify a custom SQL query to run in Google BigQuery, and import the query result into Omniscope

• Google BigQuery writer allows you to publish data to a Google BigQuery table. You can use the block to create/replace tables, as well as append data to an existing table.

The custom blocks have been written using the Python programming language. You will need a Python interpreter installed on your machine in order to use these blocks. Alternatively, you could use Docker to run custom blocks.

For more information on how to setup custom blocks see: https://help.visokio.com/support/solutions/articles/42000071133-setting-up-the-custom-block or running custom blocks in Docker: https://help.visokio.com/support/solutions/articles/42000089057-evo-custom-block-execution-in-docker-containers.

All the blocks will need a json key file in order to be able to connect to Google BigQuery. The path of the key can be specified as a system variable, or specified in the block option. 

To generate a json key file you will need a service account with BigQuery User role. When using the custom block to publish records the service account will also need the BigQuery Data Editor role.

You can learn more about how to create a service account and generate keys here:

https://cloud.google.com/bigquery/docs/quickstarts/quickstart-client-libraries