Sanction Screening
Pipelined Data Sets
>
Sanction Screening
Introduction
The goal of this pipeline is to make the Sanction Screening dataset available in Google Big Query where it can be queried using the SQL interface for business purposes and to drive downstream business processes.
Pipelines
The Sanction Screening pipeline utilizes BigQuery External Connections in the Data Hub project, to retrieve data from the Publisher’s Spanner database. Federated Queries are used with these External Connections to pull data from the Spanner Database into the BigQuery dataset / tables.
Schedule
Initially, the data import process is expected to run nightly, however the pipeline is extensible to change it to any schedule as needed in the future.
Topics in this section
Have a Question?
Have a how-to question? Seeing a weird error? Get help on
StackOverflow.
Register for the Digital Toolkit Meetup
where we answer technical Q&A from the audience.
Last updated Mon Feb 10 2025