BigID API/Scan Data In Motion Tutorial: Difference between revisions
No edit summary |
|||
| Line 2: | Line 2: | ||
In this article, you'll learn: | In this article, you'll learn: | ||
* The differences between data in motion scans and regular data source scans | * The differences between data in motion scans and regular data source scans | ||
* How to enable data in motion data sources | |||
* How to test a connection to a data in motion data source | * How to test a connection to a data in motion data source | ||
* How to add a data source using the BigID API | * How to add a data source using the BigID API | ||
| Line 11: | Line 12: | ||
First, we should check if data in motion is enabled in your environment. | First, we should check if data in motion is enabled in your environment. | ||
== Discovering Data Sources == | == Discovering Data Sources == | ||
| Line 48: | Line 48: | ||
</html> | </html> | ||
{{Note|Do you see the connector? If not, that means the DIM_ENABLED environment variable isn't set inside your sandbox system. Click the "Enable Data in Motion" button to set the flag. <html><button onclick="enableDIM()">Enable Data in Motion</button></html>}} | {{Note|Do you see the connector? If not, that means the DIM_ENABLED environment variable isn't set inside your sandbox system. Click the "Enable Data in Motion" button to set the flag. <html><button onclick="enableDIM()">Enable Data in Motion</button></html>. Instructions to do this through the UI are located at https://www.docs.bigid.com/bigid/docs/kinesis}} | ||
Revision as of 04:24, 9 March 2022
- The differences between data in motion scans and regular data source scans
- How to enable data in motion data sources
- How to test a connection to a data in motion data source
- How to add a data source using the BigID API
Many organizations are receiving and processing data in real time. Where there's data, there's bound to be personal information. In this tutorial, we'll add an AWS Kinesis data source that BigID will scan in real time.
Unlike traditional BigID scans that run weekly, monthly or quarterly, data in motion scans run continuously. This means that under scan details you'll see your data in motion scan at 0% with a status of "in progress" while you're monitoring a data in motion data source.
First, we should check if data in motion is enabled in your environment.
Discovering Data Sources
You can see what data source connectors are installed in your environment through the BigID UI, but since we're focused on the API (and because all actions in the UI can be performed in the API), we are going to use the API to retrieve them.
Press Send on the request below to get a listing of the data source connectors installed on our test BigID system.
You'll see our test system has around 70 different data source connectors installed. Use CTRL+F (CMD+F on Mac OS) to search for the Kinesis connector.