DataHubGc

CLI based Ingestion

Install the Plugin

The datahub-gc source works out of the box with acryl-datahub.

Config Details

Options

Note that a . is used to denote nested fields in the YAML recipe.

Field	Description
cleanup_expired_tokens boolean	Whether to clean up expired tokens or not Default: True

Schema

The JSONSchema for this configuration is inlined below.

{
  "title": "DataHubGcSourceConfig",
  "type": "object",
  "properties": {
    "cleanup_expired_tokens": {
      "title": "Cleanup Expired Tokens",
      "description": "Whether to clean up expired tokens or not",
      "default": true,
      "type": "boolean"
    }
  },
  "additionalProperties": false
}

Code Coordinates

• Class Name: datahub.ingestion.source.gc.datahub_gc.DataHubGcSource
• Browse on GitHub

Questions

If you've got any questions on configuring ingestion for DataHubGc, feel free to ping us on our Slack.