Sitelet https://github.com/GoogleCloudPlatform/cloud-data-quality/pull/162
Skip to content

Remove gcs validation flag - #162

Merged
AmandeepSinghCS merged 6 commits into
mainfrom
remove-gcs-validation-flag
Apr 5, 2022
Merged

AmandeepSinghCS merged 6 commits into
mainfrom
remove-gcs-validation-flag

Conversation

@AmandeepSinghCS

Copy link
Copy Markdown
Contributor

No description provided.

@AmandeepSinghCS
AmandeepSinghCS requested review from nauh and thinhha March 29, 2022 16:23
Comment thread clouddq/main.py Outdated
"--enable_experimental_dataplex_gcs_validation",
help="If True, allows validating Dataplex GCS resources using "
"BigQuery External Tables",
help="This flag is set to True by default, it allows validating Dataplex GCS resources using "

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: "This flag has no effect and is now deprecated. GCS resource validation via BigQuery External Tables is supported regardless of the value of this flag. Please remove it from your script."

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it only for GCS resource attached to Dataplex, or any GCS resource behind BigQuery external table?

Comment thread clouddq/main.py Outdated
is_flag=True,
default=False,
default=True,
hidden=True,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We don't need to hide it, given that the description is updated (so user can actually see the description and hopefully remove flags from their script)

Comment thread clouddq/main.py
summary_to_stdout: bool = False,
enable_experimental_bigquery_entity_uris: bool = False,
enable_experimental_dataplex_gcs_validation: bool = False,
enable_experimental_dataplex_gcs_validation: bool = True,

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we remove this?

nauh
nauh previously approved these changes Apr 4, 2022
…ata-quality into remove-gcs-validation-flag

� Conflicts:
�	clouddq/classes/dq_configs_cache.py
�	clouddq/integration/dataplex/clouddq_dataplex.py
�	clouddq/main.py
�	tests/integration/test_dataplex_integration_performance.py
�	tests/integration/test_dataplex_task.py
@AmandeepSinghCS
AmandeepSinghCS merged commit 50fb4f6 into main Apr 5, 2022
@thinhha
thinhha deleted the remove-gcs-validation-flag branch April 5, 2022 09:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants