More information required for exception "BigQueryError{reason=internalError, location=null, message=An internal error occurred and the request could not be completed. Error: 4663124" #192

The following execution error is seen while executing a job which tries to uploads the data from a local file to a Bigquery table

BigQueryError{reason=internalError, location=null, message=An internal error occurred and the request could not be completed. Error: 4663124} Execution errors: [BigQueryError{reason=internalError, location=null, message=An internal error occurred and the request could not be completed. Error: 4663124}]

Following is the code snippet :

   WriteChannelConfiguration writeChannelConfiguration = WriteChannelConfiguration
            .newBuilder(tid)
            .setFormatOptions(csvOptions)
            .setSchema(schema)
            .setMaxBadRecords(0)
            .setWriteDisposition(JobInfo.WriteDisposition.WRITE_APPEND)
            .setNullMarker(nullMarker)
            .build();

    Path csvFilePath = Paths.get(csvPath);

    JobId jobId = JobId
            .newBuilder()
            .setJob(/* a unique job id*/)
            .setLocation(location)
            .setProject(client.getOptions().getProjectId())
            .build();

    TableDataWriteChannel writeChannel = client.writer(jobId,writeChannelConfiguration);

    try(OutputStream stream = Channels.newOutputStream(writeChannel)){
        Files.copy(csvFilePath /*file to be uploaded to the big query table */, stream);
    }
    catch (IOException ex){
        //  throw it
    }

    if(completedJob != null && completedJob.getStatus().getError() == null){
         // do something
    }
    else{
        /*throw exception*/
    }

Problem encountered:

Often we get the error status (this has been experienced by couple of customers who use Striim)

BigQueryError{reason=internalError, location=null, message=An internal error occurred and the request could not be completed. Error: 4663124} Execution errors: [BigQueryError{reason=internalError, location=null, message=An internal error occurred and the request could not be completed. Error: 4663124}]

I couldn't find any explanation for the error code 4663124. When/Why would this occur ? And how to fix this error?

Bigquery version used is

com.google.cloud
google-cloud-bigquery
1.35.0

Region of table is US
Job ID : Striim_BigQueryWriter_raw_cdc_tkp_flight_insurance_fi_order_journey_203_csv_gz1579083287830

Error Log:

2020-01-15 10:15:13,486 @S10_111_12_21 @NULL_APPNAME -ERROR admin.tkp_flight_insurance_bq-0 com.striim.bigquery.BigQueryIntegrationTask.execute (BigQueryIntegrationTask.java:159) Failed to upload data from /opt/striim/.striim/admin/tkp_flight_insurance_bq/raw_cdc.tkp_flight_insurance_fi_order_journey/raw_cdc.tkp_flight_insurance_fi_order_journey_203.csv.gz
com.webaction.common.exc.AdapterException: WA-100 : Unexpected Exception. Cause: Upload job failed. Reason: BigQueryError{reason=internalError, location=null, message=An internal error occurred and the request could not be completed. Error: 4663124} Execution errors: [BigQueryError{reason=internalError, location=null, message=An internal error occurred and the request could not be completed. Error: 4663124}] Job: Striim_BigQueryWriter_raw_cdc_tkp_flight_insurance_fi_order_journey_203_csv_gz1579083287830 File: /opt/striim/.striim/admin/tkp_flight_insurance_bq/raw_cdc.tkp_flight_insurance_fi_order_journey/raw_cdc.tkp_flight_insurance_fi_order_journey_203.csv.gz Target Table: raw_cdc.tkp_flight_insurance_fi_order_journey

There is no response for the same ticket here - https://issuetracker.google.com/issues/148018440