"Backend Error" when load to BigQuery table -
it appears has been common issue, happens , in load jobs. when happens there no response seems data still got loaded, wonder what's best thing in program? can ignore or wait seconds , continue?
thanks
there 2 ways can error when running bigquery job, , correct handling depends on how error:
- you can error on http request, translates http response code.
- you can job has
errorresultindicates job failed.
in second case, options easy, because know job failed. if job load job, should not have modified table. in first case, when http error code retryable (417 timeout, 500 internalerror, 503 backenderror, etc), bit trickier, since error may have communication error, , don't know whether server got message or not. way sure specify own jobid. since job ids must unique, can retry sending same job again in event of communication error, , don't have worry run same thing twice.
to reiterate: if getting http 503 response reason=backenderror, connection error indicates temporary network condition. however, doesn't mean job failed.
if can lookup job , job result has error reason=internalerror error message says "backend error. job aborted" means job failed. should safe retry.
Comments
Post a Comment