Periodically, AWS S3 files are copied to Google Cloud Storage.
There are many ways to copy, but here we use the gsutil command for the Google Cloud SDK,
The Google Cloud SDK uses a Docker image of Alpine Linux.
However, at some point, I started getting the following error message and could no longer copy.
...
Traceback (most recent call last):
File "/google-cloud-sdk/platform/gsutil/gslib/boto_translation.py", line 632, in _PerformSimpleDownload
key.get_contents_to_file(download_stream,
TypeError: get_contents_to_file() got an unexpected keyword argument 'hash_algs'
...
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe3 in position 8191: unexpected end of data
...
Reason
It seems to be an error with the latest Cloud SDK, and I fixed it by changing to an older version in the Dockerfile.
FROM google/cloud-sdk:276.0.0-alpine
Until then, I was trying to get the latest version.
FROM google/cloud-sdk:alpine
Impressions, etc.
It took me a long time to determine the cause....
When I first created the Dockerfile, I thought it would be better to fix the version at some point, but I set it to "latest" so that I could think about it when it became a problem. ....
Not only Google Cloud SDK, the latest version of Docker image is fine for testing, but once it is actually used, it is better to fix the version.
