Artifacts upload broken since 15.0.0
Hey there,
since the upgrade to 15.0.0 my artifacts upload is broken: I get a 400 bad request after a successful job execution (runner on Kubernetes)
127.0.0.1 2001:4ba0:fff1:c3::1 - - [2022/06/14:22:59:25 +0200] "POST /api/v4/jobs/request HTTP/1.1" 204 0 "" "gitlab-runner 15.0.0 (15-0-stable; go1.17.7; linux/amd64)" 27
time="2022-06-14T22:59:26+02:00" level=info msg="saved file" client_mode=local_tempfile copied_bytes=3907369 correlation_id=01G5J075ZMTFPBF2W68DWM99N3 is_local=true is_multipart=false is_remote=false local_temp_path=/opt/gitlab/gitlab/shared/artifacts/tmp/uploads remote_id= temp_file_prefix=build-klepto-master.zip
time="2022-06-14T22:59:26+02:00" level=info msg="saved file" client_mode=local_tempfile copied_bytes=177 correlation_id=01G5J075ZMTFPBF2W68DWM99N3 is_local=true is_multipart=false is_remote=false local_temp_path=/tmp remote_id= temp_file_prefix=metadata.gz
127.0.0.1 127.0.0.1 - - [2022/06/14:22:59:26 +0200] "POST /api/v4/jobs/13043/artifacts?artifact_format=zip&artifact_type=archive&expire_in=1+day HTTP/1.1" 400 47 "" "gitlab-runner 15.0.0 (15-0-stable; go1.17.7; linux/amd64)" 178
127.0.0.1
I reported this issue to the gitlab forum and the gitlab bugtracker.
The (most likely) explaination I got was TEMPDIR being set differently for rails and workhorse. I think this might be true, as the log snippet shows different dirs in the uploads. I have been asked to run irb
from the gitlab install dir, but the file does not exist in that dir tree. I'm not sure calling the system ruby will show identical settings for rails, workhorse or something else.
Can you provide a hint on how to debug this issue? There are gitlab.rb settings for both temp dirs, but I'm not sure how they translate to the gitlab.yml file used to configuring gitlab in this very install.
Thanks, Jan