Unable to upgrade to gitlab-17.0.0: `require': cannot load such file -- rdoc

I'm trying to update my gitlab to 17.0.0 but it complains saying it can't find rdoc.

 * This is a major upgrade from 16.11.2 to 17.0.0.
 * Checking for background migrations ...
<internal:/usr/lib64/ruby/site_ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:38:in `require': cannot load such file -- rdoc (LoadError)
        from <internal:/usr/lib64/ruby/site_ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:38:in `require'
        from /opt/gitlab/gitlab/vendor/bundle/ruby/3.1.0/gems/gitlab-markup-1.9.0/lib/github/markup/rdoc.rb:2:in `<top (required)>'
        from <internal:/usr/lib64/ruby/site_ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:38:in `require'
        from <internal:/usr/lib64/ruby/site_ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:38:in `require'
        from /opt/gitlab/gitlab/vendor/bundle/ruby/3.1.0/gems/gitlab-markup-1.9.0/lib/github/markups.rb:2:in `<module:Markup>'
        from /opt/gitlab/gitlab/vendor/bundle/ruby/3.1.0/gems/gitlab-markup-1.9.0/lib/github/markup.rb:53:in `instance_eval'
        from /opt/gitlab/gitlab/vendor/bundle/ruby/3.1.0/gems/gitlab-markup-1.9.0/lib/github/markup.rb:53:in `<module:Markup>'
        from /opt/gitlab/gitlab/vendor/bundle/ruby/3.1.0/gems/gitlab-markup-1.9.0/lib/github/markup.rb:5:in `<module:GitHub>'
        from /opt/gitlab/gitlab/vendor/bundle/ruby/3.1.0/gems/gitlab-markup-1.9.0/lib/github/markup.rb:4:in `<top (required)>'
        from /usr/lib64/ruby/gems/3.1.0/gems/bundler-2.5.3/lib/bundler/runtime.rb:60:in `require'
        from /usr/lib64/ruby/gems/3.1.0/gems/bundler-2.5.3/lib/bundler/runtime.rb:60:in `block (2 levels) in require'
        from /usr/lib64/ruby/gems/3.1.0/gems/bundler-2.5.3/lib/bundler/runtime.rb:55:in `each'
        from /usr/lib64/ruby/gems/3.1.0/gems/bundler-2.5.3/lib/bundler/runtime.rb:55:in `block in require'
        from /usr/lib64/ruby/gems/3.1.0/gems/bundler-2.5.3/lib/bundler/runtime.rb:44:in `each'
        from /usr/lib64/ruby/gems/3.1.0/gems/bundler-2.5.3/lib/bundler/runtime.rb:44:in `require'
        from /usr/lib64/ruby/gems/3.1.0/gems/bundler-2.5.3/lib/bundler.rb:187:in `require'
        from /opt/gitlab/gitlab/config/application.rb:18:in `<top (required)>'
        from <internal:/usr/lib64/ruby/site_ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:38:in `require'
        from <internal:/usr/lib64/ruby/site_ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:38:in `require'
        from /opt/gitlab/gitlab/vendor/bundle/ruby/3.1.0/gems/railties-7.0.8.1/lib/rails/command/actions.rb:22:in `require_application!'
        from /opt/gitlab/gitlab/vendor/bundle/ruby/3.1.0/gems/railties-7.0.8.1/lib/rails/command/actions.rb:14:in `require_application_and_environment!'
        from /opt/gitlab/gitlab/vendor/bundle/ruby/3.1.0/gems/railties-7.0.8.1/lib/rails/commands/runner/runner_command.rb:33:in `perform'
        from /opt/gitlab/gitlab/vendor/bundle/ruby/3.1.0/gems/thor-1.3.1/lib/thor/command.rb:28:in `run'
        from /opt/gitlab/gitlab/vendor/bundle/ruby/3.1.0/gems/thor-1.3.1/lib/thor/invocation.rb:127:in `invoke_command'
        from /opt/gitlab/gitlab/vendor/bundle/ruby/3.1.0/gems/thor-1.3.1/lib/thor.rb:527:in `dispatch'
        from /opt/gitlab/gitlab/vendor/bundle/ruby/3.1.0/gems/railties-7.0.8.1/lib/rails/command/base.rb:87:in `perform'
        from /opt/gitlab/gitlab/vendor/bundle/ruby/3.1.0/gems/railties-7.0.8.1/lib/rails/command.rb:48:in `invoke'
        from /opt/gitlab/gitlab/vendor/bundle/ruby/3.1.0/gems/railties-7.0.8.1/lib/rails/commands.rb:18:in `<top (required)>'
        from <internal:/usr/lib64/ruby/site_ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:38:in `require'
        from <internal:/usr/lib64/ruby/site_ruby/3.1.0/rubygems/core_ext/kernel_require.rb>:38:in `require'
        from bin/rails:4:in `<main>'
 * ERROR: www-apps/gitlab-17.0.0::gitlab failed (setup phase):
 *   failed to check for background migrations
 *
 * Call stack:
 *              ebuild.sh, line 136:  Called pkg_setup
 *   gitlab-17.0.0.ebuild, line 203:  Called die
 * The specific snippet of code:
 *                      elog "The new version may require a set of background migrations to be finished."
 *
 * If you need support, post the output of `emerge --info '=www-apps/gitlab-17.0.0::gitlab'`,
 * the complete build log and the output of `emerge -pqv '=www-apps/gitlab-17.0.0::gitlab'`.
 * The complete build log is located at '/var/tmp/portage/www-apps/gitlab-17.0.0/temp/build.log'.
 * The ebuild environment file is located at '/var/tmp/portage/www-apps/gitlab-17.0.0/temp/die.env'.
 * Working directory: '/var/tmp/portage/www-apps/gitlab-17.0.0/empty'
 * S: '/var/tmp/portage/www-apps/gitlab-17.0.0/work/gitlab-17.0.0'

My /etc/conf.d/gitlab contains:

export RUBYLIB="$(find /usr/lib64/ruby/ -regextype egrep -iregex '.*rdoc-.*/lib')"