[Dune-devel] website builder

[Dedner, Andreas]

Hi.
I've investigated a bit further. The failure is probably caused by an new version of the docker image for the ciwebsitebuilder uploaded about 3 days ago which switches to python3.11. Classes from 'collections' can not be directly imported anymore but require 'collections.abc' in Python3.11. The offending package is 'lya' which I can't really find anything about except this basically empty pypi page
https://pypi.org/project/lya/
with a package last updated in 2015 and a weird homepage link. This package is imported into 'grabbox' which is a python package in a local repo from Steffen.

I don't really know how to fix this except by simply going back to an older version of the ciwebsitebuilder docker image - and I'm not quite sure how to do this either. I tried changing the image in the ci yml file to debian11 but that gives me an error saying that this is not an allowed image for the runner
https://gitlab.dune-project.org/infrastructure/dune-website/-/jobs/584214
MR:https://gitlab.dune-project.org/infrastructure/dune-website/-/merge_requests/535

Why was a new version of the ciwebsitebuilder docker image uploaded and did this new docker image work locally for building the doxygen/sphinx docu and is failing on our ci for some other reason? I tried it locally and it fails with the same error message.

Is there anyone who actually know how the ciwebsitebuilder package works and what grabbox does (or lya for that matter).

Andreas
________________________________
From: Dedner, Andreas <A.S.Dedner at warwick.ac.uk>
Sent: 31 May 2024 08:57
To: dune-devel at lists.dune-project.org <dune-devel at lists.dune-project.org>
Subject: website builder

Hi.
The scheduled deployment of the website has been failing for the last two weeks. Some issue with switching to Python 3.11 in a new docker image I think is causing an import error in the ci-website-builder:

from .lya import OrderedDictYAMLLoader, AttrDict, configure_logging
File "/usr/local/lib/python3.11/dist-packages/lya/lya.py", line 5, in <module>
from collections import Mapping, Sequence, Set, OrderedDict, defaultdict
ImportError: cannot import name 'Mapping' from 'collections' (/usr/lib/python3.11/collections/__init__.py)

so this 'lya' package possibly needs an update - assuming a newer version exists.

Our ci-website-builder package is not directly importing this but importing
from grabbox.click.logbook import init_logbook, LogHandler which then uses lya.

I was wondering is someone has already looked into this? Are these python packages part of the docker image so that needs rebuilding?

Best
Andreas
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.dune-project.org/pipermail/dune-devel/attachments/20240602/312e8060/attachment.htm>