Compatibility Issue with Setuptools

[pgm99]

Hi, I have been working with your tool for a while without problem, until yesterday. Updating and refreshing some environments I update CPA to 0.8.8 version. The tool keeps working fine, but the autotuning using Ray is failing:
ImportError: cannot import name 'packaging' from 'pkg_resources'

The problem seems to stem from a conflict with setuptools 70.0.0, which is required by CPA. However, this version causes failures in Ray's dashboard and worker registration.
I have seen downgrading setuptools to version 69.5.1, which is not an option in this case. Is there any known workaround or fix for this incompatibility? Thanks in advance and for your excellent work.

This is the complete error:

2024-09-19 10:51:32,020	ERROR services.py:1329 -- Failed to start the dashboard , return code 1
2024-09-19 10:51:32,020	ERROR services.py:1354 -- Error should be written to 'dashboard.log' or 'dashboard.err'. We are printing the last 20 lines for you. See 'https://docs.ray.io/en/master/ray-observability/ray-logging.html#logging-directory-structure' to find where the log file is.
2024-09-19 10:51:32,021	ERROR services.py:1398 -- 
The last 20 lines of /tmp/ray/session_2024-09-19_10-51-27_576222_2310047/logs/dashboard.log (it contains the error message from the dashboard): 
  File "/home/pagonzalez/mambaforge/envs/cpa/lib/python3.9/site-packages/ray/dashboard/dashboard.py", line 75, in run
    await self.dashboard_head.run()
  File "/home/pagonzalez/mambaforge/envs/cpa/lib/python3.9/site-packages/ray/dashboard/head.py", line 325, in run
    modules = self._load_modules(self._modules_to_load)
  File "/home/pagonzalez/mambaforge/envs/cpa/lib/python3.9/site-packages/ray/dashboard/head.py", line 219, in _load_modules
    head_cls_list = dashboard_utils.get_all_modules(DashboardHeadModule)
  File "/home/pagonzalez/mambaforge/envs/cpa/lib/python3.9/site-packages/ray/dashboard/utils.py", line 121, in get_all_modules
    importlib.import_module(name)
  File "/home/pagonzalez/mambaforge/envs/cpa/lib/python3.9/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 850, in exec_module
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
  File "/home/pagonzalez/mambaforge/envs/cpa/lib/python3.9/site-packages/ray/dashboard/modules/dashboard_sdk.py", line 10, in <module>
    from pkg_resources import packaging
ImportError: cannot import name 'packaging' from 'pkg_resources' (/home/pagonzalez/mambaforge/envs/cpa/lib/python3.9/site-packages/pkg_resources/__init__.py)
2024-09-19 10:51:33,285	INFO worker.py:1724 -- Started a local Ray instance.
[2024-09-19 10:51:35,910 E 2310047 2310047] core_worker.cc:215: Failed to register worker 01000000ffffffffffffffffffffffffffffffffffffffffffffffff to Raylet. IOError: [RayletClient] Unable to register worker with raylet. No such file or director