Skip to content

Test failure: test_build_notebook_dependency_graphs_when_installing_notebooks_twice[pip_install_multiple_packages] #4300

@github-actions

Description

@github-actions
❌ test_build_notebook_dependency_graphs_when_installing_notebooks_twice[pip_install_multiple_packages]: databricks.sdk.errors.platform.ResourceDoesNotExist: Cluster TEST_DEFAULT_CLUSTER_ID does not exist (1m16.453s)
databricks.sdk.errors.platform.ResourceDoesNotExist: Cluster TEST_DEFAULT_CLUSTER_ID does not exist
[gw5] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:30 INFO [databricks.labs.ucx.framework.utils] Invoking command: ['pip', '--disable-pip-version-check', 'install', '--quiet', 'splink', 'mlflow', 'hyperopt', '-t', '/tmp/ucx-0ylrey43', '--upgrade']
05:31 DEBUG [databricks.labs.ucx.source_code.python_libraries] pip output:

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
databricks-labs-ucx 0.59.1 requires databricks-sdk<0.59.0,>=0.58.0, but you have databricks-sdk 0.59.0 which is incompatible.

05:31 INFO [databricks.labs.ucx.framework.utils] Invoking command: ['pip', '--disable-pip-version-check', 'install', '--quiet', 'splink', 'mlflow', 'hyperopt', '-t', '/tmp/ucx-0ylrey43', '--upgrade']
05:31 DEBUG [databricks.labs.ucx.source_code.python_libraries] pip output:

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
databricks-labs-ucx 0.59.1 requires databricks-sdk<0.59.0,>=0.58.0, but you have databricks-sdk 0.59.0 which is incompatible.
[gw5] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:30 INFO [databricks.labs.ucx.framework.utils] Invoking command: ['pip', '--disable-pip-version-check', 'install', '--quiet', 'splink', 'mlflow', 'hyperopt', '-t', '/tmp/ucx-0ylrey43', '--upgrade']
05:31 DEBUG [databricks.labs.ucx.source_code.python_libraries] pip output:

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
databricks-labs-ucx 0.59.1 requires databricks-sdk<0.59.0,>=0.58.0, but you have databricks-sdk 0.59.0 which is incompatible.

05:31 INFO [databricks.labs.ucx.framework.utils] Invoking command: ['pip', '--disable-pip-version-check', 'install', '--quiet', 'splink', 'mlflow', 'hyperopt', '-t', '/tmp/ucx-0ylrey43', '--upgrade']
05:31 DEBUG [databricks.labs.ucx.source_code.python_libraries] pip output:

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
databricks-labs-ucx 0.59.1 requires databricks-sdk<0.59.0,>=0.58.0, but you have databricks-sdk 0.59.0 which is incompatible.
05:31 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.QjDe/config.yml) doesn't exist.
05:31 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:31 INFO [databricks.labs.ucx.installer.hms_lineage] HMS lineage init script already exists and enabled
05:31 INFO [databricks.labs.ucx.install] Fetching installations...
05:31 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:31 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:31 ERROR [databricks.labs.blueprint.parallel] ensure clusters running('TEST_DEFAULT_CLUSTER_ID') task failed: Cluster TEST_DEFAULT_CLUSTER_ID does not exist
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/mixins/compute.py", line 277, in ensure_cluster_is_running
    raise e
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/mixins/compute.py", line 254, in ensure_cluster_is_running
    info = self.get(cluster_id)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/compute.py", line 10971, in get
    res = self._api.do("GET", "/api/2.1/clusters/get", query=query, headers=headers)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 85, in do
    return self._api_client.do(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/_base_client.py", line 196, in do
    response = call(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 57, in wrapper
    raise err
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 36, in wrapper
    return func(*args, **kwargs)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/_base_client.py", line 298, in _perform
    raise error from None
databricks.sdk.errors.platform.ResourceDoesNotExist: Cluster TEST_DEFAULT_CLUSTER_ID does not exist
05:31 ERROR [databricks.labs.blueprint.parallel] More than half 'ensure clusters running' tasks failed: 0% results available (0/3). Took 0:00:00.109513

Running from nightly #567

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions