Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

remove unused 'joblib' and 'numba' dependencies, other packaging cleanup #2532

Merged
merged 3 commits into from
Jan 7, 2025

Conversation

jameslamb
Copy link
Member

@jameslamb jameslamb commented Dec 17, 2024

Proposes some cleanup of packaging details, noticed while I was working on #2531

  • removes runtime dependencies on joblib and numba for raft-dask
    • raft-dask doesn't directly import from these libraries, and the git blame didn't suggest any other reason that they were being pinned here
    • *checked with git grep -E 'joblib|numba'
  • removes setup.cfg files
    • these are currently being ignored by tools, in favor of identical configuration in pyproject.toml and .flake8 files
    • e.g.
      - id: black
      files: python/.*
      # Explicitly specify the pyproject.toml at the repo root, not per-project.
      args: ["--config", "pyproject.toml"]
  • packages license files in conda packages
  • removes some outdated / inaccurate comments in packaging configs

@jameslamb jameslamb added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Dec 17, 2024
Copy link

copy-pr-bot bot commented Dec 17, 2024

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@jameslamb jameslamb added the 2 - In Progress Currenty a work in progress label Dec 17, 2024
@jameslamb
Copy link
Member Author

/ok to test

@jameslamb jameslamb changed the title WIP: remove unused 'joblib' and 'numba' dependencies, other packaging cleanup remove unused 'joblib' and 'numba' dependencies, other packaging cleanup Dec 17, 2024
@jameslamb jameslamb removed the 2 - In Progress Currenty a work in progress label Dec 17, 2024
@jameslamb jameslamb marked this pull request as ready for review December 17, 2024 21:53
@jameslamb jameslamb requested review from a team as code owners December 17, 2024 21:53
@jameslamb jameslamb requested a review from msarahan December 17, 2024 21:53
Copy link
Contributor

@bdice bdice left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! It seems like setup.cfg is mostly duplicating the settings we already have in pyproject.toml, so I assume this was an oversight and not removed earlier. Either way the final state looks good to me.

seberg pushed a commit to rapidsai/legate-raft that referenced this pull request Dec 30, 2024
Came here looking to remove the `setup.cfg` file, inspired by
rapidsai/raft#2532.

But this PR uncovered a few other packaging things to be cleaned up.
Proposes:

* removing `Cython` dependency
* aligning `cmake_minimum_required()` version with the one from the
conda recipe, and with what RAPIDS has been using for the last few
releases
* removing `maptlolib` dependency for benchmarks

## Notes for Reviewers

### How is it safe to remove `Cython`?

As far as I can tell, this project doesn't have any Cython code. It is
building a shared library and then loading it with `ctypes`:


https://github.com/rapidsai/legate-raft/blob/3260952df5cc09fe356ccf07e8832070f1029abb/legate_raft/library.py#L21-L26

Signed-off-by: James Lamb <[email protected]>
@jameslamb jameslamb removed the request for review from msarahan December 31, 2024 18:43
rapids-bot bot pushed a commit to rapidsai/cuvs that referenced this pull request Jan 7, 2025
Similar to rapidsai/raft#2532, this proposes some small packaging cleanup.

* removes `setup.cfg` files
   - *these are currently being ignored by tools, in favor of identical configuration in `pyproject.toml` and `.flake8` files*
   - e.g. https://github.com/rapidsai/cuvs/blob/b3ce774d39e149d4e34c401068f24136eac44e13/.pre-commit-config.yaml#L31-L35
* alphabetizes dependency lists in `dependencies.yaml`
* changes `cupy:` group in `dependencies.yaml` to `depends_on_cupy:` (for consistency with other dependencies)

Authors:
  - James Lamb (https://github.com/jameslamb)

Approvers:
  - Vyas Ramasubramani (https://github.com/vyasr)
  - Micka (https://github.com/lowener)

URL: #544
Copy link
Member

@cjnolet cjnolet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM no concerns from my end.

@jameslamb
Copy link
Member Author

/merge

@rapids-bot rapids-bot bot merged commit 8fc988e into rapidsai:branch-25.02 Jan 7, 2025
71 checks passed
@jameslamb jameslamb deleted the remove-unused-deps branch January 7, 2025 21:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
improvement Improvement / enhancement to an existing function non-breaking Non-breaking change python
Projects
Development

Successfully merging this pull request may close these issues.

4 participants