Pip-compile: Could not find a version that matches dill<0.3.6,>=0.3.6
MEMBER
Thanks for reporting, @Rijgersberg.

We were waiting for the release of `dill` 0.3.6, that happened 2 days ago (24 Oct 2022): https://github.com/uqfoundation/dill/releases/tag/dill-0.3.6
- See comment: https://github.com/huggingface/datasets/pull/4397#discussion_r880629543

Also `multiprocess` 0.70.14 was released 2 days ago: https://github.com/uqfoundation/multiprocess/releases/tag/multiprocess-0.70.14

We are addressing this issue to align dependencies.
2022-10-26T07:40:51Z
https://github.com/huggingface/datasets/issues/5162#issuecomment-1291626255
https://api.github.com/repos/huggingface/datasets/issues/5162
IC_kwDODunzps5M_KcP
https://api.github.com/repos/huggingface/datasets/issues/comments/1291626255/reactions
2022-10-26T07:53:33Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1291626255
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
In your specific setup, I guess the compatible configuration is with `multiprocess` 0.70.13 (instead of 0.70.14).
2022-10-26T08:59:08Z
https://github.com/huggingface/datasets/issues/5162#issuecomment-1291720293
https://api.github.com/repos/huggingface/datasets/issues/5162
IC_kwDODunzps5M_hZl
https://api.github.com/repos/huggingface/datasets/issues/comments/1291720293/reactions
2022-10-26T08:59:08Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1291720293
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
@Rijgersberg this issue is fixed. It will be available in our next `datasets` release.
2022-10-29T07:18:35Z
https://github.com/huggingface/datasets/issues/5162#issuecomment-1295757557
https://api.github.com/repos/huggingface/datasets/issues/5162
IC_kwDODunzps5NO7D1
https://api.github.com/repos/huggingface/datasets/issues/comments/1295757557/reactions
2022-10-29T07:18:35Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1295757557
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
NONE
Thanks!
2022-10-29T15:13:21Z
https://github.com/huggingface/datasets/issues/5162#issuecomment-1295866715
https://api.github.com/repos/huggingface/datasets/issues/5162
IC_kwDODunzps5NPVtb
https://api.github.com/repos/huggingface/datasets/issues/comments/1295866715/reactions
2022-10-29T15:13:21Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1295866715
https://avatars.githubusercontent.com/u/8604946?v=4
https://api.github.com/users/Rijgersberg/events{/privacy}
https://api.github.com/users/Rijgersberg/followers
https://api.github.com/users/Rijgersberg/following{/other_user}
https://api.github.com/users/Rijgersberg/gists{/gist_id}
https://github.com/Rijgersberg
Rijgersberg
MDQ6VXNlcjg2MDQ5NDY=
https://api.github.com/users/Rijgersberg/orgs
https://api.github.com/users/Rijgersberg/received_events
https://api.github.com/users/Rijgersberg/repos
https://api.github.com/users/Rijgersberg/starred{/owner}{/repo}
https://api.github.com/users/Rijgersberg/subscriptions
User
https://api.github.com/users/Rijgersberg
public
NONE
> @Rijgersberg this issue is fixed. It will be available in our next `datasets` release.

Any chance you have a eta? 
2022-11-04T23:45:35Z
https://github.com/huggingface/datasets/issues/5162#issuecomment-1304342546
https://api.github.com/repos/huggingface/datasets/issues/5162
IC_kwDODunzps5NvrAS
https://api.github.com/repos/huggingface/datasets/issues/comments/1304342546/reactions
2022-11-04T23:45:35Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1304342546
https://avatars.githubusercontent.com/u/48621369?v=4
https://api.github.com/users/StefanSamba/events{/privacy}
https://api.github.com/users/StefanSamba/followers
https://api.github.com/users/StefanSamba/following{/other_user}
https://api.github.com/users/StefanSamba/gists{/gist_id}
https://github.com/StefanSamba
StefanSamba
MDQ6VXNlcjQ4NjIxMzY5
https://api.github.com/users/StefanSamba/orgs
https://api.github.com/users/StefanSamba/received_events
https://api.github.com/users/StefanSamba/repos
https://api.github.com/users/StefanSamba/starred{/owner}{/repo}
https://api.github.com/users/StefanSamba/subscriptions
User
https://api.github.com/users/StefanSamba
public
MEMBER
@StefanSamba we are disussing about making a release early this week.
2022-11-14T07:48:37Z
https://github.com/huggingface/datasets/issues/5162#issuecomment-1313226154
https://api.github.com/repos/huggingface/datasets/issues/5162
IC_kwDODunzps5ORj2q
https://api.github.com/repos/huggingface/datasets/issues/comments/1313226154/reactions
2022-11-14T07:48:37Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1313226154
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
@Rijgersberg, please also that you can make `pip-compile` work by using the backtracking resolver (instead of the legacy one): https://pip-tools.readthedocs.io/en/latest/#a-note-on-resolvers
```
pip-compile --resolver=backtracking requirements.in
```
This resolver will automatically use `multiprocess` 0.70.13 version. 
2022-11-14T08:25:37Z
https://github.com/huggingface/datasets/issues/5162#issuecomment-1313272156
https://api.github.com/repos/huggingface/datasets/issues/5162
IC_kwDODunzps5ORvFc
https://api.github.com/repos/huggingface/datasets/issues/comments/1313272156/reactions
2022-11-14T08:25:37Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1313272156
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
### Describe the bug

When using `pip-compile` (part of `pip-tools`) to generate a pinned requirements file that includes `datasets`, a version conflict of `dill` appears.

It is caused by a transitive dependency conflict between `datasets` and `multiprocess`.

### Steps to reproduce the bug

```bash
$ echo "datasets" > requirements.in
$ pip install pip-tools
$ pip-compile requirements.in 
Could not find a version that matches dill<0.3.6,>=0.3.6 (from datasets==2.6.1->-r requirements.in (line 1))
Tried: 0.2, 0.2, 0.2.1, 0.2.1, 0.2.2, 0.2.2, 0.2.3, 0.2.3, 0.2.4, 0.2.4, 0.2.5, 0.2.5, 0.2.6, 0.2.7, 0.2.7.1, 0.2.8, 0.2.8.1, 0.2.8.2, 0.2.9, 0.3.0, 0.3.1, 0.3.1.1, 0.3.2, 0.3.3, 0.3.3, 0.3.4, 0.3.4, 0.3.5, 0.3.5, 0.3.5.1, 0.3.5.1, 0.3.6, 0.3.6
Skipped pre-versions: 0.1a1, 0.2a1, 0.2a1, 0.2b1, 0.2b1
There are incompatible versions in the resolved dependencies:
  dill<0.3.6 (from datasets==2.6.1->-r requirements.in (line 1))
  dill>=0.3.6 (from multiprocess==0.70.14->datasets==2.6.1->-r requirements.in (line 1))
```

### Expected behavior

A correctly generated file `requirements.txt` with pinned dependencies

### Environment info

Tested with versions `2.6.1, 2.6.0, 2.5.2` on Python 3.8 and 3.10 on Ubuntu 20.04LTS and Python 3.10 on MacOS 12.6 (M1).