compile error on linux with cuda 12.1

[kforkkk]

I use a container created from nvidia/cuda:12.1.0-cudnn8-devel-ubuntu22.04 image.
python :3.10.15

Then i build it from source using

but when i "make", i got the problem below when i simply use pip to install bitsandbytes, i keep getting the traceback , which sugguests building bitsandbytes from source. What should i do to fix this

[matthewdouglas]

Hi,

What GPU are you targeting? I'm guessing it's trying to build for e.g. Maxwell by default which isn't supported anymore.
I would recommend limiting to compile to target that specific GPU(s) you need with e.g.

-DCOMPUTE_CAPABILITY=80

You can build for multiple with a semi-colon separated list:

Use 60 or 61 for Pascal cards like P100, GTX 1080, etc.
Use 70 for V100.
Use 75 for Turing, such as T4, RTX 2080, etc.
Use 80 for A100.
Use 86 for other Ampere such as A10, RTX 3090, etc.
Use 89 for Ada such as L4, L40S, RTX 4090, etc.
Use 90 for Hopper.
Use 100 for B200
Use 120 for consumer Blackwell such as RTX 5090.