If you are having trouble following the installation instructions in the README, Reddit user Technical_Leather949 has created a more detailed, step-by-step guide covering:
The guide can be found here: https://www.reddit.com/r/LocalLLaMA/comments/11o6o3f/how_to_install_llama_8bit_and_4bit/