james/MikuAI
1
0
Fork 0
Code Issues 9 Pull Requests 2 Packages Projects Releases Wiki Activity

Quantization #4

New Issue
Open
opened 2024-12-05 10:13:22 +00:00 by james · 1 comment
james commented 2024-12-05 10:13:22 +00:00
Owner
Copy Link

We can give her a larger model and make her smarter!

We can give her a larger model and make her smarter!
james added the
enhancement
 label 2024-12-05 10:13:22 +00:00
james commented 2024-12-06 03:39:39 +00:00
Author
Owner
Copy Link

Currently uses 4-bit quantization with load_in_4bit flag, and the RVC model is loaded in float16 format

Currently uses 4-bit quantization with load_in_4bit flag, and the RVC model is loaded in float16 format
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
Something is not working
duplicate
This issue or pull request already exists
enhancement
New feature
help wanted
Need some help
invalid
Something is wrong
question
More information is needed
wontfix
This won't be fixed
No Label
enhancement
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: james/MikuAI#4
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?