james/MikuAI
1
0
Fork 0
Code Issues 9 Pull Requests 2 Packages Projects Releases Wiki Activity

Multimodal Model #6

New Issue
Open
opened 2024-12-17 23:46:28 +00:00 by james · 2 comments
james commented 2024-12-17 23:46:28 +00:00
Owner
Copy Link

Specifically, I want to try unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit.

Specifically, I want to try `unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit`.
james added the
enhancement
 label 2024-12-17 23:46:28 +00:00
james commented 2025-01-03 04:21:03 +00:00
Author
Owner
Copy Link

figure out if second model entirely is needed for vision, or if it’s possible to train vision models on datasets without images

figure out if second model entirely is needed for vision, or if it’s possible to train vision models on datasets without images
james commented 2025-01-03 09:23:23 +00:00
Author
Owner
Copy Link

when a message is sent to miku with an image, we can just have it infer an image description and offer it as context in the longer langchain instruct prompt; #9

when a message is sent to miku with an image, we can just have it infer an image description and offer it as context in the longer langchain instruct prompt; #9
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
Something is not working
duplicate
This issue or pull request already exists
enhancement
New feature
help wanted
Need some help
invalid
Something is wrong
question
More information is needed
wontfix
This won't be fixed
No Label
enhancement
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: james/MikuAI#6
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?