AI Images + Vision, Initial V2 Propeller
"Hey 45, Generate me an image of..."
I’ll try to keep the scope creep at bay but this is just too cool!
What is a “PLITS 16”!? I generated a lot more images and you can see my favorites in the gallery below. I’ll continue to work on improving the quality with a control net or upscaler. I’ll need another GPU to make this anywhere close to real time but I could add a feature to have it generate images and have them appear on my website. This will come much later if at all because the compute required might be too much. I’m using ComfyUI which has lots of flexibility so I hope I’ll be forced to learn more about AI.
Trying out MoonDreamV2
The First Image was the input and its Responses are in Blue
This is a small model meant to run on edge devices and it is very capable for its size but it gets some things wrong. The issue is if I want to run all these AI models to give my robot the functionality I set out for, I’ll need a lot of VRAM. The chatbot model, Sentiment analysis model, and whatever vision model I choose will all need to be loaded at once. Right now this would probably be fine on my 16GB 4080 because it takes about 11GB to run 45 which requires these components:
- Hermes-3-Llama-3.1-8B-6.0bpw-h6-exl2 (Chatbot)
- Faster Whisper (Speech Transcription)
- VITS (Speech Generation)
The MoonDream model tends to load 4GB into VRAM when in use so this would fit with my current setup. If I want near real time image generation in the future I would need to put in on another GPU. The Flux-Dev model I’m using loads at least 13GB into VRAM and even more into RAM.
Work on the V2 Propeller
The first CAD model is ugly like usual but I’ll make it better soon
I found a plugin that lets me generate high efficiency propellers in Fusion 360 and that is what I was trying to do here with little success. The generator only lets me make thin blades so I need to assemble them myself. It also makes the root wide instead of thicker so they are difficult to make a propeller out of. I have some ideas of how I can fix this that I’ll try next week. I also tried multiple times to print this propeller with a 0.1mm nozzle for high resolution but it got clogged every time. I think my ender 3’s extruder isn’t powerful enough to push the filament though. I might up the temperature and flow rate even more and try again. I did get it to print with a 0.4mm nozzle but it came out poor because of bed adhesion. You can see the images of this in the gallery below.
This Week's Gallery:
Plans For Next Week:
The AI images are a distraction but I’m waiting on reactor parts anyway
I want to figure out control nets so I can feed in my picture and have it put me outside the ISS in space. The career fair is coming up and an AI edited headshot would be a very cool thing to put on my resume. I will get back to work on the main project soon but I have another week before the nickel for the electrolysis reactor comes in.
Todo List:
- Figure out control nets so I can generate cool images
- Rework the propeller so it prints properly
- Try to get a 0.1mm nozzle working on my Ender 3?