HartyBart posted at 5:41 AM Wed, 3 January 2024 - #4479927

Stable Diffusion is Python, Poser is Python. So, let the Poser and SD talk to each other. By simply allowing any third-party script to be plugged into Poser's PostFX. That's the obvious choice, and then after that the Poser developers don't have to wrangle with AI. I'm sure they have enough to do, and don't want to be 'chasing the tail' of AI.

For instance... I plug a script into PostFX to let me send my basic Poser render to Stable Diffusion Controlnets (Canny, Depth and Openpose), with one click, for the "SD render". Someone more Python-y than me could probably rig up a normal script to do that anyway, once the SD UI's can also be officially scripted ('take renders from Poser, slot them in here, here and here, set SD sliders to my 'Poser preset', then generate an image'). Of course that can be done manually, but it's a of fiddly pixel-size input, clicks and dragging. It would be nice to have it done automatically via PostFX.

Another option might be to add the equivalent of PostFX to Poser's Comic Book Preview panel. In the form of a simple radio button... "And make it look Pro!", by sending the real-time render over to be re-generated in a special comics-art SD model. Again, one can do that already manually, but it would be nice to have a one-click option.

Your idea of adding textured primitives to the scene, via a simple SD text prompt, is a good one. Though bear in mind that SD itself will be able to do that. There's already one special SD model in which you can basically say "keep the scene the same, but just add a glowing blue 3D orb above the head of the figure". And it just changes that one thing.

As I've mentioned before, Renderosity could consider buying out Ken's Openpose plugin and making it free with Poser 14. It would get the AI crowd thinking about using Poser, especially if it was also bundled free with the $50 Poser 13 (I assume another perma-deal on the earlier version of Poser, as before). The buyout might be in the form of giving Ken $2 on every sale of the $50 Poser 13, so there might be no up-front buyout cost.

The Python API does seem like the obvious choice.  There are still plenty of critical things that can't be done with it.  It's not quite as extensive as Blender's API.

Along those lines, it might be nice to improve the performance and reach of the Python API.  Then things like this would be simple.

I have Ken's plugin.  I'm waiting for my new Mac so I can run odyssey which gives me a nice node based AI workflow tool.  Into which I can plug Ken's output.  Poser makes it quick to pose, which is the essential of keyframing.  I've talked to Odyssey and external nodes are on their roadmap.  That is, node that can be attached to via an API to accept input and deliver output.  

Ala, my poor 18 core iMac Pro is not optimal for AI.  An m3Pro gives me the ML silicon I need for AI stuff :)