POV-Ray : Newsgroups : povray.animations : Scripts for Controlling a Render Farm Server Time: 30 Mar 2020 14:29:35 GMT
  Scripts for Controlling a Render Farm (Message 1 to 10 of 10)  
From: Steve Anger
Subject: Scripts for Controlling a Render Farm
Date: 30 Jan 2020 14:50:01
Message: <web.5e32ec85d288f9963774b87b0@news.povray.org>
I'm just getting ready to write up some scripts to automatically distribute an
animation job between a number of Windows computers (probably Azure VM's).
Before I get too far I thought I'd check if someone else has set something like
this up already.

Up to now I've been manually creating a separate .INI file for each machine and
assigning it a portion of the job based on the machine's speed. This gets a bit
tedious after a while and makes it difficult to add and remove computers on the
fly.


Post a reply to this message

From: Steve Anger
Subject: Re: Scripts for Controlling a Render Farm
Date: 30 Jan 2020 16:30:00
Message: <web.5e33035f31cc7d453774b87b0@news.povray.org>
I've hit my first glitch in this process. Years ago I did something similar by
having a script call povray.exe for each frame to render. povray.exe would not
exit until the render of the frame was complete. After povray.exe returned the
script could pick the next frame to render and continue. The current
pvengine32/64.exe program runs asynchronously and returns immediately so the
script can't tell when the render is finished. Also, once pvengine is open you
can't call it again with another .ini file to start another frame.

Any ideas?


Post a reply to this message

From: jr
Subject: Re: Scripts for Controlling a Render Farm
Date: 30 Jan 2020 17:35:01
Message: <web.5e3313ad31cc7d4528c55bc90@news.povray.org>
hi,

"Steve Anger" <nomail@nomail> wrote:
> I've hit my first glitch in this process. Years ago I did something similar by
> having a script call povray.exe for each frame to render. povray.exe would not
> exit until the render of the frame was complete. After povray.exe returned the
> script could pick the next frame to render and continue. The current
> pvengine32/64.exe program runs asynchronously and returns immediately so the
> script can't tell when the render is finished. Also, once pvengine is open you
> can't call it again with another .ini file to start another frame.
>
> Any ideas?

on a *nix-like box, your script could, for instance, use 'ps' to see whether
POV-Ray is still running.  maybe the Windows Ubuntu sub-system thing provides
such tools?


regards, jr.


Post a reply to this message

From: Steve Anger
Subject: Re: Scripts for Controlling a Render Farm
Date: 30 Jan 2020 17:55:00
Message: <web.5e33183731cc7d453774b87b0@news.povray.org>
"jr" <cre### [at] gmailcom> wrote:
> hi,
>
> "Steve Anger" <nomail@nomail> wrote:
> > I've hit my first glitch in this process. Years ago I did something similar by
> > having a script call povray.exe for each frame to render. povray.exe would not
> > exit until the render of the frame was complete. After povray.exe returned the
> > script could pick the next frame to render and continue. The current
> > pvengine32/64.exe program runs asynchronously and returns immediately so the
> > script can't tell when the render is finished. Also, once pvengine is open you
> > can't call it again with another .ini file to start another frame.
> >
> > Any ideas?
>
> on a *nix-like box, your script could, for instance, use 'ps' to see whether
> POV-Ray is still running.  maybe the Windows Ubuntu sub-system thing provides
> such tools?
>
>
> regards, jr.

Unfortunately the pvengine never terminates unless the user manually close it.


Post a reply to this message

From: jr
Subject: Re: Scripts for Controlling a Render Farm
Date: 30 Jan 2020 18:10:00
Message: <web.5e331b7031cc7d4528c55bc90@news.povray.org>
hi,

"Steve Anger" <nomail@nomail> wrote:
> "jr" <cre### [at] gmailcom> wrote:
> > "Steve Anger" <nomail@nomail> wrote:
> > > ...
> > > Any ideas?
> >
> > on a *nix-like box, your script could, for instance, use 'ps' to see whether
> > POV-Ray is still running.  maybe the Windows Ubuntu sub-system thing provides
> > such tools?
> >
> > regards, jr.
>
> Unfortunately the pvengine never terminates unless the user manually close it.

not even when your ini file contains 'pause_when_done = off' ?


regards, jr.


Post a reply to this message

From: Bald Eagle
Subject: Re: Scripts for Controlling a Render Farm
Date: 30 Jan 2020 19:00:00
Message: <web.5e33269031cc7d454eec112d0@news.povray.org>
"Steve Anger" <nomail@nomail> wrote:

> Unfortunately the pvengine never terminates unless the user manually close it.

Can you use something like:

Post_Scene_Command=taskkill /f pvengine32/64.exe

in your .ini?

http://wiki.povray.org/content/Reference:Shell_Command_Options#Shell_Command_Sequencing

https://techieinspire.com/how-to-start-and-end-or-kill-process-using-dos-command-prompt/


Post a reply to this message

From: Dick Balaska
Subject: Re: Scripts for Controlling a Render Farm
Date: 30 Jan 2020 23:21:40
Message: <5e336504$1@news.povray.org>
Am 1/30/20 12:53 PM, also sprach Steve Anger:
> "jr" <cre### [at] gmailcom> wrote:
>> hi,
>>
>> "Steve Anger" <nomail@nomail> wrote:
>>> I've hit my first glitch in this process. Years ago I did something similar by
>>> having a script call povray.exe for each frame to render. povray.exe would not
>>> exit until the render of the frame was complete. After povray.exe returned the
>>> script could pick the next frame to render and continue. The current
>>> pvengine32/64.exe program runs asynchronously and returns immediately so the
>>> script can't tell when the render is finished. Also, once pvengine is open you
>>> can't call it again with another .ini file to start another frame.
>>>
>>> Any ideas?
>>
>> on a *nix-like box, your script could, for instance, use 'ps' to see whether
>> POV-Ray is still running.  maybe the Windows Ubuntu sub-system thing provides
>> such tools?
>>
>>
>> regards, jr.
> 
> Unfortunately the pvengine never terminates unless the user manually close it.
> 
> 
> 

I have povconsole.exe which does what you want.  A gui-less version that 
I drive from my renderfarm.  It's a little old since I switched my farm 
to all linux and haven't needed to update it.
http://www.buckosoft.com/povclipse2/povray/

-- 
dik
Rendered 49,882,521,600 of 49,882,521,600 pixels (100%)


Post a reply to this message

From: Steve Anger
Subject: Re: Scripts for Controlling a Render Farm
Date: 31 Jan 2020 14:35:00
Message: <web.5e343a5f31cc7d453774b87b0@news.povray.org>
Dick Balaska <dic### [at] buckosoftcom> wrote:

> I have povconsole.exe which does what you want.  A gui-less version that
> I drive from my renderfarm.  It's a little old since I switched my farm
> to all linux and haven't needed to update it.
> http://www.buckosoft.com/povclipse2/povray/
>
> --
> dik
> Rendered 49,882,521,600 of 49,882,521,600 pixels (100%)

Was there an official source release for that or was it a version you customized
yourself? I need to use povray-3.8.0 since it corrects a rendering bug that
existed in the older versions. If you have the source I could update it with the
latest code.


Post a reply to this message

From: Dick Balaska
Subject: Re: Scripts for Controlling a Render Farm
Date: 31 Jan 2020 15:54:36
Message: <5e344dbc$1@news.povray.org>
Am 1/31/20 9:31 AM, also sprach Steve Anger:
> Dick Balaska <dic### [at] buckosoftcom> wrote:
> 
>> I have povconsole.exe which does what you want.  A gui-less version that
>> I drive from my renderfarm.  It's a little old since I switched my farm
>> to all linux and haven't needed to update it.
>> http://www.buckosoft.com/povclipse2/povray/
>>
>> --
>> dik
>> Rendered 49,882,521,600 of 49,882,521,600 pixels (100%)
> 
> Was there an official source release for that or was it a version you customized
> yourself? I need to use povray-3.8.0 since it corrects a rendering bug that
> existed in the older versions. If you have the source I could update it with the
> latest code.
> 
> 
> 

It is the official source.

 From memory, so I'm likely wrong:
In VS2015 load povray.sln.  Enable subproject Console, disable 
subproject Gui.
Build it.
It will complain that you need to #define _CONSOLE somewhere, and tell 
you where. (Hint: in my copy it's at
windows/povconfig/syspovconfig.h:54:// _CONSOLE must be defined when 
building the console version of POVWIN.
windows/povconfig/syspovconfig.h:56:// #define _CONSOLE
)
So do that and rebuild.

et voilà!

-- 
dik
Rendered 49,882,521,600 of 49,882,521,600 pixels (100%)


Post a reply to this message

From: Steve Anger
Subject: Re: Scripts for Controlling a Render Farm
Date: 1 Feb 2020 19:55:06
Message: <web.5e35d70031cc7d453774b87b0@news.povray.org>
> It is the official source.
>
>  From memory, so I'm likely wrong:
> In VS2015 load povray.sln.  Enable subproject Console, disable
> subproject Gui.
> Build it.
> It will complain that you need to #define _CONSOLE somewhere, and tell
> you where. (Hint: in my copy it's at
> windows/povconfig/syspovconfig.h:54:// _CONSOLE must be defined when
> building the console version of POVWIN.
> windows/povconfig/syspovconfig.h:56:// #define _CONSOLE
> )
> So do that and rebuild.
>
> et voilà!
>
> --
> dik
> Rendered 49,882,521,600 of 49,882,521,600 pixels (100%)

Sounds great. Thanks!


Post a reply to this message

Copyright 2003-2008 Persistence of Vision Raytracer Pty. Ltd.