POV-Ray : Newsgroups : povray.general : JCGrid (a tools for POVRay rendering on clusters) Server Time
3 Aug 2024 08:10:56 EDT (-0400)
  JCGrid (a tools for POVRay rendering on clusters) (Message 6 to 15 of 15)  
<<< Previous 5 Messages Goto Initial 10 Messages
From: David Bucciarelli
Subject: Re: JCGrid (a tools for POVRay rendering on clusters)
Date: 29 May 2004 11:35:59
Message: <40b8addf$1@news.povray.org>
David Bucciarelli wrote:
> I have written a tool for POVRay rendering on clusters. The name of the 
> tool is JCGrid. Thanks to JCGrid, you can use as many 
> Workstations/PCs/Macs as you like for the rendering of a single POVRay 
> image.
< [...]
> The homepage is at http://jcgrid.sourceforge.net/
> You can download sources and binaries from: 
> http://sourceforge.net/project/showfiles.php?group_id=109146

Version 0.03 is now available.

Change log since 0.02: JCGridWorker can now run multiple workers (useful 
on SMP); Investigated the "Failed to execute" problem under RedHat 9.0; 
Grid statistics can be accessed by using the GUI; Grid statistics are 
now available; Grid administration mechanism is now available; New class 
design in the server package; The GUI client for POVRay now supports 
partial image rendering; Written a GUI client for POVRay.

Since 0.01:  Written installation instruction for Windows; Will 
Lloyd-Davies has written the scripts for using JCGrid with POVRay under 
Windows; Docs are now included in binary releases.

David Bucciarelli
Pisa
Italy


Post a reply to this message

From: Dennis Miller
Subject: Re: JCGrid (a tools for POVRay rendering on clusters)
Date: 31 May 2004 10:20:22
Message: <40bb3f26$1@news.povray.org>
Hi, How well will this work for animations across, say 150 computers?
Thanks,
Dennis
"David Bucciarelli" <dav### [at] tinit> wrote in message
news:40b8addf$1@news.povray.org...
> David Bucciarelli wrote:
> > I have written a tool for POVRay rendering on clusters. The name of the
> > tool is JCGrid. Thanks to JCGrid, you can use as many
> > Workstations/PCs/Macs as you like for the rendering of a single POVRay
> > image.
> < [...]
> > The homepage is at http://jcgrid.sourceforge.net/
> > You can download sources and binaries from:
> > http://sourceforge.net/project/showfiles.php?group_id=109146
>
> Version 0.03 is now available.
>
> Change log since 0.02: JCGridWorker can now run multiple workers (useful
> on SMP); Investigated the "Failed to execute" problem under RedHat 9.0;
> Grid statistics can be accessed by using the GUI; Grid statistics are
> now available; Grid administration mechanism is now available; New class
> design in the server package; The GUI client for POVRay now supports
> partial image rendering; Written a GUI client for POVRay.
>
> Since 0.01:  Written installation instruction for Windows; Will
> Lloyd-Davies has written the scripts for using JCGrid with POVRay under
> Windows; Docs are now included in binary releases.
>
> David Bucciarelli
> Pisa
> Italy


Post a reply to this message

From: David Bucciarelli
Subject: Re: JCGrid (a tools for POVRay rendering on clusters)
Date: 31 May 2004 11:26:44
Message: <40bb4eb4@news.povray.org>
Dennis Miller wrote:
> Hi, How well will this work for animations across, say 150 computers?

The larger grid I have ever used until today includes 8 nodes: 3xDual 
Athlon SMP and 2xPC. It is something very small compared to one with 150 
nodes so the true answer is: I don't know :-)

Anyway, I don't see why it shouldn't work. The performances of a so 
large grid will be highly related to the amount of data (.pov files, 
etc.) JCGrid needs to transfer between the server and the nodes for the 
rendering.

JCGrid uses a centralized model (1 server, many workers) and this model 
can not scale up infinitely. However the limit can be very high for a 
time consuming task like rendering.

In a grid with 150 nodes, if the rendering of a single image fragment 
requires 3 minutes, the server will have to handle something like 1 or 2 
requests for seconds (a low load for a good workstation). More time 
requires the rendering of the single image fragment and less load the 
server has to handle.

I would really like to run a test on a 150 nodes grid.

David Bucciarelli
Pisa
Italy


Post a reply to this message

From: stephen parkinson
Subject: Re: JCGrid (a tools for POVRay rendering on clusters)
Date: 1 Jun 2004 03:38:15
Message: <40bc3267@news.povray.org>
David Bucciarelli wrote:
> David Bucciarelli wrote:
> 
>> I have written a tool for POVRay rendering on clusters. The name of 
>> the tool is JCGrid. Thanks to JCGrid, you can use as many 
>> Workstations/PCs/Macs as you like for the rendering of a single POVRay 
>> image.
> 
> < [...]
> 
>> The homepage is at http://jcgrid.sourceforge.net/
>> You can download sources and binaries from: 
>> http://sourceforge.net/project/showfiles.php?group_id=109146
> 
> 
> Version 0.03 is now available.
> 
i seem to have a couple of minor problems,

first was a classpath error, but did a re-install of j2sdk1.4.2, seems 
to have gone now (rtfm next time) - works now on dual p3-1ghz, now to 
fix the xeon :-)
xeon now ok

second is
edited the .sh scripts for server/worker/client and fired them off

box sizes in gui are rather squished, in particularly the host and 
session name boxes

using the gui to select an ini file, browse to /usr/share/povray-3.5/ini 
and select allscene.ini, gives "-3.5/ini/allstill.ini" on clicking ok

should give "/usr/share/povray-3.5/ini/allscene.ini"

another silly suggestion, check if JAVA_HOME is none null before 
configuring as /opt.... ?

looking better

in the scripts i see the server option as
  -server org.homedns.dade.jcgrid.cmd.povray.JCGridServer

is there an explanation of what this does?
should it be something different on home network of 
[amd32|xeon|dual|zmemw16].lan.uk hosts

on a network do i only run a server on one host or on all? i suspect one
is the answer

a thought occurs that this is the -server field, so if i run 
jcgrid-server on xeon.lan.uk -  if i then run server on other hosts, do 
i need
something along lines of
-server xeon.lan.uk or export JCGRID_SERVER_NAME=xeon.lan.uk

where does the rest of it "jcgrid.cmd.povray.JCGridServer" come from
or is it specific for your setup?


ok i have three machines for doing this, povray available on all

xeon.lan.uk - best box
amd32.lan.uk
zmemw16.lan.uk

server on xeon or all?
client or clients on each ?
workers on all?

any chance of a structure diagram for such a setup, useful for a 
tutorial :-)

slightly confused set of questions i'm afraid, but i'm slightly confused
as to the topology(sp?)/structure of this

stephen


Post a reply to this message

From: David Bucciarelli
Subject: Re: JCGrid (a tools for POVRay rendering on clusters)
Date: 1 Jun 2004 10:24:39
Message: <40bc91a7@news.povray.org>
stephen parkinson wrote:
> David Bucciarelli wrote:
>> Version 0.03 is now available.
>>
> i seem to have a couple of minor problems,
> 
> first was a classpath error, but did a re-install of j2sdk1.4.2, seems 
> to have gone now (rtfm next time) - works now on dual p3-1ghz, now to 
> fix the xeon :-)
> xeon now ok
> 
> second is
> edited the .sh scripts for server/worker/client and fired them off
> 
> box sizes in gui are rather squished, in particularly the host and 
> session name boxes

This could be related to your system default font (larger than mine I 
guess). Anyway the default window size should be larger and it will be 
larger in next release. BTW, you can resize the window.

> using the gui to select an ini file, browse to /usr/share/povray-3.5/ini 
> and select allscene.ini, gives "-3.5/ini/allstill.ini" on clicking ok
> 
> should give "/usr/share/povray-3.5/ini/allscene.ini"

This one looks like a bug, I will check.

> another silly suggestion, check if JAVA_HOME is none null before 
> configuring as /opt.... ?
> 
> looking better
> 
> in the scripts i see the server option as
>  -server org.homedns.dade.jcgrid.cmd.povray.JCGridServer
> 
> is there an explanation of what this does?

"-server" is an option of the java virtual machine. It should give some 
performace advantage for server-like applications. It is an 
optimization, it is not strictly required.

"org.hmedns.dade.jcgrid.cmd.povray.JCGridServer" is the name of the 
class (a file with Java code) to run (if you unzip the jcgrid.jar 
archive, you will find a file named 
org/homedns/dade/jcgrid/cmd/povray/JCGridServer.class")

The two keywords are not related.

> should it be something different on home network of 
> [amd32|xeon|dual|zmemw16].lan.uk hosts

No, it is just the name of a file (it is the java way to name packages). 
It is not related to the workstation where you run the software.

> ok i have three machines for doing this, povray available on all
> 
> xeon.lan.uk - best box
> amd32.lan.uk
> zmemw16.lan.uk
> 
> server on xeon or all?
> client or clients on each ?
> workers on all?

I suggest you:

- One Server on Xeon;
- Workers on all (don't forget to set JCGRID_WOKER_CPU=4 on dual xeon 
and JCGRID_WOKER_CPU=2 on dual PentiumIII);
- Clients on any host where you want to use JCGrid/POVRay for rendering.

Run a client and the rendering will be splitted among the 7 workers 
available on your grid.

Let me know if it is still unclear.

David Bucciarelli
Pisa - Italy


Post a reply to this message

From: David Bucciarelli
Subject: Re: JCGrid (a tools for POVRay rendering on clusters)
Date: 17 Jun 2004 11:21:33
Message: <40d1b6fd@news.povray.org>
David Bucciarelli wrote:
> David Bucciarelli wrote:
> 
>> I have written a tool for POVRay rendering on clusters. The name of 
>> the tool is JCGrid. Thanks to JCGrid, you can use as many 
>> Workstations/PCs/Macs as you like for the rendering of a single POVRay 
>> image.
> 
> < [...]
> 
>> The homepage is at http://jcgrid.sourceforge.net/
>> You can download sources and binaries from: 
>> http://sourceforge.net/project/showfiles.php?group_id=109146

Version 0.04 is now available.

Change log since 0.03:
- Introduced animation support. You can now split rendering of fragments 
of a single frame and/or complete frames (better to split complete frame 
in order to avoid preprocessing overhead);
- POVRay 3.6 has fixed the "Failed to execute" problem;
- New POVRay client implementation;
- POVRay worker now use stdout instead of temporary file for the 
rendered image;
- Written session name autogeneration;
- New confguration file format;
- New confguration GUI dialogs;
- New confguration class design;
- The "Failed to execute" problem under RedHat 9.0 happens because
of a coredump when the DISPLAY env. variable is not defined;
- Adam Wells reports JCGrid works fine under MacOS X 10.3.4.

David Bucciarelli
Pisa - Italy


Post a reply to this message

From: David Bucciarelli
Subject: Re: JCGrid (a tools for POVRay rendering on clusters)
Date: 6 Jul 2004 04:11:12
Message: <40ea5ea0@news.povray.org>
David Bucciarelli wrote:
> David Bucciarelli wrote:
>
>> I have written a tool for POVRay rendering on clusters. The name of 
>> the tool is JCGrid. Thanks to JCGrid, you can use as many 
>> Workstations/PCs/Macs as you like for the rendering of a single 
>> POVRay image.
>
>
> < [...]
>
>> The homepage is at http://jcgrid.sourceforge.net/
>> You can download sources and binaries from: 
>> http://sourceforge.net/project/showfiles.php?group_id=109146


Version 0.05 is now available.

Change log since 0.04:

- POVRay support now works fine with POVRay 3.6 for Windows;
- Written WebStart support for JCGrid Mandel;
- Written the first version of JCGrid Mandel. Mandelbrot set rendering 
done over public grid computing. You can share your CPU time for fast 
exploring the Mandelbrot set;
- Fixed a problem related to POVRay fragment images under Windows;
- Added a developpers section to the docs;
- Added more information about the grid in the administration;
- Added compressed communication channel;
- VFS can be now disabled (mainly for security);

David Bucciarelli
Pisa - Italy


Post a reply to this message

From: weirdboy84
Subject: Re: JCGrid (a tools for POVRay rendering on clusters)
Date: 20 Oct 2004 04:20:00
Message: <web.41761f3e82fded22ec75817c0@news.povray.org>
Hi.. i had encounter some errors while running the static picture using
JCgrid ver 0.0.5.

2004-10-15 17:08:44,859 [main] WARN   Error while parsing command line
org.apache.commons.cli.MissingArgumentException: no argument for:d
 at org.apache.commons.cli.Parser.processArgs(Parser.java:239)
 at org.apache.commons.cli.Parser.processOption(Parser.java:277)
 at org.apache.commons.cli.Parser.parse(Parser.java:170)
 at org.apache.commons.cli.Parser.parse(Parser.java:114)
 at org.homedns.dade.jcgrid.cmd.MainCmd.parseCommonOptions(MainCmd.java:89)
 at
org.homedns.dade.jcgrid.cmd.povray.JCGridClient.main(JCGridClient.java:208)

this is the errors i got. The server and worker were working fine. But
whenever i use povray-guiclient-go batch file and render one of my static
picture, it render till 51% and stop and pop out the above error in my
worker. Needed help badly. Many thanks.


Post a reply to this message

From: weirdboy84
Subject: Re: JCGrid (a tools for POVRay rendering on clusters)
Date: 22 Oct 2004 03:20:00
Message: <web.4178b3ab82fded22ec75817c0@news.povray.org>
A few changes to the previous post.

2004-10-15 17:08:44,859 [main] WARN   Error while parsing command line
org.apache.commons.cli.MissingArgumentException: no argument for:d
 at org.apache.commons.cli.Parser.processArgs(Parser.java:239)
 at org.apache.commons.cli.Parser.processOption(Parser.java:277)
 at org.apache.commons.cli.Parser.parse(Parser.java:170)
 at org.apache.commons.cli.Parser.parse(Parser.java:114)
 at org.homedns.dade.jcgrid.cmd.MainCmd.parseCommonOptions(MainCmd.java:89)
 at
org.homedns.dade.jcgrid.cmd.povray.JCGridClient.main(JCGridClient.java:208)

this is the errors i got is when i open povray-client-go, not worker.


59665 2004-10-22 10:01:54,698 [Thread-0] WARN   Working for: desk
59745 2004-10-22 10:01:54,778 [Thread-0] WARN   VFS starting on path:
C:Documents and
Settingsadministrator.RENDERGRIDDesktopjcgrid-workercache_0desk
59765 2004-10-22 10:01:54,798 [Thread-0] WARN   VFS updating: C:Documents
and Settingsadministrator.RENDERGRIDDesktopjcgrid-workercache_0deskdesk.ini
60716 2004-10-22 10:01:55,749 [Thread-0] WARN   VFS updating: C:Documents
and Settingsadministrator.RENDERGRIDDesktopjcgrid-workercache_0deskdesk.pov
61067 2004-10-22 10:01:56,100 [Thread-0] WARN   VFS session cache size:
0/64MB
61577 2004-10-22 10:01:56,610 [Thread-0] WARN   Error in
WorkerThread.run.loop()
java.io.IOException: CreateProcess: C:programmipovray-3.6binpvengine.exe
/exit /render -V -D +W392 +H250 +SC129 +EC192 +SR1 +ER40 +FP "+OC:Documents
and
Settingsadministrator.RENDERGRIDDesktopjcgrid-workercache_0deskjcgrid-worker-tmp-img-file.ppm"
desk.ini error=3
 at java.lang.Win32Process.create(Native Method)
 at java.lang.Win32Process.<init>(Win32Process.java:66)
 at java.lang.Runtime.execInternal(Native Method)
 at java.lang.Runtime.exec(Runtime.java:566)
 at org.homedns.dade.jcgrid.util.ConsoleCmd.run(ConsoleCmd.java:132)
 at
org.homedns.dade.jcgrid.worker.impl.povray.POVWorker.doWork(POVWorker.java:131)
 at org.homedns.dade.jcgrid.worker.WorkerThread.run(WorkerThread.java:113)

this is the errors in the workers. Needed help asap. Many Thanks!


Post a reply to this message

From: Ross
Subject: Re: JCGrid (a tools for POVRay rendering on clusters)
Date: 22 Oct 2004 14:42:16
Message: <41795488$1@news.povray.org>
"weirdboy84" <wei### [at] hotmailcom> wrote in message
news:web.4178b3ab82fded22ec75817c0@news.povray.org...
> A few changes to the previous post.
>
> 2004-10-15 17:08:44,859 [main] WARN   Error while parsing command line
> org.apache.commons.cli.MissingArgumentException: no argument for:d
>  at org.apache.commons.cli.Parser.processArgs(Parser.java:239)
>  at org.apache.commons.cli.Parser.processOption(Parser.java:277)
>  at org.apache.commons.cli.Parser.parse(Parser.java:170)
>  at org.apache.commons.cli.Parser.parse(Parser.java:114)
>  at
org.homedns.dade.jcgrid.cmd.MainCmd.parseCommonOptions(MainCmd.java:89)
>  at
>
org.homedns.dade.jcgrid.cmd.povray.JCGridClient.main(JCGridClient.java:208)
>
> this is the errors i got is when i open povray-client-go, not worker.
>
>
> 59665 2004-10-22 10:01:54,698 [Thread-0] WARN   Working for: desk
> 59745 2004-10-22 10:01:54,778 [Thread-0] WARN   VFS starting on path:
> C:Documents and
> Settingsadministrator.RENDERGRIDDesktopjcgrid-workercache_0desk
> 59765 2004-10-22 10:01:54,798 [Thread-0] WARN   VFS updating: C:Documents
> and
Settingsadministrator.RENDERGRIDDesktopjcgrid-workercache_0deskdesk.ini
> 60716 2004-10-22 10:01:55,749 [Thread-0] WARN   VFS updating: C:Documents
> and
Settingsadministrator.RENDERGRIDDesktopjcgrid-workercache_0deskdesk.pov
> 61067 2004-10-22 10:01:56,100 [Thread-0] WARN   VFS session cache size:
> 0/64MB
> 61577 2004-10-22 10:01:56,610 [Thread-0] WARN   Error in
> WorkerThread.run.loop()
> java.io.IOException: CreateProcess: C:programmipovray-3.6binpvengine.exe
> /exit /render -V -D +W392 +H250 +SC129 +EC192 +SR1 +ER40 +FP
"+OC:Documents
> and
>
Settingsadministrator.RENDERGRIDDesktopjcgrid-workercache_0deskjcgrid-worker
-tmp-img-file.ppm"
> desk.ini error=3
>  at java.lang.Win32Process.create(Native Method)
>  at java.lang.Win32Process.<init>(Win32Process.java:66)
>  at java.lang.Runtime.execInternal(Native Method)
>  at java.lang.Runtime.exec(Runtime.java:566)
>  at org.homedns.dade.jcgrid.util.ConsoleCmd.run(ConsoleCmd.java:132)
>  at
>
org.homedns.dade.jcgrid.worker.impl.povray.POVWorker.doWork(POVWorker.java:1
31)
>  at org.homedns.dade.jcgrid.worker.WorkerThread.run(WorkerThread.java:113)
>
> this is the errors in the workers. Needed help asap. Many Thanks!
>
>
>

This seems to be more of a JCGrid problem than povray. You may want to
consider posting to a forum related to that, or povray.tools.general, or..?
It seems a little off topoc for povray.general.


Post a reply to this message

<<< Previous 5 Messages Goto Initial 10 Messages

Copyright 2003-2023 Persistence of Vision Raytracer Pty. Ltd.