Povray 3.7 on Ubuntu crashes as sson as it overpass 4giga of memory use.
Won't it be possible to release this threshold ?

Post a reply to this message

Le 06/12/2013 15:41, fdecomite a écrit :
> Povray 3.7 on Ubuntu crashes as sson as it overpass 4giga of memory use.
> Won't it be possible to release this threshold ?

Can you provide a scene to reproduce ?

Which version of ubuntu ?

(IIRC, I went past the 4giga without problem in the 3.7RC series)

Have you check that your ulimit is not set to kill any process that use
more than 4 giga of memory ? (ulimit -m)

What is your memory size ?
Do you have a swap enable ?

Is povray on your system a 32 bits or 64 bits application ? Is your
system a 32 or 64 bits ?


-- 
Just because nobody complains does not mean all parachutes are perfect.

Post a reply to this message

Le_Forgeron <lef### [at] freefr> wrote:
> Le 06/12/2013 15:41, fdecomite a écrit :
> > Povray 3.7 on Ubuntu crashes as sson as it overpass 4giga of memory use.
> > Won't it be possible to release this threshold ?
>
> Can you provide a scene to reproduce ?

https://bigfile.univ-lille1.fr/get?k=I319vBtHiACWmRtPQmr
>
> Which version of ubuntu ?
13.10
>
> (IIRC, I went past the 4giga without problem in the 3.7RC series)
>
> Have you check that your ulimit is not set to kill any process that use
> more than 4 giga of memory ? (ulimit -m)
unlimited
>
> What is your memory size ?
32g
> Do you have a swap enable ?
don't know
>
> Is povray on your system a 32 bits or 64 bits application ?
64
Is your
> system a 32 or 64 bits ?
64
>
>
> --
> Just because nobody complains does not mean all parachutes are perfect.

Post a reply to this message

Le 06/12/2013 16:26, fdecomite nous fit lire :
> Le_Forgeron <lef### [at] freefr> wrote:
>> Le 06/12/2013 15:41, fdecomite a écrit :
>>> Povray 3.7 on Ubuntu crashes as sson as it overpass 4giga of memory use.
>>> Won't it be possible to release this threshold ?
>>
>> Can you provide a scene to reproduce ?
> 
> https://bigfile.univ-lille1.fr/get?k=I319vBtHiACWmRtPQmr

A dos file ?

Had to change seuilDeBase to 1.0 to get a memory hungry script

You have a division by 0 on first iteration (where level=0)

Parsing went fine to grab more than 5 giga (checked with top)

>>
>> Which version of ubuntu ?
> 13.10

Same for me.


>> Is povray on your system a 32 bits or 64 bits application ?
> 64

I would challenge that point:

My result for "file /usr/local/bin/povray" is:

ELF 64-bit LSB executable, x86-64, version 1 (GNU/Linux), dynamically
linked (uses shared libs), for GNU/Linux 2.6.24,
BuildID[sha1]=0xadea6f17ceef66d4c66591feb618ef1a11cdba05, stripped


> Is your
>> system a 32 or 64 bits ?
> 64

Me too.

Post a reply to this message

Attachments:
Download 'top.png' (21 KB)

Preview of image 'top.png'

Am 06.12.2013 16:26, schrieb fdecomite:
> Le_Forgeron <lef### [at] freefr> wrote:
>> Le 06/12/2013 15:41, fdecomite a écrit :
>>> Povray 3.7 on Ubuntu crashes as sson as it overpass 4giga of memory use.
>>> Won't it be possible to release this threshold ?
...
>> Have you check that your ulimit is not set to kill any process that use
>> more than 4 giga of memory ? (ulimit -m)
> unlimited

Are you absolutely sure about this?

I can't think of any mechanism whatsoever in POV-Ray that could lead to 
a hard crash at passing exactly 4GB of memory use.

If it was due to limited address space (i.e. a 32 bit version of 
POV-Ray), the crash would presumably at 2GB or 3GB, as the OS usually 
wants a chunk of the address space, too.

If it was due to some internal variable overflowing, the crash would be 
at a much more arbitrary limit, as it would affect only an individual 
data structure, with plenty of other data being around to take up 
additional space.

There is also no mechanism implemented in POV-Ray to monitor memory 
consumption (although such a mechanism would be useful at least on 
Windows machines, in order to prevent the system from entering swap hell 
when the physical memory limit is exceeded).


There is, however, that very mechanism in the Linux OS to forcefully 
limit the size of any user process, and if it kicks in it will do 
exactly what you see: Terminate the process hard.

Post a reply to this message

Le_Forgeron <jgr### [at] freefr> wrote:
> Le 06/12/2013 16:26, fdecomite nous fit lire :
> > Le_Forgeron <lef### [at] freefr> wrote:
> >> Le 06/12/2013 15:41, fdecomite a écrit :
> >>> Povray 3.7 on Ubuntu crashes as sson as it overpass 4giga of memory use.
> >>> Won't it be possible to release this threshold ?
> >>
> >> Can you provide a scene to reproduce ?
> >
> > https://bigfile.univ-lille1.fr/get?k=I319vBtHiACWmRtPQmr
>
> A dos file ?
>
> Had to change seuilDeBase to 1.0 to get a memory hungry script
>
> You have a division by 0 on first iteration (where level=0)

Sorry, was level from1to7.1 to 8 should work the same
>
> Parsing went fine to grab more than 5 giga (checked with top)
>

I also reached 5g. i don't understand from your mail if you also experienced a
scratch ?
> >>
> >> Which version of ubuntu ?
> > 13.10
>
> Same for me.
>
>
> >> Is povray on your system a 32 bits or 64 bits application ?
> > 64
>
> I would challenge that point:
>
> My result for "file /usr/local/bin/povray" is:
>
> ELF 64-bit LSB executable, x86-64, version 1 (GNU/Linux), dynamically
> linked (uses shared libs), for GNU/Linux 2.6.24,
> BuildID[sha1]=0xadea6f17ceef66d4c66591feb618ef1a11cdba05, stripped
>
>
> > Is your
> >> system a 32 or 64 bits ?
> > 64
>
> Me too.

Post a reply to this message

Am 06.12.2013 21:21, schrieb fdecomite:
> Le_Forgeron <jgr### [at] freefr> wrote:
>> Le 06/12/2013 16:26, fdecomite nous fit lire :
>>> Le_Forgeron <lef### [at] freefr> wrote:
>>>> Le 06/12/2013 15:41, fdecomite a écrit :
>>>>> Povray 3.7 on Ubuntu crashes as sson as it overpass 4giga of memory use.
>>>>> Won't it be possible to release this threshold ?
>>>>
>>>> Can you provide a scene to reproduce ?
>>>
>>> https://bigfile.univ-lille1.fr/get?k=I319vBtHiACWmRtPQmr
>>
>> A dos file ?
>>
>> Had to change seuilDeBase to 1.0 to get a memory hungry script
>>
>> You have a division by 0 on first iteration (where level=0)
>
> Sorry, was level from1to7.1 to 8 should work the same
>>
>> Parsing went fine to grab more than 5 giga (checked with top)
>>
>
> I also reached 5g. i don't understand from your mail if you also experienced a
> scratch ?

Wait a minute - didn't you say that POV-Ray crashes as soon as it 
exceeds 4GB? How could it reach 5GB then?

Please be more precise about the symptoms you are seeing, otherwise we 
can't help you figuring out what's wrong.

Post a reply to this message

clipka <ano### [at] anonymousorg> wrote:
> Am 06.12.2013 21:21, schrieb fdecomite:
> > Le_Forgeron <jgr### [at] freefr> wrote:
> >> Le 06/12/2013 16:26, fdecomite nous fit lire :
> >>> Le_Forgeron <lef### [at] freefr> wrote:
> >>>> Le 06/12/2013 15:41, fdecomite a écrit :
> >>>>> Povray 3.7 on Ubuntu crashes as sson as it overpass 4giga of memory use.
> >>>>> Won't it be possible to release this threshold ?
> >>>>
> >>>> Can you provide a scene to reproduce ?
> >>>
> >>> https://bigfile.univ-lille1.fr/get?k=I319vBtHiACWmRtPQmr
> >>
> >> A dos file ?
> >>
> >> Had to change seuilDeBase to 1.0 to get a memory hungry script
> >>
> >> You have a division by 0 on first iteration (where level=0)
> >
> > Sorry, was level from1to7.1 to 8 should work the same
> >>
> >> Parsing went fine to grab more than 5 giga (checked with top)
> >>
> >
> > I also reached 5g. i don't understand from your mail if you also experienced a
> > scratch ?
>
> Wait a minute - didn't you say that POV-Ray crashes as soon as it
> exceeds 4GB? How could it reach 5GB then?
>

Well, I said 4gb to make it simple. It was somewhere aroud 4-5g, i didn't wait
for the scratch loking the screen

> Please be more precise about the symptoms you are seeing, otherwise we
> can't help you figuring out what's wrong.

Post a reply to this message

Le 07/12/2013 09:04, fdecomite nous fit lire :
> Well, I said 4gb to make it simple. It was somewhere aroud 4-5g, i didn't wait
> for the scratch loking the screen

Do not simplify. 4gb is a classical 32bits limit, but 4-5gb is something
different.

Did you run memtest86+ recently ? (there is now a fix for it, as running
it from grub failed since 12.04, either it has reached already the
official distribution or i can search the PPA if you need it)

Testing your script with seuilDeBase = 1, and updated test of macro for
>= 7, it should generate about 21^7 objects.

Just 1 801 088 541 leaves. I do not have enough memory for that (that's
2G objects... ), but parsing went fine till 7.9g and more, (even past
8.4g is fine)

Parsing 6264062K tokens

By the time I finished that post, the memory used is at 10g and counting.

Parsing 8222562K tokens

Post a reply to this message