POV-Ray : Newsgroups : povray.beta-test : Processor Groups Server Time
23 Dec 2024 04:25:33 EST (-0500)
  Processor Groups (Message 1 to 6 of 6)  
From: Christian Froeschlin
Subject: Processor Groups
Date: 3 May 2010 19:43:04
Message: <4bdf5f88$1@news.povray.org>
Just out of idle curiosity, will 3.7 have special support for
processor groups? As far as I understand this will be required
under Windows if an application wishes to make use of more than
64 logical cores ;) It's not *that* far-fetched really, you
could already get 64 logical cores today with four of these:

http://www.intel.com/p/en_US/products/server/processor/xeon7000/

Given the release cycle of POV-Ray it is likely that 3.7 will
be used on such systems before the next version is out.


Post a reply to this message

From: Warp
Subject: Re: Processor Groups
Date: 4 May 2010 08:14:50
Message: <4be00fba@news.povray.org>
Christian Froeschlin <chr### [at] chrfrde> wrote:
> As far as I understand this will be required
> under Windows if an application wishes to make use of more than
> 64 logical cores

  Why?

-- 
                                                          - Warp


Post a reply to this message

From: Fredrik Eriksson
Subject: Re: Processor Groups
Date: 4 May 2010 09:47:37
Message: <op.vb6olnig7bxctx@toad.bredbandsbolaget.se>
On Tue, 04 May 2010 14:14:50 +0200, Warp <war### [at] tagpovrayorg> wrote:
> Christian Froeschlin <chr### [at] chrfrde> wrote:
>> As far as I understand this will be required
>> under Windows if an application wishes to make use of more than
>> 64 logical cores
>
>   Why?

Windows clusters processors into groups of no more than 64 in each group  
for performance reasons.

More information here (Yes, this is the "I feel lucky" link):
http://msdn.microsoft.com/en-us/library/dd405503(VS.85).aspx



-- 
FE


Post a reply to this message

From: Le Forgeron
Subject: Re: Processor Groups
Date: 4 May 2010 12:24:02
Message: <4be04a22$1@news.povray.org>
Le 04/05/2010 15:47, Fredrik Eriksson nous fit lire :
> On Tue, 04 May 2010 14:14:50 +0200, Warp <war### [at] tagpovrayorg> wrote:
>> Christian Froeschlin <chr### [at] chrfrde> wrote:
>>> As far as I understand this will be required
>>> under Windows if an application wishes to make use of more than
>>> 64 logical cores
>>
>>   Why?
> 
> Windows clusters processors into groups of no more than 64 in each group
> for performance reasons.

Tsss.

So, because the ms-os scheduler is flawed (and might not scale fine on
high number of processors (including pseudo-cores of HT), as well as
they have a limited API interface), they are reporting the usage of more
than one group to the applications.

Remind me of (non-)multitasking... the microsoft way in windows 3.

I like the marketing-bs about hot-pluggable processors and the
reservation of room in groups, and yet making groups as big as
possible... laughable.

Notice: you need a 64-bit version of 7 or 2008R2...
And for a lot of memory, you need the higher (more expensive) versions
(for just a registry change... AFAIK)
Well, given the hardware cost per cpu (even with 8 cores/16 HT) and the
others parts, it might be a fine line in the pricelist.
But on such hardware, usually, you use virtualisation at its best,
running windows only as a VM, not the main (barebone) OS. Chances are
windows won't get to see all the processors at once anyway.

Now, if someone wants to prove me wrong and offer me a 256-way xeon 7500
machine, fully loaded with processors, memory, and all, just feel
free... I would install Linux in it (bigiron kernel), and might need
some more money for the electricity bild (and cooling).
I'm afraid the graphic card will be horrible.

I would stand by: source of povray are available, if you have such a
computer, and wants full povray on it, you might as well perform the
fine tuning of the code for the actual setting. Then share it with the
pov-team!

Note also, MS-way: groups are not backward compatible with Vista, 2008,
2003, XP...


Post a reply to this message

From: Christian Froeschlin
Subject: Re: Processor Groups
Date: 4 May 2010 16:17:54
Message: <4be080f2$1@news.povray.org>
Fredrik Eriksson wrote:

> Windows clusters processors into groups of no more than 64 in each group 
> for performance reasons.

there are also some restrictions in the classic api such as the
integer bitmask for thread affinities which only has so many bits.
On a 32-bit system the limit is 32 logical cores. Probably a case
of "32 cores ought to be enough for everybody" ;)


Post a reply to this message

From: Warp
Subject: Re: Processor Groups
Date: 5 May 2010 07:54:19
Message: <4be15c6b@news.povray.org>
Christian Froeschlin <chr### [at] chrfrde> wrote:
> Fredrik Eriksson wrote:

> > Windows clusters processors into groups of no more than 64 in each group 
> > for performance reasons.

> there are also some restrictions in the classic api such as the
> integer bitmask for thread affinities which only has so many bits.
> On a 32-bit system the limit is 32 logical cores. Probably a case
> of "32 cores ought to be enough for everybody" ;)

  My wild guess is that since the kernel of Windows NT had huge problems
dealing with even 16 CPUs, and since the kernel of Windows XP and newer
are based on NT, they have developed the multiprocessor routines a bit
further, but are probably still hitting some efficiency limits somewhere
at 64 CPUs.

  It's not like it's impossible to write a multitasking operating system
which can efficiently scale up even to thousands of CPUs. Many Unix
operating systems which were built from the very beginning to handle
multiple CPUs are very efficient at it. (If I'm not mistaken, Sun Solaris
is one example. I have heard that it can easily handle 2048 CPUs and even
more, without any significant overhead.)

-- 
                                                          - Warp


Post a reply to this message

Copyright 2003-2023 Persistence of Vision Raytracer Pty. Ltd.