Hi guys, has anyone ever thought of merging povray with a music 
description language?
I mean, to have a language that generates movies with sound. We can sync 
the sound together with our animation using an SDL (with support for sound).
Is there a language that does this already? That generates 3D animation 
with sound from a scene description?

The thing I imagined would be something like this:

sphere {
   0, 1
   translate <12, 0, 0> * clock
   pigment {
     color rgb 1
   }
}

sound {
   wav "background.wav"
   from 0
   to 1
}

It could also have the syntax specific to generate music notes or even 
instruments.

maybe something like this

sound {
   note "c"
   from 0
   to 0.5
}

sound {
   note "A"
   from 0.5
   to 1
}

I am missing other info such as tempo, bit rate, and all stuff related 
to sound.

I am not very familiar with sound theory. But that is more or less the idea.

I think a good idea would be to create another language with povray 
syntax and the extra syntax for the sound. Then create a sort of 
compiler for the language that generates povray files for the animation 
side and nyquist (a music description language) files for the music side.

Wouldn't that be cool?

All the best

Fidel.

Post a reply to this message

Just my 2 (euro) cents, but I guess it makes no sense
to merge sounds at the time the images composing the animation
are calculated. Just think of what is done in video editing:
the soundtrack is always added after the film edit because
otherwise you would end up with non-linear music score each
time there's a scene cut.

Post a reply to this message

Another idea: as POV-Ray generates synthetic images/animations. What POV-Ray
like program would generate synthetic sounds?

Post a reply to this message

"Apache" <apa### [at] yahoocom> wrote in
news:3e80978c@news.povray.org 

> Another idea: as POV-Ray generates synthetic images/animations. What
> POV-Ray like program would generate synthetic sounds?

Hmm.. imho this could be grate - take from POV - CSG, shape definitions 
etc, and add to material another property - sound - that defines how object 
is reflecting sound (or diffusing it).

I.e. :

// mettal pipe
cylinder { -z,+z, 0.1 sound { reflection .5 } } 


// echo chamber
box { -1,+1 inverse sound { reflection .3 } }


// carpeted holway 
box { -1,+1 inverse sound { diffuse .75 } }

Sound can be interpreted like a special type of... wave, and therefore it 
can be traced just as light do :

light-ray-tracer => wave-ray-tracer

light_source => sound_source
diffuse => sound { diffuse }
reflection => sound { reflection } - makes echo

etc...



-- 
#macro g(U,V)(.4*abs(sin(9*sqrt(pow(x-U,2)+pow(y-V,2))))*pow(1-min(1,(sqrt(
pow(x-U,2)+pow(y-V,2))*.3)),2)+.9)#end#macro p(c)#if(c>1)#local l=mod(c,100
);g(2*div(l,10)-8,2*mod(l,10)-8)*p(div(c,100))#else 1#end#end light_source{
y 2}sphere{z*20 9pigment{function{p(26252423)*p(36455644)*p(66656463)}}}//M

Post a reply to this message

Apache wrote:
> Another idea: as POV-Ray generates synthetic images/animations. What POV-Ray
> like program would generate synthetic sounds?

the closest thing i can think of would of course be csound
( http://www.csounds.com/ ).  it also uses some kind of
"scene description language" (or "sound ~", for that matter),
and runs on many platforms.

i have already used it to create sounds for povray animations,
where the sources for both povray and csound were generated
by a perl skript, then rendered, and the outputs put together
in adobe premiere.

IMHO there is really no need to integrate those two things,
as they already cooperate smoothly that way.


g.

-- 
"There are still places where people think that the function
of the media is to provide information." -- Don Rottenberg
++++++++++++++++ http://www.psico.ch/ ++++++++++++++++

Post a reply to this message

Nicolas Calimet wrote:
>     Just my 2 (euro) cents, but I guess it makes no sense
> to merge sounds at the time the images composing the animation
> are calculated. Just think of what is done in video editing:

I guess I didn't explain myself here. Well, what I meant was to merge 
the two languages into one, which would be pre-processed by another tool 
and generate a povray file for the animation and another file let's say 
csound or nyquist for the music. It would be useful to compose the sound 
  tracks for your movie since you know the timing. But obviously it 
would be great for guys that love coding cause most guys use cubase or 
other visual software.
It would be cool to design the sound together with your animations cause 
you would know the timming for both the movie and the sound track.

Then you just put it together with a film editor.

This of course is if you do your complete animation in povray. Without 
extra transitions that you may add later on your editing software. I 
have seen a lot of animations whose transitions were all made in povray. 
Take John Vansickle, for instance, he does all his transitions in povray.

All the best

Fidel.

Post a reply to this message

Apache wrote:
> Another idea: as POV-Ray generates synthetic images/animations. What POV-Ray
> like program would generate synthetic sounds?
> 

There is nyquist (a lisp like programming language) or csound (a c like).

All the best

Fidel.

Post a reply to this message

In article <Xns### [at] 204213191226>,
 "Rafal 'Raf256' Maj" <raf### [at] raf256com> wrote:

> Sound can be interpreted like a special type of... wave, and therefore it 
> can be traced just as light do :

Wrong. POV does not simulate the wave nature of light. It can get away 
with a pure particle simulation because the wavelengths of light are so 
small, so the effects are usually invisible or unnoticed. There are 
special cases where wave effects are faked, like iridescence or 
dispersion, but overall POV treats light as particles with RGB 
intensities.
Sound has a much larger wavelength (for example, a 5 KHz sound in normal 
conditions has a wavelength of about 7cm, 500Hz about 0.7m) and travels 
at a much lower speed, so effects such as lag time and diffraction have 
much greater importance. Raytracing techniques may have some application 
in sound simulation (though I doubt it), but you would want a program 
designed from the start for it.

-- 
Christopher James Huff <cja### [at] earthlinknet>
http://home.earthlink.net/~cjameshuff/
POV-Ray TAG: chr### [at] tagpovrayorg
http://tag.povray.org/

Post a reply to this message

"Apache" <apa### [at] yahoocom> wrote:
> Another idea: as POV-Ray generates synthetic images/animations. What
> POV-Ray like program would generate synthetic sounds?

Not quite an "idea"... Such a program does exist -- for many, many, many
years. Has its own community, lots of unoficial versions (I made one some 5
years ago..:-), etc.:
  http://www.csounds.com/

Canonic version is here:
  http://www.cs.bath.ac.uk/~jpff/dream.html

I havn't used it for many years... and now it seems like it wasn't updated
for quite a while. The mainteiner used to be John ffitch, but the notes for
the latest version contain some other guy's name... Strange.

Post a reply to this message