Thanks for that - very detailed - explanation. It reminds me of two 
things (or rather three):

1) You may remember my POV-Ray scene 'Paris la nuit' a couple of years 
ago, based on a photograph by Sabine Weiss in 1953. It was just done by 
trial and error of course, and a hell of a challenge with all kind of 
assumptions. Nothing to do with photogrammetry of course, but I 
appreciate your caveats about any "easy magic" ;-).

2) I have seen on a couple of occasions (on TV), archaeologists make a 
lot of photographs of an object, under all kind of angles, and later 
combine those into a 3d model (with software of course). I saw that done 
  in particular on the terracotta army in China. Closer to home, geology 
students recently used a drone to photograph the walls of a quarry in 
the same manner, and assembled them into a 3d model of the quarry. 
Fascinating stuff, and relatively cheap to implement, especially for 
students I understood.

3) I have been interested in archaeology for most of my life and so came 
quite early across the use of photogrammetry there. If I remember well, 
it was used by Unesco during the construction of the Assouan Dam in 
Egypt to move the Abou Simbel temple to a higher position. I was a 
reader of 'Archeologia' at the time.

-- 
Thomas

Post a reply to this message

On 7/4/2021 2:20 AM, Thomas de Groot wrote:
> 2) I have seen on a couple of occasions (on TV), archaeologists make a 
> lot of photographs of an object, under all kind of angles, and later 
> combine those into a 3d model (with software of course). I saw that done 

> students recently used a drone to photograph the walls of a quarry in 
> the same manner, and assembled them into a 3d model of the quarry. 
> Fascinating stuff, and relatively cheap to implement, especially for 
> students I understood.
> 

I wonder *how* cheap it really is. Probably *not* cheap, in terms of the 
work and expertise involved.


Mike

Post a reply to this message

Op 4-7-2021 om 11:09 schreef Mike Horvath:
> On 7/4/2021 2:20 AM, Thomas de Groot wrote:
>> 2) I have seen on a couple of occasions (on TV), archaeologists make a 
>> lot of photographs of an object, under all kind of angles, and later 
>> combine those into a 3d model (with software of course). I saw that 

>> geology students recently used a drone to photograph the walls of a 
>> quarry in the same manner, and assembled them into a 3d model of the 
>> quarry. Fascinating stuff, and relatively cheap to implement, 
>> especially for students I understood.
>>
> 
> I wonder *how* cheap it really is. Probably *not* cheap, in terms of the 
> work and expertise involved.
> 
I don't really know. What I understood, in particular from the Chinese 
example, was that the hardware came 'cheap' as only a perfectly common 
digital camera was needed and no sophisticated laser-controlled stuff. 
And a simple stepladder in addition, to get around the statues. The same 
applied for the students with their drone. Concerning the software, I 
have no idea. The results looked good however, and I doubt that they had 
any particularly high expertise in the matter.

-- 
Thomas

Post a reply to this message

> 1) You may remember my POV-Ray scene 'Paris la nuit' a couple of years
> ago, based on a photograph by Sabine Weiss in 1953. It was just done by
> trial and error of course, and a hell of a challenge with all kind of
> assumptions. Nothing to do with photogrammetry of course, but I
> appreciate your caveats about any "easy magic" ;-).

I can't recall it from the name, neither find it with Google. Would you have a
link ? I would certainly enjoy seeing it again, as usual with your scenes :-)

> 2) I have seen on a couple of occasions (on TV), archaeologists make a
> lot of photographs of an object, under all kind of angles, and later
> combine those into a 3d model (with software of course). I saw that done
>   in particular on the terracotta army in China. Closer to home, geology
> students recently used a drone to photograph the walls of a quarry in
> the same manner, and assembled them into a 3d model of the quarry.
> Fascinating stuff, and relatively cheap to implement, especially for
> students I understood.

Yes, it's heavily used in archaeology, generally only for the most important
pieces as it is very time consuming, and sometime challenging. You will probably
enjoy this speech of an archaeologist talking about their struggles to produce
models of obsidian artifacts:
https://www.youtube.com/watch?v=g0YaWDrl5qI
I haven't mention it in my previous post but, any reflective or transparent
texture is also an immediate 'no go'. It completely confuses all current
algorithms.

> 3) I have been interested in archaeology for most of my life and so came
> quite early across the use of photogrammetry there. If I remember well,
> it was used by Unesco during the construction of the Assouan Dam in
> Egypt to move the Abou Simbel temple to a higher position. I was a
> reader of 'Archeologia' at the time.

I had plan to become a paleobiologist until I entered university where I've been
reoriented toward computer science. This has probably been a wise advice but I
always wonder what would have become that other me. So, I've been really happy
when I had the chance to work for archaeologists a few years ago.

Post a reply to this message

Thomas de Groot <tho### [at] degrootorg> wrote:
> Op 4-7-2021 om 11:09 schreef Mike Horvath:
> > On 7/4/2021 2:20 AM, Thomas de Groot wrote:
> >> 2) I have seen on a couple of occasions (on TV), archaeologists make a
> >> lot of photographs of an object, under all kind of angles, and later
> >> combine those into a 3d model (with software of course). I saw that
>
> >> geology students recently used a drone to photograph the walls of a
> >> quarry in the same manner, and assembled them into a 3d model of the
> >> quarry. Fascinating stuff, and relatively cheap to implement,
> >> especially for students I understood.
> >>
> >
> > I wonder *how* cheap it really is. Probably *not* cheap, in terms of the
> > work and expertise involved.
> >
> I don't really know. What I understood, in particular from the Chinese
> example, was that the hardware came 'cheap' as only a perfectly common
> digital camera was needed and no sophisticated laser-controlled stuff.
> And a simple stepladder in addition, to get around the statues. The same
> applied for the students with their drone. Concerning the software, I
> have no idea. The results looked good however, and I doubt that they had
> any particularly high expertise in the matter.
>
> --
> Thomas


You can indeed produce good results with a standard camera. The software itself,
if not freeware is quite expensive, but if they were students it's probably
provided by their university and that's surely not much compared to a university
budget. About expertise, if they were students, that very probably mean they had
teachers with a high level of expertise to guide them.

Post a reply to this message

"BayashiPascal" <bai### [at] gmailcom> wrote:
> @baldeagle, sorry for the late reply.

No apologies necessary, as it's a complicated topic, and I'm sure you have
PLENTY to keep you busy IRL.

> Yes, and no. Let's take the example of the coordinates of the corner of your
> table. First, you have to know that's a corner of the table. It can be specify
> by the user manually, or done by automatic detection which works more or less
> depending on the image. Once you have the 2D coordinates in the image, in order
> to get the 3D coordinates you actually need several images (and identify that
> particular corner in each of them) and the intrinsic and extrinsic parameters of
> the camera.

This is certainly what I would have expected from my )all too brief) readings of
the photogrammetry literature, which is why I was so surprised when I came
across the work of Kevin Karsch.  It seems like "magic" - certainly very bold
claims, and I was wondering if
a) you could look deeper into his work, with your education and experience in
the area and see how much of what he claims to accomplish is "embellished"
and
b) if he and his colleagues/coworkers/students have done a lot of the puzzling
out and heavy lifting already, then perhaps he might provide you with tools that
would help you in your own work that you might not be familiar with.

I certainly didn't want to send you "off into the weeds" without thinking that
there might be some personal/professional benefit for you in the process.

> Then, even if you have your
> 3D coordinates of corners, how do you know which corner relates to which other
> corner ?

Dr Karsch apparently has most of that figured out, and even has the code (mostly
..js) posted on his site.  He welcomes someone to get it up and running on a
server again, and if we have a web guru amongst us, I can envision using his
work as a basis for better understanding what he did, converting some of that
javascript to SDL / source code, and perhaps even spurring some further
development of a POV-Ray modeler.

I am not worried about the texture, as that is separate from the geometry.

> About finding the
> light position, in a real environment I hope you understand now that's barely
> feasible in an fully automated way.

Again, this is part of the series of bold claims that Karsch makes and
apparently demonstrates in his papers, software, and videos.  (He does mention
that a database is used, and references an open source DB)


> Yes, and from my experience these apps are all clumsy and inaccurate at best. I
> know there are a lot of mesmerizing videos on Youtube about such apps. To me,
> these are just clickbait and commercials. When you have to do it every days
> under real conditions and looking for professional level accurate results, it
> takes a lot of experience, preprocessing and postprocessing work, which are
> rarely spoken of in those videos.

Right - "the more you know"...  And I'm fine with a lot of what I've come across
in the past few years being declared to be fantastic claims that mislead the
reader/viewer.

> In a sense that's what I'm doing, having convinced my employer that we could use
> a combination of POV-Ray and photogrammetry to help solving a certain AI
> problem. But it's already been 1.5 years of R&D and still a WIP, so when it
> comes to "quickly implement some of the basics", I hope you now understand that
> even the basics are far from simple and definitely not quick to implement.

Certainly.  I understand that, and was in no way expecting a tutorial of any
kind.

> I'm
> really sorry but writing tutorials on the subject would be a way too big project
> for me to embark on (just replying to your message took me a week!).


Besides the explicitly photogrammetric aspect of the above where the first step
is acquiring key vertices of the geometry in the image, I was thinking it would
be much simpler, straightforward, and immediately useful if any POV-Ray work
were limited to what to do with vertex data already in possession of the user.

What if I took the uv coordinates or the interpolated <x,y,z> coordinates from
the screen position-finder macro

http://news.povray.org/povray.binaries.images/thread/%3C5baddad1%40news.povray.org%3E/?mtop=424795
or the modifications to the screen.inc macros
http://news.povray.org/povray.binaries.scene-files/thread/%3C4afccd8a%241%40news.povray.org%3E/

and worked from there, without having to worry about all the messy data
extraction from a photograph?   I think the basic geometric transformations
would be instructive and useful all on their own.

I mean, you're already familiar with the issues regarding the FieldCam macro.
http://news.povray.org/povray.binaries.images/thread/%3C5fb22ee0%40news.povray.org%3E/?mtop=432106

I mean, I was able to measure and guess when I was recreating this challenging
piece:
https://secureservercdn.net/45.40.146.28/ik7.9d0.myftpupload.com/wp-content/uploads/revslider/home-part/hero_part_with_
circles.png

But perhaps there is a way to embed specially colored pixels into an image at
key reference points, like they do with steganography?  (thinking for testing,
and future recovery of scene geometry if it is lost) Then a scan for vertices
could be done with the raw pixel data, and it would be even easier.   Also, a
user could mark a copy of the photo with an image editor before a macro
processed it.

Just some ideas for what we could do with existing povray technology and some
educated application of matrix transforms.


Thanks for your caveats and opinions.   Hopefully some of what I posted can help
you in your own work.  I am always interested in hearing about what challenges
you experience in trying to solve your own geometric problems - it's an
interesting field.

- Bill

Post a reply to this message

Op 4-7-2021 om 14:36 schreef BayashiPascal:
>> 1) You may remember my POV-Ray scene 'Paris la nuit' a couple of years
>> ago, based on a photograph by Sabine Weiss in 1953. It was just done by
>> trial and error of course, and a hell of a challenge with all kind of
>> assumptions. Nothing to do with photogrammetry of course, but I
>> appreciate your caveats about any "easy magic" ;-).
> 
> I can't recall it from the name, neither find it with Google. Would you have a
> link ? I would certainly enjoy seeing it again, as usual with your scenes :-)
> 
It was made for one of the TC-RTC Challenges. Since Stephen and I closed 
that down, it has also disappeared from the web.

I shall repost the image with some comments I wrote at the time; I hope 
to find that back in my archives...

>> 2) I have seen on a couple of occasions (on TV), archaeologists make a
>> lot of photographs of an object, under all kind of angles, and later
>> combine those into a 3d model (with software of course). I saw that done
>>    in particular on the terracotta army in China. Closer to home, geology
>> students recently used a drone to photograph the walls of a quarry in
>> the same manner, and assembled them into a 3d model of the quarry.
>> Fascinating stuff, and relatively cheap to implement, especially for
>> students I understood.
> 
> Yes, it's heavily used in archaeology, generally only for the most important
> pieces as it is very time consuming, and sometime challenging. You will probably
> enjoy this speech of an archaeologist talking about their struggles to produce
> models of obsidian artifacts:
> https://www.youtube.com/watch?v=g0YaWDrl5qI
> I haven't mention it in my previous post but, any reflective or transparent
> texture is also an immediate 'no go'. It completely confuses all current
> algorithms.
> 
Yes, I can understand that !

>> 3) I have been interested in archaeology for most of my life and so came
>> quite early across the use of photogrammetry there. If I remember well,
>> it was used by Unesco during the construction of the Assouan Dam in
>> Egypt to move the Abou Simbel temple to a higher position. I was a
>> reader of 'Archeologia' at the time.
> 
> I had plan to become a paleobiologist until I entered university where I've been
> reoriented toward computer science. This has probably been a wise advice but I
> always wonder what would have become that other me. So, I've been really happy
> when I had the chance to work for archaeologists a few years ago.
> 
Who knows? I wonder sometimes about my life in an alternate universe ;-] 
  But life has sometimes a high degree of serendipity.

-- 
Thomas

Post a reply to this message

Op 4-7-2021 om 14:36 schreef BayashiPascal:
>> 1) You may remember my POV-Ray scene 'Paris la nuit' a couple of years
>> ago, based on a photograph by Sabine Weiss in 1953. It was just done by
>> trial and error of course, and a hell of a challenge with all kind of
>> assumptions. Nothing to do with photogrammetry of course, but I
>> appreciate your caveats about any "easy magic" ;-).
> 
> I can't recall it from the name, neither find it with Google. Would you have a
> link ? I would certainly enjoy seeing it again, as usual with your scenes :-)
> 
There is this:

http://news.povray.org/povray.binaries.images/thread/%3C4d8dea6b%40news.povray.org%3E/?mtop=359553

-- 
Thomas

Post a reply to this message

Op 4-7-2021 om 17:32 schreef Thomas de Groot:
> Op 4-7-2021 om 14:36 schreef BayashiPascal:
>>> 1) You may remember my POV-Ray scene 'Paris la nuit' a couple of years
>>> ago, based on a photograph by Sabine Weiss in 1953. It was just done by
>>> trial and error of course, and a hell of a challenge with all kind of
>>> assumptions. Nothing to do with photogrammetry of course, but I
>>> appreciate your caveats about any "easy magic" ;-).
>>
>> I can't recall it from the name, neither find it with Google. Would 
>> you have a
>> link ? I would certainly enjoy seeing it again, as usual with your 
>> scenes :-)
>>
> There is this:
> 
>
http://news.povray.org/povray.binaries.images/thread/%3C4d8dea6b%40news.povray.org%3E/?mtop=359553

> 
> 
There is also this. A later version:

http://news.povray.org/povray.binaries.images/thread/%3C5b7a6cb0%40news.povray.org%3E/?ttop=428926&toff=150&mtop=424347

-- 
Thomas

Post a reply to this message

Thomas de Groot <tho### [at] degrootorg> wrote:
> Op 4-7-2021 om 17:32 schreef Thomas de Groot:
> > Op 4-7-2021 om 14:36 schreef BayashiPascal:
> >>> 1) You may remember my POV-Ray scene 'Paris la nuit' a couple of years
> >>> ago, based on a photograph by Sabine Weiss in 1953. It was just done by
> >>> trial and error of course, and a hell of a challenge with all kind of
> >>> assumptions. Nothing to do with photogrammetry of course, but I
> >>> appreciate your caveats about any "easy magic" ;-).
> >>
> >> I can't recall it from the name, neither find it with Google. Would
> >> you have a
> >> link ? I would certainly enjoy seeing it again, as usual with your
> >> scenes :-)
> >>
> > There is this:
> >
> >
http://news.povray.org/povray.binaries.images/thread/%3C4d8dea6b%40news.povray.org%3E/?mtop=359553
> >
> >
> There is also this. A later version:
>
>
http://news.povray.org/povray.binaries.images/thread/%3C5b7a6cb0%40news.povray.org%3E/?ttop=428926&toff=150&mtop=4243
47
>
> --
> Thomas

Thanks. A very faithful reproduction of the original, very nice work :-)

Post a reply to this message