Office Hours 2024-08-16

===

[00:00:00] Eliot: All 

[00:00:04] Ryan: right. There you go. About nine reference images for my location. And when it runs through, it only sees, when I do the GUI check, it only shows that there's three images there. And then it fails with, um, the last line of code is COLMAP returned to none, cal net false, COLMAP returned negative six. 

[00:00:27] Eliot: Ah, interesting.

[00:00:28] Eliot: Um, all right. I wonder if that's. It's uh, I wonder if it's seeing enough feature points or something. Um, that's kind of weird. Okay, uh, for that one, actually the good thing to do is zip up the take, uh, because the take will include the calibration images. And, um, and then we can, uh, uh, or actually have you, have you, oh, wait a second, you're, you're doing push calibration.

[00:00:53] Eliot: So it's not solving, right? Is that the, that the issue? 

[00:00:55] Ryan: Well, so far I haven't shot a take yet. I'm just trying to calibrate the lens. 

[00:00:59] Eliot: [00:01:00] Okay. 

[00:01:00] Ryan: Okay. So I went through, set my, set my, um, origin point, did the, um, scene calibration. I'll tell you what, 

[00:01:10] Eliot: let me switch on our remote preview and we can screen share and I can just kind of look at what your calibration system, if you, are you set up to try doing a calibration?

[00:01:18] Eliot: I can kind of switch it on and look over your shoulder. All right. So let me, uh, let me go find this. Uh, there we go. I'm going to highlight a QR code. I'm trying to remember if we used the, have you used our, uh, our screen share system before? I 

[00:01:31] Ryan: have not, no. Okay, 

[00:01:33] Eliot: so the way it works, I'm gonna share a screen, let's switch this on, share this.

[00:01:38] Eliot: Okay, there we go. So go ahead and exit Jetset and then, um, all right, and then point your iOS camera at that. Um, and it'll pop up a little yellow, uh, yellow indicator, uh, button and just click that and that'll relaunch, that'll reopen Jetset, uh, but with one additional button on the upper right, [00:02:00] and that is a screen share button, uh, and it'll ask you, is it okay to record pixels?

[00:02:05] Ryan: You just gotta finagle a little bit around us, swing the camera around to point at this. All right. 

[00:02:09] Eliot: All right, there we go. All right, I'm gonna, I'm gonna share my screen so you can see what I'm seeing. All right. Share.

[00:02:18] Eliot: And share. There we go. Okay. So what this, this is great. Cause this lets us look over your shoulder and kind of see, uh, what that was going on in the Jetset UI. So, um, all right, so, uh, let's see, are you, uh, are you, there we go. So that's live. All right. So you can just, uh, tap a grid, set an origin, doesn't matter where.

[00:02:41] Eliot: There we go.

[00:02:45] Eliot: There we go. Okay. That looks like, oh, okay. So. It looks like it calibrated, uh, at least the, which, so let's just, we can go walk through a calibration and just make sure to see if it's working correctly. Um, but that yellow [00:03:00] reticule means that the, uh, looks like your 35 millimeter lens, uh, looks like that calibrated.

[00:03:05] Eliot: So 

[00:03:05] Ryan: both, both times that I did, I did the same lens and both times I'm getting the exact same error. Like that, the, um, I tried to copy and paste it. I'll have to try to get a different way of sending that over to you, but it says it's failing. Oh, okay. Both times when I switch between what I have currently, I'm getting the yellow box, like it is calibrated.

[00:03:27] Ryan: So I haven't gone any further than this. It's just like, it's. Kicking out an error for me right now. So I'm like, I don't know if I should go any further for the test. 

[00:03:35] Eliot: Oh, okay. Let's just, let's just try it. And then what we'll do is we'll switch to sharing your screen when you're doing your, your push calibration, and we'll just kind of see if we can kind of replicate it.

[00:03:45] Eliot: So, uh, let's just, uh, let's try Cal calibration. Are you, are you set up to do a calibration? 

[00:03:50] Ryan: Yeah. Okay. 

[00:03:51] Ryan: Yep. 

[00:03:53] Eliot: There 

[00:03:53] Ryan: we go. Back to just a regular feed. 

[00:03:56] Eliot: All right. So let's just go ahead and tap on a grid, set an origin. And [00:04:00] while I'm watching, we'll just do the, uh, there we go.

[00:04:04] Eliot: That's fine. All right. Let's do a menu. There we go. So I'm watching that, calibration, new. All right. So it looks like you're ready. So you can click start. All right. So let's. Start on one side of the hemisphere and work your way around. Okay, keep it framed a little bit. And yeah, there you go. Make sure you're translating.

[00:04:32] Eliot: There we go. And let's just translate another foot off to the right. And yeah, remember no panning. You got to translate. 

[00:04:42] Ryan: Okay, so no panning. 

[00:04:44] Eliot: Yeah, no panning. Panning will mess you up. This is, we're doing photogrammetry. So get it, you know, It was on a tripod. You got to pull it off the tripod and, and, uh, walk around in a, in a hemisphere.

[00:04:53] Eliot: Cause it's should I, uh, should I restart the calibration then since I panned? No, that's okay. But I think we just found out what the, what the problem was. [00:05:00] Uh, so this is a quirk of, of, uh, of math and optics is that rotation doesn't work. You got to translate in a hemisphere and we're actually going to, um, start adding that to our UI to make sure people understand that you got to do that.

[00:05:17] Eliot: All right, there we go. And let's move. Another foot or so over. There we go, and we're just kind of working our way in a hemisphere around it. Uh, around the central objects. Yeah, you got it. Keeping them, keeping them at the center and getting different views of it. 

[00:05:33] Ryan: Oh, shoot. I think I just hit start. There we go.

[00:05:40] Eliot: There we go.

[00:05:45] Eliot: And just keep moving so you can get some parallax. Because the parallax is what does the magic.[00:06:00] 

[00:06:05] Eliot: And you can come in closer if you're running into a door issue. Ha, ha, 

[00:06:08] Ryan: ha. Yeah, I'm gonna have to do a, I'm on a cart right now and they ran into our lift, so. 

[00:06:17] Eliot: All right. That's all right, you can come over to the other side and we'll just capture a, we'll just capture a couple more and I think that'll, that'll probably do it.

[00:06:25] Eliot: Sorry, can you say that again? Yeah, you can just come over and we'll capture a couple more. Uh, you get the idea. We're basically, if you imagine the camera being on a string tied to the central object, we're just, you know, moving an arc around that central object. All right. Uh, you know, and in capturing frames, we want to cover a swath of at least 90 degrees of rotation and preferably a little bit more than 90 degrees of rotation around that central object.

[00:06:50] Eliot: Uh, so it's almost like you're walking around a circle, pointing the camera at the, at the center object of it. 

[00:06:59] Ryan: [00:07:00] Gotcha. Yeah, that makes sense. I definitely did more of a semi circle the first time. 

[00:07:05] Eliot: Yeah, if you were just panning the net, then you're going to get a numerical, then it's going to bonk numerically.

[00:07:10] Eliot: It's not going to work. That's probably what was going on. Uh, but yeah, this, this should probably get you a decent, decent way. Yeah, we can, okay. You can capture a couple more.

[00:07:24] Eliot: There we go. 

[00:07:26] Ryan: Think we got enough? 

[00:07:27] Eliot: Yeah, I think, I think that should do it. And when you can do save

[00:07:38] Eliot: and no, let's get rid of the spaces. Actually, it shouldn't let you do spaces. 

[00:07:44] Ryan: No spaces? 

[00:07:45] Eliot: Yeah, let's. And I thought we put something in Jetset to keep you from doing spaces. So maybe it'll, maybe it'll just save it without spaces, uh, but that's all right.[00:08:00] 

[00:08:03] Eliot: There we go. And then now we can exit.

[00:08:08] Eliot: There we go. And then that's, uh, I'll let you screen share your auto shot. Uh, and that will, uh, then we'll, we'll watch how it, how it, how it processes this, but now that you have more parallax, I think 

[00:08:20] Ryan: it'll do a little bit better. 

[00:08:22] Eliot: Yeah, 

[00:08:22] Ryan: no worries. There we go. All right, so I can share my screen and I'll get Autoshot set up here.

[00:08:28] Ryan: Think I gotta double check that. I know I just typed it in, but 24. 6. Yep. 

[00:08:38] Eliot: And 

[00:08:39] Ryan: then just hit 

[00:08:40] Eliot: calibrate? Calibrate. Yeah, just calibrate. It'll uh, it should push the, a little bit hard to see them. 

[00:08:47] Ryan: Yeah, what happened to my console here? There we go. All right.

[00:08:57] Eliot: So it's going to crunch through those. It looks like it's crunching. [00:09:00] Let's watch it for a while and make sure it converges. But that's, yeah. So this is, this is one of these funny quirks of motion tracking is that in a lot of cases are of, of basically photogrammetry is if you pan it on, on tripod, it's there's, there's, there's no numerical data for the algorithm.

[00:09:15] Eliot: It just, it doesn't know what to do. Yeah, it makes sense. 

[00:09:19] Ryan: It's so, so if I had to do a lot of lenses to calibrate, ideally it would be a central point. And then just make a big arc around that central point. 

[00:09:30] Eliot: Yeah, and it doesn't have to be like, you know, you don't need to lay down like an arc track or anything like that.

[00:09:35] Eliot: Uh, you could just like, you know, put it on, put the camera on a cart, point it toward a central point, you know, um, and start calibrating and just push the cart along, you know, over a good, at least a 90 degree swath, you know, get more of even better. Um, but that, that should do it. And just pick something with a bunch of detail, you know, like, uh, a bunch of drawings on a wall, those that works great, you know, or the, you know, the things, things you were shooting that, [00:10:00] that should work fine too.

[00:10:01] Eliot: You were getting lots of feet and feature matches and they were, they're both correlating, you know, the, the upward and downward one and the right to left one, we're both correlating. Um, all right, yeah, that's kind of weird. Let's see, man, we are having lots of, lots of things with COLMAP on the Mac. Um, calibration run return false.

[00:10:19] Eliot: So that's kind of funny. The good thing is that the bundle adjustment report, if I look at the text on the top, it converged with a, uh, an error of less, you know, four tenths of a pixel and the termination was convergence.

[00:10:31] Eliot: So I think it, it, it, let me, uh, I'm going to, uh, pull up the Jetset screen share again. So I'm going to go back to, um, that, and if you tap on your grid to set an origin back in Jetset, uh, let me pull up my zoom and share that. Uh, there we go. There we go. And yep, there we go. And just reset your origin somewhere.

[00:10:56] Eliot: There you go.[00:11:00] 

[00:11:02] Ryan: Can I just hit, I can do 

[00:11:03] Eliot: reset right now, right? Yeah, yeah. You can do reset. That's fine. 

[00:11:07] Ryan: Start new. Let's get some panning going. 

[00:11:14] Eliot: Yeah. As you go back, you get more points. You can see the, uh, you can see the, uh, the compass. There we go. Yeah. Okay. So it calibrated. So, okay. So that's interesting. That's, that's actually really good to know that we're getting kind of a.

[00:11:27] Eliot: Uh, an odd, I, I spent part of this morning dealing with weird numerical things on, we use a solver system called cold map, uh, to, to crunch the, to crunch the values and on the Mac, sometimes it's the numerical things act weird. Uh, but it's doing it. So it's, it's doing, it's doing the right, as long as you're getting a yellow reticule, it looks like it's working correctly.

[00:11:49] Eliot: Uh, so I think, I think you're good. Um, I'd shoot it, maybe shoot a quick test take and go through it and make sure that, you know, do a scan, make sure the mesh lines up, but I think your calibration is fine. I'm going to show this to Greg [00:12:00] and see if there's something we can put in to make that look a little bit, make that error message look less scary.

[00:12:06] Ryan: Sure, is, um, so just if I would take the same setup that I have right now, essentially and connect that to my PC and run the calibration again. Would it help to give you the difference between the two? Like 

[00:12:22] Eliot: you certainly can. I'm that, that actually, and maybe a save the, uh, um, actually what would, what would work well, I think is just send us a chew to take a quick take with it and then zip up the take and send it to us because then we can just run it, run the calibrations ourselves on the, on PC versus Mac and see what's going on.

[00:12:40] Eliot: Okay. So that, that'd be perfect. 

[00:12:42] Ryan: Okay. Sounds good. I will, I'll just, I deleted my, my post just cause I was able to get in contact with you. So I'll just start a new post with, um, the take that I shoot after this point and, um, go from there. But hopefully this, you know, it's just a weird error that came up and it's actually [00:13:00] calibrated.

[00:13:00] Eliot: Yeah. It's benign. Yeah. Let's let's, let's test it. But that, I think that's, I think that's the case. Okay. Okay. Fantastic. Appreciate it. Excellent. Yep. Thanks a lot, Elliot. Appreciate it. No worries.