What features should we add to Photosynth?

  • 1
  • translation missing: en.shared.topic.styles.singular.talk
  • Updated 5 years ago
We've got our backlog list of things that we know will make Photosynth better, but I'm sure we're only seeing some of the opportunities here. What would make Photosynth drmatically more useful and fun for YOU?
Photo of David Gedye

David Gedye, Principal Group Manager

  • 176 Posts
  • 78 Reply Likes
  • unsure

Posted 10 years ago

  • 1
Photo of Blaise Aguera y Arcas

Blaise Aguera y Arcas, Employee

  • 81 Posts
  • 38 Reply Likes
When we ship, we should put some of our backlog items up here!
Photo of Jack

Jack

  • 3 Posts
  • 0 Reply Likes
How can I user this technology on my web application in .NET? Like if I will create a map. Thanks for the reply.
Photo of Ken

Ken, Official Rep

  • 41 Posts
  • 13 Reply Likes
Videosynthing, resynth (with add/remove), assisted synthing.
Photo of Jay Spear

Jay Spear

  • 1 Post
  • 0 Reply Likes
just another person agreeing. If i could add more photos to up my synthy percentage I would be very happy.
Photo of Seika

Seika

  • 5 Posts
  • 0 Reply Likes
Agreed. Reuploading again hundreds of pictures sounds really tedious. The long time needed to process and upload the pictures could take down the enjoyment of using this product.
Photo of Blaise Aguera y Arcas

Blaise Aguera y Arcas, Employee

  • 81 Posts
  • 38 Reply Likes
Seikan, note that although the processing is repeated for the time being (which is tedious, no denying it), the upload isn't repeated. The system knows when you've already uploaded a photo and doesn't re-upload it.
Photo of Seika

Seika

  • 5 Posts
  • 0 Reply Likes
Blaise. Will it recognize the file even if the Synth project name is different ? For example adding "version 2" suffix; because I can't make another Synth with identical name
Photo of SarekOfVulcan

SarekOfVulcan

  • 1 Post
  • 0 Reply Likes
Assisted synth, definitely. I created http://photosynth.net/view.aspx?cid=A... and wound up with some dozen groups. I'd love to be able to tell PS how to fit them together.
Photo of Ken

Ken, Official Rep

  • 41 Posts
  • 13 Reply Likes
How about an artificial 3d slideshow from non-connected images. For example project them onto a cube and space bar causes the cube to rotate. Or a ring that rotates like a carousel.
Photo of Matthieu.C

Matthieu.C

  • 1 Post
  • 0 Reply Likes
or perhaps the possibility to help the software to make the connexion between non-connected images : I have some "well-connectable" images that are not connected by the software (but that, for instance, can be connected using the panoramic picture tool of windows live gallery)
Photo of paulie

paulie

  • 1 Post
  • 0 Reply Likes
A way to print panoramas that don't look like a bunch of stitched images together.

The 3d point view is really wild, but it would be amazing if you could fill in the space between the point with polygons and export a 3d, textured object.

Keep up the amazing work!
Photo of Luke

Luke

  • 39 Posts
  • 5 Reply Likes
If that is possible, is think I would even buy it and use is as 3D modeling tool. It would be so awesome to have a 3D model of a house where you can walk in every room with such great detail.
Photo of scrambler

scrambler

  • 1 Post
  • 0 Reply Likes
If you want to stich images for free, you can Download Deep Zoom Composer. It includes such a feature, and you can output the result either as a Deep Zoom Web page, or simply save the Panoramic image
Photo of j616

j616

  • 1 Post
  • 0 Reply Likes
If you could make a 3D model, you could use the possition of the orriginal photos to find which section is the floor. You could then virtualy "walk" around the model.
Photo of Peenie Wallie

Peenie Wallie

  • 29 Posts
  • 0 Reply Likes
Yes. That's right. What jg16 said. That's it exactly. Need to be able to virtually "walk" around the model, but there should not be separate buttons/controls/keys for moving vs. zooming. These have to be the same. Bringing in a walk and a zoom into VR brings the limitations of the real world into the Virtual World. Zoom and walk should be one and the same. Like flying through a virtual world on a magic carpet. Bingo.
Photo of recneps

recneps

  • 1 Post
  • 0 Reply Likes
Regarding further functionality with the point cloud, there is no need for Photosynth to make a 3D model - most of the better 3D CAD software packages (and probably a lot of the 3D graphics apps) already have a method for converting a point could into a series of surfaces. The only prerequisite is that the point could data must be in a recognizable (and preferably neutral) format, like .iges or .vda. Any chance Photosynth could generate this type of file? This effectively makes Photosynth a key component of a 3D scanning solution. Imagine being able to 3D scan small parts to entire landscapes using Photosynth..now that would rock!!
For reference here is an example of point cloud importing into the CAD s/w I currently use (SolidWorks):
http://www.rickyjordan.com/2006/08/so...
Photo of helloitsme

helloitsme

  • 1 Post
  • 0 Reply Likes
What a cool tool. The only thing I miss a better split between "open to all" and only make it viewable to a specific group; simular to the dozens of online photo albums on the web. In my opinion there is a "natural" link between a normal online photo album and your amazing extention of making it 3D. Congrats to all of you and go for it!
Photo of ScottIsAFool

ScottIsAFool

  • 1 Post
  • 0 Reply Likes
I would love to see a preview before I upload, so that I know it's going to look ok before I upload a massive amount of pictures.
Photo of r-gordon-7

r-gordon-7

  • 9 Posts
  • 0 Reply Likes
Exactly want I was goint to post!
Photo of Jordan

Jordan

  • 1 Post
  • 0 Reply Likes
Definitely agree with this.
Photo of gogan

gogan

  • 3 Posts
  • 0 Reply Likes
What he said
Photo of jmert

jmert

  • 2 Posts
  • 0 Reply Likes
Add another vote for this feature.
Photo of Nashev

Nashev

  • 9 Posts
  • 0 Reply Likes
Yes!! Yes!! Yes!!
And ability to remove/add some photos to this synth!
And manually force and hint to synth some pair of photos!
Photo of raskol

raskol

  • 2 Posts
  • 0 Reply Likes
The first thing I'd do is not allow public synthing of fewer than, say, 15 images per project. Have you seen how many projects are on display using less than 5 images? What's the point? It's just adding to the server overloads and obviously doesn't take advantage of the technology.
Photo of Chris Cardinal

Chris Cardinal

  • 3 Posts
  • 1 Reply Like
For what it's worth, I'm pretty sure the Photosynth plugin offloads all the heavy-synthing-lifting to your computer, instead of using the server to process it. But I agree that synthing with fewer than 5 images is kinda meh.

However, simply stopping users from being able to do that is a bit weird. Instead, allow me to better sort search results. Filter by: synths with at least 5,10,20 images that are at least 65%,75%,85% synthy...
Photo of Oneironaut

Oneironaut

  • 7 Posts
  • 0 Reply Likes
There should be a synthiness limit a synth must exceed in order to be uploaded. For example if synthy <10% then don't upload. I've seen so many synths on here of people who clearly don't understand what the point is. Like 10 random unrelated pictures 0% synthy. That garbage should be left on the users PC.
Photo of Peenie Wallie

Peenie Wallie

  • 29 Posts
  • 0 Reply Likes
Actually, a 0% synthy is a brilliant way to display photos using Photosynth as a GUI front-end to Seadragon. I agree that we should be able to see the synthy% and choose to upload or not based on that data, but if you stick a bunch of totally different images out there and get a 0% synthy, I personally think that it's one of Photosynth's strongest features. Allows users to browse photos effortlessly, and Seadragon includes detail only as they zoom in to inspect an image.
Photo of Oneironaut

Oneironaut

  • 7 Posts
  • 0 Reply Likes
Actually Peenie, if that's what you're after then you should check out Deep Zoom Composer. It is using the SeaDragon technology. Its a desktop app for creating DeepZoom compositions for use with Silverlight apps.
Photo of Warren

Warren

  • 9 Posts
  • 0 Reply Likes
If the favorites/view were richer (like YouTube) than the non-synthy ones would just sink to the bottom, though, right? And the cool ones would pop to the top of related and tag-lists. so maybe add a 5-star or a thumbs-up/down feature?
Photo of GeoHueb

GeoHueb

  • 1 Post
  • 0 Reply Likes
An inside and outside button. So that I can just click a button and zoom into the interior of the Taj Mahal for example.
Photo of Glencannon

Glencannon

  • 9 Posts
  • 0 Reply Likes
Perhaps what you're really suggesting is a filtering system for a synth to, in effect make is searchable. This just HAS to be in the works. Imagine just being able to search all the tags of images people upload. Or even better, using image recognition (like the image search stuff I guess on live.com) to auto-populate tags. Of course, you definitely want user generated tags such as inside/outside or whatever. I guess eventually this would HAVE to be done if you're going to make a super synth of every interesting place in the universe :)

Hey! When are you guys going to synth this up with that MSR project, WorldWide Telescope?
Photo of Shane

Shane

  • 18 Posts
  • 0 Reply Likes
Yeah, any type of filtering... filtering on resolution quality, date range, day/night, model of camera, seasons, and any major image property
Photo of Jon_Davie

Jon_Davie

  • 1 Post
  • 0 Reply Likes
The ablility to pull photos from the web, like synth my picasaweb albums. Also to create a static 3d model of the synth with all the photos visible at the same time.
Photo of Glencannon

Glencannon

  • 9 Posts
  • 0 Reply Likes
For sure! Isn't that how you all built the Notre Dame synth? By scraping all the photos tagged with Notre Dame Cathedral? So you guys can do this... Wonder how that would make Google and Flickr feel? Scraping all "their" photos :P
Photo of topmonkey

topmonkey

  • 4 Posts
  • 0 Reply Likes
Hmm...a few copyright issues involved there - Microsoft has already got in trouble for that this year!
Photo of topmonkey

topmonkey

  • 4 Posts
  • 0 Reply Likes
Hmm...a few copyright issues involved there - Microsoft has already got in trouble for that this year!
Photo of ToStr1V

ToStr1V

  • 1 Post
  • 0 Reply Likes
That would be fantastic! I was surprised to find that I couldn't view all the images in the synth at one time. It would be really useful to have a full 3-D model, as well as the fly-through feature mentioned earlier. As long as all the images used to create it are mine, what are the obstacles to making this available?
Photo of Jack Handy

Jack Handy

  • 1 Post
  • 0 Reply Likes
Add a video import feature that synths each video keyframe together. Certainly data overload but maybe you could select either keyframes or a preset number of frames/second. Also, add a feature to layer photos based on perspective. While looking at an object up close in Photosynth it would allow it to be larger. However, if you added photos taken a mile away, it would change the layers based on your 3D point of view. The result would be images at a distance would come to the top layer and the close-up image would go to the bottom.

Keep up the great work.

PS Fanboy
Photo of Matt Shannon

Matt Shannon

  • 2 Posts
  • 0 Reply Likes
Exactly. I've been doing this manually, as it's much easier to cruise around my kitchen and sample out images than take each shot over and over.
Photo of CosmicRay

CosmicRay

  • 4 Posts
  • 0 Reply Likes
Is there a processing script to do this with YouTube videos?

Someone should write a plug-in to let you sample #__ of keyframes from and synth the resulting image series.

If this happens faster then real-time, we could process live video feeds, into point clouds, which would geo-locate themselves once acquired (video uploaded to YouTube already has this information), and then perhaps render to a 3d model for use in virtual/augmented reality visualizations.
I see photosynth enabling free view point video.

I'm imagine free view point LIVE video would be the goal in this, then 3d free view point live, for remote telepresence
Photo of Jan Wesbuer

Jan Wesbuer

  • 1 Post
  • 0 Reply Likes
I would like to download the resulting pointcloud files of my synths
Photo of Sam Page

Sam Page

  • 7 Posts
  • 0 Reply Likes
Yes! This would be fantastic, I would love this feature.
Photo of Sam Page

Sam Page

  • 7 Posts
  • 0 Reply Likes
Yes! This would be fantastic, I would love this feature.
Photo of CosmicRay

CosmicRay

  • 4 Posts
  • 0 Reply Likes
Agreement and vote up.
Photo of Nashev

Nashev

  • 9 Posts
  • 0 Reply Likes
Yes, it is "must have". And not only "for my synth", I think, it must be available for every synth.

And i think, in viewer must be mode to view only full pointcloud, without photos over it. It interesting view too!
Photo of Nathanael Lawrence

Nathanael Lawrence

  • 795 Posts
  • 55 Reply Likes
Nashev, try holding the 'Ctrl' key while you're viewing a synth. Also try the 'p' key for more lasting results that don't require constantly holding something.

For more fun, click here and read the last two pages.
Photo of JackH

JackH

  • 43 Posts
  • 0 Reply Likes
present an option to allow access to the picture. I'd like the pictures in my synth to be under some CC license and I'd be happy if users were able to get a download URL for the picture that's currently marked in the synth.
Photo of Glencannon

Glencannon

  • 9 Posts
  • 0 Reply Likes
yes that would be very convenient! Also, make synth's a searchable "verticle" in Live.com You know like news or images etc. I guess the number of synths right now and amount of metadata makes this worthless for now but maybe if there "happens" to be a synth of your search term, it shows up as a possible categorized result.
Photo of Nashev

Nashev

  • 9 Posts
  • 0 Reply Likes
I'm agree and vote for it!
Photo of george

george

  • 1 Post
  • 0 Reply Likes
How bout a way to navigate between multiple synths...like when you go through a door it loads a different synth, or if you go to the outer bounds of a synth it checks for others in that area of the world...then if you add GPS locations to all of them you would have the entire world navigatable...
Photo of Andrew

Andrew

  • 6 Posts
  • 0 Reply Likes
Yes, I'd like to explore synths by locations on a map.
Photo of JackH

JackH

  • 43 Posts
  • 0 Reply Likes
I'm also surprised that I haven't seen this map yet. I guess I am just overlooking it. At least I did geotag my synthes so I'd expect that I can display them on a map somewhere.
Photo of Nashev

Nashev

  • 9 Posts
  • 0 Reply Likes
Yes! Geotag for synth need to be

And need to be ability to merge synth of a same place.
Photo of Warren

Warren

  • 9 Posts
  • 0 Reply Likes
or hyperlink from synth to synth - or within parts of the same one.
Photo of TDN169

TDN169

  • 14 Posts
  • 0 Reply Likes
I can't get geotagging to work.
Photo of Glennon

Glennon

  • 2 Posts
  • 0 Reply Likes
A few suggestions for additions:
--- An API specification (including ability to search for author, time stamp, mashup with Live Local, etc).
--- Ability to export georeferenced images into MS Virtual Earth (in 3D space), or perhaps Collada or KML file support.
--- More diversity in mouse camera control (for instance, a middle button 3D pivot would be good).
--- Multiple measures of scene quality (more besides Synthiness).
--- In-scene hyperlinks (with ability to click the links layer on and off)
--- 3D user-generated tagging of in-scene objects
--- when supercritical mass hits for some areas/scenes, enable a mode to fade out hard edges from the scene.
--- time browsing support. Same scene through time. At the extreme, I suppose that would mean embedded "synthed" video.
--- ability to host our own Synth scenes (so users can better control privacy and copyright issues).
--- Ability to add 3D objects or terrain models (dxf, collada?) to assist Synth process.

For sure, it's cool so far.
Regards!
Photo of Glennon

Glennon

  • 2 Posts
  • 0 Reply Likes
A quick search about mashing Virtual Earth and Photosynth yielded a blog entry from the Virtual Earth team posted last night. Cool.

Link (may be ugly) ----->

http://blogs.msdn.com/virtualearth/ar...
Photo of Glencannon

Glencannon

  • 9 Posts
  • 0 Reply Likes
Aww freakin' SWEET! Guess I should read all the posts before adding my two cents. Many great suggestion Glennon
Photo of Arrow

Arrow

  • 8 Posts
  • 0 Reply Likes
I think the API request is something that is definitly to be considered.
Having a photo collection and being able to use that collection (where ever it is) and creating and uploading a synth.
I'm currently involved in a project to be able to view picassa, Flickr and possibily other album art in Vista MCE. Having these albums and having an interface could let users generate a Synth automaticaly. This then should also allow users to open the synth afterwards.
AND I'M VERY GLAD that all synths are public viewable. This generates content and It is very nice to view others.... please USE!
Photo of jmert

jmert

  • 2 Posts
  • 0 Reply Likes
I fully agree, and would like to see, better/more movement controls and 3D model abilities. I also think the faded edges option would be really cool, and could make the synth look more like a real-life scene.
Photo of Nashev

Nashev

  • 9 Posts
  • 0 Reply Likes
Agree to all
Photo of neight

neight

  • 1 Post
  • 0 Reply Likes
A Mac version!
Photo of Ryan

Ryan

  • 3 Posts
  • 0 Reply Likes
Oh yeah! I REALLY don't like having to boot camp just to look at PhotoSynth. If photosynth is awesome in Windows, just think of how much cooler it would be in Mac. :)
Photo of Ryan

Ryan

  • 3 Posts
  • 0 Reply Likes
Oh yeah! I REALLY don't like having to boot camp just to look at PhotoSynth. If photosynth is awesome in Windows, just think of how much cooler it would be in Mac. :)
Photo of Blaise Aguera y Arcas

Blaise Aguera y Arcas, Employee

  • 81 Posts
  • 38 Reply Likes
uh.. I think the coolness would be.. exactly the same! But yes, we're working on crossplatform compatibility. You do have an option other than bootcamp-- apparently VMware works too.
Photo of kenmizell

kenmizell

  • 2 Posts
  • 0 Reply Likes
i'm running it on XP SP2 on VMware Fusion on a mac-book pro while running other mac things... (Note I had to turn on the accelerated graphics in the vm settings and up the ram allocation to get it to work, but it works great!)
Photo of Nashev

Nashev

  • 9 Posts
  • 0 Reply Likes
+1
Photo of cutts

cutts

  • 1 Post
  • 0 Reply Likes
Very cool!! But really have to have privacy setting... I, for one, am not ready to share all my photos with the world.

Great job!
Photo of Glencannon

Glencannon

  • 9 Posts
  • 0 Reply Likes
So just go make some sythns of your world that you are ready to share! I'm sure there's an interesting building or farm or something around you that you would like others to see :)
Photo of ACE

ACE

  • 3 Posts
  • 0 Reply Likes
Hi David,

I am envisioning the use of this application for the purpose of technical illustration in the construction field. I am, rather ironically, working on a design for a three dimensional ceiling for a Microsoft building in Boise. The product is made in France and as such, requires a signifigant amount of cooridnation to get the custom fabrication made correctly the first time.

What I envision: A file or fileshare link that could be shared with viewer permissions (aka: make it private) that would be used for a customer or in this case, a manufacturer, to understand the structure that they are going to fabricate pieces for. First step would be basic vector / Architectural type drawings that would be viewable at the proper elevations (X, Y, Z) relative to the pointcloud map of the structure. Second step would be to follow up with actual pictures of the structure. Sounds somewhat straight forward, right?

The last step is to organized the views into something definable or identifyable. On Architectural drawings, the various elevations might have a designation like "2 / A 2.2 west". The "2" is the elevation, the "A2.2" is the page number and "west" is clearly the direction of the elevation.

With Photosynth, the page number could be replaced with an overall "floorplan" type map. This is obviously a broad term that could apply to both building interiors, but also any location on the planet based on a "Live Maps" kind of navigator. And that is really the ticket. You need to eventually have a way to navigate between Photosynths in a straight forward way, but that might be a bit big picture for this discussion.

For the time being, each Synth should have a floor plan / map overview for navigation and relevance. Right now, I really don't have an idea of the scope of the Synth without button clicking for a fair bit. Have a look at what your friends at Bungie do for a floorplan of each game level in Halo 3.

P.S. Very cool application, the creativity is oozing out of your team.
Photo of Stuartr

Stuartr

  • 4 Posts
  • 0 Reply Likes
Spell check!!!
Photo of Nathanael Lawrence

Nathanael Lawrence

  • 795 Posts
  • 55 Reply Likes
Firefox 3!

(includes spell check in any textbox for a variety of languages [lest you think I'm spamming you].)
Photo of Siggi Jarl

Siggi Jarl

  • 1 Post
  • 0 Reply Likes
I really want to be able to fly through the point-cloud without the images getting in the way
Photo of Joshua Podolak

Joshua Podolak, Employee

  • 63 Posts
  • 13 Reply Likes
You can actually do this. Press the "P" button to toggle between showing the points, showing the images or showing both.
Photo of diffdude

diffdude

  • 8 Posts
  • 0 Reply Likes
Can we have a full list of keyboard shortcuts?
Photo of Blaise Aguera y Arcas

Blaise Aguera y Arcas, Employee

  • 81 Posts
  • 38 Reply Likes
You bet! We should have the keyboard shortcuts less hidden, but they're here http://photosynth.net/documentation/P...
Photo of Vagabum

Vagabum

  • 4 Posts
  • 0 Reply Likes
I noticed there is no fly through command in the current PDF docs, but I recall there being a point cloud fly through in one of the earlier Beta releases. What happened to that?
Photo of niente0

niente0

  • 3 Posts
  • 0 Reply Likes
I think you should definitely add a button in the interface with the same functionality of the 'P' key. I think many people don't read the documentation and ignore this VERY important view mode.
So please add a button for this effect asap!
Thanks
Photo of Sinclair

Sinclair

  • 1 Post
  • 0 Reply Likes
A Mac version AND an iPhone version!
Photo of Ryan

Ryan

  • 3 Posts
  • 0 Reply Likes
Oh yeah! Just imagine: taking photos with your iPhone and having them instantly turned into a PhotoSynth! That would be AWESOME!
Photo of eee25

eee25

  • 1 Post
  • 0 Reply Likes
1) It would be great if you could produce output like youtube, plain swf without any iframe. Something like:

<object width="400" height="300"><param name="movie" value="http://whatever...?cid=5a44f6f4-9870-... name="allowFullScreen" value="true"></param><embed src="http://whatever...?cid=5a44f6f4-9870-..." type="application/x-shockwave-flash" allowfullscreen="true" width="400" height="300"></embed></object>

2) A stand alone application for making and viewing synths. I understand that its main parts actually exist and work as required (PSWebClient.exe + browser plugins). Just allow them to work without the web.
Photo of leRoi

leRoi

  • 1 Post
  • 0 Reply Likes
create the possibility to add a (self made) 3D model to the synth for architectural presentation purposes.
Photo of trippeh

trippeh

  • 2 Posts
  • 0 Reply Likes
First things that popup in me:
1. An option to reverse mouse-move control.
2. Right-mouse picture-options like Zoom, Print, Copy...more...
3. Mobile version (e.g. Windows Mobile or Symbian), possibility to take pictures (with your phone) and upload them to create fast and directly a Synth)
4. Open format, like Flash or Silverlight, but I know I'm not the first one who says this...
5. An overview of possible shortcut-key's, I had to read from some topic here that "P" is the key to change between picture, points and both. What features do we have more?
Photo of bitplane

bitplane

  • 56 Posts
  • 11 Reply Likes
1) Triangulate and texture map those point clouds, or at least calculate occluding surfaces and make the points variable sizes
2) 3D view with head tracking via webcam or DIY wii-mote (see Jonny Lee's video on Youtube)
3) Support for stereoscopic views using red/blue glasses
4) Support / generate autostitch style panoramic images

Stuff that might already be supported but I don't know since I haven't had chance to play with it yet-

1) Add GPS tags to the point cloud
2) Allow multiple users to add images to the same project...
3) ...then allow people to tag images and vote on them, also technical tags like contrast / brightness adjustment etc
4) Find optimal image sizes before uploading (for blurred images)
5) Use meta-data: rotation, timestamps etc

I'm sure I'll be able to think of a million other things once I get started!
Photo of bernardo

bernardo

  • 3 Posts
  • 0 Reply Likes
i am a sculptor and would love to be able to provide the viewer with a virtual walk around the statue. is this doable?
thanks
b portner
bport4450@aol.com
Photo of Matt

Matt, Employee

  • 60 Posts
  • 13 Reply Likes
Yes. Have a look at the document on creating a synth. Basically, take about 20 photos from all around the sculpture, more if it's shiny, then create the synth.
Photo of bernardo

bernardo

  • 3 Posts
  • 0 Reply Likes
Matt- thanks for the reply. but i would like to keep the lighting and background stationary and rotate the statue on a lazy-susan type deal. does the program require a changing background? thanks
Photo of Matt

Matt, Employee

  • 60 Posts
  • 13 Reply Likes
The program certainly does better when the background changes the same way as the foreground. To work around this, you can do one or both of two things: 1) Use a really flat background like a blue or white screen. 2) Make sure the sculpture takes up a majority of the picture. Let me know how it goes; I'd love to see what you come up with.