Label or annotate elements in images

I would like to add markers with labels or annotations to images. The idea is to have a photo of a masonry wall with pits and cracks. Those should be identified.

There seems to be no option to add markers on an ImageView and no option to add an image to MapView and GeoJSONView.

So far I have managed to add a photo to a Folium map by uploading it, but unfortunately this is a WebView which does not support the GeoPoint, GeoPolyline or GeoPolygon.

I will relabel this a feature request as indeed it is currently not possible to add markers to an image view.

Could you elaborate on the use case? Is it purely to do classification on images? What would you like to do with the map view? Or did you only tries this because that supports interaction by means of points, lines and polygons?

The use case I think of would be to mark points, lines and areas of interest in a photo. In particular we work on historic structures (quay walls, but it would also be useful for other objects) and would like to identify cracks, pits, etc. At the moment only the number of cracks is written down. The tracability (herleidbaarheid) / reproducibility would increase tremendously when it is possible to check what was identified as a crack.
I think the implementation would be similar to the current possibilities to draw points, lines and polygons on a map, that is why I tried to do it with a map view as a kind of work around.

Great thanks for the additional context.

We are considering adding a more generic form of interaction on a webview. This would allow developers to implement their own javascript code to return information from the view back to the parametrization. I think that should make it possible to achieve what you want to do here.

I hope that works. Will it include the possibility to easily reproduce / show the original photo with the added points, lines, areas and annotations?
As I wrote, I think a feature similar to the option to draw on a map, but more versatile (including photos) would be great. Also just making it possible to overlay a photo on a MapView would be great and be very versatile to include for instance geotiffs on maps.

Wow, sounds promising. Do I understand it correctly that (theoretically) we could than have a WMS map (like leaflet-and-web-map-service) and allow for a MapInteraction?

@rkg That would be very nice :grinning:

Yes indeed. The idea of the prototype we created is that a developer can implement their own logic in javascript and send information back to the parametrization. The FE subsequently sets this information on the parameters in a similar way as a SetParamsButton.

1 Like

When will the prototype be available for testing?

Hi Thomas, unfortunately this is not clear yet. I will update when I know more

Yesterday we released a platform version that supports a communication channel between the WebView and the Parametrization.The communication channel works like a SetParamsButton. For a basic implementation example please have a look at our documentation.

plotly_interaction

With this feature you can write your own logic in JavaScript to determine which data you want to send back to the params.

Looking forward to hear your experiences and feedback!

1 Like

@Johan_Tuls @Enrique I think you guys might be interested to play around with this new functionality as well :technologist:

1 Like

Thanks for sharing, yes we do, thanks for tagging!