@ciupava @grischard @soporificoctopus Interesting project. Some feedback -

1. It's not clear what "swipe left" or "swipe right" means. Is it swipe _to_ the left/right, or swipe _from_ the left/right? UIs usually show a color and some text as you start to swipe, to give you a hint.

1/3

@ciupava @grischard @soporificoctopus

2. I usually like to be able to zoom in and also hide the data to check outline correctness, but there's no way to do that here. A no-interaction way would be to slowly blink the building outline.

2/3

@ciupava @grischard @soporificoctopus

3. Sometimes, only imagery is shown, with no outline.

3/3

@ciupava @grischard @soporificoctopus

What I can say: takes some time getting used to the swipe on the computer. The buttons are also not super responsive, which confuses me a bit

But thanks a lot for this SUPER NICE initiative!

@ciupava @grischard @soporificoctopus Great tool.

Some feedback. Sometimes there is no red shape at all.

@ciupava @grischard @soporificoctopus

is that demo site supposed to repeat the same few pictures over and over?

@ciupava @grischard My first though would be: how will you handle accessibility here? As vision-impaired users may not be able to fill in visual captchas.

@ciupava @grischard @soporificoctopus what’s your plan for accessibility?

@ciupava @grischard @soporificoctopus

Some images dows not have a marked building at all so its neither correcly nor incorrectly mapped.

Same Images come again and again

@ciupava @grischard @soporificoctopus overall I think the idea in interesting, however, I see a few issues at the moment:

1. this seems completely non-accessible
2. I think it requires more detailed instructions
- how precisely must the shape match? (some examples have a hand-drawn shape, some are zoomed in to show there is a slight inconsistency, though the shape is almost good... are they correct, are they not?)
- must it be a single buildings or are multiple buildings OK?

1/2

@ciupava @grischard @soporificoctopus as others have noted, being able to turn off the red outline (e.g. long press and hold?) would be a welcome improvement.

Great idea though, I hope it takes off!

@ciupava @grischard @soporificoctopus what's the accessibility fallback for people who have some kind of sight impairment?

I think even a red-green color blindness would pose issues on a photo with red outline and a lot of grass.
Getting blurred/low resolution vision is also an issue in low contrast situations.

Here's an example of red on red:

(Medien: 1)

@ciupava @grischard @soporificoctopus
i really like the idea, but see some accessibility issues and the other things people already mention here. (and i hinted at in the questionaire at the end of the demo)

some of those buildings are so hard to detect, it could also have been a trailer or something. especially when objects get small.

@ciupava @grischard @soporificoctopus sounds great but what about accessibility? 🤔

👏 👏 👏 for the release

@ciupava @grischard @soporificoctopus did a first try, I genuinely can't tell 🤷

what I am supposed to do? No "I don't know" or "skip" button?

(Medien: 1)

@ciupava @grischard @soporificoctopus like others I often get the same one a few times, or get no outline

Sometimes the building is cut by the edge of the image, and the red line goes along the edge of the image.

@ciupava @grischard @soporificoctopus

hmm, some of the images aren't zoomed in enough to decide, like this one...

(Medien: 1)

@ciupava @grischard @soporificoctopus So the first obvious problem is that some of the images have highlighted areas that are just too small to be able tell what's going on and the second problem is that after doing half a dozen or so screens I have yet to see a single case that I was prepared to mark as an accurate outline - in other words it had detected a building but had failed to generate an accurate outline.

@ciupava
@grischard @soporificoctopus If it is supposed to be a CAPTCHA alternative, maybe throw in some known bad outlines? That would also give a human some kind if confidence for their selection.

@ciupava @grischard @soporificoctopus How am I supposed to interpret this? And I don't suffer from reduced vision or anything, I'm just tired after 8h of work.

My two cents: this is a terrible idea. 'outlining' a building is no easy task. You mean one floor? One `building:part`? When talking about long rows of houses, just one or all of them?
This is confusing, time-consuming to parse, and probably in the capabilities of a computer vision Python script.

(Medien: 1)

There are a lot of color-blind people.

@ciupava @grischard @soporificoctopus

@ciupava @grischard @soporificoctopus As a non-native English speaker, I had a hard time to understand the instructions. And I was puzzled because in a number of images there is no "red shape" I can spot. Overall I feel not competent enough to succeed this test...

@ciupava @grischard @soporificoctopus
Not clear what to do when the building is almost correctly surrounded.
Also on mobile the red area can be very small and needs zooming to see. Maybe autozoom every time so the red part is 1/4 of image size.

@ciupava @grischard @soporificoctopus

Maybe let users switch the color or let the outline blink.
You should be able to zoom in.

“Correctly outlining a building” is not easy to understand, and not well defined. ONE building? A WHOLE building? A good outline or any that more or less catches a building? Some little rectangle might be something else than a building: just a roof, a container, a trailer, concrete on the ground…

Maybe add roads/rivers: Does this line mark a road/river?