Jump to content

Wikipedia talk:Labels/Edit types/Archive 1

Page contents not supported in other languages.
From Wikipedia, the free encyclopedia

Start with grounded theory

[edit]

Hey Mdann52. I hope you don't mind me pinging you for this question. You're the only volunteer so far!

So, we're working on a taxonomy on the meta pages: m:Research:Automated classification of edit types/Taxonomy But I'm thinking that we might do a better job if we actually look at a sample of edits and try to describe them. A standard way of identifying categories when you aren't sure what categories exist is grounded theory. Essentially, I imagine that we'd load the Wiki labels system with a small sample of edits and rather than a form full of pre-filled categories that can be selected, we'd just have one big text box in which we'd describe the edit however we thought was appropriate. Afterwards, we can review these descriptions and compare them to our taxonomy.

  • Benefits: We'd make sure our taxonomy reflects reality and the intuition you have when looking at the edit.
  • Drawbacks: We'd increase the workload for you, me, and our future collaborators.

What do you think? --EpochFail (talk • contribs) 16:40, 30 October 2015 (UTC)[reply]

Ping He7d3r and Mdann52 :D --EpochFail (talk • contribs) 22:19, 4 November 2015 (UTC)[reply]
Sorry, thought I'd already replied! I think this would be a better way of doing it, yes - I'm sure we could always change if it was too much work. Mdann52 (talk) 08:28, 5 November 2015 (UTC)'[reply]
OK Mdann52, I'll get something set up. --EpochFail (talk • contribs) 15:03, 6 November 2015 (UTC)[reply]

Recruitment

[edit]

Mdann52 & He7d3r, would you be interested in helping us recruit some other Wikipedians? Our volunteer pool is pretty small now which means a lot of work for us and less diversity in judgements. I'll be doing some more reaching out to folks today too. --EpochFail (talk • contribs) 15:05, 6 November 2015 (UTC)[reply]

Recruitment from last campaign (WP:Labels/Edit quality)

[edit]

とある白い猫 (talk · contribs), Ladsgroup, Noyster, EoRdE6, SchreiberBike, JoeSperrazza, Epicgenius, Stuartyeates, MrX, Jay8g, Blackmane, Coretheapple, Pishcal, TheMagikCow, ONUnicorn, Esquivalience, Kharkiv07, Philippe (WMF). Sarr Cat, Odeesi, Masssly Hey folks. I'm sorry for the mass ping. I figured that this would be less disruptive than posting on everyone's talk pages. Based on your previous work helping us label edit quality (which was a massive success and resulted in much better vandalism detectors), I'd like to invite you to participate in a new labeling campaign. In this one, we'll ask you to help us evaluate edits by the type of change that is made. Our goal is to stand up an automated system that can automatically label edits. See our simple mockup of what this might look like on an article history page. I figure that such a system has quite broad applications.

Unlike the last wiki labels campaign, we need your help before we can get started with labeling. We need to figure out what taxonomy we should apply to edits. Specifically, I'd like you to review/extend our complete taxonomy. If you'd like to help out, please add your name to the list of volunteers and I'll make sure you receive updates when we're ready to get started with work. If you're not interested, I'll not ping you again about this campaign. Thanks! --EpochFail (talk • contribs) 15:31, 6 November 2015 (UTC) [reply]

Mini open coding

[edit]

Hey folks. To get a sense for how to start the open coding process, I'd like to have us look at and describe a very small, random sample of edits together. I gathered a random sample of 20 edits from the last week of October and pasted links below. We'll use these open evaluation of work to extend the taxonomy of edit types and the form that we'll build for wiki labels. --EpochFail (talk • contribs) 16:29, 6 November 2015 (UTC)[reply]

Instructions
For each edit, describe both the operations performed in the edit and the reason/meaning for the changes in whatever format you think makes sense.

Mocking up a new edit type labeling interface

[edit]
Mockup of edit types form

Hey folks. I've been working with Diyiy to update the form that we'll be using with Wiki labels. We're trying to work out how to organize the work of associating "semantic" meaning about edits with "syntactic" operations. We've mocked up a form interface (see right) and we've been working a set of "semantic" meanings to capture in that form. I'll paste our proposed semantic categories below. Please feel free to boldly make modifications. --EpochFail (talk • contribs) 15:17, 11 November 2015 (UTC)[reply]

I figured that a little more explanation might be necessary. The mockup on the right shows an interface that allows you to select a semantic "intention" for a change. Then within each semantic intention box, you can add syntactic operations. Syntactic operations are "object" and "action" pairs. Building the labels this way will allow us to associate syntactic changes with the intention of those changes. An edit can have many intentions -- though only one of each. An intention can many operations associated with it. --EpochFail (talk • contribs) 18:26, 12 November 2015 (UTC)[reply]

Proposed "semantic" categories

[edit]
Link Disambiguation
redirect, repair a dead link
Fact Update
update numbers, dates, scores, table, etc..
correct inaccuracies
Formatting
change font, fix errors in wikitext code
Verifiability
add sources, citation
Cleanup
remove unnecessary information, delete whitespace
Vandalism
a deliberate attempt to damage articles
Neutral Point of View
fairly, proportionately and without bias
Clarification
specification, explanation to existing view
Adding Information
elaboration, add substantive content, insert point of views, add facts.
Copy Editing
rephrases, improve grammar, spelling, tone, punctuation

Here, copy editing might be categorized into several different semantic categories. For example, rephrase expresses the sentence/word meaning in an alternative way, replacing the original words with similar ones. Grammar checking focuses more on modifying the spelling, punctuation, tone, etc. Both rephrase and grammar checking correspond to word-level modification, and we are not sure whether they are two different types of editing work, and should be put into copy editing or two separate categories. Please feel free to provide your feedback about this, thanks! :-) Diyiy (talk) 17:27, 15 November 2015 (UTC)[reply]

Status update: 2015-11-21

[edit]

Hey folks. Thanks for your patience. Diyiy and I are working to turn the mockup into a usable part of m:wiki labels and we're making good progress, but it means that we're silent here. We're making sure that we interact well with mw:OOjs_UI, MediaWiki's standard library for form elements. Here's the repo where we are doing the work: https://github.com/halfak/semantic-labeler I suspect that we'll have something ready for testing next week. --EpochFail (talk • contribs) 15:54, 21 November 2015 (UTC)[reply]

Quick update. We've got a working prototype that is wrapped up in OOjs-UI style code. We're now working on integration into Wiki Labels. If you want to see our progress, clone https://github.com/halfak/semantic-labeler and open oo_test.html in your browser. I'll update again when we have something working in Wiki labels. Then, we'll be able to start a pilot run. Thanks for your patience! --EpochFail (talk • contribs) 00:22, 3 December 2015 (UTC)[reply]
Quick update again. The code is done. It was a lot of engineering work, but we now have a flexible, internationalized strategy for gathering a mixture of semantic and syntactic labels. We're doing a quick pilot run with just the research team so that we can give you folks something cleaner to critique. If you are impatient and want to see what we are doing, you can request a workset from the "Edit type (0.1k random sample)" campaign right now on WP:Labels. Otherwise, I'll do another ping here in a few days to let you know that the pilot run is ready and to provide instruction. Thanks for you patience! --EpochFail (talk • contribs) 16:32, 22 December 2015 (UTC)[reply]

Pilot ready for testing!

[edit]

Ping: EpochFail (talk · contribs), Mdann52 (talk · contribs), He7d3r (talk · contribs), DarTar (talk · contribs), ONUnicorn (talk · contribs), Epicgenius (talk · contribs), TheMagikCow (talk · contribs), Kharkiv07 (talk · contribs), Stuartyeates (talk · contribs), Noyster (talk · contribs), Masssly (talk · contribs), Blackmane (talk · contribs), Diyiy (talk · contribs)

We've deployed the new labeling form and a campaign containing a random sample of 100 edits. Please request a workset from the "Edit types (0.1k random sample)" campaign and label 10 edits. If you get an error saying that there are no tasks left, let us know and we'll add more. To label an edit, you'll need to "Select a semantic meaning" from the main drop-down box and add object/action pairs for the syntactic operations related to that change. If you'd like us to make changes to the available Semantic Meanings, Objects or Actions, please edit the Wikipedia:Labels/Edit types/Taxonomy boldly and we'll implement the changes for the full run. If you find any edits difficult to label, please post about them here so that we can all review.

Our goal during this pilot is to vet the taxonomy against real data and to test the labeling form to make sure it is working as expected. Once we're done with the pilot, we'll implement changes based on your feedback and deploy the full campaign. Thanks for your patience! This data is going to be super valuable. Thanks for your help. --EpochFail (talk • contribs) 17:30, 29 December 2015 (UTC)[reply]

We've gotten enough labels to move forward from the pilot. Thanks everyone who contributed. We'll be looking through the notes that you left as you were working. Please post any other thoughts or concerns you want us to address in the next iteration. --EpochFail (talk • contribs) 17:24, 9 January 2016 (UTC)[reply]
Mdann52 & ONUnicorn, pinging because you have been the most active here. I want to make sure that we know what you'd like changed in the labeling form before we do the full run. Could you reply with any concerns/ideas you have that you'd like to see implemented. We like to deploy the full campaign on Wednesday. Any notes that you can give us before then would be great. --EpochFail (talk • contribs) 17:24, 11 January 2016 (UTC)[reply]
A couple of the diffs were talk or user talk page conversations, and I don't think any of the labels really apply there. Also, one was a page move. ~ ONUnicorn(Talk|Contribs)problem solving 18:21, 11 January 2016 (UTC)[reply]
Thanks ONUnicorn. Saw those talk page edits. We'll make sure they are filtered out before we run the larger campaign. Otherwise, any concerns about the category structure? Did you have difficulty using it to describe an edit or is there anything missing that you'd like us to include? --EpochFail (talk • contribs) 18:30, 11 January 2016 (UTC)[reply]
It seems somewhat limited; like one shouldn't be able to describe every edit using those descriptors. That said, I can't put a finger on what's missing. I think most edits can be sandwiched into those categories, but they are broad enough that I'm not sure they'd all be helpful. Also, sometimes parts of one edit can be described with more than one category (for example, copy-editing an existing paragraph and adding another with new info at the same time), but the solution there is to label for the most significant change. Overall, I don't think it's too difficult. ~ ONUnicorn(Talk|Contribs)problem solving 18:36, 11 January 2016 (UTC)[reply]
Aha! It may not be clear, but you can actually apply multiple Semantic categories. That way you can label an edit for all of the changes. Just select a new semantic meaning from the drop-down and click the "+" button again. --EpochFail (talk • contribs) 18:42, 11 January 2016 (UTC)[reply]
Ping ONUnicorn :) --EpochFail (talk • contribs) 20:34, 11 January 2016 (UTC)[reply]
@EpochFail: not a lot to add here, other then the non-mainspace edits coming up :) Mdann52 (talk) 09:33, 12 January 2016 (UTC)[reply]
Will do! Thanks. Diyi and I are going to work on a few examples edits that we can use to discuss the labels. I think this will help clarify how multiple semantic meanings can be described. We should have a post today or tomorrow about that. --EpochFail (talk • contribs) 16:19, 12 January 2016 (UTC)[reply]

Testing out some templates.

[edit]

Looking at Special:Diff/651810957. I see:

Cleanup
Word
Deletion
Elaboration
Sentence
Insertion

Does that make sense? --EpochFail (talk • contribs) 16:34, 12 January 2016 (UTC)[reply]
Ping ONUnicorn. Does the above make sense to you or would you label the edit differently? --EpochFail (talk • contribs) 16:35, 12 January 2016 (UTC)[reply]

Yep, that makes sense. ~ ONUnicorn(Talk|Contribs)problem solving 16:38, 12 January 2016 (UTC)[reply]
Great! Thanks! --EpochFail (talk • contribs) 16:42, 12 January 2016 (UTC)[reply]

Examples, Taxonomy, and Discussions

[edit]

Hey folks. We've been working to make it easier to discuss our current taxonomy and potential modifications. See Wikipedia:Labels/Edit_types/Taxonomy and discussion at Wikipedia_talk:Labels/Edit_types/Taxonomy.

I've also been working on a set of examples at Wikipedia:Labels/Edit_types/Examples. I'd like to have ~10 representative examples there before we start the full campaign so that we can direct everyone to those examples for training. Right now, there's just two. Please feel free to add your own examples. It would be great if you could target some hard-to-classify edits. --EpochFail (talk • contribs) 15:57, 13 January 2016 (UTC)[reply]

Pilot v2 is live!

[edit]

Ping: EpochFail (talk · contribs) Mdann52 (talk · contribs) He7d3r (talk · contribs) DarTar (talk · contribs) ONUnicorn (talk · contribs) Epicgenius (talk · contribs) TheMagikCow (talk · contribs) Kharkiv07 (talk · contribs) Stuartyeates (talk · contribs) Noyster (talk · contribs) Masssly (talk · contribs) Blackmane (talk · contribs) Diyiy (talk · contribs) Econterms (talk · contribs) DGG (talk · contribs)

Hey folks! I just loaded a new pilot campaign into the Wiki labels system. This pilot contains 500 revisions so that we can more thoroughly test the taxonomy against real edits. Please see the new "Edit types (0.5k sample)" campaign at Wikipedia:Labels and request some worksets. Also please take notes in the labeling form if you struggle to fit an edit into the taxonomy. We'll use your notes to make changes. Happy labeling! --EpochFail (talk • contribs) 17:01, 16 February 2016 (UTC)[reply]

Pilot v2 Notes

[edit]

@ EpochFail (talk · contribs) Based on the revisions that I've labeled, I summarized my notes as below:

  1. 'Relocation': I do not need how to properly label this one. Currently, I regard 'Relocation' as 'Refactoring' intention, and for the syntactic operations, every operation comes in pair. That is, if the relocated paragraph contains wikilink and body copy, I will have wikilink-insertion, wikilink-deletion, body copy-insertion and body copy-deletion.
  2. I found it is helpful to better identity the intentions by taking into account the comments that editors provided to summarize their edits.
  3. Why do people add pictures or files? I labeled it as 'Elaboration'.
  4. For adding categories, I labeled it as 'Process'. Does this make sense?
  5. I'm not sure for formatting (remove punctuation or insert space in some tables), should I label it as Copy Editing or Wikification?
  6. Maybe we should pay special attention to 'Information' object in the syntactic operations, if the current edit modifies the meaning of the article, then please select information-modification or information-insertion. If an edit removes some opinions from the article, then it belongs to information-deletion. --Diyiy (talk) 23:15, 18 February 2016 (UTC)[reply]
I thought adding categories fell more under "Wikification". ~ ONUnicorn(Talk|Contribs)problem solving 17:41, 19 February 2016 (UTC)[reply]
+1 for Wikification. That's my thought too. --EpochFail (talk • contribs) 20:26, 19 February 2016 (UTC)[reply]
+1 for pictures or file adding going into Elaboration. I agree that special attention needs to be paid to the "Information" object. Do you think we should break that out of the SemanticOperationsSelector and have it be a separate field? That might call the appropriate attention to it. --EpochFail (talk • contribs) 20:45, 19 February 2016 (UTC)[reply]
@ EpochFail (talk · contribs)  : I think 'Information' here represents a non-physical object, where all other objects (body copy, template, markup) are all physical objects. Having it in the syntactic objects seems reasonable. But we need to let people know that, for each annotation, we also care about whether such edit changes the meaning or not.
Other thoughts:
  1. I think it might sense to change Fact Update to Fact Correction. Fact update means, something was correct in the past (not correct in present). and we update it to be correct now. Fact Correction means, something could be either correct or incorrect, and we change it to be correct in present.
  2. Body Copy seems a bit too professional, a bit journalistic. Should we consider 'Body Text' here?--Diyiy (talk) 15:52, 22 February 2016 (UTC)[reply]

Diyiy, it was not clear from your response... Are you in favor of separating "Information" into a separate field? I'm having a bit of fun imaging what Maxwell would say about information being a physical thing or not. lol I don't see a clear need to change "Fact Update". I don't see the term "Correction" to be relevant in the case that a fact is added -- nothing is being "corrected". I also don't see what the problem is with being professional or how "body text" is more desirable. Could you elaborate? --EpochFail (talk • contribs) 16:08, 22 February 2016 (UTC)[reply]

Ping Diyiy.  :) --EpochFail (talk • contribs) 15:19, 15 March 2016 (UTC)[reply]
@EpochFail (talk · contribs): (1) I agree to put information or meaning changes annotation into a separate field; might be a separate box below the current Notes field. However, it might increase the annotation cost; (2) Using either Body Copy or Body Text is okay, as long as we could explain/make 'Body Copy' easy to understand for others; (3) Fact correction could update something from incorrect to correct, from less correct to correct and from none to correct; fact update can deal with something that were correct in the past (incorrect right now), and we update it to be correct in present. Even though there are some slight differences, using fact update is fine. --Diyiy (talk) 15:20, 16 March 2016 (UTC)[reply]

Pilot v2 Preliminary Analysis

[edit]

Up to March 10, 2016, we've had 199 revisions annotated by 15 different annotators. About 60 revisions were annotated by two judges. The most common semantic labels used were copyediting (37), elaboration (33), wikify (26) and factupdate (12) and the most common syntactic labels were bodycopy_insert (24) wikilink_insert (19) bodycopy_modification (18) and bodycopy_deletion (16).

To calculate the agreement between annotations, we divided the number of labels in common for the same revision (i.e., the interaction of labels) by total of distinct labels used on that revision (i.e., their union). Agreement was low, with 22% overlap for semantic labels and 25% for syntactic ones. At this point, we don't know why the agreement is so low. One possibility is that both judges were correct in the labels they applied, but identified different subsets of the edits to a revision. The other is that judges had low agreement because they disagreed about the edits they saw (e.g., someone labeled the same revision as a copyedit and another labeled it as wikify).

In any case, this level of agreement is too low to use as the basis of ground truth for a classifier to automatically label revisions. It suggests that we can't just simply rely upon expert Wikipedians with no training to do the labeling. To increase reliability, we'll need multiple judges per revisions and will also need to train the judges. In addition, the rate of labeling was very slow, with only 199 of 1000 revisions annotated in a month period. We're considering whether we should recruit Wikipedian volunteers more vigorously and provide them with online training. Another possibility is to recruit paid research assistants at a university and provide them training. Robertekraut (talk) 18:42, 11 March 2016 (UTC)[reply]

I wonder if we could look through a few of these examples of disagreement so that we could evaluate why they happened. It seems like a good idea to include any edits that were particularly hard to classify into the WP:Labels/Edit types/Examples. It seems like the 78% of edits with two labels and no overlap would be a good place to start. --EpochFail (talk • contribs) 15:18, 15 March 2016 (UTC)[reply]

Annotation Comparison

[edit]

This part compares annotations given by two users in the pilot 2 study. --Diyiy (talk) 19:39, 15 March 2016 (UTC)[reply]

Problems:

  • Some annotators submit Empty annotations, with either Empty semantic labels or Empty syntactic labels or both.
  • Empty submit

annotation pairs table
revision_id notes semantic_labels user_id
Special:Diff/702515542 factupdate 27447625
factupdate 42038131
Special:Diff/701542520 Switches to a more specific category other 6877667
Update of Category name. 689
Special:Diff/704294204 elaboration 30495
12553875
Special:Diff/702518115 copyediting 42038131
wikify 725
Special:Diff/704027539 28410464
factupdate 30495
Special:Diff/701852174 Not sure if correct edit, it's a stronger statement than the previous one, without a ref. 689
simplification 42038131
Special:Diff/704750361 as noted previously, edits adding single items to an existing list seem pretty frequent and it's unclear if list modified is the right way of capturing them. elaboration 1511845
12553875
Special:Diff/703357231 disambiguation 1511845
copyediting 42038131
Special:Diff/703082863 Commons bot renaming image file. process 8303885
factupdate 42038131
Special:Diff/701668119 clarification 42038131
clarification 8303885
Special:Diff/702983685 9142666
process 42038131
Special:Diff/702005482 process 1511845
38330651
Special:Diff/703233024 30495
38330651
Special:Diff/703354004 copyediting 27447625
12553875
Special:Diff/703161813 15210047
countervandalism 42038131
Special:Diff/703814167 elaboration 1511845
elaboration 42038131
Special:Diff/704927758 disambiguation 1511845
disambiguation 42038131
Special:Diff/702799825 15210047
factupdate 42038131
Special:Diff/704393871 15210047
wikify,process 8303885
Special:Diff/702833745 copyediting 27447625
simplification 42038131
Special:Diff/702695599 elaboration 1511845
factupdate 30495
Special:Diff/702090205 vandalism 27447625
vandalism 1511845
Special:Diff/700921971 addition of single fact 2688978
I've come across an edit adding an item to an existing list for the 3rd time in a workset. Unclear if this should be categorized as a list modified or new information inserted. elaboration 1511845
Special:Diff/702987460 Add a wikilink (not just the brackets, the whole wikilink). 689
38330651
Special:Diff/704102928 copyediting 27447625
9142666
Special:Diff/700884947 15210047
disambiguation,copyediting 42038131
Special:Diff/702921384 2688978
factupdate 42038131
Special:Diff/704500788 refactoring 42038131
12553875
Special:Diff/705007180 elaboration,refactoring 27447625
wikify,clarification 42038131
Special:Diff/703419170 2688978
elaboration,clarification 42038131
Special:Diff/704437632 copyediting 27447625
wikify 42038131
Special:Diff/701258460 2688978
copyediting 27447625
Special:Diff/701634677 wikify 8303885
wikify 42038131
Special:Diff/702499251 Clearer word. 689
copyediting 42038131
Special:Diff/705204449 copyediting 27447625
wikify 725
Special:Diff/700627853 Deleted a paragraph. Not sure if legit edit. 689
simplification 42038131
Special:Diff/702802858 elaboration 1511845
38330651
Special:Diff/704220052 2688978
factupdate 42038131
Special:Diff/703397716 copyediting 28410464
unclear how to file edits trimming whitespace copyediting 1511845
Special:Diff/701761174 15210047
wikify 42038131

OK Reviewing the table here, I can see some trends that are probably due to our lacking instructions or some interface issues. I'll sign after each note so that we can have some sub-discussions.

I'm pretty sure I chose labels for each edit(except for two I believe).I Don't know what to tell you!(a bug perhaps?)Let's see what will other users say about this.--Arian Ar (talk) 16:02, 16 March 2016 (UTC)[reply]
Arian Ar. Aha! It could be a bug. What browser & OS are you using? If you load up the workset again, do you see the labels you submitted earlier? --EpochFail (talk • contribs) 16:03, 16 March 2016 (UTC)[reply]
It's fixed!Last time the green add button for the lables wasn't there!I think it was a problem with my browser.I used google chrome v47 but today I updated it and saw the add button!Anyway I fixed my workset and added labels for each edit.(btw I use Windows 7) tnx for informing me!--Arian Ar (talk) 12:51, 17 March 2016 (UTC)[reply]
Great! Thanks for having another look. It seems like others are having similar issues, so I'll keep looking into this, but your report is very helpful for finding out what went wrong. --EpochFail (talk • contribs) 13:42, 17 March 2016 (UTC)[reply]
I think I used labels for all of the edits, but I'm not sure. Can I go back and look again? epicgenius (talk) 16:15, 16 March 2016 (UTC)[reply]
epicgenius, seems to be a recurring theme here. When I look into the wikilabels system, it looks like we got your notes, but no semantic/syntactic labels. You can re-load your past worksets from WP:Labels to have a look, but I'm guessing you won't see past labels there. Can you tell me what browser/operating system you are using? --EpochFail (talk • contribs) 16:54, 16 March 2016 (UTC)[reply]
@EpochFail: OS X El Capitan version 10.11.2. I use either Mozilla Firefox or Google Chrome. Today, I used Firefox, but before, I think I used Chrome. epicgenius (talk) 18:17, 16 March 2016 (UTC)[reply]
epicgenius, I'll try to replicate the problem. In the meantime, could you try to submit a few more labels to see if the system is currently working? --EpochFail (talk • contribs) 20:51, 16 March 2016 (UTC)[reply]
@EpochFail: I just submitted another workset, and I labeled all of the 10 edits. The strange thing is, when I went to review my workset again, the notes were still there, but the labels had disappeared. epicgenius (talk) 21:24, 16 March 2016 (UTC)[reply]
@Epicgenius:, I just looked through our data report and it seems that these labels weren't saved either. Are you clicking on the "+" button? I've take some screenshots demonstrating how the "+" button works. See imgur.com/JrbQygl. --EpochFail (talk • contribs) 14:32, 17 March 2016 (UTC)[reply]
@EpochFail: Nope. (Oops.) I guess I should go back and fix these. epicgenius (talk) 15:18, 17 March 2016 (UTC)[reply]
Sorry, User:EpochFail, I've been busy with other things. Mainly real life things. Stuartyeates (talk) 08:39, 17 March 2016 (UTC)[reply]
@Epicgenius:, Aha! Our fault! The UI should be more clear. I'll think about this and see if there's a nice change that we can make to make this more obvious. --EpochFail (talk • contribs) 21:26, 17 March 2016 (UTC)[reply]
@EpochFail: It's OK, I think I didn't pay attention to the [+] label, as I am inattentive a lot of the time. epicgenius (talk) 14:23, 18 March 2016 (UTC)[reply]
Stuartyeates, no worries. I wonder if you have some thoughts on why we got a bunch of blank labels from you though. It seems that some people have been reporting that they'd been submitting labels, but they haven't been saved. --EpochFail (talk • contribs) 13:41, 17 March 2016 (UTC)[reply]
I think this is clarification; this might be my mis-selection (will be more careful next time :-) ). --Diyiy (talk) 17:38, 16 March 2016 (UTC)[reply]

Inconsistent Annotation

[edit]

Here are some inconsistent annotations. --Diyiy (talk) 19:39, 15 March 2016 (UTC)[reply]

Revision ID Annotation A Annotation B
Special:Diff/705204449 copy editing wikify
Special:Diff/705007180 Elaboration, refactoring clarification, wikify
Special:Diff/704437632 copy editing wikify
Special:Diff/702518115 copy editing wikify

Some notes on these examples with inline signatures so we can have separate discussion threads.

Retrieved from "https://wiki.riteme.site/w/index.php?title=Wikipedia_talk:Labels/Edit_types/Archive_1&oldid=712679730"