Wikipedia talk:ReFill/Archive 4

This is an archive of past discussions on Wikipedia:ReFill. Do not edit the contents of this page. If you wish to start a new discussion or revive an old one, please do so on the current talk page.

Archive 1

Archive 2

Archive 3

Archive 4

Discussion at WP:VPT § Proposed Google Summer of Code project: expanding citations

You are invited to join the discussion at WP:VPT § Proposed Google Summer of Code project: expanding citations. Enterprisey (talk!) 08:02, 12 January 2022 (UTC)

This discussion is archived now. If anyone goes looking for it, the permalink is Wikipedia:Village pump (technical)/Archive 194#Proposed Google Summer of Code project: expanding citations. Curb Safe Charmer (talk) 14:27, 26 January 2022 (UTC)

RfC: Block reFill until fixed

Wikipedia:Village_pump_(proposals)#RfC:_Block_reFill_tool_until_fixed -- GreenC 21:58, 21 January 2022 (UTC)

This discussion has since been archived. The new location is Wikipedia:Village pump (proposals)/Archive 187#RfC: Block reFill tool until fixed. Curb Safe Charmer (talk) 12:12, 7 March 2022 (UTC)

Please add support for simplewiki?

Tracked in Phabricator
Task T295327

This doesn't seem to work on simplewiki? Mako001 (C) (T) 11:40, 16 January 2022 (UTC)

@Mako001: This is the same issue that is affecting the other language versions. Curb Safe Charmer (talk) 14:46, 26 January 2022 (UTC)

Turkish Wikipedia

Tracked in Phabricator
Task T295327

Can you add tr.wikipedia.org --Hedda Gabler (talk) 14:47, 20 March 2022 (UTC)

Uh-Oh!

I always get to Uh-Oh! message. Where is the other version of reFill? The one with a greek letter, or something. --Bageense^(disc.) 02:09, 21 April 2022 (UTC)

@Bageense: try User:Dispenser/Reflinks. Curb Safe Charmer (talk) 07:07, 10 May 2022 (UTC)

Is this tool down again?

Tracked in Phabricator
Task T308989

Just asking because I've been waiting for an available worker for the last fifteen minutes. This is Paul (talk) 18:22, 22 May 2022 (UTC)

Looks like there is a problem, I have raised a ticket. We have not had a problem for a long time. Keith D (talk) 20:06, 22 May 2022 (UTC)

Thanks for raising the ticket. The tool is still down. "Waiting for an available worker" is still the message. Skilgis1900 (talk) 16:28, 23 May 2022 (UTC)

The tool has been repaired and is now operational.Skilgis1900 (talk) 19:49, 23 May 2022 (UTC)

This was thanks to TheresNoTime who responded to my ping on IRC and quickly went to work on this; she's now in the maintainers group for the tool. She redeployed the project and it started working again. Hopefully she'll look at the root cause and document her steps in due course. Curb Safe Charmer (talk) 14:24, 24 May 2022 (UTC)

spaced hyphens rather than spaced endashes

Hello: This is an instance where ReFill converted spaced endashes into spaced hyphens. Also it added spaced hyphens. But MOS:HYPHEN says we should spaced endashes. Can you convert this feature and correct the problem. If it produces "{{snd}}" or "& nbsp; – " we'd have a better tool. Thanks so very much. – S. Rich (talk) 06:41, 18 December 2021 (UTC)

Data incorrectly indentified as names on IndiaToday.in

Tracked in Phabricator
Task T245092

Task Name fixWikipage
Task ID 0ae01fce-e612-4ce9-8fc2-da5b2f73f939
Change ID 1
Old Text https://www.indiatoday.in/india/story/bengali-theatre-actor-play-bjp-1778746-2021-03-13
New Text {{Cite web|url=https://www.indiatoday.in/india/story/bengali-theatre-actor-play-bjp-1778746-2021-03-13|title=Bengali theatre actor loses his role in play after joining BJP|first1=Prema Rajaram New|last1=DelhiMarch 13|first2=2021UPDATED:|last2=March 13|first3=2021 08:18|last3=Ist|website=India Today|accessdate=12 September 2021}}

– Rummskartoffel 22:10, 12 September 2021 (UTC)

We need to work out a way of deploying fixes to this tool, as at the moment we have requests but have been unable to change the tool until existing fixes can be deployed. Keith D (talk) 00:34, 13 September 2021 (UTC)

@Rummskartoffel and Keith D: This issue is not specific to reFill. Fixing it would require somebody to create a Zotero translator specific to India Today. I have added a new section to the reFill home page to explain why this is so and how to create such a translator. Curb Safe Charmer (talk) 16:16, 26 January 2022 (UTC)

Next steps

I have had a go at putting together a list of steps needed to achieve a release of the tool and help in future work. There could be lots of holes in this, but it is a start. I have placed it at Wikipedia talk:ReFill/Plan rather than clutter this page, feel free to modify it as needed. Keith D (talk) 22:17, 25 February 2022 (UTC)

@Keith D: see also meta:Grants:Project/Rapid/TheresNoTime/reFill 3.0#Endorsements. It would help if you could add your support there. Curb Safe Charmer (talk) 16:24, 27 February 2022 (UTC)

Please add simple.wikipedia.org support

Tracked in Phabricator
Task T295327

Same templates and language, so should be easy. Although that might fool the tool into thinking it is en. AManWithNoPlan (talk) 16:08, 26 February 2022 (UTC)

Just to be clear, I am talking about support this way:

mw.loader.load( "https://meta.wikimedia.org/w/index.php?title=User:Zhaofeng_Li/Reflinks.js&action=raw&ctype=text/javascript" );

AManWithNoPlan (talk) 16:10, 26 February 2022 (UTC)

@JPxG: Are you able to take this on? Curb Safe Charmer (talk) 09:27, 1 March 2022 (UTC)

the JS interface returns "en". AManWithNoPlan (talk) 12:39, 1 March 2022 (UTC)

But mw.config.get( 'wgServer' ) returns simple.wikipedia.org. AManWithNoPlan (talk) 14:06, 1 March 2022 (UTC)

RTE.ie is not a journal

Refill converts raw www.rte.ie urls to Template:cite journal, thus causing a cs1 error flag ("{{cite journal}}: Cite journal requires |journal=(help)"). Template:cite web would be more appropriate, in general, with Template:cite news for www.rte.ie/news -Bogger (talk) 22:34, 25 February 2022 (UTC)

ditto www.bis.org -Bogger (talk) 15:29, 8 March 2022 (UTC)

last=published added often

https://wiki.riteme.site/w/index.php?title=Fennec_Shand&type=revision&diff=1071520729&oldid=1071520650 AManWithNoPlan (talk) 15:42, 14 February 2022 (UTC)

@AManWithNoPlan: This is an issue with Citoid / Zotero, rather than specifically with reFill. Curb Safe Charmer (talk) 20:41, 14 February 2022 (UTC)

I think this edit is also related:

Task Name fixWikipage
Task ID ab7e70bb-4123-4e3a-befd-f7b9c52682b3
Change ID 2
Old Text [http://diepresse.com/home/panorama/religion/448726/index.do?_vl_backlink=/home/index.do Gerhard Wagner ist neuer Weihbischof für Linz.]{{Dead link|date=December 2019 |bot=InternetArchiveBot |fix-attempted=yes }}
New Text {{Cite web|url=https://www.diepresse.com/448726/gerhard-wagner-ist-neuer-weihbischof-fuer-linz|title=Gerhard Wagner ist neuer Weihbischof für Linz|first=31 01 2009|last=Um 13:03|date=31 January 2009|website=Die Presse}}

Lokfahrer (talk) 08:34, 28 March 2022 (UTC)

creates bogus |title=value

This edit. |title= should never hold a url; this tool should not make up values for |title=. Don't know the title of the source? Abandon the edit.

—Trappist the monk (talk) 15:09, 25 June 2022 (UTC)

@Trappist the monk: that edit was from 18 March 2021. In the test I just carried out, the same original ref is now not processed by reFill. Curb Safe Charmer (talk) 17:01, 26 June 2022 (UTC)

Soft-404

Special:Diff/1031964482/1045055733: The URL http://www.astronautix.com/lvs/tope111l.htm redirects to http://www.astronautix.com/4/404page.html which returns status 200 ie. a soft-404. The only way to catch these is a filter that looks for "404page.html". We found 25 so far reFill incorrectly migrated, and manually going through and fixing. -- GreenC 13:38, 23 April 2022 (UTC)

Two links

I still get, on en.Wikipedia, two entries under "Tools":

reFill 2 New!
reFill(o)

They link, respectively, to:

https://refill.toolforge.org/ng/result.php?page=[whatever]
https://refill.toolforge.org//result.php?page=[whatever]

Is that expected, and if so, why? Andy Mabbett (Pigsonthewing); Talk to Andy; Andy's edits 17:35, 8 May 2022 (UTC)

There is a problem that needs fixing. The second link should go to an options page where it allows you to set options for the run and save them for future runs. I did raised this here. Keith D (talk) 16:44, 9 May 2022 (UTC)

If someone with JavaScript skills would like to fix this in meta:User:Zhaofeng_Li/Reflinks.js I can deploy the updated code to a new location (rather than in Zhaofeng Li's userspace). Curb Safe Charmer (talk) 07:04, 10 May 2022 (UTC)

Is it wise to fork the tool, especially when so many people use the original? Andy Mabbett (Pigsonthewing); Talk to Andy; Andy's edits 12:44, 10 May 2022 (UTC)

Ignores existing reference names that are pointers

When there are references with the same content, the tool will change their names to match (and this is good). But, if there are leftover <ref="oldone" />, they do not get changed to <ref="newone" /> often. This is a bug that has existed for many years. AManWithNoPlan (talk) 15:20, 10 May 2022 (UTC)

Cite web vs cite web

It appears that cite web is preferred to Cite web, so the tool should at the very least stop correcting cite web to Cite web. Perhaps even reverse it. AManWithNoPlan (talk) 15:32, 10 May 2022 (UTC)

Cite type

May be we could expand to use {{cite news}} in some cases, rather than always using {{cite web}} Keith D (talk) 17:32, 10 May 2022 (UTC)

Invisible characters

Sometimes, when filling in references, the tool can attempt to insert invisible characters. Here is an example. Now, I've noticed this is actually quite a deep-rooted issue, since its from the site's metadata, however I think it may be worth implementing an automatic or at least partial automatic fix, as it seems some users ignore these errors anyways, and its actually quite a safe fix from a coding standpoint. The best move would be to replace all non-breaking spaces with regular spaces, and to remove any other character considered "invisible". This is because the NBSPs are just spaces with line break rules, and removing the spacing could just make everything looklikethis. But the rest of the characters are actually invisible. (Except soft-hyphen, im not sure which action would be better in that scenario). Aidan9382 _(talk) 06:25, 24 May 2022 (UTC)

@Aidan9382: there is no current active maintenance of the tool, though an application for funding has been submitted to enable some development to be undertaken. This is due for a decision to be made, but you could still support it. See here Keith D (talk) 22:04, 24 May 2022 (UTC)

creating bogus url from an archive snapshot url

Tracked in Phabricator
Task T309630

I've been noticing stuff like this edit recently where the tool converts something like this:

<ref>[https://archive.today/20120909162942/http://www.sgilibrary.org/view.php?page=923&m=3&q=all the beings Sokai Gakka International: All the beings]</ref>

to this:

<ref>{{Cite web|url=http://www.sgilibrary.org/view.php|archiveurl=http://archive.today/20120909162942/http://www.sgilibrary.org/view.php?page=923&m=3&q=all|deadurl=y|title=SGI Library Online - The Writings of Nichiren Daishonin}}</ref>

Yeah, the same ongoing |deadurl=y problem (will this never be fixed?) but also the original url named in the archive snapshot has been stripped of an important query string so that we get |url=http://www.sgilibrary.org/view.php instead of |url=http://www.sgilibrary.org/view.php?page=923&m=3&q=all. The tool should not be stripping query strings from urls.

Sigh.

—Trappist the monk (talk) 14:35, 31 May 2022 (UTC)

and another bogus url

From this edit, in addition to the |deadurl=y problem, the tool converts this:

<ref>[http://www.jgk.be.ch/site/index/g_gerichte.htm Gerichte und Strafverfolgungsbehörden] {{webarchive |url=https://web.archive.org/web/20050901011010/http://www.jgk.be.ch/site/index/g_gerichte.htm |date=1 September 2005 }}</ref>

to this:

<ref>{{Cite web|url=https://www.dij.be.ch/de/start.html|archiveurl=https://web.archive.org/web/20050901011010/http://www.jgk.be.ch/site/index/g_gerichte.htm|deadurl=y|title=Direktion für Inneres und Justiz des Kantons Bern - Startseite|archivedate=1 September 2005|website=Kanton Bern}}</ref>

In this conversion, the tool apparently ignores all of the path part of the original url (/de/start.html) – http://www.jgk.be.ch redirects to https://www.dij.be.ch/de/start.html and from that redirected url the tool gets the invalid |title=Direktion für Inneres und Justiz des Kantons Bern - Startseite; not the title of the original external link (Gerichte und Strafverfolgungsbehörden). The tool should not do that.

—Trappist the monk (talk) 15:50, 31 May 2022 (UTC)

Strange link

This:

<ref name=Input>{{cite web|url=https://www.inputmag.com/gaming/what-real-life-tall-women-really-think-about-resident-evil-villages-tall-vampire-lady-dimitrescu|title=What real-life tall women really think about 'Resident Evil Village''s tall vampire lady|last=Wright|first=Steven|date=May 7, 2021|work=Input Mag|access-date=May 6, 2021}}</ref>

Became this:

<ref name=Input>{{cite web|url=[https://www.inputmag.com/gaming/what-real-life-tall-women-really-think-about-resident-evil-villages-tall-vampire-lady-dimitrescu|title=What ] real-life tall women really think about 'Resident Evil Village''s tall vampire lady|last=Wright|first=Steven|date=May 7, 2021|work=Input Mag|access-date=May 6, 2021}}</ref>

It can be examined here. I archived the URL. ―Susmuffin ^Talk 04:19, 15 June 2022 (UTC)

@Susmuffin: I've just done a test, running reFill over the original reference and cannot reproduce this behaviour - reFill doesn't modify the reference. Curb Safe Charmer (talk) 17:06, 26 June 2022 (UTC)

That is strange. I tested it again, and I was able to reproduce it. For reference, I was using [1] on Lady Dimitrescu. ―Susmuffin ^Talk 17:24, 26 June 2022 (UTC)

@Susmuffin:Thanks, I can reproduce now. I have narrowed the problem down to the following

a<ref>{{cite web|url=https://www.inputmag.com/gaming/what-real-life-tall-women-really-think-about-resident-evil-villages-tall-vampire-lady-dimitrescu|title=What real-life tall women really think about 'Resident Evil Village''s tall vampire lady|last=Wright|first=Steven|date=May 7, 2021|work=Input Mag|access-date=May 6, 2021|archive-date=May 7, 2021|archive-url=https://web.archive.org/web/20210507044543/https://www.inputmag.com/gaming/what-real-life-tall-women-really-think-about-resident-evil-villages-tall-vampire-lady-dimitrescu|url-status=live}}</ref> ''B''

The problem only occurs when the reference is followed by something in italics. The reason is that in the title that is already present, the phrase Resident Evil Village begins with one apostrophe but is followed by two apostrophe's (presumably, one to end the phrase and one for the possessive). This is messing with the markup as it is being treated as unbalanced italic tags. Curb Safe Charmer (talk) 14:48, 27 June 2022 (UTC)

Proposed WMF grant funding of maintenance of reFill

TheresNoTime has requested a grant from WMF to fund maintenance work on reFill. Your support for their proposition is welcomed. Curb Safe Charmer (talk) 10:42, 14 February 2022 (UTC)

@TheresNoTime and Curb Safe Charmer: has there been any news on this application, as it looks like the end date was May 2022? Keith D (talk) 18:03, 2 July 2022 (UTC)

Hey Keith D, between making that grant request and now, I've accepted a position working for the WMF. Having spoken to a grants coordinator a little while ago, I made clear that I would be uncomfortable continuing the request — you have however reminded me to email Curb Safe Charmer about potentially taking up leading the grant proposal

— TNT (talk • she/her) 18:54, 2 July 2022 (UTC)

Thanks for the update, just seams to be dragging on and no light at the end of the tunnel as yet. Keith D (talk) 23:33, 2 July 2022 (UTC)

deadurl=y

[2] Dispays error for cite web, because it was changed to "url-status=dead" Pelmeen10 (talk) 13:27, 29 July 2022 (UTC)

Thanks for you post Pelmeen10. This has been a problem for years. You need to paste the |url-status=dead over the old format. We live in hope that it will get fixed one day but I suspect it won't be anytime soon. MarnetteD|Talk 13:35, 29 July 2022 (UTC)

—Trappist the monk (talk) 13:44, 29 July 2022 (UTC)

@Trappist the monk: the weird thing is, in the Russian language Wikipedia it still accepts the deadurl=y :-) Lotje (talk) 15:14, 29 July 2022 (UTC)

Not at all weird. ru.wiki is a wholly separate project that is using a modified, old (looks like c. 2018) version of the cs1|2 module suite. At en.wiki, |deadurl= and |dead-url= were deprecated at the 3 September 2019 module-suite update and became unsupported at 11 January 2020‎ update. At ru.wiki, it appears that the default value for |deadurl= is no.

—Trappist the monk (talk) 16:01, 29 July 2022 (UTC)

Linkrot template removal

Nothing high-priority, but when you use ReFill to expand citations on an article with {{linkrot}} and all references are filled, the tool removes the template, but leaves a blankline behind like this. I have to manually remove the line before saving the changes. ~Styyx^Talk? 22:16, 1 August 2022 (UTC)

BBC garbled URL

Refill is turning a working address like this https://www.bbc.co.uk/mediacentre/2021/death-in-paradise-recommission into a broken URL like this, https://www.bbc.co.uk/mediacentre/2021/bbc.com/mediacentre/2021/death-in-paradise-recommission/ by adding the bolded text to the URL. I'm guessing it's to do with the server being outside the UK and not handling a redirect to BBC.com. - X201 (talk) 09:27, 3 August 2022 (UTC)

tool puts a url in |website=; discards valid but dead |url=

The tool also discarded the valid (though dead) original url (http://articles.philly.com/1994-04-24/sports/25863114_1_corvette-heller-and-mike-golic-eagles) in favor of a meaningless url (https://www.inquirer.com/archives/). The tool should never do that.

—Trappist the monk (talk) 14:17, 4 August 2022 (UTC)

@Trappist the monk: the problem here is that when reFill (or a user) visits http://articles.philly.com/1994-04-24/sports/25863114_1_corvette-heller-and-mike-golic-eagles the server responds as follows:

HTTP/1.1 301 Moved Permanently Date: Thu, 06 Oct 2022 06:55:23 GMT Server: Apache/2.4.29 (Ubuntu) Location: https://www.inquirer.com/archives Content-Length: 326 Content-Type: text/html; charset=iso-8859-1

When reFill follows the redirect, https://www.inquirer.com/archives returns the following metadata:

<title>Inquirer.com: Philadelphia local news, sports, jobs, cars, homes</title>

The site name open graph property is being misused - it should return The Philadelphia Inquirer. I have contacted their technical team to ask them to change it.

Curb Safe Charmer (talk) 07:17, 6 October 2022 (UTC)

how do i run on sandbox w/o saving source text

Resolved

my current work flow: copy article source text replacing sandbox template on my sandbox, make changes, verify, copy changed source text to article, save changes. however, when i run refill it prompts to (1) "leave this page", but if i click it, nothing is changed since it process my sandbox, (2) if i click "stay on this page" nothing is changed. in simple words, is it possible to use this similar to "citation expander" in source text mode. if this feature is not available, can you please consider it. _>jindam, vani (talk) 16:51, 5 October 2022 (UTC)

@Jindam vani: Looks like you're previewing changes to User:Jindam vani/sandbox but not saving them. reFill accesses the page as it currently exists on the wiki, so it can't see what you have on screen in preview without saving the changes. Why would you not want to save the changes to your sandbox? That would solve the problem? You could always revert the changes in the history of your sandbox afterwards if you wanted to. Curb Safe Charmer (talk) 07:34, 6 October 2022 (UTC)

@Curb Safe Charmer right now, i am using wpcleaner with autoformatter & citation expander. Why would you not want to save the changes to your sandbox? That would solve the problem? (1) it saves a lot of bandwith (2) doesnt flood my contributions (3) why waste a lot of wikimedia resources for minor edits. my current workflow: copy article source from wpcleaner, open sandbox, edit sandbox, paste copied text, run citation expander (check ok) & then autoformatter (check ok), paste edited text in wpcleaner & change edit summary & hit send. my personal opinion: as a reasonable man, i expect or demand refill to fit into my present workflow!?! <_>jindam, vani (talk) 09:24, 6 October 2022 (UTC)

@Jindam vani: It can only access saved pages, so that's not going to work. The page name gets entered into https://refill.toolforge.org/index.php either manually if you access that URL directly, or automatically and seamlessly if using the JavaScript gadget in the left-hand menu. Curb Safe Charmer (talk) 13:22, 6 October 2022 (UTC)

Submitting your task...

The tool appears to have frozen. I'm getting the above message at the top of the screen along with a blank page. This is Paul (talk) 20:09, 10 October 2022 (UTC)

Yes; me too. - Derek R Bullamore (talk) 20:18, 10 October 2022 (UTC)

Looks like this is working now. Keith D (talk) 23:49, 10 October 2022 (UTC)

(enhancement) freezing device

Resolved

i am running debian bullseye on userland. my browser is palemoon (version 31.3.0.1) from obs. when i run refill 2022 UCI Mountain Bike season, its freezing device completly. error messages from developer console option

of browser:

Timestamp: 10/12/22 08:39:28
Error: TypeError: aPool is null
Source File: resource://gre/modules/commonjs/toolkit/loader.js -> resource://devtools/server/actors/webconsole.js
Line: 498

Timestamp: 10/12/22 08:39:29
Error: A promise chain failed to handle a rejection. Did you forget to '.catch', or did you forget to 'return'?
See https://developer.mozilla.org/Mozilla/JavaScript_code_modules/Promise.jsm/Promise

Date: Wed Oct 12 2022 08:38:12 GMT+0000 (UTC)
Full Message: TypeError: iframe is null
Full Stack: focusTool@resource://gre/modules/commonjs/toolkit/loader.js -> resource://devtools/client/framework/toolbox.js:1522:7
selectTool/<@resource://gre/modules/commonjs/toolkit/loader.js -> resource://devtools/client/framework/toolbox.js:1505:7
process@resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:931:23
walkerLoop@resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:812:7
scheduleWalkerLoop/<@resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:746:11

Source File: resource://gre/modules/commonjs/toolkit/loader.js -> resource://devtools/client/framework/toolbox.js
Line: 1522
Source Code:
1522

if possible please look into

this. <_>— jindam, vani (talk • e-mail • contrib • actions) 09:11, 12 October 2022 (UTC)

I tried it using Firefox 105.0.3 (64-bit) on Windows 10 and on first attempt it crashed the tab, but on second try works OK. So looks like it is the set-up rather than the tool itself that is causing the problem. Keith D (talk) 17:47, 12 October 2022 (UTC)

@Jindam vani: this particular article is excessively long, falling into the Pages where post-expand include size is exceeded category, and it has over 250 references, which is extreme. These things will cause difficulty for reFill. I would not imagine it would crash your browser, but I am not familiar with Pale Moon and I don't run Linux so I cannot replicate your setup. I note that as of 2 October 2022 Firefox has 2.0% market share on Wikipedia for desktop devices, although 13.9% of users' browsers fall into the category of 'other'. I suggest if you want to run reFill over such a long page, try a more mainstream browser. Curb Safe Charmer (talk) 21:18, 12 October 2022 (UTC)

@Keith D in address

type & hit enter about:crashes. click submit relevant tab crash id in "unsubmitted crash reports". also please provide crash id. if i remember correctly, they dont mind billion or zillion duplicates or new as long as they do not look or identified as spam. if the crash id is not in their top list, they mostly be unaware of it. need to kindly bring to their attention about 2% wikimedia users also. if there is no crash id, i will create an issue on bugzilla. see also Troubleshoot Firefox crashes (closing or quitting unexpectedly) @Curb Safe Charmer i will try another browser. Jindam vani (talk) 02:38, 13 October 2022 (UTC)

The crash id was 6eff0405-bf73-4643-ab9c-fa30fedfb25c Keith D (talk) 08:53, 13 October 2022 (UTC)

@Keith D if you clicked submit, it might take atleast 24hrs to show up, right now, it doesnt visible. thanks for sharing crash id ;) Jindam vani (talk) 09:30, 13 October 2022 (UTC)

refill removing deadlink template

refill2 removed deadlink template on Cernuella virgata. please look into it. thank u. Jindam vani (talk) 06:11, 14 October 2022 (UTC)

enabled "remove dead link rot tags" on refill0 removed deadlink template on Cernuella virgata, is this intended behviour? — Preceding unsigned comment added by Jindam vani (talk • contribs) 07:29, 14 October 2022 (UTC)

(bug) incorrect edit of url without text

diff adding external without text. http://courses.washington.edu/anth457/stratif.htm is displayed as [1]. this is quite useless. <_> Jindam vani (talk) 14:27, 18 October 2022 (UTC)

@Jindam vani: that URL returns a 404 and the following message:

<html>
<head>
<title>Not Found</title>
</head>
<body>
<h1>Not Found</h1>
<p>
The requested resource                 does not exist on this server.
</body></html>

Curb Safe Charmer (talk) 07:30, 19 October 2022 (UTC)

refill isnt intelligent enough to stop editing if it encounters 404? strange..... <_> Jindam vani (talk) 16:49, 19 October 2022 (UTC)

If this was a reference in an article, reFill will stop - see the first image, but if it is an external link, it will create a blank label.

Curb Safe Charmer (talk) 17:44, 19 October 2022 (UTC)

curl -sL -w "%{http_code} %{url_effective}\\n" "http://courses.washington.edu/anth457/stratif.htm" -o /dev/null shows 404 http://courses.washington.edu/anth457/stratif.htm divergent behaviour for the same issue? <_> Jindam vani (talk) 01:26, 20 October 2022 (UTC)

(bug) ShieldSquare Captcha

In this change, bare url "https://www.sportskeeda.com/player/sukesh-hegde" should have mapped to "|website=www.sportskeeda.com |url=https://www.sportskeeda.com/player/sukesh-hegde%7Ctitle=Sukesh Hegde" but instead resulted in "|url=http://validate.perfdrive.com/sportskeeda/captcha?ssa=ff55a3c6-f57b-a88e-465b-29b5a0640586&ssc=http%3A%2F%2Fwww.sportskeeda.com%2Fplayer%2Fsukesh-hegde&ssi=56c5fac1-a33a-c8a4-85e3-788b215fdd3f&ssk=contactus@shieldsquare.com&ssm=17830260681708870104190720594593&ssn=3de4acad11585936007e4e404e43a79a5324c63ccaff-503c-f05c-20ab89&sso=c2cd6084-e08cfc34bc4df9670373ac6a989be7c31878c211001d86bb&ssp=62190422811571384179157137342726414&ssq=21011194250024033237542500057184896752304&ssr=MjA4LjgwLjE1NC40OQ==&sst=ZoteroTranslationServer/WMF%20(mailto:services@lists.wikimedia.org)&ssw=%7Ctitle=ShieldSquare Captcha|website=validate.perfdrive.com" There are over 100 examples of this.^[1] -Bogger (talk) 12:12, 23 October 2022 (UTC)

References

^ https://wiki.riteme.site/w/index.php?title=Special:Search&limit=150&offset=0&ns0=1&search=%22shieldsquare+captcha%22

Bot not working

Just a heads up. Looks like the bot might be down again. I've had a pending message for the last ten minutes, and tried refreshing the page a couple of times without success. This is Paul (talk) 16:43, 30 December 2022 (UTC)

Seems to be ok now. This is Paul (talk) 17:02, 30 December 2022 (UTC)

RTE.ie is not a journal

Refill converts raw www.rte.ie urls to Template:cite journal, thus causing a cs1 error flag ("{{cite journal}}: Cite journal requires |journal=(help)"). Template:cite web would be more appropriate, in general, with Template:cite news for www.rte.ie/news -Bogger (talk) 08:25, 12 January 2023 (UTC)

ditto www.bis.org -Bogger (talk) 08:25, 12 January 2023 (UTC)

reFill is a wrapper of Citoid. I suggest you report at Wikipedia:The Wikipedia Library/Citoid#Results. Curb Safe Charmer (talk) 08:30, 12 January 2023 (UTC)

(bug) changed dead url to soft 404 url in ref

this edit changed url to landing page. source text copy pasted from Adrienne Haan. it also contains template dead link in original article. i dont understand why this edit occured. <_> jindam, vani (talk) 14:39, 5 November 2022 (UTC)

Broken again

Looks like this is broken again. It was working earlier today, but I've just made two or three attempts to run something through it but without success. I'm getting the egg timer and "Waiting for an available worker" messages. This is Paul (talk) 15:37, 13 February 2023 (UTC)

Looks like it got fixed. Thanks, This is Paul (talk) 15:45, 13 February 2023 (UTC)

What is RFLe9LFR

I'm having trouble with Pyramid (magazine) it's flagging up bare urls with RFLe9LFR. What does this mean? Sciencefish (talk) 10:00, 3 February 2023 (UTC)

I think it is a marker it uses while processing the page. If you look at the result you will find that there are no changes made. Keith D (talk) 17:56, 3 February 2023 (UTC)

3 April

T333477 Is there a problem with reFill as I just keep getting the error message "Failed An error has occurred.", latest article tried is Dennis Skinner. Keith D (talk) 11:01, 3 April 2023 (UTC)

Same, tried multiple pages.--Auric talk 11:36, 3 April 2023 (UTC)

@Keith D and Auric: It turns out that there is scheduled maintenance taking place on Toolforge today. I wasn't aware of it, but I've now subscribed to a mailing list to be aware of any future scheduled downtime. Today's downtime is an NFS migration, which began at midnight UTC and may run on as long as 1900 UTC. During this period, Toolforge is read-only causing tools that write a log file to fail. The existing NFS is running on aged hardware, and will be moved to a virtual server. "To improve this we are moving NFS to a cinder+VM platform which should support easier upgrades, migrations, and expansions in the future. In order to maintain data integrity during the migration, the old server will need to be made read-only while the last set of file changes is synchronized with the new server. Because the NFS service is actively used, it will take many hours to complete the final sync." Curb Safe Charmer (talk) 12:28, 3 April 2023 (UTC)

FWIW, this was the notification! Curb Safe Charmer (talk) 12:42, 3 April 2023 (UTC)

Thanks, missed that one, but probably would not expect it to affect the tool. Keith D (talk) 20:03, 3 April 2023 (UTC)

Should be all done and dusted now. Curb Safe Charmer (talk) 21:18, 3 April 2023 (UTC)

Still active?

Is this tool still relevant? I saw that not all wiki languages are in the list of reFill page on toolforge. What needs to be done to add certain wiki to it? Zygimantus (talk) 20:12, 10 February 2023 (UTC)

@Zygimantus: It is certainly still relevant and very widely used. The project could do with more volunteers with development skills. If you're inquisitive enough to have been looking on toolforge, perhaps you're the kind of person who could help? Curb Safe Charmer (talk) 16:03, 13 February 2023 (UTC)

I have IT background, but not sure how can I help or how can I even start contributing to toolforge. Zygimantus (talk) 20:41, 13 February 2023 (UTC)

Big Page Backend Problem

Is there a way to give reFill 2 a helping hand when it tries to parse pages with lots of references, like this one? DarklitShadow (talk) 22:30, 20 December 2022 (UTC)

@DarklitShadow: not that I know of. Curb Safe Charmer (talk) 16:05, 13 February 2023 (UTC)

I've gotten 'error' (as opposed to 'success') when it tries to parse 600 references as a task. I can't be sure but I don't think I've noticed this happening with fewer than 150-200 refs.

DarklitShadow (talk) 02:36, 17 February 2023 (UTC)

Help needed

Hello anybody hanging around who might be able to take a look at the tool? Don't know what I am doing wrong, but when entering an article name, on the right hand side the wordt arrow forward pops up. Don't know what to think of these magical words. Thank you so much for your time. Lotje (talk) 16:26, 15 May 2023 (UTC)

Just mentionning: it's up and going again

Lotje (talk) 04:18, 16 May 2023 (UTC)

The Cloud Services Team did some maintainance on 15 May that was not expected to involve any downtime but did not go as expected and some some toolforge nodes were affected with some processes hung and needed to be restarted. See T316544. Curb Safe Charmer (talk) 09:26, 17 May 2023 (UTC)

Add code to reFill 2 to common.css

Can you add reFill 2 to common.css? Aaron106 (talk) 20:53, 26 April 2023 (UTC)

Seems to be down again

Tracked in Phabricator
Task T338101

If anyone has any ideas about how to get this wonderful app working again. Thanks. Sundayclose (talk) 15:36, 3 June 2023 (UTC)

Pinging Curb Safe Charmer, who seems to know more than most of us. Sundayclose (talk) 15:45, 3 June 2023 (UTC)

Still working on this. Danilo.mac in Portugal gave me some help this evening, but I am hoping TheresNoTime will be around tomorrow. Curb Safe Charmer (talk) 20:55, 4 June 2023 (UTC)

Can you add support for other Wikipedias?

Tracked in Phabricator
Task T29532

Wikipedia:ReFill points to this page for requests to add support for other Wikipedias. I'd gladly help with a few, but need to know if such requests are now accepted, and what I can help with. We can start with hrwiki (CS1 module+templates), adding bs/sh/sr-wiki should then be easy. Thnx, Ponor (talk) 05:07, 18 March 2023 (UTC)

Anyone? – Silence is still a noise. Ponor (talk) 21:22, 5 April 2023 (UTC)

Anyway... https://refill.toolforge.org/ng/ seems to work for all languages. Ponor (talk) 17:22, 20 April 2023 (UTC)

"Do not remove link rot tags", and a tangent

What's the reason this option isn't the default and must be manually selected? I'm sure there must be a reason why this behaviour is desired but link rot tags seem helpful for identifying sources that should be updated.

User:Curb Safe Charmer, we interacted recently at the MfD relating to the ReferenceExpander script, and I had no idea you were a primary maintainer of ReFill. I appreciate how much more thorough your documentation is in warning users that the script's output may not be perfect, and I think there are a few easy improvements that can be made downstream of Citoid in any automated reference tool that calls it, like truncating title parameters at the first ndash or pipe (which your documentation calls a "known issue"). Is there a good place to discuss that? I'm trying not to be a jerk and feel like I'm failing. Folly Mox (talk) 03:18, 3 June 2023 (UTC)

@Folly Mox: I stepped in to this role because the developer of reFill retired from Wikipedia leaving nobody else with access to the back-end and active tools should not be in that position. At the time it was hanging frequently and nobody knew why. As a heavy user of reFill, I thought I should do something about it, so I gained access to the back-end and code repo and liaised with the right people to get that issue resolved. While I class myself as a software developer it is on a different technology stack, and I have found that there are too many moving parts for me to get up to speed on, especially given the demands of my day job. While I still have a role to play with reFill, we really need more developer resource on it. A handful of people have shown an interest but ultimately not stayed the course. Unfortunately this is the nature of Wikipedia being a volunteer project. People have 'real lives' and do need to step away for one reason or another. Curb Safe Charmer (talk) 04:26, 3 June 2023 (UTC)

Gotcha. I remember having a real life. Good times. No worries then. I know tone doesn't come across in text-based communication, so I'll append that I'm being genuine and appreciate your efforts. Folly Mox (talk) 04:43, 3 June 2023 (UTC)

pulitzer.org links broken

Tracked in Phabricator
Task T340500

Links to pulitzer.org are broken badly see this edit. Apparently this garbage was noticed and has been annoying an admin for a while but they had not found a way to report. It is a damn mess and any tool that breaks a ref is not good, I had just not noticed. Cheers KylieTastic (talk) 21:48, 26 June 2023 (UTC)

If you are talking about me, I know how to report the crap that is produced by this tool but have given up doing so because no one is maintaining it. Nor, apparently, is anyone maintaining the citoid tool that feeds crap to refill. For example, using RefToolbar to auto-fill a {{cite web}} template from a 'good' pulitzer url creates this mess:

{{cite web |title={{(global.pageOgTitle) ? global.pageOgTitle : global.pageTitle}} |url=https://www.pulitzer.org/finalists/zora-howard |website=www.pulitzer.org |language=en}}

"{{(global.pageOgTitle) ? global.pageOgTitle : global.pageTitle}}". www.pulitzer.org.

Nothing to do with refill. Pulitzer.org is written in some sort of code that cannot be deciphered by citoid. The value that should go in |title= is Finalist: ''Stew'', by Zora Howard but if you look at the pulitzer.org html page source, that text does not appear anywhere so the 'pulitzer-problem' is not confined to refill but can also be attributed to citoid and whatever translator it uses to read the pulitzer.org web pages.

—Trappist the monk (talk) 22:15, 26 June 2023 (UTC)

Nope, I was not talking about you. Looking at the source not surprised some tools get it wrong. If we don't have the people to fix we should at least be able to get an ignore list implemented, or if this is happening enough shut down the tool. Not breaking links should be the first concern. I keep meaning to help out with the tools, but just don't have the time (yet). Also I'm already juggling too many languages and technologies in the day job to get into more. KylieTastic (talk) 22:29, 26 June 2023 (UTC)

There was a burst of activity on this repo a couple weeks ago by @Curb Safe Charmer and @SD0001. Hopefully we can keep the momentum. There's a lot that needs fixing behind the scenes though. They're using multiple repos, multiple bug trackers, and multiple branches. I think that tech debt needs to be paid off before we can get a good velocity with bug fixes. I'll make some Phab tickets. –Novem Linguae (talk) 00:58, 27 June 2023 (UTC)

Since that burst of activity I've been flat out at work to meet a deadline so haven't had any time to move forward on moving all open issues to Phabricator. I would hope to be able to do that at the end of this week or early next week.

Regarding this specific issue, I suspect it needs a Zotero translator written for it. My view is that tools like reFill that use Citoid shouldn't be the place to implement site-specific functionality; instead that should be done upstream by the Citoid project or by creating a translator. My rationale is that there are so many sites on the Internet and some don't use metadata properly - this project doesn't have capacity to deal with that scale. Even if it did, it would be duplicating effort if every tool that consumes Citoid had to implement such workarounds. Citoid is WMF-maintained, so they are better placed than a volunteer project. Curb Safe Charmer (talk) 12:46, 27 June 2023 (UTC)

The vast number of work-arounds that CitationBot implements is annoying. But, it is a Bot, and ReFill is a tool. The bot just rejects a lot of Citoid data, including good data, just to be safe. AManWithNoPlan (talk) 13:33, 27 June 2023 (UTC)

Agreed, if the issue is with Citoid (and I've just verified the RefToolbar also mungs the output) then the problem should be raised there. Although I still think maybe having an ignore list feature with the list stored on-wiki for easy updating would be useful for short term issues. Cheers KylieTastic (talk) 14:31, 27 June 2023 (UTC)

Citoid is WMF-maintained. Citoid is giving some hints that it's unmaintained. For example, it has been undergoing code stewardship review since 2021. However I think I recall that Mvolz works on Citoid sometimes? –Novem Linguae (talk) 18:55, 27 June 2023 (UTC)

I recently spent 3 days cleaning up after reFill (mostly), which had been adding the domain-squatter hugedomains.com into thousands of pages over many years. Yeah ideally Citoid should filter these things, but it doesn't, probably because the WMF doesn't make content decisions. So we take ownership for doing what we can do. I removed all these links and added it to the WP:SBL so when reFill tries to edit with that domain again, it will get blocked from the page. - GreenC 20:40, 28 June 2023 (UTC)

@GreenC: thanks for doing that. I took a look at some of those articles to see if we needed to remind specific editors that are using reFill that they are responsible for their edits made using the tool. The first few I looked at were this edit to Fairfield Materials Management Ltd by MarnetteD on 22 October 2020‎, this edit to Larry Wright (street drummer) by Ser Amantio di Nicolao on 4 February 2018 and this edit to Jamil Alibekov by Egeymi on 11 March 2023. MarnetteD was also responsible for this edit to West Park, Darlington on 13 October 2021. There was also an edit by someone since blocked as a sockpuppet - but it was interesting that four out of the five edits I looked at were by very experienced, prolific editors. Curb Safe Charmer (talk) 09:14, 29 June 2023 (UTC)

What it tells us is that "responsible for their own edits" very often doesn't work out. This is why tools and bots needs to be super accurate by being continually maintained and updated. -- GreenC 11:59, 29 June 2023 (UTC)

I found about 46 that still need to be fixed ... Plastikspork _―Œ^(talk) 14:39, 29 June 2023 (UTC)

done - KylieTastic (talk) 13:17, 30 June 2023 (UTC)

DNS_PROBE_FINISHED_NXDOMAIN

Tracked in Phabricator
Task T346177

Hi, I'm getting the above message when I try to run this bot. I'm editing with Chrome. Can anyone help? Thanks, This is Paul (talk) 18:49, 12 September 2023 (UTC)

@This is Paul: there appears to be a general problem with all toolforge hosted tools. See WP:VPT#XTools not working. Keith D (talk) 21:00, 12 September 2023 (UTC)

ok thanks, I'll take a look. This is Paul (talk) 21:28, 12 September 2023 (UTC)

@This is Paul and Keith D: This should be resolved now after the service was restarted by TheresNoTime. Curb Safe Charmer (talk) 16:35, 13 September 2023 (UTC)

Cheers, I've just run a few articles through it and all is working good now. This is Paul (talk) 18:30, 13 September 2023 (UTC)

Developers needed!

I'd like to appeal again to users of reFill - if you have developer skills in JavaScript or Python, or experience with Kubernetes, please consider volunteering some of your time as a maintainer of this project. Please message me directly for details. Thanks! Curb Safe Charmer (talk) 05:13, 5 June 2023 (UTC)

Hello, any angel hanging around willing to take a look at this wonderful magical tool? Looks like it is in need of a small push

Thank you every so much for your time. Cheers. Lotje (talk) 14:11, 5 June 2023 (UTC)

Huzzah, huzzah, reFill is back

Thanks to the Angel(s) Lotje (talk) 09:47, 6 June 2023 (UTC)

Indeed! Now we just need to work out why it has suddenly started working again. As far as I know, none of the maintainers (of which we have a new one as of today, welcome SD0001!) has changed anything, although I did merge a change that a new contributor on GitHub called GlazerMann made, but I don't think that's related. Anyone know GlazerMann's Wikipedia account name? Curb Safe Charmer (talk) 10:19, 6 June 2023 (UTC)

Glad to see it's back — I very quickly took a look last night and restarted some pods/the webservice. The originally targeted Python version (in the service manifest file, refill-api) is no longer supported, so I bumped this to python3.9 (and I think the same applies for the targeted PHP version in refill...?) — TheresNoTime (talk • they/them) 11:13, 6 June 2023 (UTC)

@TheresNoTime: thanks very much Sammy and it is great to know that you're still around and are willing to use your skills and knowledge to benefit reFill. It was only today reading your blog that I became aware of the drama you've been through. Sending positive thoughts... Curb Safe Charmer (talk) 11:32, 6 June 2023 (UTC)

You're welcome, sorry it took a moment to look at (and 100% agree that more developers are needed! Where possible, never rely on one or two volunteers — the more the merrier!) — TheresNoTime (talk • they/them) 12:20, 6 June 2023 (UTC)

Moved to Wikipedia talk:Refill/technical

– keeping all technical discussion together Curb Safe Charmer (talk) 14:08, 9 June 2023 (UTC)

Error on dead links

Tracked in Phabricator
Task T305178

Hi, when creating archive links, archiveurl=, it's also creating deadurl=yes, which is a deprecated parameter, and therefore errors. Please replace with |url-status=dead. Thanks for setting up the tool, I use it loads, Tom B (talk) 13:20, 31 May 2023 (UTC)

@Tpbradbury: thanks Tom, this is known about, and once we've got our house in order this will get fixed at last. I will archive this thread for now. Curb Safe Charmer (talk) 16:48, 9 June 2023 (UTC)

Bare link to PDF removed

Irreligion in Turkey (Diff 1186450098)
@Egeymi?
Deleted a bare link reference to https://minorityrights.org/wp-content/uploads/2015/07/MRG_Rep_Turk2007_TURK.pdf. (which is a working link) — Alexis Jazz (talk or ping me) 14:11, 23 November 2023 (UTC)

@Alexis Jazz: I think Egeymi must have removed that by hand, at the same time as adding the tag about dmy dates, as when I run reFill over the same content in my sandbox, reFill doesn't remove the bare ref. Curb Safe Charmer (talk) 14:23, 23 November 2023 (UTC)

@Alexis Jazz: Yes I did remove it manually, because it was redundant and bare. --Egeymi (talk) 16:14, 23 November 2023 (UTC)

Egeymi, thanks, that clears that up. (makes me wonder why you used reFill at all?) — Alexis Jazz (talk or ping me) 06:08, 24 November 2023 (UTC)

@Alexis Jazz: Because it's a perfect tool to remove bare urls, but not help for PDF sources. Now I wonder why you asked me this. I've been using reFill since November 2022 to remove bare urls. I mean I didn't use it only for the page you mentioned. --Egeymi (talk) 07:17, 24 November 2023 (UTC)

Egeymi, I don't follow you around so I wouldn't know. I recently edited the article in question so it was on my watchlist. It's just that Filled in 0 bare reference(s) looked kinda odd to me, but I think I understand it now. — Alexis Jazz (talk or ping me) 07:40, 24 November 2023 (UTC)

504 Gateway Time-out

It always seems to be me that discovers these lately. The above message is appearing whenever the bot is run. Thanks, This is Paul (talk) 12:10, 27 September 2023 (UTC)

@This is Paul: I'm taking a look now. Curb Safe Charmer (talk) 12:12, 27 September 2023 (UTC)

ok cheers, This is Paul (talk) 12:16, 27 September 2023 (UTC)

Done @This is Paul: running webservice restart on the frontend seems to have worked. Curb Safe Charmer (talk) 13:37, 27 September 2023 (UTC)

Backend error

Not sure what one is, but it's showing up when I run the programme. There's a red symbol that looks a bit like the outline of a cloud with a line through it. The error doesn't occur with every article. For example, I had success running REFILL through 2023 in British music and 2023 in England, but it produced the error with 2023 in United Kingdom politics and government and 2023 in the United Kingdom. This is Paul (talk) 15:44, 25 September 2023 (UTC)

@This is Paul: I am not sure if there's a hard limit but the error will be because of the extreme number of references on those particular articles. Curb Safe Charmer (talk) 16:38, 25 September 2023 (UTC)

The size of the article did occur to me as a possible explanation, but 2023 in the United Kingdom was recently shrunk by a quarter (including the removal of around 200 references) when the deaths section was hived off to a new article, and it worked without a glitch up until today. From the articles I've put through REFILL this evening it seems to be anything over about 200K that's failing. This is Paul (talk) 18:47, 25 September 2023 (UTC)

Translation of "cite web" parameters

Is there a way to use reFill on a non-English wiki and have the "cite web" template translated into the selected language? I work on it-wiki, and this tool is very useful, but it would be even more complete if the generated "cite web" template had the parameter names translated into the language of the page (e.g., for Italian: "cita web" instead of "cite web", "titolo=" instead of "title="...). I've tried to translate them manually on the translatewiki project, but these strings are not inserted for translation. RiccardoFila (talk) 20:53, 25 September 2023 (UTC)

You might look into adapting {{Cite web/Italian or Spanish}} on it.WP. It was created here so that editors could copy and paste templates like {{cita web}} directly from other Wikipedias and have the parameter names translated. – Jonesey95 (talk) 21:46, 25 September 2023 (UTC)

Titles getting cleared randomly

References filled by reFill getting cleared randomly in subsequent run of the tool.

This happens frequently on this page.

List of Malayalam films of 2023 - Wikipedia

Anish Viswa 13:42, 5 October 2023 (UTC)

Removal of all relevant information

I stumbled upon a couple of edits like The Queers (Diff ~947631361).
This is hopefully not happening anymore? — Alexis Jazz (talk or ping me) 11:38, 18 November 2023 (UTC)

@Alexis Jazz. Can you clarify what is wrong with that particular diff? Maybe I'm dense but I don't see the error right off the bat. –Novem Linguae (talk) 02:29, 19 November 2023 (UTC)

Novem Linguae, the original URL was www.chartattack.com/news/53698/the-queers-to-drop-live-album-recorded-at-cbgb which is clearly supposed to link to some article. It was not archived, but entering this URL in the Wayback Machine gives you some redirects to www.chartattack.com, the homepage. ReFill changed the URL to the homepage (that's virtually always useless) and set the title to the title of the homepage: "Chart Attack - Best Magazine 2020". As of 2018 Chart Attack is defunct, whoever owns the domain now has nothing to do with the original publication. The original URL held some relevant information in the sense one might try to use it to track down the original article somehow. (in case the URL scheme changed or they moved to another domain or something) Reducing that to a link to a homepage just isn't helpful. — Alexis Jazz (talk or ping me) 04:36, 19 November 2023 (UTC)

Citoid is still stripping this ref in the way you describe. Curb Safe Charmer (talk) 15:04, 20 November 2023 (UTC)

Curb Safe Charmer, thanks. That's unfortunate. Can't the user at least be warned before changing a deep link to a homepage link? — Alexis Jazz (talk or ping me) 21:35, 20 November 2023 (UTC)

I suggest you take it up with Wikimedia Foundation-maintained Citoid project. Curb Safe Charmer (talk) 08:11, 21 November 2023 (UTC)

phab:T351694 — Alexis Jazz (talk or ping me) 08:45, 21 November 2023 (UTC)

Tool not working

The bot seems to be stuck this morning. Can someone please raise the issue (assuming I am not alone in this). Thanks, - Derek R Bullamore (talk) 13:49, 20 February 2024 (UTC)

@Derek R Bullamore: seems fine to me? Curb Safe Charmer (talk) 15:00, 20 February 2024 (UTC)

Yes, I have just tried it again and it worked OK. Sorry if I wasted anyone's time. - Derek R Bullamore (talk) 15:01, 20 February 2024 (UTC)

Time Out Error

Just a heads up of a problem that's occurred this evening. The bot appears to have stopped rendering bare URLs, and I've been getting an "error-type-ReadTimeout" error for the last half an hour or so. Apologies if you're already aware of the error. This is Paul (talk) 22:17, 26 February 2024 (UTC)

I've had the same problem for the last few hours. Roger 8 Roger (talk) 09:02, 27 February 2024 (UTC)

Me, too. I don't know whether this is pertinent or not, but I notice that all the sites have pop-ups asking to confirm that I accept cookies.--Gronk Oz (talk) 10:30, 27 February 2024 (UTC)

About the same time, the autofill for templates like cite web also stopped working. Not sure if it is related, but it's a curious coincidence.--Gronk Oz (talk) 13:54, 27 February 2024 (UTC)

@This is Paul, Roger 8 Roger, and Gronk Oz: I have just tested reFill on a page and it worked fine - can you confirm whether or not you are still seeing an error? Curb Safe Charmer (talk) 14:21, 27 February 2024 (UTC)

@Curb Safe Charmer: I don't know what magic you did, but I just tried it with César Muñoz Arconada and it seems to have worked fine. Well done!--Gronk Oz (talk) 14:53, 27 February 2024 (UTC)

I didn't change / fix anything... Curb Safe Charmer (talk) 16:54, 27 February 2024 (UTC)

It worked for me this afternoon. This is Paul (talk) 18:25, 27 February 2024 (UTC)

Seems to work this morning, thanks. Roger 8 Roger (talk) 21:30, 27 February 2024 (UTC)

504 Gateway Time-out

Tool seems to be down again. I've been getting a "Webservice request timed out" error for the past hour or so. it seemed to be working ok before 9pm GMT. Cheers, This is Paul (talk) 22:07, 1 December 2023 (UTC)

RTÉ News links

I'm not sure if here is the place to mention this, but I wanted to bring attention to a potential issue with pages from the website https://www.rte.ie/news/. When run through the bot they are rendered as cite journal links rather than cite web, which creates an error as the site does not appear with the parameter journal=. I hope this makes sense and that someone could take a look. Cheers, This is Paul (talk) 14:17, 31 December 2023 (UTC)

Diff. –Novem Linguae (talk) 14:28, 31 December 2023 (UTC)

Adding pages to Category:CS1 errors: unsupported parameter

See this diff. ReFill keeps adding |deadurl=y to citations, which causes a CS1 error. It should use |url-status=dead instead. :Jay8g [V•T•E] 19:59, 18 January 2024 (UTC)

This is one of the known issues of the tool. A fix is available but needs deploying. Keith D (talk) 01:49, 19 January 2024 (UTC)

Please stop adding dx.doi.org links

The tool adds url=https://dx.doi… links to templates with DOIs. Since most of these are not free, it is misleading to title link them. If anything, these links should be removed not added. AManWithNoPlan (talk) 12:48, 22 January 2024 (UTC)

More wikis supported?

Hi. Are yiu going to support more language wikipedias? Thanks Xia ^{talk to me} 17:58, 31 January 2024 (UTC)

Configure to autorun in a page

Is there any option or Bot to configure to autorun this tool on a certain article and publish the updated article?
Anish Viswa 06:57, 21 February 2024 (UTC)

@Anishviswa: No. But you could develop something using the API. Curb Safe Charmer (talk) 12:46, 21 February 2024 (UTC)

If you do, remember that you are responsible for each edit. This tool makes many errors; each edit needs to be inspected by a human before the change is saved. – Jonesey95 (talk) 20:25, 21 February 2024 (UTC)

Pending

Sorry to be the bringer of bad news again, but the bot appears to be down. I've been getting the Pending "waiting for an available worker" message since around 2pm UTC this afternoon. As always, apologies in advance if you're already aware of any problems. Cheers, This is Paul (talk) 17:44, 1 March 2024 (UTC)

Seems to be fixed now, so huge thanks to whoever did that. This is Paul (talk) 18:50, 1 March 2024 (UTC)

Tracked in Phabricator
Task T359159

We had the same again today, and Sammy investigated and was able to restart it after making a configuration change. You can take a look at the technical details if you are interested. We might want to change which scheduler the backend uses, going forward. Curb Safe Charmer (talk) 14:11, 5 March 2024 (UTC)

Pending again

Just a heads up, refill has been down for almost an hour. Says "pending: waiting for an available worker". Thanks, This is Paul (talk) 14:52, 3 June 2024 (UTC)

Yes, refill is still down and the same pending message is appearing.Skilgis1900 (talk) 15:17, 3 June 2024 (UTC)

The tool is still not working today. The note at the top of the page states "If the tool is stuck displaying "waiting for an available worker", and you have a Phabricator login, then you can use this link to raise a report to get it restarted". That is fine, but I do not have a Phabricator login. Can anyone help us with this, please ? Thanks. - Derek R Bullamore (talk) 09:46, 4 June 2024 (UTC)

Hi, I just did that, see: T366588

Tracked in Phabricator
Task T366588

. Best regards, Redalert2fan (talk) 12:18, 4 June 2024 (UTC)

Thank you. - Derek R Bullamore (talk) 12:21, 4 June 2024 (UTC)

I've seen the Phabricator report now, thanks, and have tried the obvious things. Hoping @TheresNoTime will take a look. Curb Safe Charmer (talk) 13:07, 4 June 2024 (UTC)

Thanks from me as well. This is Paul (talk) 14:41, 4 June 2024 (UTC)

@This is Paul, Skilgis1900, Derek R Bullamore, and Redalert2fan: it is working again now - can't say why! Curb Safe Charmer (talk) 17:13, 4 June 2024 (UTC)

Hate to report bad news. I used it once an hour ago and it worked perfectly. Then I went to use it again moments ago and it is now back to "pending: waiting for an available worker" status.Skilgis1900 (talk) 21:00, 4 June 2024 (UTC)

I used it last at 20:47 UTC, then tried to do something else at 21:00 and it was kaput. Hopefully it rights itself again. This is Paul (talk) 21:08, 4 June 2024 (UTC)

I just used it again and it's working fine now. This is Paul (talk) 22:14, 4 June 2024 (UTC)

Outage

~~== reFill is down at the moment (16 April) ==~~

Tracked in Phabricator
Task T362613

~~Curb Safe Charmer (talk) 08:58, 16 April 2024 (UTC)~~

UTF-8 Character Issues

After noticing odd character combinations appearing in references from time to time, such as â€™ appearing in place of ', I found that the errors were known as Mojibake, a character conversion error (common examples listed here). After determining how the errors were introduced into articles, I found that they occurred in edits that used Reflinks and ReFill. Is this something that could be fixed? CoolieCoolster (talk) 01:28, 6 April 2024 (UTC)

@CoolieCoolster: Please could you provide some example Wikipedia articles where this has happened, ideally as diffs? Curb Safe Charmer (talk) 09:17, 6 April 2024 (UTC)

Here, here, here, here, and here are examples. Each of those edits updated a reference title using â€™ in place of '. CoolieCoolster (talk) 09:46, 6 April 2024 (UTC)

Eurosport

Hi! I was wondering if you can help me. Any ideas why refill doesn't handle Eurosport.com/Eurosport.co.uk web addresses? I swear it used to work. Example page is 2024 World Snooker Championship Lee Vilenski ^{(talk • contribs)} 16:12, 5 May 2024 (UTC)

@Lee Vilenski: hmm, interesting. I created User:Curb Safe Charmer/sandbox to test this. I see what you mean. No, I don't know why it doesn't work. Nothing obvious. Would require some debugging. Curb Safe Charmer (talk) 15:49, 7 May 2024 (UTC)

Interesting. I was worried I'd done something wrong. Any ideas who might be able to help me with that? Lee Vilenski ^{(talk • contribs)} 19:02, 7 May 2024 (UTC)

deadurl parameter

Tracked in Phabricator
Task T305178

Why is this tool still using the deadurl parameter instead of url-status? I can see that it was changed in the GitHub repository last year, but it still creating the deprecated parameter. What needs to be done to get the code rolled out to the tool? —Ost (talk) 19:49, 4 June 2024 (UTC)

@Ost316: The project needs volunteer developers, with skills in the tech stack. If you fit the bill, please volunteer! Curb Safe Charmer (talk) 07:18, 5 June 2024 (UTC)

Moved to Wikipedia talk:reFill/technical

– keeping technical conversations together

Curb Safe Charmer (talk) 13:16, 6 June 2024 (UTC)

Removing filled references with 'None' in subsequent run

This issue is still persisting. Some or the other reference filled previously getting replaced with None in a subsequent run.

"Agathokakological (2024) - Movie | Reviews, Cast & Release Date - BookMyShow".

➡

"None".

Did the tool suggest a faulty change? Please include the following information when reporting the issue:

Task Name fixWikipage
Task ID f279c760-3a75-49f0-980a-d1947595bd0b
Change ID 17
Old Text {{Cite web|url=https://in.bookmyshow.com/movies/agathokakological/ET00390242|title=Agathokakological (2024) - Movie | Reviews, Cast & Release Date - BookMyShow}}
New Text {{Cite web|url=https://in.bookmyshow.com/movies/agathokakological/ET00390242|title=None}}

Anish Viswa 14:14, 26 June 2024 (UTC)

@Anishviswa: please can you provide diffs? Curb Safe Charmer (talk) 10:47, 27 June 2024 (UTC)

it is there is the script I copied and pasted above. See Old Text and New Text.
Anish Viswa 11:43, 27 June 2024 (UTC)

No, I was asking for a link to your actual edit. Which article was it in? Curb Safe Charmer (talk) 16:55, 27 June 2024 (UTC)

List of Malayalam films of 2024. I did not proceed to save any Refill run which resulted in errors.
Anish Viswa 04:35, 28 June 2024 (UTC)

504s for a few hours now

Tracked in Phabricator
Task T369439

I have been seeing this error a lot today, just loading the page, not even running a query:

Webservice request timed out The tool responsible for the URL you have requested, https://refill.toolforge.org/, is taking too long to respond.

If you have reached this page from somewhere else... This URI is managed by the refill tool, maintained by Curb Safe Charmer, Cyberpower678, Novem Linguae, Samtar, SD0001, Zhaofeng Li.

You may wish to notify the tool's maintainers (above) about the error.

If you maintain this tool The web service for this tool is running but cannot be reached. Please check the error logs of your web service.

Anyone know why? awkwafaba (📥) 23:53, 5 July 2024 (UTC)

It's still happening as of now. This is Paul (talk) 14:35, 6 July 2024 (UTC)

It is working fine for me !? - Derek R Bullamore (talk) 14:43, 6 July 2024 (UTC)

Timing out for me as well. Link [3] – robertsky (talk) 15:15, 6 July 2024 (UTC)

Me too (using Robertsky's link) –Novem Linguae (talk) 18:43, 6 July 2024 (UTC)

Still happening. Significa liberdade (she/her) (talk) 00:26, 7 July 2024 (UTC)

Just seen this. I won't be able to take a look for several hours, so if someone else with the relevant permissions could investigate that would be great. @There'sNoTime:? Curb Safe Charmer (talk) 09:27, 7 July 2024 (UTC)

Right, just home and having a look now. Curb Safe Charmer (talk) 11:46, 7 July 2024 (UTC)

https://refill.toolforge.org/ not working - currently returning 403 - forbidden.

https://refill.toolforge.org/ng works

API works

Toolbox link works

If you are trying to use https://refill.toolforge.org/ please use https://refill.toolforge.org/ng instead.

Curb Safe Charmer (talk) 12:14, 7 July 2024 (UTC)

the 504 happened on the /ng endpoint (I have a screenshot of this). @Curb Safe Charmer, is it possible for you to do a redirect of anything on the base path to /ng path? This is because meta:User:Zhaofeng Li/Reflinks.js primarily shows the link to the base URL to all wikis, with an exception of enwiki which has both / and /ng links. – robertsky (talk) 17:42, 7 July 2024 (UTC)

@Robertsky: interesting, thanks. I can't reproduce that. A redirect is presumably possible (by configuring nginx?) but I don't know how to do that. I am not sure if there would be any undesirable effects of effectively killing off the original front-end and forcing everyone to /ng, I would hope there wouldn't. Seems like a good way to get around not being able to edit reflinks.js. Curb Safe Charmer (talk) 20:09, 7 July 2024 (UTC)

@Curb Safe Charmer if the original endpoints are not being revived, then there's no point to have the links to be directed to it. – robertsky (talk) 01:07, 8 July 2024 (UTC)

@Curb Safe Charmer you are absolutely amazing thank you!, came here fearing the worst tbh, Thank you all for continuing to keep this invaluable tool running, Thanks, –Davey2010^Talk 18:02, 9 July 2024 (UTC)

From Community Wishlist

An entry on the Community Wishlist regarding ReFill - https://meta.wikimedia.org/wiki/Community_Wishlist/Wishes/Improve_reFill,_make_it_work_with_PDFs Keith D (talk) 00:14, 20 July 2024 (UTC)

403 forbidden

Hi I have installed reFill userscript on my Tewiki account. Whenm I clicked the toolbox link, I am getting the 403 forbidden error s it s going to " refill.toolforge.org//result.php?" instead of " refill.toolforge.org/ng/result.php?" I know this issue was discussed above. I am just curious to know if there is any solution for this so that I can use it as userscript, I mean, from the toolbox link (not as bookmarklet). Thanks. __ Chaduvari (talk) 03:48, 28 July 2024 (UTC)

@Chaduvari: this page being on my watchlist.

Following the refill.toolforge.org/ng/result.php: The browser (or proxy) sent a request that this server could not understand.

Also, as a test, I tried it here. It does work, but imo it is not good, because of the text in the dates that have to be translated into English. Hope that answers your question. Lotje (talk) 04:16, 28 July 2024 (UTC)

Lotje, thanks for helping. When I go to "refill.toolforge.org/ng/result.php?", it works fine. But the toolbar link of "reFill" is going to "refill.toolforge.org//result.php?". Please note there is no "ng" in the url. That is my problem. I am not sure if I am doing anything wrong here. __ Chaduvari (talk) 04:22, 28 July 2024 (UTC)

Too bad I could not be more helpful. Cheers. Lotje (talk) 04:53, 28 July 2024 (UTC)

@Chaduvari: Have you got the incorrect link in your common.js file (may be called something else on Tewiki)? Keith D (talk) 21:01, 28 July 2024 (UTC)

Yes, Keith D. Here is my common.js page.

When I clicked the reFill link on some random page, it took me to the 403 - Forbidden page at "https://refill.toolforge.org//result.php?page=%E0%B0%A2%E0%B0%BF%E0%B0%B2%E0%B1%8D%E0%B0%B2%E0%B1%80_%E0%B0%A4%E0%B1%86%E0%B0%B2%E0%B1%81%E0%B0%97%E0%B1%81_%E0%B0%85%E0%B0%95%E0%B0%BE%E0%B0%A1%E0%B0%AE%E0%B1%80&defaults=y&nowatch=y&wiki=te"

__ Chaduvari (talk) 00:19, 29 July 2024 (UTC)

@Chaduvari: Looks like the entry in your common.js file is OK. The reFill set-up puts 2 entries in the toolbar list, reFill 2 & reFill(o), which one are you using? Do both give the same problem? Keith D (talk) 09:58, 29 July 2024 (UTC)

@Keith D, only "reFill" is shown in the tool bar. "reFill 2", which is shown in enwiki, is not there in tewiki. __ Chaduvari (talk) 10:29, 29 July 2024 (UTC)

Looks like it is the reFill(o) link that is the problem as that entry gives "403 forbidden" here on English Wiki. That one is supposed to give you the setup of the options to use for the run. Keith D (talk) 10:44, 29 July 2024 (UTC)

@Chaduvari, I have a modified Reflinks.js which just utilise /ng/ endpoints:

mw.loader.load( "https://meta.wikimedia.org/w/index.php?title=User:Robertsky/Reflinks.js&action=raw&ctype=text/javascript" );

Try using this instead? – robertsky (talk) 10:35, 29 July 2024 (UTC)

@Robertsky Great! it is working now. I could correct a reference in an article. Thanks for the help.__ Chaduvari (talk) 11:00, 29 July 2024 (UTC)

It appeared as "reFill" and not as "reFill 2", but worked fine. __ Chaduvari (talk) 11:02, 29 July 2024 (UTC)

Yeah... If it is expected to be reFill 2, I will update accordingly. There are some hidden options in the JavaScript codes for enwiki which I will seek to explore and restore, and see if it is something that can be used for the other wikis. – robertsky (talk) 11:35, 29 July 2024 (UTC)

403 error, again

Unfortunately, I'm still getting the "403 error" when I go in from my bookmark/the project page. I've tried https://refill.toolforge.org/ng but this just arrives at a blank page. This is frustrating, as I have Perrycroft which is in desperate need of a clean-up! Anything that can be done to get it going again would be greatly appreciated. KJP1 (talk) 09:57, 4 August 2024 (UTC)

Now working again - hurrah! Thanks so much for your work in keeping this essential tool running. KJP1 (talk) 11:07, 4 August 2024 (UTC)

Stuck with "Pending"

Now we have the "Pending" issue. Can someone wield a spanner. KJP1 (talk) 09:29, 11 August 2024 (UTC)

Pending again

Tracked in Phabricator
Task T373233

Since about 15:30 UTC. Could someone help? Cheers in advance, This is Paul (talk) 17:20, 23 August 2024 (UTC)

Seconded. It seems to be down. BD2412 T 04:10, 24 August 2024 (UTC)

Thirded? Still down. Significa liberdade (she/her) (talk) 16:58, 24 August 2024 (UTC)

It is still displaying the "Waiting for available worker." message. Skilgis1900 (talk) 03:35, 25 August 2024 (UTC)

Same message here. Ixocactus (talk) 03:46, 25 August 2024 (UTC)

It seems to be fixed again, so a huge thanks to whoever did that. This is Paul (talk) 16:46, 25 August 2024 (UTC)

Now, I'm not getting no response to an entry. Skilgis1900 (talk) 20:43, 25 August 2024 (UTC)

Same here, my last successful entry was at 17:25 UTC today. Seemed to go wrong after that. I've been out for the evening and just tried again but still appears to be broke. This is Paul (talk) 22:10, 25 August 2024 (UTC)

It appears to be working again now. Curb Safe Charmer (talk) 08:24, 27 August 2024 (UTC)

Sorry I forgot to update this. It does seem to be intermittently breaking then working again. At this moment I'm waiting for an available worker. I had the same thing happen yesterday evening, but it started working again after a few minutes of waiting, so I'm hoping the same thing will happen again tonight. It's a hugely useful tool to have as it saves time when adding references, so I hope if there's any bugs they can be fixed. This is Paul (talk) 21:59, 29 August 2024 (UTC)

Now it's working again. This is Paul (talk) 22:42, 29 August 2024 (UTC)

Seems to be down again. Not sure what is going on DualDoppler (talk) 02:33, 4 September 2024 (UTC)

@DualDoppler: Working fine right now. Curb Safe Charmer (talk) 13:01, 4 September 2024 (UTC)

Should we change the link?

For the past month or so, I only get a 403 error page from the link. The suggested https://refill.toolforge.org/ng/ seems to work. Should we change the link to point there, or is there some fix planned for the errors at https://refill.toolforge.org/ ? Rjjⁱⁱⁱ (talk) 17:22, 11 August 2024 (UTC)

I changed the page lede to point to toolforge:refill/ng. The problem is described at phab:T369439 and Wikipedia talk:ReFill/Archive 4#504s for a few hours now, and has now persisted since 5 July 2024. I'm not sure how the two interfaces differed, and wish that was documented. The bug seems likely to get fixed eventually, so we should continue to monitor toolforge:refill. Daask (talk) 16:52, 15 October 2024 (UTC)

@Daask: thanks for doing this. The old version had stopped working suddenly, and given that the 'new' version continued to work, we abandoned the old version but overlooked making that change. The old and new versions did much the same thing. See Wikipedia talk:ReFill/technical#/ng, language support for how they differed. The old version won't be reinstated. By the way, if you have the technical skills and the interest, it would be great if you'd like to volunteer to work on the code? Curb Safe Charmer (talk) 19:23, 17 October 2024 (UTC)

Good idea killing off the old version. Should make it much easier to get everything into one repo and one branch. –Novem Linguae (talk) 20:15, 17 October 2024 (UTC)

@Novem Linguae: thanks very much for setting up the redirect. Curb Safe Charmer (talk) 08:41, 18 October 2024 (UTC)

Unnecessary :443 in URL

reFill 2 strangely wrote |url=https://www.bizpal.gov.nl.ca:443 in [4]. It should strip the ":443" part because that's the default for HTTPS.

The website itself played a role in this. curl -v http://www.bcbizpal.ca/ returned < Location: https://www.bizpal.gov.nl.ca:443. However, browsers like Firefox will actually immediately remove the ":443" part in the address bar and before making the network request. reFill should stop adding the port when it's ":443" so that both the HTML and wikitext source is cleaner (hovering doesn't show the :443 for some reason). 174.89.12.36 (talk) 13:35, 10 September 2024 (UTC)

Per Wikipedia:ReFill#How it works, it is actually Citoid that is not stripping the 443, rather than something that should be fixed in reFill. reFill is just a wrapper of Citoid. I can't see anything relating to this in the open tasks in Phabricator, so you could report it there? Curb Safe Charmer (talk) 08:48, 18 October 2024 (UTC)

[1] ttps://wiki.riteme.site/w/index.php?title=Special:Search&limit=150&offset=0&ns0=1&search=%22shieldsquare+captcha%22

[1]