Deleted/old answers still appearing in tests

@DrewSSP ~ was this message meant for @Arete_Hime or me ? I wasn’t sure…

You!, pdao! Sorry, I’m not really sure why pressing reply on somebody’s post makes that obvious only sometimes.

@DrewSSP ~ thank you for your response, and generous offer of assistance. I thought about it, and while you are a very kind, generous and helpful person, I will respectfully decline the offer. It’s not that I don’t ultimately want nice, clean courses, but I genuinely feel that the issue at hand (phantom entries appearing in courses that were supposedly deleted in databases by their respective course creators) is a Memrise issue to resolve, not a user issue.

It’s wonderful to know that there are illuminated, created, gifted people such as yourself who can expend the time and energy to find workarounds for Memrise issues, but at some point Memrise needs to take ownership of their own issues. A user script to resolve an issue is great for the person(s) who have a script initiated on their behalf, but it doesn’t help any other users who didn’t have that luxury afforded them. This is a Memrise database issue that Memrise needs to resolve, for everyone.

The bottom line seems to be that when a course creator deletes a database entry, it should not appear in future testing/reviews courses designed with that database. Delete should mean delete. Not store an entry in some quasi space that course creators cannot see, or have access to. If they have to reside in that quasi space, then at least give course creators the tool(s) to access WITHIN Memrise to eradicate them (if such is their desire).

I realize this is probably not a high priority to Memrise, and that they have other issues to resolve, and limited staff to assign issues to, so I remain hopeful that somewhere, sometime, someday, in some way or fashion this issue will be addressed and resolved. They are making headway with the other database issues (i.e. search and ordering) so maybe this issue will somehow be daisy-chained into that work area as well.

So, I thank you very much for your kind offer, but I would rather wait and see how Memrise will resolve this. I do however wish you success with your offers to others, or how you use your talents with your own created courses. We all want good, clean courses; we just sometimes take different paths to achieve this goal.

2 Likes

I came here looking for a solution to phantom entries, and my experience on your first point is a little different than yours. I am making an Korean-English study list and added a list of only Korean words for which I did not know the English, and also another list I added through the bulk add which mistakenly was listed as ‘Korean’ but contained both the English and the Korean answer.

I updated both lists, and I started getting phantom entries in the answers the first time I tested on the lists.

I have been pulling my hair out trying to figure out where these entries might still exist. The course is not nearly as useful if half the possible answers to choose from are always obviously wrong.

2 Likes

@blooscorn ~ thank you for sharing this. It seems this issue then is even more diverse than before. Yet another reason for Memrise to address the issue and vanquish these phantom entries once and for all !

I fear that they won’t get around to this for a long time, if ever. I learned a lot when addressing this issue for myself and it is apparent that fixing the issue will require that they change a ton of the logic behind how memrise presently works. The changes made to fix the issue would also be a lot less efficient, meaning that they would need to pay more for servers. I know that I would not fix it if I was in their position.

That being said, I would provide a way of fixing it for the user who is truly desperate. Maybe I would make something that works like my script but then make it a little bit inconvenient to use. Course creators would therefore know where it is but then wouldn’t inclined to use it every time they open the course database. Otherwise, it could kill the servers.

2 Likes

@DrewSSP ~ wow, way out of my league. I guess it will continue to be a nuisance then. Another one of those “Memrise things” that I used to hear people talk about when I first began using the program a few years ago.

If it means adding more servers, then that is probably the buzz killer in and of itself. It seems that they are either struggling to control or maintain the ones they have, or looking to minimize the number overall.

Thanks again for your insight into this issue. I guess a lot of us will just have to wait and see what the future holds. Hopefully there are not too many desperate course creators out there.

Best of luck to you with your HSK6 issues, and anything else you are working on.

@DrewSSP is your script available online?

@skstudio No yet. I’m willing to upload it though. I’m moving at the moment from one country to another and travelling a bit in the meantime. I’ll upload it when I get the chance but please understand that my temporary homelessness might make it difficult to do that any time soon.

1 Like

Here it is! Set up is a bit complicated but it’s there for those who want it

3 Likes

Thank you very much @DrewSSP! The script looks good. I’ll try it on my database.

I just thought I’d let you all know, set up on the script here is just a bit less complicated than it was before. I revisited it and noticed that I could make a few quick improvements.

1 Like

I think I was having this problem and I think I found a workaround that no one will like. The words that pull the wrong or broken answer pools have to be deleted and re entered into the database/level. That’s the only way I found to fix it. apparently the phantoms live in a word not the whole database.

I only had this problem with levels that I tried to bulk insert. They didn’t sort properly so i deleted just the ones that were wrong and started over without starting from scratch. I haven’t tested all levels yet but the words i replaced no longer have the issue.

1 Like

I have ghost entries also but I haven’t deleted a word. I have just modified them and the old versions are appearing.

Let me explain what causes the phantom answers.

Every word in your database has a bunch of information associated with it. You can see this in your database in the form of columns. Oftentimes, this information will be the english translation for the word, an audio file, its attributes, etc… There is also hidden information that is not shown in the database page. One of the hidden pieces of information is a list of words that Memrise will use to populate all the incorrect answers in questions. This is the stuff that’s causing phantom answers.

If you don’t fully understand the above paragraph, then remember this: The wrong answers for any question are stored in secret information inside every word in your course.

This is actually a good idea on Memrise’s part because, if you think about it, Memrise doesn’t need to search through your entire database to make incorrect options in your questions. It just needs to look inside the word’s secret information and it’s right there. It’s very efficient.

So where to the phantom answers come from? Well, imagine that you have a word that you want to change, but that word is inside the hidden information of another word. The problem comes from the fact that these two words have now way of talking to each other. One word will have no way of knowing if you changed something elsewhere in the course database. So a word will just continue using information that it got a long time ago, which can sadly become outdated. That outdated information is being shown as phantom answers.

So the big question is, how can we make words update their hidden information? Every time you change something in a word, the word will update the hidden information associated with the part you just updated. So if you change the English translation, it will update the hidden information related to the English translation for that word. Included in that hidden information will be all of the possible wrong answers when asked for the English translation during a session.

Long story short, Memrise allows phantom answers because it allows for higher efficiency. If you see a phantom answer in a session, find that word in the database and change the field on which you were just tested. So if you saw a phantom answer on “pomme” and you were supposed to click “apple”, find the word “pomme” in the database, change the part that says “apple” just a little bit (ie “appleA”), save the change, and then go back and change it back to “apple” and save the change once again. This will force Memrise to re-evaluate the answers that it might present you with during testing for that word.

4 Likes

I used to have the idea that Memrise picked the wrong answers from a range surrounding the current entry. Do you have any more info on that? And do you know how many incorrect answers each entry is associated with?

Do you think this behavior can be manipulated to our advantage?

@Arete_Hime There are times when I’ve wondered if Memrise favours using words from the same level. There might be something to that suspicion since we’ve both thought it. But I promise that Memrise cares a lot more about how much a word resembles another in the database. If there is a word in the database that closely resembles the correct answer of the word in the question, it will include that one in its list of possible incorrect answers every every time.

As for your question toward the quantity of words that exist in the hidden list of possible incorrect answers, I’ve seen some words with 8, and others with 12. I don’t know why it changes between those two numbers but it does. It’s interesting to watch the learning/review sessions after learning about this because you start to notice that individual words will always have mostly the same options each time that you see them.

As for manipulating it, I don’t see how we could. The only way to control which words get put into the hidden information is to control which words are in the database when it most recently changed. That could only work predictably for one word and then you would start having to rely on luck with exponentially decreasing probability that it works in your favour for every word that you add to the database.

2 Likes

I’m skeptical of your explanation, because I’m pretty sure that I’ve seen very old words (that I haven’t updated in forever) show some multiple choice options that include some of the newer words I’ve added to the same database. If that’s true, that contradicts what you said. I’m also skeptical because it would make the sizes of their databases much larger, by an order of magnitude at least, maybe two.

Do you have any reliable sources saying that it works the way you described?

@cos A bigger database is much better for servers than making 7 or 11 extra requests to the database every time a word comes up for review.

There may be a second method that Memrise uses to populate wrong answers, as @Arete_Hime and I were talking about. That doesn’t make my explanation incorrect. I’m just describing the piece that’s broken and how to fix it. Either way, I fixed the error for my own courses, which requires the knowledge that you are challenging. Believe me or don’t, it doesn’t matter to me.

What is your source for your explanation of how it works? That is, how do you know that that’s how it works? I gave reasons that I’m skeptical, but that doesn’t mean you’re wrong - it means it doesn’t seem right and I have no idea where your information is coming from. So, where did you get this from?