Taxonomy cleaner is not populating tidInterpreted when matching on a newly-added CoL name

[themerekat]

For example, this name was added to the taxonomic thesaurus when I ran the cleaning tool previously: https://allasiatcn.org/taxa/index.php?taxon=6279

But when I ran it again, I found that it the specimen had not actually been linked to the new taxonomic name:

[egbot]

I'm not able to reproduce this issue. I'm finding that the occurrence are being indexed to the thesaurus.
However, the indexing step happens at the end of the processing. Thus, if they page times out or is closed before the processing finishes, indexing the occurrences to the new names will not happen. According to the output in the screenshot, I'm guess that is what happened in this case.

[egbot]

Running the cleaning and linking script after each addition of a name would significantly slow down the process. However, we could trigger that process after every hundred or so names are added. That way, if the process fails before completion, most of the occurrence will be indexed. Unindexed names are often resolved in short order, since that same cleaning process gets triggered by other tools. Occurrences rarely remain unlinked to the thesaurus for long.

[themerekat]

Ah, ok, thanks for the clarification! That makes a lot of sense.

[egbot]

I'm going to leave this open with an enhancement tag. Until then, it's best to add taxa in smaller batches (e.g. <= 2000), or if a larger run fails, run tool with a limit of 10 and that will trigger the indexing script.

[themerekat]

Sounds good! I've moved it to the symbiota-docs repo, where we put optional enhancements.