This forum is read-only - Please use our new Citavi Forum instead.
Dieses Forum dient nur zur Recherche - Bitte nutzen Sie das neue Citavi Forum für Ihre Fragen.

Data cleaning tool and various bugs

Got questions about Citavi 5? The Citavi team and other users are happy to help.

Data cleaning tool and various bugs

Postby shenri » 2016-03-20 18:14

System information: [ Citavi Version 5.x Beta, Windows 7, English, Firefox 43 or newer, MS Office 2010 64Bit, - ]

Another really useful suggestion:

Citavi needs a "data cleaning" tool to consolidate data fields. Data bunch modify is a great approach, but it does not relate to author, series, publisher...and so on. So, at the end, we have a lot of different data that regards to the same subject and you need to correct that manually, when the software can apply a kind of fuzzy logic to consolidate and clean the data.
JabRed in this sense is much for useful:
- has more than 16 options to clean and consolidate the database and;
- a merge tool to merge slightly different versions and,
- a find unlinked files in the database.
Please, take a look at JabRef, Citavi can do better.

Another bug: Citavi export the content section with especial characters to the BIB file. My Latex dies every time and I need to clean the database with JabRef by some non compliant rules. (yes, I checked every option in the export tool, including the UTF8.).

Another BUG:
When you open the MS Word with the plugin and the TexStudio and click to insert one reference at TexStudio, Citavi simply insert in the MS Word, even if you locked the MS Word Doc for no changes. Magic. Everything is configured to work with TexStudio and works perfectly, but clearly Citavi has some predilection towards MS Word at the code.

Another thing:
Would be very useful to configure the main source website based on some rules. Today we need to do that manually for every entry. If you create rules such as "every DOI will be the fist main source entry" will be much more useful.

All the best,
shenri
 

Re: Data cleaning tool and various bugs

Postby Sebastian Pabel » 2016-03-29 12:40

Hi, shenri,

thank you very much for your feedback.

I'm not entirely sure what you mean by a data cleaning tool in Citavi. Citavi stores its data in a fundamentally different way than JabRef does. Almost all the options offered by JabRef refer to changing the content of a bib file (which is what JabRef uses to store its data).

In Citavi you can Search and Replace all database fields that are not lists. You can merge e.g. authors or journals through the Lists menu. A merge tool is very high on our wish list but due to our limited resources and our focus on completing the web version of Citavi it'll take some more time. You can find unlinked files in Citavi by clicking the filter icon above the list of references on the left hand side of the main window and selecting More > Local file unavailable.

Regarding the BibTeX export issue: Could you please send me a Citavi project with a couple of references that cause problems as well as the preamble you use in your LaTeX document so that I can check what causes the errors? To transfer the files, please use our secure upload service. So that we can match the files to the issue, please put the address of this page in the message field.

You are right, of course, references should be inserted in TeXstudio and not in Word using the configuration you describe. I could reproduce this behaviour and have already filed a bug report for our developers so that the issue can be resolved as quickly as possible.

I'm not really sure what you mean by "main source website". Could you perhaps attach a screenshot?

Best regards
Sebastian

Did we answer your question completely? If so, please click the green check mark in the upper-right corner of this post. This helps other users find the solution to their questions.

Sebastian Pabel
Site Admin
 

Re: Data cleaning tool and various bugs

Postby shenri » 2016-04-02 04:48

Dear Sebastian,

Thank you very much for your reply.

Regarding JabRef, if you go to the whole "Quality" menu in Jabref, we will have a lot of interesting options that can be fully applied to CITAVI, and some of them already are. I know that JabRef is much more simple regarding the database question, however, I don´t really see why Citavi can´t do something similar. I attached two images to exemplify.
JabRefcleanup.jpg

JabRef.jpg


Thank you very much for your suggestion about the List Menu. It worked perfectly, my fault. I was able to merge a lot of replicate items. I just would like to suggest the ability to select more than two similar items. When we have to selected a lot "Springer" items (in my case, more than 10 variations), we should be able to merge all of them under the same name without selecting two after two. But a centralized Merge tool with more options would much more valuable for the whole product.

Regarding the BibTex, was not exactly the BibTex, but Latex itself has some prohibited characters - I don't remembered which exactly. Citavi formats everything well to export, but some fields seems to not be under the "parsing" to Latex function: the Abstract. So, when we have some prohibited characters in this field and export to Latex, it breaks the Latex compilation. I used JabRef to identify those which item was the responsible (in my case, 6 entries with the abstract not being in compliance) and then fixed manually in Citavi to export again. It worked like a charm, but I cannot reproduce it anymore, because I fix it already in the Citavi database.

I looked again and all my DOI source are coming first, If I find again the case I will upload - but I will attach one image to show. Thanks again!
Would be great to fully remove some sources based in some regex expression. Sometimes, we have a lot of proxies of libraries instead of a full path to the source.
NOTE: I will attach the this print in the post below.

Thank you very much for the TexStudio issue, it is quite annoying and damages the Word Doc.
I would like to see one feature to a general insertion. For example, when we are editing the Latex code at "Sublime" software, Citavi Pshould be able to work in a agnostic way. Even in Notepad++ ...
Maybe one option to enable a click and drop function that insert in a citation ( ( \cite{*Bib Key*} )style instead of just this kind of example: " {Using Population Data Systems 2008 #1078} .

Is this function for local file really working as it is supposed to be? I made exactly what you suggested and Citavi brings a weird result, with a local file available.
Local file.jpg


Thank you very much,
All the best,
Sylvio
shenri
 

Re: Data cleaning tool and various bugs

Postby shenri » 2016-04-02 04:52

Images regarding the post above.
The image about the local file filter is more exemplified now.
Thank you again!
Attachments
DOi.jpg
Doi Example
local file 2.jpg
Local File filter
shenri
 

Re: Data cleaning tool and various bugs

Postby Sebastian Pabel » 2016-04-04 10:49

Hi, Sylvio,

most of what JabRef offers here is due to its mode of operation. As BibTeX files are plain text files that can be created manually or by a multitude of applications their exact form varies considerably. Most of the options in the JabRef dialog are either handled automatically by Citavi (the database is stored in Unicode format) or is set for the database, e.g. relative attachment paths for linked PDF files under File > Project properties > Paths.

Superscripts and suchlike, e.g. for edition numbers, are handled by Citavi's citation styles when used with Word or OpenOffice.

If there is a need to rename attached PDFs in Citavi according to a specific pattern, I'm happy to provide you with a macro (not yet in our FAQ) that does just this.

If you need to export for use with biblatex, please use our BibLaTeX export filter.

I'm not exactly sure what the JabRef field formatters do, but I'm fairly confident that -- as Citavi is extendable by macros as well as AddOns -- such features could be added relatively easily. I assume that these are highly specialised LaTeX formatting options and we have to make a decision between keeping the Citavi interface as clean as possible while providing necessary options for a majority of users. In this case I think an AddOn or macro that is not part of the main program itself is the way to go.

A central merge tool, as I said, is already on our list, but will take another while.

There are still a few issues with escaping special characters to LaTeX notation, e.g. ä => \"a. This, e.g., doesn't work if the ä is Unicode decomposed to a and the dieresis. The problem here is the Citavi export as well as the non-existent Unicode support of bibtex. If you have a lot of literature with special characters, you might want to consider switching to biblatex and biber which don't have any of the legacy codepage limitations of bibtex.

The pasting to Word issue has been fixed in the last nightly build and will be part of the next Citavi beta version, for which I don't know a release date yet. Citavi copies the BibTeX-Key to the clipbord via Citation > Quote > Copy to Clipboard (Alt+Ctrl+C).

I tried a DOI search for 10.1007/978-0-387-22466-4_5 in Citavi and I got two references: the parent book ("Kizza 20014 - Ethical And Social Issues") and a contribution ("Anonymity, Security, Privacy and Civil Liberties", no author). This and the two web links are about as much as Citavi can get from the raw metadata CrossRef provides. I did not get any PDF files for this reference. How did you import the local PDF files?

Best regards
Sebastian

Did we answer your question completely? If so, please click the green check mark in the upper-right corner of this post. This helps other users find the solution to their questions.

Sebastian Pabel
Site Admin
 


Return to Citavi 5 Support (English)