Things that you should learn to do with a spreadsheet editor

Years of experience have convinced us that you don’t need a more sophisticated tool than a spreadsheet editor (i.e. Excel or Calc, the Open/Libreoffice equivalent) if you want to properly store (input) and analyze (categorize and create visualizations and calculation based on) historical data for a research project. For a PhD dissertation, say, or for any other project that is personal or involves just a few collagues. (Sharing data with the general public is a different matter)

So you won’t find advice on this blog about database managers or the TEI. Nothing wrong with those, and please do use them if you know how to (you’ll still have to export .csv files if you want to quantify). What we just say is that learning them is not necessary to quantify properly, and that they are more difficult to learn, in our experience, than the proper use of a spreadsheet editor. (We discuss this with more details in Chapter 3) So here is a list of functions that you should learn to use in order to store and analyze your data using a spreadsheet editor. This is the more practical complement to our “ten commandments of inputting data.” (those are the core of our book, in our view, and they seem to have helped a lot of users of the French version)

Continue reading “Things that you should learn to do with a spreadsheet editor”

Running statistical tests online

In Chapter 2, we explain why “statistical tests” such as the chi-squared test can be useful. If you use R (or other statistical software), it will routinely run such tests. It is very cumbersome (impossible for some tests) to run them in a spreadsheet editor. Fortunately, you can still use these tests without installing or learning how to use statistical software: there are dedicated websites that run the test (in fact, run the statistical software) for you.

Continue reading “Running statistical tests online”

Network analysis tools and tutorials

Which tool should I use? This is a complicated question, with not very satisfying, constantly evolving answers, so prepare for an evolving post. But first, three things that are actually more important than the choice of software.

Continue reading “Network analysis tools and tutorials”

Analyzing texts – software and tutorials

First, it is important to understand that you do not necessarily need specific software to analyze texts. Sometimes, even if what you are interested in is style, you will be better off creating a “classical” dataset (one row per text, one column per interesting feature of the text) and analyzing it with a spreadsheet editor or classical functions in R, rather than feeding the entire text into specific software (provided that you have the means to digitize it). But sometimes, as we also explain in Chapter 7, you might want to use specific tools devised for texts – the object of this post. Here is a useful, if far from exhaustive, survey of software; we give more details on some options below.

Blogs that introduce several tools

Tutorials on diverse techniques

Topic modeling: tools and tutorials

Continue reading “Analyzing texts – software and tutorials”

Analyzing texts – structured historical corpora

In Chapter 7, we warn readers against the use of Google Books as a source on the historical use of words: Google Books does not contain everything that has ever been printed; it is biased in many directions (e.g. towards the English language), most of which are unknown. There are, however, corpora, generally built by linguists, that allow you to know inside which group of texts exactly you plot the use of this or that word, or you investigate which words were often used together. You can also choose to restrict your analysis to a part of the corpus (by author, say, or period). Those are also texts that have been checked and indexed by humans: they do not include errors due to optical character recognition and in most cases, they allow an analysis of grammatical categories. The drawback is, of course, that you can only explore what is in the corpus, i.e., often, something like the canon. But anyway, you cannot seriously count if you have not defined a perimeter of what you include and do not include. Continue reading “Analyzing texts – structured historical corpora”

Factor analysis

Factor analysis is addressed in our Chapter 4. Factor analysis graphs may look strange; it certainly takes some time to learn how to read them (to that effect, you should re-read our chapter and look into our suggestions for further reading). Still, many historians want to use factor analysis, once they have understood that it is an exploratory method that allows them to get a general idea of “everything that is in their dataset,” and to create typologies. (Perhaps this is also true in other disciplines, but the words “exploratory”, “having a look at everything at once,” and “typology” seem to have a special appeal for historians – ourselves included)

Continue reading “Factor analysis”

Learning R

As we write in the book, for most historical and humanistic research, you won’t need methods of analysis more complicated than contingency tables (which you can create easily with a spreadsheet editor), and perhaps a test such as the chi-squared test, which will help you interpret the tables (you can easily perform this test online). We strongly believe that the most important, interesting, and difficult task is to create good data: our book therefore focuses on the imputting and categorizing stages of this process. A straightforward descriptive analysis is then sufficient in many cases.

Should I learn R?

Graphical user interfaces

Tutorials Continue reading “Learning R”