A new object-oriented infrastructure for the creation of HTML code
is used in
format_html() methods. This infrastructure is exposed
Support for with model groups in
c.mtable() now creates
groups of models, if arguments are tagged.
Flattened contingency tables (
ftable()s as they are created
by the eponymous function in the
stats() package) can now be
ftable_matrix() objects. This can be done by
There is now an object class for survey items containing dates (without
Support for including sandwich estimates of sampling variances and
standard errors into the output of
by the new generic functions
Support for different parameter sections is added to
mtable. This is intended to allow output of mixed
effects models to distinguish between ("fixed effects")
coefficients and variance parameters.
Objects created by
mtable() also can have several
header lines. Facilities to add additional header lines will
be added soon.
mtable() shows the left-hand sides of
model equations. This can be controlled by the optional
show.eqnames and by the global option
mtable() objects also include, if applicable,
a note that explains the "significance stars" for p-values.
Summary statistics reported by
mtable() can now be
selected for each object or object class (via calls to
It is now possible to compress the output concerning control
Support for HTML and LaTeX output in Jupyter notebooks is added to objects
toLatex() method for "ftable" objects gains a
fold.leaders option (with default value
which allows the row labels (leaders) to remain in a single column.
codeplan() creates a data frame
describing the structure of an "importer", "data.set" or "item"
object. It is possible to copy this so described structure
from one "data.set" object to another or to a data frame.
[[ operators for "importer" objects
allow to create codebooks for single items/variables in
imported data files.
duplicated_labels() function allows to show and
describe duplicated labels and a
function allows to get rid of such duplicates.
manipulate annotations and other attributes.
List() function adds names to its elements by deparsing
arguments in the same way as
A new function
Groups() allows to split a data frame or a
"data.set" into group based on factors in a more convenient
way. There are methods of
within() to deal with
resulting objects of class "grouped.data". For example, the
within() method allows to substract group means from the
observations within groups.
withinGroups() allows to split a
data frame or "data.set" objects into groups, make within-group
computations and recombine the groups into the order of the original
data frame or "data.set" object.
A new function
Reshape() simplifies the syntax to reshape data frames
and "data.set" objects from wide into long or from long into
'tibbles', including those created with the haven package can be translated into "data.set" objects without loss of information. Also "data.set" objects can be translated into 'tibbles' with minimal loss of information.
An extendable function
view() allows to use the
View() facilities provided by graphical user interfaces (in
particular RStudio) with objects not originally supported by these
user interfaces. In addition,
view() methods for
"codeplan", "decriptions", "data.set", and "inporter" are
provided, which allow to conviently inspect the contents of
these objects in RStudio.
An "as.data.table" for coercing "data.set" objects directly into "data.table" objects.
It is now possible to specify the measurement level for a set
of variables in a "data.set" objects, either by using the
assignment operator with
measurement() or by using
the new function
There are convenience wrappers such as
Mean() etc. for
mean() etc. that have the default setting
deduplicate_labels() function allows to deal with
duplicate labels (where several codes have the same label)
It is now possible to create codebooks for weighted data.
trim_labels() allows to trim codes from
reverse() allows to reorder the
codes of a survey item in reverse order.
The generic function
Means() allows to conveniently obtain
group means, optionally with standard errors and/or confidence
The colon operator (
:) can be used to refer to ranges of
Code plans (objects in class "codeplan") can now be exported to and imported from YAML and JSON files.
A new generic function
(contributed by Mael Astrud-Le Souder) allows to format R
objects in Markdown. Currently, methods for codebooks (and entries
in codebooks) are implemented.
A new generic function
coarsen() allows to coarsen
numeric vectors into factors, based on a given number of
A new generic function
allows to automatically select the appropriate measurement
level for survey items.
A new operator
%if% allows to assign values to a variable
for observations that satisfy a condition.
Subset methods for importer objects are much more memory efficient and now can handle files of size larger than 1GB.
useBooktabs arguments of
toLatex() methods now have global options as defaults
toLatex() methods optionally escape dollar, subscript and
superscript symbols. This can be set either by an explicit
toLatex.escape.tex or by a global option
with the same name.
toLatex() method for "ftable" objects has a new
spss.system.file() now translates numeric variables with any SPSS
date format into a "datetime.item"
List() adds names to the elements of the
resulting list in a way similar to how
adds names to the columns of a data frame.
Stata.file() now handles files in format rev. 117 and
later as they are created by Stata version later than 13.
User definded missing values are now reported in separate
tables in entries created by
codebook() even if these
entries refer to items with measurement level "interval" or
If the annotation or the labels of a non-item is set to NULL this no longer causes an error.
Changing varible names to lowercase while importing data
spss.system.file() is now optional.
spss.system.file() now have optional arguments that
allow to deal with variable labels or value labels in
non-native encoding (e.g.
CP1252 on a
spss.file() acts as a common interface to
tail() now work with
"data.set" and "importer" objects in the same sensible way as they
do with data frames.
recode() behaves more coherently: If a labelled
vector is the result of 'recode' it gets the measurement level
"nominal". Factor levels explictly created first come first in the order of
spss.system.file() now handles buggy SPSS
system files that lack information about the number of
variables in their header. (These files are typically
created by the library ReadStat, used e.g. by the R package
SPSS syntax files are now converted to the encoding of the host system if they have a different one. By default, the original encoding is assumed to be Codepage 1252 (extended Latin-1).
value.filter, and related functions return
codeplan() also works with indiviual survey items and
can set to
NULL, which means that all memisc-specific
information is removed from the data.
codebook() works also with data frames (or "tibbles")
imported with the haven package.
codebook() now makes use of the "label" attribute of variables if the
attribute is present.
genTable() are considerably
faster now. They can also make use of certain automatic
variables such as
i_ that contain group
sizes and group indices.
do no longer require their arguments to be enclosed in
Operators '$', '[', and '[[' can now be appied to codebook objects to get a codebook of a subset of the varaibles.
spss.system.file() now uses information contained in SPSS
files (if available) to determine the measurement level
of the improrted variables.
spss.system.file() uses information about the character set
encoding if available in the file to translate variable labels and
value labels into the coding of the machine on which R is
spss.system.file() also (optionally) uses information
about the intended measurement level fo variables in the file.
as.item() now drops non-unique labelled values when applied to a
"labelled", "haven_labelled", or "haven_labelled_spss" object.
spss.system.file() no takes into account metadata about
measurement levels ("nominal", "ordinal", or "scale") to set
measurement() attributes of the items in
mtable() now handles objects of class "clmm" (from package "ordinal")
and the handling of objects of class "merMod" (from package "lme4")
is more consistent with those of class "glm" (e.g. the number of
observations is shown).
Variance component estimates of "merMod" and "clmm" objects are reported as distinct statistics.
recode() has a new optional argument
TRUE, existing codes (and labels) are retained.
recode() now allows to recode factors into numeric vectors.
If the change in codes done by
reorders codes, labels are reordered accordingly, unless
labels are explicitly given.
subset() is S3-generic again, as this allows for lazy
evaluation of its arguments.
NAs more sensibly - if a
case condition is
TRUE this leads to a non-
result even if other conditions evaluate to
cases() is called with
The result of
subset and of the bracket-operator (
applied to importer objects has row names that indicate the rows
selected from the full data.
A method of
format for data set objects is added.
The row names of subsets fo importer objects reflect the row numbers in the original data.
collect.data.set gain a
use_last and a
to improve handling of variables with different attributes
in different objects being collected.
NAs when an
otherwise argument is given and
NAs are not
codebook() now fully supports logical vectors.
ls.str are imported from the
utils package to prevent a NOTE in R CMD check
HTML tables and lists are no loger wrapped in HTML paragraphs
codebookEntry methods for the
"datetime.item" now work asexpected.
NAs more gracefully
toLatex.ftable output has been improved: No attempt at
showing non-existent variable names, better application of
Duplicate value labels now produce an error if item object is coerced into a factor.
A bug concerning missing values in SPSS files is fixed.
Headlines in vignettes are now coherent.
mtable with empty summary sections can be created
Objects returned by
mtable return objects with class
"memisc_mtable" to avoid name clash with objects created by the
model.table in package "stats".
Calls to PROTECTION are added to the C-source to prevent protection errors.
toLatex() now handles matrices in data frames.
spss.portable.file() now handles files with weighting
variables and empty variable labels.
spss.fixed.file() now handles files with lines that are
longer than the number of columns specified in the columns
spss.system.file() now correctly imports value labels
of string variables.
Some PROTECTION issus in the C-source flagged by Tomas
rchk utility are fixed.
If "data.set" objects are combined and succeeding objects contain "items" not contained in the preceding ones, the result now will still be a valid "data.set" object.
seekData etc. no longer try to recreate external
pointers in order to avoid segmentation faults. Also the deletion of
empty pointers is avoided for the same reason.
as.data.set works for "tibbles" also when method dispatch
via class inheritance does not work.
codebook() now handles character variables in SPSS
system files correclty.
codebook() uses the appropriate logical operator in checking
All vignettes are now using knitr.
HTML output uses unicode characters by default instead of amersand-escapes to enhance compatibility with pandoc.
codebook() no longer shows the skewness and kurtosis of
numeric variables to save output space.
UnZip has been removed from the package.
unzip in conjunction with
system.file does the same job, as can be seen in the example for
Support for exporting results of various functions into HTML format is now
supported by the function
This should make it easier to import them into HTML or word-processing
documents (that support importing HTML). A preview of the HTML is made available
by the new (generic) function
In particular, results of the functions
mtable (i.e. tables of
ftable (i.e. flattened contingency tables etc.),
codebooks, can be exported int. HTML using
Also data frames can be exported into HTML.
dsView is added, which allows a display of
objects similar as
View displays data frames.
mtable now handles multi-equation models better, in particular
if the model objects supplied as arguments vary in the number and/or names
of the equations. There is also a new option to place confidence intervals
to the right of coefficient estimates. Further
the following optional aguments:
allows to suppress the display of baseline categories of dummy variables,
when dummy variable coefficients are displayed
sdigits, to specify the number of digits of summary statistics.
gs.options, to pass optional arguments to
for more flexibility in creating tables.
One can now use a
generic function for formatting model summaries, in addition to set the template by
Finally, parts of "mtables" can be extracted using the
[ operator as
with matrices, and "mtables" can now also be concatenated.
There is now an object class for survey items containing dates and times, called
There is a new function
wild.codes to check wild codes (i.e.
unlabelled codes of an otherwise labelled item.)
codebook now supports data frames, factors, and numeric vectors.
toLatex method exists now for
data.set objects, data frames and other objects.
percentages function is added to allow easy creation of tables of percentages.
spss.fixed.file is now able to handle labelled strings and
value labels and
missing values statements.
Internal C-code used by
spss.fixed.file no longer assumed that
arguments are copied – some strange behaviour of objects created by
is now corrected.
Description of items in external data sources is more complete now - the same
information as for items in internal
applyTemplate now returns empty strings for undefined quantities.
collect method for
data.sets now works as expected.
spss.fixed.file now checks whether there are undefined variables in
Stata.file now can import Stata 9 and Stata 10 files.
drop no longer used by function
Format of file produced by
write.mtable can now be
specified using a
format= argument. But
still can be used to get LaTeX files.
are defunct. Graphics similar to those built with
can be created with facilities provided by the package "mplot", which
is currently available on GitHub.
spss.portable.file gain a
that defaults to
allows to change annoying all-upper-case variable names to lower case
New generic function
Iconv() that allows to change the character enconding of variable
descriptions and value labels. It has methods for
There is now a method of
"codebook" objects and a convenience
Write() with methods for
"description" to make it more
convenient to direct the output of
description() into text files.
A method for
"merMod" objects of the
getSummary() generic function.
mtable() now should be able (again) to handle estimation results produced by
recode() handles character vectors in a more convenient way: They are converted
into factors with sorted unique values (after recoding) as levels.
getSummary.expCoef is renamed into
aggregate.formula has been removed from the package to avoid
clash with method of the same name in the
base package. The function
can be used instead.
detach.sources as these are flagged
as modifying the global namespace.