About

What is EmoCodes?

EmoCodes is a coding system designed to characterize both visual and auditory elements of video stimuli. We developed this system because we use movie stimuli in our research, however there isn’t a standardized way to characterize complex videos. This way, everyone has access to a common coding structure and we can better interpret and replicate each other’s work.

EmoCodes is in 2 parts:

1. The coding manual: for manually-coded objective and subjective video content. We supply a coding manual, training videos, and sample codes for training purposes. With these materials, you can learn how to do frame-by-frame coding of both the affective and non-affective portions of a video. Please see the training page for more details.
2. The emocodes python library: the software to the EmoCodes system, this library contains functions and classes that perform basic, automatic video processing as well as processing of the manual codes into an analyzable format. For more information, please refer to the tutorials and documentation found here.

How can I use EmoCodes?

EmoCodes was designed to capture affective content in cartoons and other children’s media, however it can also be used to characterize face, word, number, color, and biological motion processing in video stimuli. The EmoCodes software can then convert time segment codes to time series for use in bio-behavioral timeseries analysis, such as EEG, fMRI, fNIRS, RSA, EDA, pupillometry, and more. The software can also extract low level features (such as luminance or audio loudness) from video files.

How does EmoCodes work?

For the manual coding portion, click over to the Training tab at the top and find out!
For instructions on using the python library, click here.

How was EmoCodes developed?

For the full details on how we developed EmoCodes, please refer to the publication in Affective Science:

Original Publication Download

Camacho, M.C.^, Williams, E.M.^, Balser, D., Kamojjala, R., Sekar, N., Steinberger, D., Yarlagadda, S., Perlman, S.B., & Barch, D.M. (2022). EmoCodes: A standardized coding system for socio-emotional content in complex video stimuli. Affective Science. https://doi.org/10.1007/s42761-021-00100-7
^denotes co-first authorship

Analysis notebooks can be found on our GitHub page here.